Repository navigation

[shardformer]: support Qwen3-MoE with expert parallelism - #6450

Open

LiRunGuo wants to merge 3 commits into

hpcaitech:mainfrom

LiRunGuo:feat/qwen3-moe

Open

[shardformer]: support Qwen3-MoE with expert parallelism#6450
LiRunGuo wants to merge 3 commits into
hpcaitech:mainfrom
LiRunGuo:feat/qwen3-moe

Commits on Oct 13, 2026
- [checkpoint] unpad padded parameters when saving sharded MoE checkpoints
  LiRunGuo
  committed
  792a5f3
- [shardformer] support Qwen3-MoE with expert parallelism
  LiRunGuo
  committed
  7b89bc1
Commits on Oct 14, 2026
- [pre-commit.ci] auto fixes from pre-commit.com hooks
  pre-commit-ci[bot]
  committed
  264d096