[No merge] Draft test - #4747

Draft

NuojCheng wants to merge 8 commits into

mainfrom

chengnuojin-bharatgen

Commits on Aug 6, 2026

Update qwen3-next-80b-a3b.yml config parameters

darisoy
authored and
NuojCheng
committed
0dae68e
Integrate mHC into Qwen3NextDecoderLayer (mhc_expansion_rate=4)

darisoy
authored and
NuojCheng
committed
d3d7a3a
Implement Newton-Schulz log-depth custom VJP triangular matrix solver for GDN (PR #4577 / cl/955390793)

darisoy
authored and
NuojCheng
committed
d50c557
add scan support for qwen3-next model
NuojCheng
committed
63fc9e1
Implement Hybrid GDN v3 Tokamax forward + Newton-Schulz Custom VJP backward (with shard_map sharding support)

darisoy
authored and
NuojCheng
committed
8e94b20
Checkpoint [B, S, E] hidden states and recompute [B, S, 4, E] 4-manifold representations in Qwen3-Next decoder layers

darisoy
authored and
NuojCheng
committed
d7fed6e
update scan logic and muon
NuojCheng
committed
b001b94
add pure fsdp scripts
NuojCheng
committed
5d1a147