Skip to content

[Fix] Improve MTP compatibility and mitigate MoE load imbalance by skipping pad tokens - #1952

Open
tina-wen wants to merge 2 commits into
InternLM:mainfrom
tina-wen:mem-opt-bugfix
Open

[Fix] Improve MTP compatibility and mitigate MoE load imbalance by skipping pad tokens#1952
tina-wen wants to merge 2 commits into
InternLM:mainfrom
tina-wen:mem-opt-bugfix

缓解MoE负载不均:skip pad_token

1a729fc
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning
detect_changes
succeeded Jul 10, 2026 in 8s