Skip to content

[shardformer]: fix llama causal mask with sequence parallelism and no flash attention - #6452

Open
LiRunGuo wants to merge 1 commit into
hpcaitech:mainfrom
LiRunGuo:fix/llama-sp-causal-mask
Open

[shardformer]: fix llama causal mask with sequence parallelism and no flash attention#6452
LiRunGuo wants to merge 1 commit into
hpcaitech:mainfrom
LiRunGuo:fix/llama-sp-causal-mask

Commits

  1. Commits on Sep 22, 2026