Repository navigation
[devops] add large-scale distributed test marker #4451
Description
Overview
Hybrid parallelism need at lease 8 processes to be fully tested. Our CI runner is run on a 4-gpu node and a 8-gpu node.
As the 8-gpu node is not always available, we run the most tests on 4-gpu node. And for those need 8-gpu, we run them regularly on 8-gpu node.
In short, we should add a marker to indicate which test should be run on 8-gpu node.
Metadata
Metadata
Assignees
Labels
No labels
Type
Projects
- Status
Activity
JazyJiang commentedon Oct 16, 2026
Closing as completed. The
largedistmarker is defined inpytest.ini("at least 8 GPUs") and is used by the 8-GPU tests. The new three-layer CI (#6462) runs them as a dedicated batch: batch 10 selects-m largedist, while the 4-GPU batches use-m "not largedist". Batch membership is defined in.github/scripts/ci/run_colossalai_batch.sh.