Add Qwen3.5 NVFP4 V2 GB200 Dynamo-SGLang MTP / 新增 Qwen3.5 NVFP4 V2 GB200 Dynamo-SGLang MTP 配置 - #2594
Add Qwen3.5 NVFP4 V2 GB200 Dynamo-SGLang MTP / 新增 Qwen3.5 NVFP4 V2 GB200 Dynamo-SGLang MTP 配置#2594RohitNagraj wants to merge 3 commits into
Conversation
新增 Qwen3.5 FP4 GB200 Dynamo-SGLang MTP 配置。
|
Thanks for the contribution! Please reach out to respective companies' CODEOWNER to fill in the latest PR_REVIEW_CHECKLIST.md before pinging core maintainer on Slack for review. In order for the signoff PR check bot to trigger, you must follow the PR_REVIEW_CHECKLIST.md template correctly, including the phrase For PR verification, add the PR authors are responsible for ensuring that after merging, all GitHub Action jobs fully pass. A lot of the time, failures are just flakes and simply re-running the failed jobs will fix it. See GitHub's docs on re-running failed jobs 感谢你的贡献!请联系相应公司的 CODEOWNER 填写最新的 PR_REVIEW_CHECKLIST.md,然后再在 Slack 上联系核心维护者进行审阅。为了触发 signoff PR 检查机器人,你必须正确遵循 PR_REVIEW_CHECKLIST.md 模板,包括保留英文语句 如需进行 PR 验证,请为此 PR 添加 PR 作者有责任确保合并后所有 GitHub Action 任务完全通过。 很多时候失败只是偶发抖动(flake),重新运行失败的任务即可解决。参见 GitHub 关于重新运行失败任务的文档 |
1 similar comment
|
Thanks for the contribution! Please reach out to respective companies' CODEOWNER to fill in the latest PR_REVIEW_CHECKLIST.md before pinging core maintainer on Slack for review. In order for the signoff PR check bot to trigger, you must follow the PR_REVIEW_CHECKLIST.md template correctly, including the phrase For PR verification, add the PR authors are responsible for ensuring that after merging, all GitHub Action jobs fully pass. A lot of the time, failures are just flakes and simply re-running the failed jobs will fix it. See GitHub's docs on re-running failed jobs 感谢你的贡献!请联系相应公司的 CODEOWNER 填写最新的 PR_REVIEW_CHECKLIST.md,然后再在 Slack 上联系核心维护者进行审阅。为了触发 signoff PR 检查机器人,你必须正确遵循 PR_REVIEW_CHECKLIST.md 模板,包括保留英文语句 如需进行 PR 验证,请为此 PR 添加 PR 作者有责任确保合并后所有 GitHub Action 任务完全通过。 很多时候失败只是偶发抖动(flake),重新运行失败的任务即可解决。参见 GitHub 关于重新运行失败任务的文档 |
| - "Add nine checked-in srt-slurm recipes covering TP and data-parallel-attention topologies" | ||
| - "Use chat-formatted benchmark inputs with Mooncake KV transfer" | ||
| - "Image: lmsysorg/sglang:nightly-dev-cu13-20260709-074bb928" | ||
| pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/XXX |
There was a problem hiding this comment.
🟡 The new perf-changelog.yaml entry (line 5966) uses a placeholder pr-link: .../pull/XXX instead of a real PR number. Since this is PR #2594, it should read pull/2594, matching every other entry in the file.
Extended reasoning...
The last block appended to perf-changelog.yaml in this diff ends with:
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/XXXXXX is a literal, unfilled placeholder rather than an actual PR number. Every other entry in the file follows the same schema and always points to its own real PR — for example the immediately preceding entries link to pull/2577, pull/2578, and pull/2580. This PR is #2594, so the correct value is pull/2594.
Why existing checks don't catch it: the PR description states that a 'changelog newline' check passed, but that only verifies the file ends with a trailing newline / is well-formed YAML — it does not validate that pr-link contains a real, resolvable PR number. There is no schema or CI validation cross-checking the pr-link field against the PR number that is actually opened, so a placeholder like XXX sails through untouched.
Proof / step-by-step:
- Open
perf-changelog.yamlat the new entry (last block in the diff, starting at line ~5956). - Read the
pr-linkfield:https://github.com/SemiAnalysisAI/InferenceX/pull/XXX. - Compare against the file's own convention: scroll up to the entries directly above it (lines 5940-5955) — they use
pull/2577,pull/2578,pull/2580, each matching the PR that introduced that entry. - Note the current PR's actual number is 2594 (per PR metadata).
- Following the file's established convention, the link should be
https://github.com/SemiAnalysisAI/InferenceX/pull/2594.
Impact: this is a documentation/metadata-only bug — the changelog is not consumed by any runtime code path, so nothing breaks functionally. However, anyone who later clicks the link while investigating this changelog entry (e.g., during a regression bisect or audit) will hit a 404 or an unrelated PR, making it harder to trace which PR introduced the entry. It should be fixed before merge since it is a one-line, unambiguous fix.
Fix: replace pull/XXX with pull/2594 in the new changelog block.
|
see unofficial run visualizer at https://inferencex.semianalysis.com/inference?unofficialRun=31746204670 |
|
Temporarily removing full sweep label |
Description
Add a Qwen3.5-397B-A17B NVFP4 V2 GB200 Dynamo-SGLang disaggregated MTP configuration for the fixed-sequence 8k/1k scenario.
Validation:
中文说明
新增 Qwen3.5-397B-A17B NVFP4 V2 在 GB200 上的 Dynamo-SGLang 分离式 MTP 配置,用于固定序列长度 8k/1k 场景。
验证:
Related Issue
N/A
Type of Change
Checklist
perf-changelog.yamlwithout editing historical entries/reuse-sweep-runonly after a final green sweep with passing evals