Repository navigation
[ci-scan] Build break: Windows Helix work items fail on unexpanded $HELIX_PYTHONPATH in gen-debug-dump-docs post-command #131382
Description
Build Information
Build: https://dev.azure.com/dnceng-public/public/_build/results?buildId=1524472
Build error leg or test failing: Build / android-arm64 Release NativeAOT / Send to Helix — Windows Helix work items (e.g. System.Security.Cryptography.Tests, System.Net.Sockets.Tests)
Pull request: (rolling main build, not a PR build)
Error Details
gen-debug-dump-docs.py invokes the shell
variable $HELIX_PYTHONPATH using Unix syntax. On Windows work items cmd.exe does not
expand $HELIX_PYTHONPATH, so the command is not found and the work item exits with code 1
after the test run itself has already completed and reported results. Every Windows Helix
work item on the affected legs of runtime-extra-platforms fails this way, and the failure
recurs across consecutive builds (source build 1524472 and follow-up build 1526281). -->
D:\h\w\...\e>$HELIX_PYTHONPATH $HELIX_CORRELATION_PAYLOAD/gen-debug-dump-docs.py -buildid 1524472 -workitem $HELIX_WORKITEM_FRIENDLYNAME -jobid $HELIX_CORRELATION_ID -outdir $HELIX_WORKITEM_UPLOAD_ROOT -templatedir $HELIX_CORRELATION_PAYLOAD -dumpdir $HELIX_DUMP_FOLDER -productver 11.0.0
'$HELIX_PYTHONPATH' is not recognized as an internal or external command,
operable program or batch file.
D:\h\w\...\e>EXIT /b 1
Error Message
{
"ErrorMessage": "'$HELIX_PYTHONPATH' is not recognized as an internal or external command",
"ErrorPattern": "",
"BuildRetry": false,
"ExcludeConsoleLog": false
}Filed by ci-failure-scan (detection only). ci-failure-fix walks open [ci-scan] KBEs and either opens a small fix PR or comments here to loop in owners — it never disables the test.
Warning
Firewall blocked 1 domain
The following domain was blocked by the firewall during workflow execution:
awmgmcpg
To allow these domains, add them to the
network.allowedlist in your workflow frontmatter:
network:
allowed:
- defaults
- "awmgmcpg"See Network Configuration for more information.
Generated by CI Outer-Loop Failure Scanner · 360.6 AIC · ⌖ 15.3 AIC · ⊞ 18.6K · ◷
Report
Summary
| 24-Hour Hit Count | 7-Day Hit Count | 1-Month Count |
|---|---|---|
| 25 | 221 | 345 |
Activity
dotnet-policy-service commentedon Jul 28, 2026
Tagging subscribers to this area: @dotnet/runtime-infrastructure
See info in area-owners.md if you want to be subscribed.
[ci-fix] Gate gen-debug-dump-docs post-command on WindowsShell (refs #…
matouskozak commentedon Jul 29, 2026
I see the same failure on maccatalyst x64 jobs
https://helixr1107v0xdeko0k025g8.blob.core.windows.net/dotnet-runtime-refs-heads-main-b63e5a2aba0c458391/IcuAppLocal.Tests/1/console.cb7b36f7.log?helixlogtype=result
github-actions commentedon Oct 12, 2026
Workflow artifact: ci-fix
Artifact kind: handoff
Linked KBE: #131382
Note
AI/Copilot-generated triage note.
This Known Build Error has no producible automated product or test change: the failure occurs in Helix post-command execution before affected Windows work items can run.
Root cause (best analysis)
gen-debug-dump-docs.pyis invoked through$HELIX_PYTHONPATHin theSend to Helixpost-command. The variable remains unexpanded in the Windows work-item command, so the interpreter cannot be launched and the affected work items fail before test execution. A member report also shows the analogous MacCatalyst path invoking a non-existentgen-debug-dump-docs.py; this points to shared Helix payload/post-command staging rather than a library or test defect.Evidence
Suggested reviewers / area contacts
area-Infrastructure):@agocke,@dotnet/runtime-infrastructureA fix likely needs to correct the Helix post-command/payload staging so the Python path expands in the target shell and
gen-debug-dump-docs.pyis present at the referenced location.Structured data:
{ "artifact_kind": "handoff", "linked_kbe": 131382, "workflow_artifact": "ci-fix" }Exclude mobile targets from Helix dump-doc generation (#135875)