Skip to content

Run Windows Python unit tests in parallel - #24895

Open
zingo wants to merge 2 commits into
pytorch:mainfrom
zingo:Run-Windows-Python-unit-tests-in-parallel
Open

zingo wants to merge 2 commits into
pytorch:mainfrom
zingo:Run-Windows-Python-unit-tests-in-parallel

Conversation

@zingo

@zingo zingo commented Nov 11, 2026 •

Copy link
Copy Markdown
Collaborator

Use eight pytest workers to reduce the sequential test runtime. Report the 20 slowest test phases to help identify bottlenecks.

Compared with a main run from earlier the same day:
Windows job	Main:       sequential	      PR: 8 workers	    Improvement
Debug Python tests	      60m 45s	        14m 52s	        4.1× faster
Editable Python tests	  60m 04s	        14m 33s	        4.1× faster
Entire Debug job	   1h 51m	         1h 02m	            49 minutes saved
Entire editable job    1h 51m	         1h 03m	            49 minutes saved

Both versions reported 2,348 passed, 104 skipped and the same single failure, so the improvement isn’t from dropping tests. Native build times were similar.

Authored with assistance from OpenAI Codex.

cc @digantdesai @freddan80 @per @oscarandersson8218 @mansnils @Sebastian-Larsson @robell @rascani

Use eight pytest workers to reduce the sequential test runtime.
Report the 20 slowest test phases to help identify bottlenecks.

Authored with assistance from OpenAI Codex.

Change-Id: If14c0047bae03bd39f35624b0640b89aa33ddb24
Signed-off-by: Zingo Andersen <Zingo.Andersen@arm.com>
@pytorch-bot

pytorch-bot Bot commented Nov 11, 2026 •

Copy link
Copy Markdown

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/24895

Note: Links to docs will display an error until the docs builds have been completed.

❌ 4 New Failures

As of commit 7b062d7 with merge base b3b565b (image):

NEW FAILURES - The following jobs have failed:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Nov 11, 2026
@zingo zingo added release notes: none Do not include this in the release notes module: windows ciflow/trunk partner: arm For backend delegation, kernels, demo, etc. from the 3rd-party partner, Arm help wanted Extra attention is needed labels Nov 11, 2026
@zingo

zingo commented Nov 11, 2026 •

Copy link
Copy Markdown
Collaborator Author

@digantdesai or @rascani here is small CI speedup that might be nice to get in.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ciflow/trunk CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. help wanted Extra attention is needed module: windows partner: arm For backend delegation, kernels, demo, etc. from the 3rd-party partner, Arm release notes: none Do not include this in the release notes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant