Repository navigation
ci: resolve Ubuntu's archive to Azure's mirror of it in the integration jobs - #813
Merged
Merged
Conversation
…on jobs Ubuntu's archive stopped answering for minutes to hours at a time on 11-19 (index files taking 20-40 s, then no answer at all), failing every image build and compose that runs apt in the integration tiers, on main too, while azure.archive.ubuntu.com, the mirror the runners' own apt uses, stayed up. A step now runs dnsmasq on Docker's bridge, answering archive.ubuntu.com and security.ubuntu.com with that mirror's address and forwarding every other name to the runner's resolver, and points the runner's resolv.conf at it; Docker copies that into each container, and BuildKit into each RUN, since it isn't a loopback address. The mirror answers those hosts' names. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Why
On 11-19 Ubuntu's archive (
archive.ubuntu.com,security.ubuntu.com, now behind Cloudflare) went unresponsive three times, for minutes to hours: index files took 20–40 s, then nothing answered at all.Every image build and compose in the integration tiers runs apt against it: the ubuntu-24.04 base's Dockerfile, the composer's package resolution and the disk recipe's kernel stage. So shards hit the 20-minute test timeout, on
maintoo: its v0.9.1583 run timed out in shards 1, 9 and 11. Meanwhileazure.archive.ubuntu.com, the mirror the runners' own apt uses, answered in tens of milliseconds.What
A new step in
integration-local, the slow shards and the gateway shards:.github/scripts/ubuntu_archive_dns.sh.dnsmasqon Docker's bridge address. dnsmasq answersarchive.ubuntu.comandsecurity.ubuntu.comwith the Azure mirror's address and forwards every other name to the runner's resolver./etc/resolv.confat that dnsmasq. Docker copies that resolver into containers, and BuildKit into eachRUN, because it isn't a loopback address; user-defined networks forward to it through Docker's embedded DNS.The mirror answers requests made to those hosts' names:
Host: archive.ubuntu.comandHost: security.ubuntu.comboth return 200 from its address. Images, Dockerfiles andsrc/are unchanged. Outside CI, everything still uses Ubuntu's archive.How it was tested
On an admin VM (Ubuntu 24.04, Docker 28), with the VM's resolver restored afterwards:
RUNresolvedarchive.ubuntu.comto the mirror, andapt-get updatefetched 34 MB at 33.6 MB/s.pypi.orgthrough the forwarder.This PR's CI ran it for real: the step succeeded on all 18 integration jobs (each fails if the archive's names don't resolve to the mirror), and the Local backends run was green in 14.7 minutes (run 44528375491).
🤖 Generated with Claude Code


Confidence Score: 5/5
This PR appears safe to merge.Summary
This PR redirects Ubuntu archive requests to Azure's mirror in the local integration jobs.
No actionable issues found.
Reviews (1) · Last reviewed commit: "ci: resolve Ubuntu's archive to Azure's ..." · Reviewed by Greptile