Support local qemu builds#2284
Open
mmlb wants to merge 9 commits into
Open
Conversation
mmlb
force-pushed
the
push-smxxzkmnpkvq
branch
3 times, most recently
from
July 16, 2026 20:31
e3fabe2 to
beb2b77
Compare
PostgreSQL Extension Dependency Analysis: PR #2284
SummaryNo extensions had dependencies with MAJOR version updates. Full Analysis ResultsPostgreSQL 15 Extension DependenciesPostgreSQL 17 Extension DependenciesOrioleDB 17 Extension Dependencies |
PostgreSQL Package Dependency Analysis: PR #2284
SummaryNo packages had MAJOR version updates. Full Analysis ResultsPostgreSQL 15 Dependency ChangesExtracting PostgreSQL 15 dependencies...
Runtime Closure Size
Raw Dependency ClosurePostgreSQL 17 Dependency ChangesExtracting PostgreSQL 17 dependencies...
Runtime Closure Size
Raw Dependency Closure |
mmlb
force-pushed
the
push-smxxzkmnpkvq
branch
3 times, most recently
from
July 17, 2026 17:31
14a8309 to
9abb2f7
Compare
This comment has been minimized.
This comment has been minimized.
mmlb
force-pushed
the
push-smxxzkmnpkvq
branch
18 times, most recently
from
July 17, 2026 22:47
12d5be6 to
4281cd6
Compare
* No need for sudo to write to /tmp * Put the github token into a separate file to avoid leaking by mistake * Do not set extra-system-features = kvm until we know we have a kvm device * Drop sourcing the shell env since its not actually used in this step
…l support This way we can use this action in the qemu image build workflow that runs in dind and requires single-user install.
Signals to force clean known nix paths. This is temporarily useful for native arm runners that have a pre-existing detsys nix install.
Same as before where host must match target. This is nice to test x86_64 specific playbook tasks.
Fixes packer-qemu-plugin 100% cpu usage across all cores (similar to seen with the amazon ebssurrogate plugin). CPU usage seen with gnutime -v, before: ``` User time (seconds): 4703.36 System time (seconds): 259.53 Percent of CPU this job got: 781% Elapsed (wall clock) time (h:mm:ss or m:ss): 10:35.18 ``` after: ``` User time (seconds): 732.49 System time (seconds): 310.12 Percent of CPU this job got: 209% Elapsed (wall clock) time (h:mm:ss or m:ss): 8:17.33 ```
We don't need it.
We already have a pre-ansible step to install packages that are missing compared to the ebs setup so let move these 2 there and avoid some weird qemu only package install tasks (not to mention that I'm not sure installing gpg in supabase-admin-agent file made much sense anyway).
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What kind of change does this PR introduce?
feature
What is the current behavior?
Its a pain to try to run the qemu builds locally. We have hard coded paths to FW files and aren't using nix for any of the deps. As written we can't even run these locally since it assumes a linux aarch64 machine, not what any supabase employ has.
What is the new behavior?
We now run packer using a wrapper nix package, similar to build-ami, so that we have deps and can refer to firmware files easily. I've also added x86_64 support so those of us that have a bare-metal linux x86_64 machine can run the packer build and test ansible files. Finally, I made it so the qemu config packer runs isn't tied to linux and can run on macos, qemu is cross platform and has no issues using apple hvf instead of kvm.