Skip to content

build(docker): install prebuilt FlashAttention-3 wheel#69

Open
Rockdu wants to merge 2 commits into
mainfrom
build/install-fa3
Open

build(docker): install prebuilt FlashAttention-3 wheel#69
Rockdu wants to merge 2 commits into
mainfrom
build/install-fa3

Conversation

@Rockdu

@Rockdu Rockdu commented Jul 25, 2026

Copy link
Copy Markdown
Collaborator

What

  • Install Miles' prebuilt Hopper FlashAttention-3 wheel in the diffusion image.
  • Select matching CUDA 12.9 or CUDA 13.0 wheel releases.
  • Verify that the upstream flash_attn_interface module imports during the image build.

Why

LTX Core imports the upstream FA3 Python interface directly, while the existing SGLang kernels-hub integration does not guarantee that top-level module is installed.

Files

  • docker/Dockerfile — downloads, installs, and smoke-checks the FA3 wheel.
  • docker/justfile — selects the CUDA 13 wheel release for cu13 builds.

Validation

  • git diff --check
  • Confirmed both cu129-x86_64 and cu130-x86_64 Miles wheel releases contain exactly one flash_attn_3 wheel.
  • Docker build not run locally because the Docker daemon is unavailable.

Checklist

  • pre-commit run --all-files passes — not run
  • Added/updated tests for new behaviour — no tests added; Docker build includes an import smoke check
  • pytest -x is green — not run; Docker-only change
  • If launch flags changed, python3 train.py --help still parses — not applicable
  • If a public flag was added, it appears in the CLI reference docs — not applicable
  • If an example was added, it has a real walkthrough — not applicable

Made with Cursor

ci-sglang-repo: sgl-project/sglang
ci-sglang-pr: #32420

Use the same Miles wheel releases so ltx-core can import the upstream Hopper attention interface in both CUDA variants.

Co-authored-by: Cursor <cursoragent@cursor.com>
@Rockdu Rockdu added the run-ci-e2e Run e2e metric-regression tests on this PR label Jul 26, 2026
The justfile's release recipes push radixark/miles-diffusion, a Docker Hub
repository that does not exist — the real registry is rockdu/miles_diffusion,
built and pushed by docker-build.yml (dispatch + main-push triggers) and
pr-test.yml's docker-build job. Neither CI path invokes just, so the file only
duplicated the docker build invocation a third time (three recipes drifting
against two workflows).

The one piece of knowledge it uniquely carried — the cu13 variant build-args —
moves to a comment next to the FA3_WHEELS_TAG ARG in the Dockerfile.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@Rockdu

Rockdu commented Jul 26, 2026

Copy link
Copy Markdown
Collaborator Author

Pushed 8c4bfbb onto this branch: rather than adding a third copy of the cu13 build-arg wiring to the justfile, the commit deletes docker/justfile outright.

@Rockdu Rockdu added run-ci-e2e Run e2e metric-regression tests on this PR and removed run-ci-e2e Run e2e metric-regression tests on this PR labels Jul 26, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

run-ci-e2e Run e2e metric-regression tests on this PR

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant