Skip to content

fix(fish-speech): support CUDA 13 on arm64 - #11347

Open
localai-org-maint-bot wants to merge 1 commit into
masterfrom
bot/issue-11344-fish-speech-cuda13
Open

fix(fish-speech): support CUDA 13 on arm64#11347
localai-org-maint-bot wants to merge 1 commit into
masterfrom
bot/issue-11344-fish-speech-cuda13

Conversation

@localai-org-maint-bot

Copy link
Copy Markdown
Collaborator

Description

This PR fixes #11344.

  • expose the cloned fish-speech source through PYTHONPATH after backend relocation
  • pin CUDA 13 builds to PyTorch 2.9.1 CUDA wheels and align fish-speech upstream metadata before editable installation
  • decode reference audio with soundfile, avoiding torchcodec, which has no Linux aarch64 wheels
  • keep upstream preparation idempotent and fail the image build if the expected upstream source shape drifts

The partial-cuDNN failure reported in the same issue is already guarded on master by #10946; its existing regression suite is included in verification rather than duplicating that logic here.

Notes for Reviewers

Verified with:

  • make -C backend/python/fish-speech test-unit
  • bash scripts/build/package-gpu-libs-cudnn_test.sh (14 cases)
  • Bash syntax checks and Python byte-compilation
  • two consecutive preparation passes against a fresh clone of fishaudio/fish-speech main
  • git diff --check for both LocalAI and the transformed upstream tree

A full CUDA 13/aarch64 backend image build was not run on this host.

Signed commits

  • Yes, I signed my commits.
  • Documentation updated (docs/content/) for user-facing changes, or not applicable

Keep the relocated upstream source importable, select CUDA 13 PyTorch wheels instead of the aarch64 CPU fallback, and decode reference audio without torchcodec, which has no Linux arm64 wheels.

Assisted-by: Codex:gpt-5
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

fish-speech-s2-pro on localai/localai:latest-nvidia-l4t-arm64-cuda-13 (DGX Spark)

1 participant