Skip to content

Extend model LoRA support and add GGUF adapter merge tools - #993

Merged
0xShug0 merged 1 commit into
mainfrom
feature/lora-support
Oct 19, 2026
Merged

0xShug0 merged 1 commit into
mainfrom
feature/lora-support

Conversation

@0xShug0

@0xShug0 0xShug0 commented Oct 19, 2026

Copy link
Copy Markdown
Owner

Summary

  • Add session LoRA loading for Qwen3-TTS, Qwen3-ASR, VoxCPM1/2, Fish Audio S2 Pro, CosyVoice3, F5-TTS, and OuteTTS.
  • Add model-aware GGUF adapter export for these families plus YuE2, ACE-Step, and VibeVoice.
  • Separate checkpoint containers from adapter layouts using shared tensor I/O and checkpoint discovery; keep model-specific bindings and sidecars local.
  • Document adapter scaling, required sidecars, and conversion. F5-TTS requires reconverting the matching original checkpoint with the current converter rather than using the currently published GGUF packages.

Validation

  • Debug C++17 build and focused model-spec, weight-adapter, GGUF tensor-source, and Torch checkpoint tests.
  • Python merge-tool tests, including fused-row coverage, native/PEFT package selection, and configured-rank validation.
  • Local runtime and merge checks; malformed ranks and missing required native sidecars are rejected.

Adapters are opt-in; base weight files are not modified.

@0xShug0
0xShug0 merged commit ecfe29e into main Oct 19, 2026
12 checks passed
@0xShug0
0xShug0 deleted the feature/lora-support branch October 19, 2026 22:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant