All pull requests

Pull requests

• chore: ignore build artifacts

  #55·chen3feng opened Sep 9, 2026·

  ·
  1

• Report synthesis duration and route ggml logging through level filter

  #54·chen3feng opened Sep 9, 2026·

  ·
  1

• Fix CUDA transpose grid-y overflow and add faster 1D im2col

  #52·chen3feng opened Sep 9, 2026·

  ·
  5

• Perf: single-pass offline codec decode

  #51·chen3feng opened Sep 9, 2026·

  ·
  1

• Perf: faster generation via flash attention, CUDA graphs, and graph caching

  #50·chen3feng opened Sep 9, 2026·

  ·
  3

• Fix Windows build under NOMINMAX: use std::max

  #48·PureChocolate opened Aug 13, 2026·

  ·
  1

• feat: KV cache quantization

  #47·Skyrion9 opened Aug 5, 2026·

  ·
  19

• feat: KV cache reuse and prompt prefill caching

  #46·Skyrion9 opened Aug 4, 2026·

  ·
  19

• perf: replace standard attention with unified flash attention

  #45·Skyrion9 opened Jul 22, 2026·

  ·
  1

• feat: mmap lazy loading and phase-gated VRAM swap

  #44·Skyrion9 opened Jul 20, 2026·

  ·
  15

• perf: Conditional gallocr caching for Fast-AR decode on pure CPU runs (%4~ faster)

  #43·Skyrion9 opened Jul 15, 2026·

  ·
  1

• fix: case-insensitive arguments.

  #42·Skyrion9 opened Jul 15, 2026·

  ·
  5

• Update GGML to latest master

  #41·Skyrion9 opened Jul 15, 2026·

  ·
  1

• feat: Backend-specific prefill chunk sizes

  #39·Skyrion9 opened Jul 15, 2026·

  ·
  1

• feat: support separate codec GGUF via --codec-model

  #36·jadsongmatos opened Jun 12, 2026·

  ·
  1

• Add HIP build support.

  #35·Rafa00127 opened Jun 4, 2026·

  ·
  1