Skip to content

Fix llama-server version selection#78

Merged
ganisback merged 1 commit into
mainfrom
agent/fix-llama-server-resolution
Jul 20, 2026
Merged

Fix llama-server version selection#78
ganisback merged 1 commit into
mainfrom
agent/fix-llama-server-resolution

Conversation

@Rader

@Rader Rader commented Jul 19, 2026

Copy link
Copy Markdown
Contributor

What changed

  • Prefer a llama-server installed next to the running csghub-lite binary before searching PATH.
  • Cover the co-located binary path on macOS, Linux, and Windows.
  • Replace existing shared-library compatibility links when the installer upgrades llama.cpp.

Why

Background services can receive a different PATH from the interactive shell used for installation. This allowed a stale system-wide llama.cpp build to be selected instead of the matching release installed beside csghub-lite. The installer could also leave compatibility symlinks pointing at libraries from an older release.

The mismatch caused newer multimodal embedding models to crash during llama-server startup even though the pinned llama.cpp release was already installed under ~/.local/bin.

Validation

  • go test ./internal/inference ./internal/server
  • sh -n scripts/install.sh
  • git diff --check
  • Verified both local Qwen3-VL embedding model IDs return HTTP 200 with 2048-dimensional text embeddings while using the co-located llama-server b9158.

@Rader

Rader commented Jul 19, 2026

Copy link
Copy Markdown
Contributor Author

fix embedding model run exception: #73

@Rader
Rader marked this pull request as ready for review July 19, 2026 07:52
@Rader
Rader requested a review from ganisback July 19, 2026 07:53
@ganisback
ganisback merged commit e87f90d into main Jul 20, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants