Skip to content

Eca is not aware on context length when served by llama-swap #577

Description

@apalazzi

To upvote this issue, give it a thumbs up. See this list for the most upvoted issues.

Describe the bug

I serve my local models through llama-swap https://github.com/mostlygeek/llama-swap but ECA doesn't detect context available in the model, so auto compaction and any hook based on relative context length does not work.

Oh-My-Pi correctly shows maximum context available, and eca-emacs connected to OpenRouter correctly shows maximum context available.

To Reproduce

  • Setup a local llama-swap server
  • connect to it
  • see that max context is not returned.

Expected behavior

ECA should know about max context available to trigger events based on relative context usage, eg autocompaction.

Doctor

ECA version: 0.155.1

Server cmd: /home/andrea_palazzi/.emacs.d/eca/eca server

Workspaces: /home/andrea_palazzi/src/microplm

Default model: delfi/Gemma-4-26B-A4B-It-UD-Q6_K_XL (API key (****))

Logged providers: None
Relevant env vars:
XDG_ACTIVATION_TOKEN=kwi*****130

Credential files: None found

Screenshots

Image

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions