Skip to content

feat(models): discover context windows from Kiro catalog - #121

Open
leecoder wants to merge 4 commits into
tickernelz:masterfrom
leecoder:fix/overflow-response-for-compaction
Open

feat(models): discover context windows from Kiro catalog#121
leecoder wants to merge 4 commits into
tickernelz:masterfrom
leecoder:fix/overflow-response-for-compaction

Conversation

@leecoder

@leecoder leecoder commented Aug 11, 2026

Copy link
Copy Markdown
Contributor

Summary

Discover each account's model context window from Kiro's live model catalog instead of maintaining a hardcoded context-size table.

Changes

  • src/plugin/models.ts: Query GET https://q.{region}.amazonaws.com/ListAvailableModels?origin=AI_EDITOR with the selected account's bearer token. Read models[].tokenLimits.maxInputTokens, map resolved Kiro model IDs back to plugin aliases, cache results for 5 minutes, and fall back to the existing -1m alias heuristic when discovery is unavailable.
  • src/core/request/request-handler.ts: Refresh the catalog after selecting/refreshing the active account and before preparing the request, so response usage estimation uses the active account's actual limits.
  • src/__tests__/models.test.ts: Verify live API limits and alias mapping.

Verification

  • bun run build passed
  • bun test src/__tests__/models.test.ts passed (1 pass, 0 fail)
  • Live authenticated request verified ListAvailableModels returns tokenLimits.maxInputTokens (including 1M Sonnet 4.6 and account-specific limits for DeepSeek/MiniMax).

Note: bun test still has unrelated pre-existing failures in bearer-retry.test.ts and sdk-client.test.ts; the focused model test and build pass.

leecoder and others added 3 commits August 11, 2026 09:24
- Add MODEL_CONTEXT_WINDOWS map with explicit sizes per model
- getContextWindowSize() checks map first, falls back to isLongContextModel
- Add test coverage for context window size resolution
Ultraworked with [Sisyphus](https://github.com/code-yeongyu/oh-my-openagent)

Co-authored-by: Sisyphus <clio-agent@sisyphuslabs.ai>
Ultraworked with [Sisyphus](https://github.com/code-yeongyu/oh-my-openagent)

Co-authored-by: Sisyphus <clio-agent@sisyphuslabs.ai>
@leecoder leecoder changed the title feat(models): add per-model context window size lookup table feat(models): discover context windows from Kiro catalog Aug 11, 2026
Ultraworked with [Sisyphus](https://github.com/code-yeongyu/oh-my-openagent)

Co-authored-by: Sisyphus <clio-agent@sisyphuslabs.ai>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant