Repository navigation

feat: judge and semantic on by default; name the missing evaluator key - #45

Merged

babaliauskas merged 16 commits into

mainfrom

spec/evaluators-on-by-default

Oct 10, 2026

Merged

feat: judge and semantic on by default; name the missing evaluator key#45
babaliauskas merged 16 commits into
mainfrom
spec/evaluators-on-by-default

Commits on Oct 9, 2026
- docs(spec): judge and semantic on by default; name the missing key
  
  babaliauskas
  and
  claude
  committed
  edfe389
- docs(plan): judge and semantic on by default — implementation plan
  
  babaliauskas
  and
  claude
  committed
  e18a535
- refactor(models): one missing_api_keys check; bare text-embedding ids are OpenAI
  
  babaliauskas
  and
  claude
  committed
  236dce2
- feat(evaluators): find judge/embedding models with no API key
  
  babaliauskas
  and
  claude
  committed
  1bd430f
- feat(evaluate): skip a keyless advisory judge/embedder, refuse a keyless gate
  
  babaliauskas
  and
  claude
  committed
  baa1d81
- feat(compare,run): check judge and embedding keys before the first call
  
  babaliauskas
  and
  claude
  committed
  621407a
- feat(policy): advise promoting the judge from its own n; name skipped evaluators
  
  babaliauskas
  and
  claude
  committed
  a011b80
- feat(doctor): report judge and embedding models with no API key
  
  babaliauskas
  and
  claude
  committed
  664f9a6
- fix(compare): scope the doctor stage's evaluator-key check to the suite being run
  
  babaliauskas
  and
  claude
  committed
  db0ee06
- feat(init): scaffold semantic on for every provider, borrowing an embedder
  
  babaliauskas
  and
  claude
  committed
  0bf910d
- docs: judge and semantic on by default; missing evaluator keys
  
  babaliauskas
  and
  claude
  committed
  50c60a9
- fix(compare,run,evaluate,doctor): refuse an all-skipped run; name the forcing tool_arguments entry
  
  babaliauskas
  and
  claude
  committed
  0127b9a
- fix(policy): no "collect more" advice for a judge that measured nothing
  
  babaliauskas
  and
  claude
  committed
  742c51c
- fix(config): title missing-key errors as such
  
  babaliauskas
  and
  claude
  committed
  a11ef2b
- docs: changelog upgrade note; qualify local/hosted match
  
  babaliauskas
  and
  claude
  committed
  f72cac6
Commits on Oct 10, 2026
- Merge origin/main into spec/evaluators-on-by-default
  
  babaliauskas
  and
  claude
  committed
  accf0f9

Commits

Commits on Oct 9, 2026

Commits on Oct 10, 2026