LLM-as-judge evaluation harness — define rubric cases, score model outputs, gate CI. Runs fully offline in replay mode (no API key); EVAL_LIVE=1 hits the real Anthropic API.
-
Updated
Sep 10, 2026 - Python
#
eval-engineering
Here are 3 public repositories matching this topic...
Deterministic-first Chrome agreement analyzer showcasing eval engineering with JEV and pluggable System One classifiers.
chrome-extension classifier terms-and-conditions privacy-tech ai-evaluation agreement-analysis deterministic-ai eval-engineering jev system-one
-
Updated
Sep 28, 2026 - JavaScript
Awesome list for eval engineering (evals engineering): tools that automate LLM evals and agent evals, turn traces into test cases, and calibrate LLM-as-a-judge.
awesome awesome-list ai-agents ai-evaluation ai-testing llm-eval evals llm-evaluation llm-as-judge llm-as-a-judge llm-testing llm-evals agent-evals agent-evaluation ai-evals evaluation-engineering evals-engineering eval-engineering
-
Updated
Sep 15, 2026
Add this topic to your repo
To associate your repository with the eval-engineering topic, visit your repo's landing page and select "manage topics."