FreeCite: A Judge-Free Benchmark for Granular Citation Evaluation in Large Language Models
-
Updated
Feb 22, 2026 - Python
#
deterministic-evaluation
Here are 14 public repositories matching this topic...
Research benchmark for evidence-grounded OS-agent collaboration, continuous state diagnosis, scoped memory reuse, and stale-state rejection.
multi-agent-systems system-administration research-only agent-collaboration os-agent stateful-agents agent-benchmark tool-using-agents deterministic-evaluation linux-operations evidence-grounding memory-evaluation continuous-tasks
-
Updated
Jul 29, 2026 - JavaScript
Canonical specification and sealed execution traces for VERITAS Ω-CODE v2.0 — deterministic software verification protocol.
-
Updated
Apr 23, 2026 - HTML
As of 07/09/2026 the only open-source PT-PT benchmark that avoids LLM judges and targets email-style structured generation. Deterministic CPU-friendly benchmark for European Portuguese (PT-PT) email LLMs. No LLM judges.
nlp open-source benchmark reproducible email text-generation portuguese dialect pt-pt business-email portuguese-portugal portuguese-european llm-evaluation structured-generation portuguese-nlp llm-benchmark deterministic-evaluation european-portuguese no-llm-judge
-
Updated
Sep 10, 2026 - Python
A realistic RL environment for training LLM agents on enterprise email triage—featuring multi-step decision making, ambiguity handling, tool usage, and deterministic evaluation.
docker reinforcement-learning simulation hackathon triage ai-agents email-classifier scaler rl-environment pydantic fastapi multi-step-reasoning huggingface-spaces llm-agents tool-usage agentic-workflows openenv email-triage deterministic-evaluation pytorch-openenv
-
Updated
Jul 2, 2026 - Python
AI-assisted policy formalization and governance platform for source-traceable rule extraction, human review, immutable versioning, deterministic evaluation, quality analysis, and regression testing.
react rule-engine compliance governance policy-engine policy-as-code fastapi azure-openai azure-ai-search deterministic-evaluation
-
Updated
Sep 2, 2026 - Python
Auditable address-level rental housing law screening with verified property facts, deterministic three-valued evaluation, and source-backed change tracking.
python hackathon civic-tech explainable-ai rental-housing legal-tech deterministic-evaluation housing-law
-
Updated
Oct 4, 2026 - Python
HCAC is a completion contract for agents and tools. It defines when something is truly “done” — not just structurally, but behaviorally.
backpressure ai-agents quality-gates policy-as-code acceptance-criteria hard-constraints release-readiness deterministic-evaluation agent-contract completion-contract behavioral-contract behavioral-spec
-
Updated
Feb 28, 2026
Deterministic multi-lane evaluation domain for SnorkelAI Terminus3. Cockpit, lane orchestration, agent benchmarking, reasoning-drift detection.
python docker evaluation terminus snorkel cockpit deterministic multi-lane deterministic-evaluation agent-benchmarking snorkelai terminus3 reasoning-drift multi-lane-evaluation ml-eval
-
Updated
Sep 28, 2026 - Python
Public, fully local PoCs for counterfactually auditable lifecycle certification: exact paired replay, drift monitoring, post-drift replanning, and bridge-aware ledger control on synthetic tasks.
ai poc autonomous-agents synthetic-data drift-monitoring llm scientific-reproducibility deterministic-evaluation counterfactual-auditing paired-replay
-
Updated
Mar 19, 2026 - Python
Ultra pipeline framework for Gravity Binary, including deterministic evaluation logic, capsule workflows, and EC/Ultra integration artifacts.
python docker pipeline evaluation orchestration snorkel deterministic capsule ultra pipeline-evaluation deterministic-evaluation snorkelai ultra-pipeline ultra-sentinel high-trust-evaluation ml-eval
-
Updated
Aug 24, 2026
SnorkelAI Terminus2 task suite with deterministic evaluators, Dockerized environments, and reproducible agent-benchmarking primitives.
python docker benchmarking evaluation terminus snorkel deterministic deterministic-evaluation agent-benchmarking snorkelai terminus2 task-engineering dockerized-evaluators ml-eval
-
Updated
Jun 17, 2026 - Python
Core deterministic architecture for multi-lane ML evaluation systems. Foundational logic, capsule interfaces, reproducible execution patterns.
python azure architecture evaluation saas deterministic capsule system-design capsules multi-lane container-apps capsule-system trust-engine deterministic-evaluation gravity-binary capsule-integration evaluation-architecture gravitybinary
-
Updated
May 10, 2026 - Python
Deterministic offline ComtradeBench judge for evaluating agent robustness under pagination, retries, duplicates, page drift, and totals traps.
-
Updated
Aug 17, 2026 - Python
Add this topic to your repo
To associate your repository with the deterministic-evaluation topic, visit your repo's landing page and select "manage topics."