Skip to content

XY-818: [ELF prod P0] Add private-corpus production adoption benchmark#127

Merged
yvette-carlisle merged 1 commit into
mainfrom
y/elf-xy-818
Jun 9, 2026
Merged

XY-818: [ELF prod P0] Add private-corpus production adoption benchmark#127
yvette-carlisle merged 1 commit into
mainfrom
y/elf-xy-818

Conversation

@yvette-carlisle

Copy link
Copy Markdown
Member

Summary

  • add a production corpus manifest schema and checked-in synthetic coding-agent fixture
  • add synthetic/private production corpus cargo-make benchmark entrypoints with fail-closed private manifest handling
  • extend ELF benchmark reports with evidence IDs, wrong-result counts, latency, provider, and embedding dimensions

Verification

  • cargo make fmt
  • cargo make lint-fix
  • cargo make checks
  • cargo make baseline-production-synthetic
  • cargo make baseline-production-private (fails closed without ELF_BASELINE_PRODUCTION_CORPUS_MANIFEST)

@yvette-carlisle yvette-carlisle merged commit 1527265 into main Jun 9, 2026
10 checks passed
@yvette-carlisle yvette-carlisle deleted the y/elf-xy-818 branch June 9, 2026 04:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant