Skip to content

XY-868: [ELF benchmark vNext P2] Add live real-world adapters for ELF and qmd#157

Merged
yvette-carlisle merged 1 commit into
mainfrom
y/elf-xy-868
Jun 10, 2026
Merged

XY-868: [ELF benchmark vNext P2] Add live real-world adapters for ELF and qmd#157
yvette-carlisle merged 1 commit into
mainfrom
y/elf-xy-868

Conversation

@yvette-carlisle

Copy link
Copy Markdown
Member

Summary

  • Add a Docker-isolated live real-world adapter materializer for ELF service runtime and qmd CLI runtime.
  • Add representative live adapter fixtures and a cargo-make task that materializes adapter_response fixtures, scores reports, and writes summary evidence.
  • Update the external adapter manifest and benchmark docs so fixture-backed, live-baseline-only, and live-real-world claims remain distinct.

Validation

  • cargo make fmt
  • cargo make lint-fix
  • cargo make checks
  • cargo make real-world-memory-live-adapters

Evidence

  • ELF live real-world report: 3 encoded jobs, 3 pass, expected evidence recall 1.0.
  • qmd live real-world report: 3 encoded jobs, 3 pass, expected evidence recall 1.0.
  • Semantic drift audit verdict: pass; changed docs claims match task, manifest, and report evidence.

@yvette-carlisle yvette-carlisle merged commit a6a2c52 into main Jun 10, 2026
10 checks passed
@yvette-carlisle yvette-carlisle deleted the y/elf-xy-868 branch June 10, 2026 07:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant