Skip to content

Add ELF competitor benchmark iteration direction report#174

Merged
yvette-carlisle merged 1 commit into
mainfrom
xy/elf-benchmark-comparison-report
Jun 11, 2026
Merged

Add ELF competitor benchmark iteration direction report#174
yvette-carlisle merged 1 commit into
mainfrom
xy/elf-benchmark-comparison-report

Conversation

@yvette-carlisle

Copy link
Copy Markdown
Member

Summary

Adds a durable benchmark interpretation report that translates the current competitor-strength matrix into ELF iteration direction without claiming unproven wins.

The new report covers:

  • current measured data for fixture-backed ELF aggregate, ELF/qmd live real-world sweep, production-provider/backfill/restore evidence, and external adapter ledger counts
  • scenario-level conclusions for retrieval/debug, work resume, project decisions, source-of-truth, temporal memory, consolidation, knowledge pages, operator debugging, capture/write policy, production ops, personalization, context trajectory, core-vs-archival memory, and graph/RAG navigation
  • project guidance for all tracked memory/RAG/graph projects in the current manifest
  • explicit non-claims and recommended next reports

Scope

Report-only change. This does not implement ELF optimizations, queue Decodex lanes, or change benchmark semantics.

Verification

  • cargo make real-world-memory
  • git diff --check
  • checked that the report mentions all 17 tracked manifest projects

…ation direction report","authority":"manual-report"}
@yvette-carlisle yvette-carlisle merged commit 286af8b into main Jun 11, 2026
8 checks passed
@yvette-carlisle yvette-carlisle deleted the xy/elf-benchmark-comparison-report branch June 11, 2026 00:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant