Skip to content

Add infiniteMem external rows (LoCoMo + LongMemEval-S, self-reported) - #41

Open
marcot3ssar1 wants to merge 1 commit into
vectorize-io:mainfrom
marcot3ssar1:add-infinitemem-rows
Open

Add infiniteMem external rows (LoCoMo + LongMemEval-S, self-reported)#41
marcot3ssar1 wants to merge 1 commit into
vectorize-io:mainfrom
marcot3ssar1:add-infinitemem-rows

Conversation

@marcot3ssar1

Copy link
Copy Markdown

Add infiniteMem external rows (LoCoMo + LongMemEval-S, self-reported).

4 rows with source links to reproducible releases (harness, hashes, per-question caches), following the file's existing convention including methodology caveats in comment:

  • LoCoMo locomo10: mini top-50 75.90, kimi-k3 top-50 85.99 (judge pinned mini, cat5 excluded, n=1535)
  • LongMemEval-S: mini top-10 59.80, kimi-k3 top-5 88.80 (judge pinned mini, upstream prompts verbatim, n=500 incl. ABS, 6 structural errors declared)

Diff is additions-only (plus trailing newline). Happy to adjust wording, splits, or provide hypothesis files in any format.

@vercel

vercel Bot commented Sep 6, 2026

Copy link
Copy Markdown

@marcot3ssar1 is attempting to deploy a commit to the Vectorize Team on Vercel.

A member of the Team first needs to authorize it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant