Skip to content

Keep inference metadata and OCR columns in sync - #55

Merged
davanstrien merged 3 commits into
mainfrom
fix/inference-info-identity
Sep 12, 2026
Merged

davanstrien merged 3 commits into
mainfrom
fix/inference-info-identity

Conversation

@davanstrien

@davanstrien davanstrien commented Aug 13, 2026 •

Copy link
Copy Markdown
Owner

Summary

  • Resolve the model identity and OCR text column atomically from one inference_info entry.
  • For append-only list metadata, select the last entry whose declared output column exists.
  • Preserve scalar metadata and heuristic fallbacks while avoiding cross-entry model/output pairing.
  • Add direct and end-to-end regressions, including an incomplete final entry.

Why

OCR scripts append inference_info entries. Resolving model and text independently could pair a newer model identity with stale OCR output. Selecting one usable entry keeps them coupled.

Migration note

Existing results repositories judged by an older checkout from configs with multiple appended inference_info entries should be evaluated once with --full-rejudge. Old comparison rows do not record enough resolution provenance to prove that they used the newly selected text.

Validation

  • 609 tests passed
  • Ruff passed on src and tests
  • ty passed on src
  • git diff --check passed

@davanstrien
davanstrien merged commit 0b3ef74 into main Sep 12, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant