Skip to content

Docs: scope claims that drifted from the code - #1750

Merged
abrichr merged 2 commits into
mainfrom
review/claims-drift
Nov 3, 2026
Merged

abrichr merged 2 commits into
mainfrom
review/claims-drift

Conversation

@abrichr

@abrichr abrichr commented Nov 3, 2026 •

Copy link
Copy Markdown
Member

Follow-up to the 2026-11-03 external review (findings 3, 4, 8, 9 and 10). Docs and docstrings only.

  • Pipelined read-back: the module docstring now describes how a linear durable run with an encrypted checkpoint store defers its last step's read-back (Replayer._may_pipeline_readback, THROUGHPUT.md).
  • Production-lifecycle ratio: both result files now state the scope. The ratio comes from the cost model, with hand entry at 3 minutes per item, on a local OpenEMR with synthetic patients, and includes the record-channel duplicate check from Duplicate check asks the system of record (FHIR/REST, SQL fallback) instead of the screen list #1516.
  • Model calls: README, CAPABILITIES, llms.txt and the flow and agent READMEs now say "no calls to a hosted AI model", which is what the runtime measures.
  • Fleet patches: they move as files or through a local reference hub, and the docs describe only that transport.
  • Induction held-out check: described as structural trace coverage. The behavioural scorer is validation.behavioral_generalization. Updated in CHANGELOG, REPAIR_LIFECYCLE.md, LEARN_FROM_MANY_RUNS.md and the learning package docstring.

llms-full.txt was rebuilt. Website copy: OpenAdaptAI/openadapt-web#598.

- Pipelined read-back: durable runs can defer their last step's check.
- Production-lifecycle 3.17x: a cost-model ratio with an assumed 3-minute
  hand entry and the draft #1516, not an observed saving.
- Define "no model calls": local OCR and the optional local grounding
  model still run on the machine.
- Fleet patches move as files or through a local hub; CloudPatchFeed is
  a stub.
- induce --held-out and the learn loop's held-out check are structural
  coverage, not behavioural correctness.
@abrichr
abrichr merged commit dd908b2 into main Nov 3, 2026
47 checks passed
@abrichr
abrichr deleted the review/claims-drift branch November 3, 2026 20:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant