Repository navigation
chore: version packages - #58
Merged
Merged
Conversation
|
Important Review skippedBot user detected. To trigger a single review, invoke the
|
github-actions
Bot
force-pushed
the
changeset-release/main
branch
28 times, most recently
from
November 12, 2026 10:27
1cb31ab to
84c9ae0
Compare
github-actions
Bot
force-pushed
the
changeset-release/main
branch
28 times, most recently
from
November 14, 2026 13:38
1cf3bdc to
306c1ce
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This PR was opened by the Changesets release GitHub action. When you're ready to do a release, you can merge this and the packages will be published to npm automatically. If you're not ready to do a release yet, that's fine, whenever you add more changesets to main, this PR will be updated.
Releases
@stainless-code/verdict@0.7.0
Minor Changes
cc6bfbf: What's new in 0.7.0
Verdict 0.7.0 is a breadth release. It adds a local code index, a read-only
servesurface with a browserUI, and a backtest harness that mines past bug fixes from your own history, replays them against your
agent, and scores the result. Review output gains an auditable provenance receipt, diff-coverage
attestation, advisory risk scoring, and an optional validation pass that floors each finding on the
evidence behind it, while the CI gate now checks coverage by default. Posting grows a secret guard, honest
per-host capability reporting, and a summary-comment option, GitLab and Forgejo join GitHub as full publish
targets, and lens packs, declared recipes, and reported verification make the review pipeline itself data.
Thirteen pre-1.0 changes alter behavior — each names the migration step below — and the known limits close
the notes.
cc6bfbf: New commands and flags
pr-wait— wait for a PR to merge, close, change checks, or change review state, with a bounded timeout and typed timeout data. Bounded foreground waitsingest— import SARIF 2.1.0 results into a bundle's findings store, sharing one dedupe and suppression path with model reviews. Static-analysis ingestionthreads resolve— close the review threads whose findings your store marks addressed, one receipt per run, with--dry-runand typed refusals for threads verdict did not author. Guarded submissionrisk— rank every local bundle into an advisory triage queue by band and 0–100 score, without a host call or an index build. Triage risk queuereport --html— export the six dashboard views as a static site, published through staging and backup siblings with rollback and symlink refusals. Static dashboard exportrun --agent— run your own agent CLI against an existing bundle, assert exactly one freshreview.json, then hand off to the unchanged record/post validation. Your agent, launchedpanel— plan independent verifier dispatches locally; keep-biased results enrich findings and summaries without voting or dropping anything. Panel verification.verdict/recipes.jsondeclares a lens set, synthesizer hint, and budget as strict versioned data, read at the PR base and hashed into the bundle. Recipesskill show,skill status,skill uninstall— inspect one payload file byte-identically, gate on drift with an exit code, and remove only the files a receipt owns. Install routespost --summary comment— maintain one separate PR-level summary comment, updated in place across all three publish hosts; the defaultoffkeeps output byte-identical. Guarded submissionfix --all— the batch form of the bounded fix loop: every open inline finding at or above--min-severity, one pass per sig under the same ceilings, per-sig outcomes indata.batch, and afix.patchwritten beside the ledger. Fix loopsfix --selected— address exactly the sigs a human 👍 selected on the root verdict comment, read through one shared reaction reader; a selection file is written only when something was reacted to. Fix loopshandoff— one markdown projection of the open inline findingsfixwould take, selecting through the same selector, with--json,--format md, and repeatable--paths; read-only, with no ledger and no host call. Handoffrun --print --stage <n>— render one recipe stage at a time, so CI can dispatch the four stages under different models. Recipesbacktest reverts— record the reverts git already knows about into a sorted, byte-stable.verdict/reverts.jsonl, with.verdict/reverts.mdas the fenced reading surface. Revertsbacktest mine— mine SZZ candidates from a local clone with zero model calls and zero network, writing a timestamp-freemine.json. Backtestbacktest replay— replay mined candidates against your own agent in a throwaway worktree per candidate, bounded by review count, projected budget, and timeout. Replaybacktest score— grade a replay's findings against the candidate bug lines and report a catch rate, off-target findings per PR, and cost per review as a pure read. Scorelearn --incident— attach one revert or incident to a recorded bundle in a sorted, idempotent.verdict/incidents.jsonlledger. Knowledge basecc6bfbf: Local code index
verdict index— build a local Go index with the standard library, stored by tree SHA so an empty commit reuses a tree and a rename parses nothing. Code indexindex tests-for,index co-changed, andindex ownersanswer candidate tests, co-change partners, and the CODEOWNERS rule at a tree. Code indexindex blast-radius— one change's reach: callers to depth 2 plus candidate tests, co-change partners, and owners for the changed paths. Code indextests-forwalks the reverse import graph up to--depthhops and labels tests it reached through imports. Code indexfetch --index— hand an index you already built tofetchorfetch-localand the bundle gains animpactartifact and a fenced## impactsection. Impact hand-offindex blast-radiusandfetchnow name the revision and tree an absent index is about, with the exact shell-quoted build step that answers for it. Code indexcc6bfbf: Review quality and provenance
fetch --contextandfetch-local --contextattach named context files, and findings cite them. Explicit contextreview.jsongains an optionalcoverage[]checked against the bundle's own hunks, with--require-coverageto refuse a partial claim and one body line on a partial attestation. Diff coverageranges: nullis malformed — a coverage claim whoserangesis present but not a string now counts as unattested instead of as the whole file. Diff coverage--ignore <glob>and--no-default-excludeson fetch, both recorded in the exclusion receipt. Exclusionspost --min-severityandreport --include-withheldto read them. Exclusionslearn --pack <dir> --id <rule>imports a structured rule object and keeps its pack provenance and hash. Import a rule objectlearn --statusgainsrecalled_in,cited_in,exposure, andacceptanceper rule, reporting unmeasured recall as null rather than zero. Knowledge baseriskclaim inreview.jsonplusreport --riskandreport --max-risk, which reports the larger of your claim and a deterministic floor. Triage risk queuepost.jsonrecords, per capability, what a host could not carry and why, so a degraded publish stays auditable. Guarded submissionrearmedandprevious_headrecorded. Guarded submissionfetchwrites an advisoryauthor.json({agent, model, confidence, evidence[]}) from five harness signals, suggests a reviewer from another model family, andrecord.jsoncarries the author/reviewer pair thattrendtallies. Bundle namespacefetcha bounded, fencedreverts.txt, and the review prompt treats a revert as evidence the change broke something once. Revertsprompts/validate.mdpass writesvalidation.jsonper sig,rigor_policyfloors each severity tier, andpost --require-rigornarrows it per invocation: advisory by default, a receipted withhold in gate mode. Rigor floorsprompts/review.mdtags the evidence rung asrigorand the in-bounds flag asin-bounds, and an archtest holds every published key toreview.schema.json. Rigor floorsrecordleaves areview.jsonbody with no leading quote block byte-identical and reports nobasis-replacedwarning, because there is no confidence lead to insert under. Review-input problemsnext --coveragerefuses acoverage[].rangesarray on plain and chunked bundles with the samebad-review-inputproblemrecordreports, instead of reading it as a silent 0% attestation. Diff coveragereport --check <tier>namesmerge — gate passesin the envelope'snextand human footer, leavingaddress open threadsfor a failing gate. Machine surface*.gen.*andzz_generated.*now count as generated in the shared role heuristic, sonext --coverageand the risk floor exempt them like the other generated patterns. Diff coveragecc6bfbf: Agents and MCP
run --rounds Nre-prompts an agent with the shape checker's fix list, stops on the first valid round, and refusesrepair-exhausted. Your agent, launchedmcp configwrites snippets for six more hosts and carries--read-onlyor--operatorinto the argv it prints. Host config--read-onlyreturns the typedread-only-toolrefusal. MCP server--printcc6bfbf: Hosts and CI
postsubmits one atomic Forgejo review with the body, verdict, reviewed commit, and every inline finding, and withholds what the host cannot anchor rather than guessing. Submit per hostfetch --provider gitlab --base-shawrites the sameincremental.diffcontract the GitHub compare path writes, and hosts without a compare adapter say so in a note. Providersreadyadvises on merge requests and plaincalibratejoins live GitLab threads throughglab, on the same blocker and outcome vocabulary as GitHub. Calibrationdoctor --provider— preflight one host at a time, with a per-host probe table and credentials reported by presence, never by value. Doctor preflightcc6bfbf: Serve and the browser UI
verdict serve— a read-only HTTP surface over the current repository, loopback by default, with a session-cookie exchange, strict CSP, Host and Origin gates, and per-response source traceability. Serveserve --rootfinds nested repositories under a bounded traversal backed by a local 24-hour registry, and reports cache, truncation, and skipped patterns. Serve/v1/costadds repository, ISO-week, and model buckets and/v1/precisionadds category and tier counts, keeping unmeasured prices null and marking corrupt aggregates partial. Serveserveopens an embedded UI with inbox, review, threads, cost, precision, and gate views, dark mode, live refresh, and staticdata.jsonreading. Serve--interval,--sweep, and--no-watchto control it. Servecc6bfbf: Lens packs
perf,api-contract, andtestnow ship as a pack resolved into every bundle aslenses.txt, with the four hashed prompt files byte-identical. Lens packsmax_files: 12, and the dispatch template leads with the lens's domain. Lens packspack addand a lock — vendor a pack from a directory or git source, validated before it loads and pinned in a strict.verdict/verdict.lock. Lens packspack listreports every loaded pack with its layer, source, tree hash, ids, and drift, and a repo pack is read from the trusted base so a PR cannot edit the pack that reviews it. Lens packspack test— run a pack's eval cases offline. Lens packspack-staging-stalewith the path to delete. Lens packscc6bfbf: Measurement
real-unlisted,matches-ground-truth, orfalse-positive, andbench/runner -renderrecomputes strict and adjudicated precision and recall without re-running a model. Benchmark corpusurfave/cli(three bugs and one clean control),-max-usdstops scheduling at measured spend and marks the run uncitable, and refused samples are counted in the cost rollup. Benchmark corpusfull.diffis missing, unreadable, or prose is refused instead of graded leniently. Benchmark corpuscc6bfbf: Breaking changes (pre-1.0)
Package is on
0.x, so these ship as a minor bump; each one names the step that migrates it.index blast-radiustruncation shape — the integertruncatedcount anddepth_truncatedare replaced by the shared boolean receipt (truncated,truncation_reason,returned,total,next_offset), and a complete result omits the receipt instead of carryingtruncated: false. Migrate: readtruncation_reasonandreturned; treat an absent receipt as complete. Code indexgatechecks coverage by default — the newcoveragedimension fails when the gated HEAD has no receipt, a receipt for another HEAD, nocoverage[]attestation, or under 100% attested. Migrate:--coverage warn, or the SDKCoveragefield, keeps the old passing behavior while reviews attest nothing. Gategate --livereads every host — a non-GitHub bundle used to pass the live dimension without reading threads; it now reads the bundle's own host and fails closed when it cannot. Migrate:--live autowarns and gates on the local dimensions only. Gatebad-flagson the MCPreporttool and inReport.Check/Gate.MaxSeverity, not only on the CLI. Migrate: send a tier from the published set, or omit the field. Gateverifychild environment is default-deny — only baseline locale, terminal, shell, XDG, and toolchain names pass, and a secret-shaped name is dropped even when it matches an allowlist prefix. Migrate: list what you need in.verdict/verify-envor--env-allowlist; dropped names appear inwarnings[]. Child environmentverifyrefuses command shapes it used to run —wget --remote-name/-i,curl -K,busybox wget,pip3 download <url>,telnet,git archive --remote, and the rest refuseverify-networkedin attached and clustered spellings, and a command word built from a variable (E=rm; $E -rf ./target, including the braced, quoted,exported, loop, and wrapper spellings) refusesverify-indirection. Migrate: write the tool word plainly and rewrite the command to a plain fetch your recipe can run; every refusal keeps itstry:hint. Known residuals.verify.outis owner-only — the verify stream is written0600on Unix where it was0644, because a command that prints a credential leaves the value in it. Migrate: read it as the user that ranverify, or copy the bytes inside that same step; on Windows the file keeps the directory's inherited ACL. Enforced sandboxa/b,..,CON,x:) refusesbad-flags, and a symlinked bundle root or component refuses before any write, including a link that points inside the repository. Migrate: one plain name per bundle, and a real directory where a link used to work. Bundle namespace--providerflag, an unknown or conflicting origin now refusesprovider-unknowninstead of defaulting to GitHub. Migrate: pass--providerexplicitly, or keep a plain GitHub origin. Providerscapabilitiessplits,truncatedwidens — the binding verdict becomesapproveandrequest_changeswithreview_verdictskept as the compatibility sum,unsupportednames each absent capability, anddata.truncatedwidens frombooleantoboolean | row[]. Migrate: branch on the two new flags, and narrowtruncatedbefore you read it as a boolean. Published schemaspack addsource allowlist — onlyhttps://host/pathwith no userinfo,ssh://user@host/path, anduser@host:pathare accepted; anything else refuses before a git call, and a lock row carrying one refuses atpack list,fetch,post, andrecord. Migrate: rewrite the source in one of the three forms. Lens packsprovenance.base_shaandprovenance.head_sha(40-hex), the two commits the reviewed diff spans, and a bundle stamps the same pair. Migrate: add both commits to every realcase.json; a case without them fails validation. Benchmark corpusverdict index build --at HEAD. Code indexPatch Changes
cc6bfbf: Safety and trust
psand/proc/<pid>/cmdline. Providerspostrefuses a secret-shaped value before the first host call, naming the shape and never the value, with--allow-secret-valuesas the explicit exception. Guarded submissionrecordescapes@-mentions once, where the body is built, so recorded, posted, dry-run, and digested bytes cannot diverge. Mentions(@alice),**@alice**, and_@alice_are escaped while real addresses stay byte-identical. Mentions~~@alice~~is escaped too, while a lone tilde in prose stays as written. Mentionspack testline. Serve.verdict/kb.jsonlwrite takes one advisory lock; a second writer refusesstore-busyinstead of dropping a row. Findings storeverify --sandboxruns the verify command under bubblewrap on Linux with no network, a private PID namespace, empty~/.ssh/~/.aws/~/.docker, and no silent fallback. Enforced sandboxverify --sandboxnow denies everybind()andconnect()on macOS through the built-insandbox-exec, loopback and unix sockets included, so filesystem isolation stays Linux-only. Enforced sandboxE=rm; $E -rf ./targetand the braced, quoted,exported, loop, concatenated, and own-line spellings now refuseverify-indirection, including afterenv/timeout/xargswrappers and insidesh -c. Known residuals.verify.outis owner-only — the verify stream is written0600on Unix, like.run.out, because a command that prints a credential leaves the value in it. Enforced sandboxrun --agentoperand no longer reaches the recordedoutput_tailor the 0644 child log. Whatrunassertsskill installprobes exactly the directories it will write before the first byte, so a read-only target leaves nothing half-installed. Install routescc6bfbf: Fixes
report,next, andshowrefusals carry a shell-quotedre-enter:line naming the invocation you typed. Machine surfacenext --coveragewith no positionals — leads with oneerror:line naming what is missing, and a plainBasis:line is accepted without a warning. Machine surfacerecordwarns once percost.jsonmodels[]entry with noname, and still accepts and prices the record. Cost controldiff-too-largeandmissing-indexnow carry anext:line naming the exclusions that fit, and the exact build command. Over-cap diffsagent-failed, MCP refusals carry their warnings,index-cappednames the bytes it measured,index statuspoints at the query, and a crashed agent's partial review can no longer block on a FIFO. Machine surfaceverdict upgradequotes its project-localcdhint so a path with a space or quote pastes resolvably, and the uninstall sibling hint reads as a sentence. Machine surfacepr-waitinconsistent reads — a head that is not yet the same on both APIs is retried instead of failing the bounded wait, andinconsistent_observationskeeps the retry visible. Bounded foreground waitsresume suspended verify process. Bounded foreground waitsbacktest minein a partial clone — a--filter=blob:noneclone refusespartial-clonewith the step that fetches the missing objects, instead of stalling. Backtestinfo:line to the human stream instead of a warning or a--jsonwarnings[]entry; failed remote reads still warn. Machine surfacerecordaccepts areview.jsonwithoutschema_versionand reads it as version 1, while a present value other than"1"still refuses. Review-input problemscc6bfbf: Docs
docs/troubleshooting.mdlists every refusal code with its cause and fix, and a drift test fails the build when one is missing. Refusal codesverdict --help. docs/cc6bfbf: Known limits
verify --sandboxdeniesbind()andconnect()on macOS but has no filesystem namespace, so credential paths,/proc,/run, and a private/tmpare hidden only on Linux underbubblewrap; filesystem isolation on macOS needs a Linux VM or a container running that recipe. Enforced sandboxsh "$V", a script named by a variable, still passes the pre-exec scan, which is whyverify --sandboxis the boundary and a spelling outside the gate's reach is a gate gap to arm rather than a vulnerability. Known residuals