Skip to content

Add evidence-based task completion gate - #970

Merged
Y1fe1Zh0u merged 1 commit into
v1.11.4from
agent/completion-gate-v1.11.4
Aug 14, 2026
Merged

Add evidence-based task completion gate#970
Y1fe1Zh0u merged 1 commit into
v1.11.4from
agent/completion-gate-v1.11.4

Conversation

@Y1fe1Zh0u

@Y1fe1Zh0u Y1fe1Zh0u commented Aug 14, 2026

Copy link
Copy Markdown
Collaborator

Outcome

  • replaces the product-style Agent base prompt with a concise understand, execute, verify, finish contract
  • keeps Memory, Workspace, Focus, Trigger, and Directory/A2A discoverable in the stable prompt
  • runs deterministic Tool ledger verification before an independent semantic task-completion check
  • returns explicit completion gaps to the Agent for up to 10 repair rounds
  • fails open when the semantic judge times out or emits invalid output
  • delivers the latest normal model answer when semantic repair capacity is exhausted, while recording internal diagnostics

Safety boundary

  • Tool ledger and reference integrity remain fail-closed
  • only an explicit semantic repair decision re-enters the Agent loop
  • semantic judge infrastructure errors do not suppress normal output

Verification

  • 78 scoped backend tests passed
  • scoped Ruff passed
  • git diff check passed

Not tested

  • live provider completion-gate call
  • 3010 end-to-end Run

Replace the product-style base prompt with a concise execution contract and add an independent semantic completion gate after deterministic Tool ledger verification. Explicit repair decisions re-enter the Agent loop up to ten times; gate infrastructure failures fail open, and exhausted semantic repairs deliver the latest candidate with internal diagnostics.

Constraint: Completion checking must not suppress a usable model answer when the judge is unavailable or repeatedly disagrees.

Rejected: Treat semantic judge failures like Tool ledger failures | semantic evaluation is probabilistic and must not block normal output.

Confidence: high

Scope-risk: moderate

Directive: Keep Tool ledger verification fail-closed and semantic completion infrastructure fail-open.

Tested: 78 scoped backend tests; scoped Ruff; git diff --check

Not-tested: Live provider completion-gate call and 3010 end-to-end Run
@Y1fe1Zh0u
Y1fe1Zh0u merged commit 453503a into v1.11.4 Aug 14, 2026
1 check was pending
@Y1fe1Zh0u
Y1fe1Zh0u deleted the agent/completion-gate-v1.11.4 branch August 14, 2026 12:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant