Skip to content

Experimental protocol + runbook (BLOCKED: needs provider API keys) #90

Description

@Santisoutoo

Part of #20 (slice I). The gap, not the matrix: an 'Experimental protocol' section in docs/fase5-metrica.md (models >=2, N runs per scenario with a power justification, ablation axes as existing levers: INSTRUCTIONS_PROFILES, --sampling, tool surface) plus a runbook in bench/README.md with the exact commands the matrix will execute (a320-bench run ... && a320-bench score runs/ --json). Zero new code; nothing in CI touches the network. Unblocks when an Anthropic API key exists (Vertex express already validated).

Metadata

Metadata

Assignees

No one assigned

    Labels

    area:docsDocumentacion y decisionesarea:scenariosEscenarios de fallo y scoringblockedBloqueado por otro issuephase:5Fase 5 — Benchmark (research)

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions