Skip to content

docs: add provenance column to output fields - #1373

Draft
davidberenstein1957 wants to merge 1 commit into
docs/traction-batchfrom
docs/output-provenance
Draft

docs: add provenance column to output fields#1373
davidberenstein1957 wants to merge 1 commit into
docs/traction-batchfrom
docs/output-provenance

Conversation

@davidberenstein1957

Copy link
Copy Markdown
Collaborator

docs/reference/output.md had a complete field table that was pure naming: it told you a column is called cpu_energy, not whether that number came from a RAPL hardware counter or from cpu_load × TDP. That is the difference between a measurement and an estimate.

Changes

  • Provenance column on every CSV field, verified against source and cited with file.py:LINE.
  • Four missing fields added: experiment_id, water_consumed, pue, wue — all on the EmissionsData dataclass and all written to the CSV, none previously documented. The table now matches the dataclass exactly (checked both directions; nothing documented has been removed from the code).
  • Five notes below the table for the cases that need more than a cell:
    1. CPU backend ladder (measured RAPL / EMI / powermetrics vs modelled cpu_load / constant), routing to the methodology and accuracy pages.
    2. RAM is always modelled — DIMM-count heuristic × 5 W/DIMM (external/ram.py:82-193), with a pointer to force_ram_power.
    3. Carbon intensity fallback chain behind emissions, including that no column records which level answered.
    4. PUE inflates the per-component energy columns. emissions_tracker.py:1194 applies PUE to each measurement before accumulation, so cpu_energy is not raw CPU energy. Power columns are not scaled, so cpu_energy != cpu_power × duration when pue != 1. Previously undocumented anywhere.
    5. latitude/longitude are written at full precision in the CSV — the old table claimed reduced precision, but the rounding at core/api_client.py:246 applies only to the API path.

Verification

uv run task docs passes (zensical build + link check).

Item 3 of the methodology overhaul plan. Scoped to docs/reference/output.md only.

🤖 Generated with Claude Code

Every CSV column now states what produced it: hardware counter, model,
or config. Adds the four EmissionsData fields missing from the table
(experiment_id, water_consumed, pue, wue), documents that PUE inflates
the per-component energy columns, and corrects the lat/long precision
claim (rounding happens only on the API path).

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant