Skip to content

docs(runbooks): corrections from the 2026-06-10 update-loop run - #354

Merged
jatassi merged 1 commit into
mainfrom
docs/runbook-corrections-2026-06-10
Jun 11, 2026
Merged

docs(runbooks): corrections from the 2026-06-10 update-loop run#354
jatassi merged 1 commit into
mainfrom
docs/runbook-corrections-2026-06-10

Conversation

@jatassi

@jatassi jatassi commented Jun 11, 2026

Copy link
Copy Markdown
Owner

Self-correction PR from tonight's /operate-prod update run (deploying 3f10c8e3..ac2e6dc7).

What diverged

  1. update-loop § 1.7 tailed files that are always empty. The three .out.logs are 0 bytes by design — every daemon logs to stderr. Rewritten to tail pipeline.err.log / monitor.log / command_center.err.log, check heartbeat age against the 150 s stall bound, and state what each healthy tail looks like. Also documents that § 1.4's own stop writes KeyboardInterrupt / cancelled-connect TimeoutError tracebacks into the tails — only post-start tracebacks matter, so the old "no traceback in the last 60 s" rule false-alarmed on a clean deploy.

  2. Installer-script changes don't reconfigure installed services. PR fix(execution): remove CC's SCM dependency edges so the monitor watchdog's restart isn't refused (ALP-945) #350 deleted the CC's DependOnService edges from its installer, but the live SCM config kept both edges until the one-time sc.exe config AlphaMindCommandCenter depend= / from the commit's deploy note was applied. update-loop § 1.1 now says to scan pulled commits touching scripts/services/ for deploy notes; troubleshooting gains § 8.12 with the verified example.

Docs-only; guard tests (tests/docs/, incl. test_runbook_section_refs_resolve) pass locally.

🤖 Generated with Claude Code

- update-loop §1.7: tail the real signal sources (.err.log / monitor.log /
  heartbeat age) — the .out.log files are empty by design; note that §1.4
  shutdown residue (KeyboardInterrupt / cancelled-connect TimeoutError)
  is expected and only post-start tracebacks matter.
- update-loop §1.1: scan pulled commits touching scripts/services/ for
  deploy notes — installer edits don't reconfigure installed services.
- troubleshooting §8.12: new gotcha for live SCM/NSSM config drifting from
  the installers (observed deploying ALP-945's sc.exe config step).

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@jatassi
jatassi merged commit 0243c2b into main Jun 11, 2026
@jatassi
jatassi deleted the docs/runbook-corrections-2026-06-10 branch June 11, 2026 04:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant