Skip to content

Measure the 2.6.0 performance pair at the last kernel change, the 2662nd - #2060

Merged
Rafael-SOWNet merged 1 commit into
masterfrom
performance-pair-for-2-6-0
Oct 22, 2026
Merged

Rafael-SOWNet merged 1 commit into
masterfrom
performance-pair-for-2-6-0

Conversation

@Rafael-SOWNet

Copy link
Copy Markdown
Member

Part of #746.

The release checklist's performance pair, measured again at the last change to the kernel. The pair in #1941 measured v2.5.0 beside the 2549th (001b1caa), which was then the last kernel change; 113 commits came after it.

Both columns from one run of benchmark_key_commits.sh, on 2026-10-22, on one machine with nothing else on it: v2.5.0 (ab7a8bd6, the 1957th) and 784f69d5 (the 2662nd).

  • Control: the v2.5.0 column reproduces the run of 2026-10-18 to within 0.02% on every gated row, and Derivate and SimplifyEasy to the byte.
  • Over the release: the evaluation rows fall 95–99%, ParseHard −98.3%, SolveEasy −94.9%, SimplifyHard −52.4% and SolveHard −15.9%.
  • Since the 2549th: SimplifyHard fell a further 10.4%, which is not attributed. Every other gated row moved less than 1%.
  • Derivate is +5.65% over the release, +0.1% of it after the 2549th. It is still the five unbisected gate-baseline steps the section records.
  • SolveEasy's six recorded steps predict −94.9%, and the measurement is −94.89%.

The section replaces the one #1941 wrote, and keeps its account of Derivate's steps with one row added. Documentation only.

🤖 Generated with Claude Code

https://claude.ai/code/session_012sonx8iAspMiwRwokT1Ura

The pair recorded on 2026-10-18 measured v2.5.0 beside the 2549th, which
was then the last change to the kernel; 113 commits came after it. Both
columns again, v2.5.0 (the 1957th) and 784f69d (the 2662nd), from one run
of benchmark_key_commits.sh on one machine with nothing else on it.

The v2.5.0 column reproduces the earlier run's to within 0.02% on every
gated row. Since the 2549th, SimplifyHard fell 10.4% more (-52.4% over the
release) and every other gated row moved less than 1%; Derivate is +5.65%
over the release, +0.1% of it after the 2549th.

Part of #746.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_012sonx8iAspMiwRwokT1Ura
@Rafael-SOWNet Rafael-SOWNet added this to the 2.6.0 milestone Oct 22, 2026
@Rafael-SOWNet
Rafael-SOWNet merged commit 522eef7 into master Oct 22, 2026
34 checks passed
@github-project-automation github-project-automation Bot moved this from Todo to Done in AngouriMath Oct 22, 2026
@Rafael-SOWNet
Rafael-SOWNet deleted the performance-pair-for-2-6-0 branch October 22, 2026 12:47
@Rafael-SOWNet
Rafael-SOWNet restored the performance-pair-for-2-6-0 branch October 22, 2026 12:48
@Rafael-SOWNet
Rafael-SOWNet deleted the performance-pair-for-2-6-0 branch October 22, 2026 13:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

1 participant