Skip to content

docs(autotune): AdventureWorks runs 5-6, DimProduct privacy margin, 4.5 h default search - #48

Merged
nick-developer merged 1 commit into
mainfrom
claude/project-thread-8qmh8r
Nov 7, 2026
Merged

nick-developer merged 1 commit into
mainfrom
claude/project-thread-8qmh8r

Conversation

@nick-developer

Copy link
Copy Markdown
Owner

Requested by Cod3r · project thread

This follows up #43. It adds the result of the clean AdventureWorks autotune runs to the report and makes the workflow's search short enough for the held-out check to finish.

Result of runs 5 and 6

  • Both runs searched from scratch under pandas 3.1, with the history keyed by engine signature (feat(autotune): AdventureWorks tuning on CI, parallel seeds, rule allowance #43). Run 5 used the PR head and run 6 used main. They took the same path.
  • structure.structural_prior: 0.999 was accepted on seeds 1-3 (excess failures per seed 44.7 → 42.7, se 1.15). The held-out seeds 11-12 did not confirm it, so the defaults stay the recommendation for AdventureWorks.
  • Main finding: the DimProduct DCR privacy ratio is close to the 0.5 hard limit even at the defaults. Across seeds 1, 2, 3, 11 and 12 it is 0.58, 0.54, 0.63, 0.64 and 0.40. Every move that models DimProduct (606 rows) more closely pushes it lower: joint_max_levels 128, beta_prior 1.0, and the doctor's segment counts (0.09-0.18). This needs engine work to protect small dimensions. The options are listed under Next in the report.
  • The engine and spec items from feat(autotune): AdventureWorks tuning on CI, parallel seeds, rule allowance #43 are unchanged: novel_combination_rate, Freight/TaxAmt and UnitsBalance marginals, order codes typed as categoricals, and product/reseller cardinality.

Changes

  • docs/research/autotune-adventureworks.md: new section "Runs 5 and 6", and an updated Next.
  • .github/workflows/autotune.yml: the default search time is now 4.5 hours. Run 5 used 5 hours and the 6-hour job limit cut it off during the held-out confirmation. Run 6 used 4.5 hours and finished in 5.6.
  • CHANGELOG.md: puts back the Unreleased entries from feat(autotune): AdventureWorks tuning on CI, parallel seeds, rule allowance #43, which a merge-conflict resolution dropped, and adds the workflow change.

Checks

  • tools/claims_check.py: ok. The doc and changelog unit tests pass. No code changed.

Generated by Claude Code

…default search

Runs 5 and 6 searched from scratch under pandas 3.1 (history keyed by
engine signature) and took the same path. structural_prior 0.999 was
accepted on seeds 1-3 but not confirmed on the held-out seeds; the
defaults stay recommended. Main finding: the DimProduct DCR ratio is
near the 0.5 hard limit even at the defaults (0.40 on seed 12), and
every move that fits DimProduct more closely pushes it lower. That is
engine work, recorded under Next.

The workflow searches 4.5 hours by default: run 5 (5 hours) was cut
off by the 6-hour job limit during the held-out confirmation.

Restores the CHANGELOG entries of #43 that were lost in a merge.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01PSVqwFW6fhyVohUnuKd2fu
Signed-off-by: Claude <noreply@anthropic.com>
@nick-developer
nick-developer merged commit 75b02cf into main Nov 7, 2026
31 checks passed
@nick-developer
nick-developer deleted the claude/project-thread-8qmh8r branch November 7, 2026 09:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants