Repository navigation

Add layerwise SGDM learning rates for stock GPT-2 - #174

Merged

charlesmartin14 merged 5 commits into

mainfrom

exp/sgdm-layerwise-lr-v1

Oct 18, 2026

Merged

Add layerwise SGDM learning rates for stock GPT-2#174
charlesmartin14 merged 5 commits into
mainfrom
exp/sgdm-layerwise-lr-v1

Commits on Oct 18, 2026
- Configure layerwise SGDM schedule
  charlesmartin14
  committed
  4624946
- Add blockwise learning rates to SGDM
  charlesmartin14
  committed
  c688946
- Log layer LRs and retain resumable checkpoints
  charlesmartin14
  committed
  23c59cc
- Record layerwise LR protocol
  charlesmartin14
  committed
  515b8b7
- Update SGDM tests for layerwise schedule
  charlesmartin14
  committed
  ae63a8e