Skip to content

[OMNIML-5570, OMNIML-5569] 1/2 Add layer-wise KV-cache AutoQuant with forward KL - #2272

Merged
meenchen merged 30 commits into
mainfrom
agent/kv-cache-autoquant-core
Sep 11, 2026
Merged

[OMNIML-5570, OMNIML-5569] 1/2 Add layer-wise KV-cache AutoQuant with forward KL#2272
meenchen merged 30 commits into
mainfrom
agent/kv-cache-autoquant-core

Move KV candidate naming into AutoQuantize

ee1ac3e
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Sep 10, 2026 in 1s

DCO

All commits are signed off!

View more details on DCO