fix: size the model pool from the cgroup memory limit - #6

Merged

loks0n merged 6 commits into

appwrite:masterfrom

ChiragAgg5k:fix/cgroup-memory-budget

Sep 4, 2026

Commits on Sep 4, 2026

fix: size the model pool from the cgroup memory limit, not the host
ChiragAgg5k
committed
e6fa98d
refactor: inline the memory budget at its call sites
ChiragAgg5k
committed
07a632a
fix: let the sub-batch shrink to one text on small memory budgets
ChiragAgg5k
committed
91f5f04
refactor: pass available memory into compute_sub_batch
ChiragAgg5k
committed
89573d3
test: collapse memory sizing coverage into two cases
ChiragAgg5k
committed
9587705
fix: treat zero available memory as exhausted, not unknown
ChiragAgg5k
committed
f49e1a0