feat: apply_runtime_settings — permanent runtime config for AOT-loaded engines - #4570

Draft

tp5uiuc wants to merge 9 commits into

mainfrom

feat/apply-runtime-settings

Commits on Aug 24, 2026

fix: engines default to no runtime cache
tp5uiuc
committed
28a6d95
refactor: TRTRuntimeConfig takes only None or a RuntimeCache
tp5uiuc
committed
8c5aa83
test: cover runtime cache ownership across module and module-less paths
tp5uiuc
committed
7fffe7c
refactor: lift engine runtime-settings marshalling out of the module

tp5uiuc
and
claude
committed
ecb06b4
feat: apply runtime settings to engines that have no module

tp5uiuc
and
claude
committed
b75c89c
fix: raise instead of silently skipping engines the runtime CMs cannot restore

tp5uiuc
and
claude
committed
df428c6
test: cover applying runtime settings across module and module-less engines

tp5uiuc
and
claude
committed
7e0b837
test: collapse the duplicated runtime-settings helpers onto the public API

tp5uiuc
and
claude
committed
8bef96f
docs: document and test caller ownership of RuntimeCache.load on module-less engines

tp5uiuc
and
claude
committed
e506f69