server: reconfigure grows or shrinks the contexts live; the weights are never reloaded (S2) - #104

server: reconfigure grows or shrinks the contexts live; the weights are never reloaded (S2)#104

joelteply wants to merge 5 commits into

889580fc/seq-state-across-stream-countsCambrianTech/llama.cpp:889580fc/seq-state-across-stream-countsfrom

fable/reconfigure-liveCambrianTech/llama.cpp:fable/reconfigure-liveCopy head branch name to clipboard