Skip to content

fix(plugin): grow maxTokens when a JSON reply is cut off at the limit - #2565

Open
jeff-ang92 wants to merge 2 commits into
MemTensor:mainfrom
jeff-ang92:fix/plugin-length-truncation-retry
Open

jeff-ang92 wants to merge 2 commits into
MemTensor:mainfrom
jeff-ang92:fix/plugin-length-truncation-retry

fix(plugin): let 4096-token length retries grow and log the new budget

00b3d15
Select commit
Loading
Failed to load commit list.