Skip to content

[Native] Add chunked prefill and interactive chat to the LLM runner - #24639

Draft
metascroy wants to merge 1 commit into
offgraph-kv-runnerfrom
offgraph-kv-interactive
Draft

metascroy wants to merge 1 commit into
offgraph-kv-runnerfrom
offgraph-kv-interactive

Add chunked prefill and interactive chat to the native LLM runner

923c00e
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

2 warnings and 1 notice
label
succeeded Nov 14, 2026 in 6s