Skip to content

fix(llm): a streaming llama response is bounded by idle time, not total time - #323

Merged
plombeer31 merged 3 commits into
mainfrom
fix/llama-stream-idle-deadline
Sep 3, 2026
Merged

fix(llm): a streaming llama response is bounded by idle time, not total time#323
plombeer31 merged 3 commits into
mainfrom
fix/llama-stream-idle-deadline

fix(llm): tell a pre-first-token stall apart from a mid-reply stall

f3f103b
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning
test (default install)
succeeded Sep 2, 2026 in 2m 16s