fix(llm): a streaming llama response is bounded by idle time, not total time - #323

Merged

plombeer31 merged 3 commits into

mainfrom

fix/llama-stream-idle-deadline

Sep 3, 2026

Commits on Sep 2, 2026

fix(llm): a streaming llama response is bounded by idle time, not total time
plombeer31
committed
ca4b1c3
fix(llm): put an upper bound back on a single streaming response
plombeer31
committed
9d2bb40
fix(llm): tell a pre-first-token stall apart from a mid-reply stall
plombeer31
committed
f3f103b