|
|
|
|
|
|
by ekojs
43 days ago
|
|
|
> HTTP is just not a good transport for streaming LLM tokens and for building async agentic applications I don't know if I agree if this is a problem with SSE or HTTP. Something like a Redis Streams-backed SSE would solve most of the 'challenges' presented in the post. |
|
|