Author
Santosh Pallagatti
1 draft reviewed, 1 review in total.
draft-spk-agentproto-llm-stream
A Standard Wire Format for Large Language Model Inference Streaming
Every LLM provider streams tokens over standard transports, mostly SSE on HTTP. The JSON inside the stream is different for each one. OpenAI puts generated text at…