AI engineering glossary · Web APIs HTTP

What is streaming response?

Streaming response: A reply delivered in pieces as it is produced rather than all at once, so the client can start using data early. In AI APIs it lets a chat UI show tokens as they are generated, cutting perceived waiting time.

Level: intermediateTopic: Web APIs HTTP

Streaming response: an example

Setting stream=true on a chat request returns many small chunks instead of one big JSON object.

Related terms

More Web APIs HTTP terms

Where you learn it

Streaming response is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.

Before you go

Take the cheat sheet with you

One free PDF: the key AI-engineering terms, formulas and Python idioms. No spam; unsubscribe any time.