AI engineering glossary · Prompt context engineering
What is Batch API?
Batch API: A provider service where you submit many requests together to be processed later, often within hours, at a lower price than live calls. It suits large jobs that need no instant reply, such as labelling a whole dataset.
Batch API: an example
Upload a file of 50,000 product descriptions to classify overnight at reduced cost, then download the results file.
Related terms
More Prompt context engineering terms
- Chain-of-thought faithfulness
- Chain-of-thought prompting
- Chain-of-Verification
- Chat completions API
- Complexity-based prompting
- Context budget
- Context compression
- Context engineering
Where you learn it
Batch API is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.