Features

Streaming, tool calling, structured outputs, prompt caching, multimodal input, speech, image and video generation, and the Batch API.

Placeholder — the architect writes this chapter.

Routing

The provider object field by field, declared model fallbacks, and supply/auto triage.

Cost and billing

Credits, per-response cost, preflight estimates, budgets and spend caps, cost export, and margin transparency.