OpenAI added an Ultrafast mode for GPT-6 Astra in the Responses API. Developers can set service_tier to "ultrafast" to reduce the time between generated output tokens. It is available to API customers subject to rate limits, with global processing and US data residency only.
Read the full story on developers.openai.com
What to doUse service_tier: "ultrafast" with gpt-6-astra in the Responses API to reduce inter-token latency, keeping in mind EU and other regional inference residency are not supported.
- Provider
- OpenAI
- Source
- developers.openai.com
- Models
- GPT-6 Astragpt-6-astra