AI Gateway now supports WebSocket mode for the OpenAI Responses API. You can keep a persistent connection open and continue each turn by sending only new input items plus
OpenAI reports up to ~40% faster end-to-end execution on WebSockets for agentic rollouts with 20 or more tool calls.
The Responses route opens at
See the AI Gateway documentation for setup and the full route list.
Read more
Continue reading...
previous_response_id, instead of re-sending the full context over a fresh HTTP request every turn.OpenAI reports up to ~40% faster end-to-end execution on WebSockets for agentic rollouts with 20 or more tool calls.
Route Responses API traffic over WebSocket
The Responses route opens at
GET /v1/responses and accepts raw response.create frames over a persistent WebSocket connection. The mode is compatible with store=false and Zero Data Retention, and follows OpenAI's WebSocket mode specification upstream.See the AI Gateway documentation for setup and the full route list.
Read more
Continue reading...