AI Gateway now produces an OpenTelemetry trace for every request. Pro and Enterprise teams can send these traces through Vercel Drains to any OTLP/HTTP-compatible endpoint, including native integrations for Braintrust, Dash0, Kubiks, Sentry, and Statsig.
Each trace shows the full request lifecycle, including:
Trace Drains do not include prompt or completion content. Sampling controls let you choose how much traffic to export to each drain.
AI Gateway traces cost $0.05 per 1,000 traces delivered to each drain, plus the standard Drains rate of $0.50 per GB of data transferred. A request counts once per successful drain delivery, even when AI Gateway makes multiple provider attempts. Failed deliveries do not incur a trace charge.
Set up a Trace Drain from your team's Drains settings or learn more in the AI Gateway documentation.
Read more
Continue reading...
Each trace shows the full request lifecycle, including:
Model and provider routing
Fallback and retry attempts
Token usage and cost
Time to first token, request duration, and response status
Project, deployment, API key, environment, and custom tag attribution
Trace Drains do not include prompt or completion content. Sampling controls let you choose how much traffic to export to each drain.
AI Gateway traces cost $0.05 per 1,000 traces delivered to each drain, plus the standard Drains rate of $0.50 per GB of data transferred. A request counts once per successful drain delivery, even when AI Gateway makes multiple provider attempts. Failed deliveries do not incur a trace charge.
Set up a Trace Drain from your team's Drains settings or learn more in the AI Gateway documentation.
Read more
Continue reading...