What's new in Relay.
Releases, new providers, routing features, and platform updates. Subscribe via RSS.
- May 17, 2026·v3.4Release
Relay v3.4 — Provider reliability scoring
Provider health is now a first-class signal. Relay continuously scores each provider on uptime, latency, and quality, and routes around degradations before they hit your users.
- New /providers dashboard with reliability scores
- Auto-disable circuit breakers per region
- Bedrock and Together added as primary providers
- May 2, 2026·v3.3Routing
Declarative routing policies (YAML/JSON)
Define routing as code. Version your policies in git. Promote between staging and production with the same workflow you use for application code.
- YAML + JSON routing manifests
- CLI: relay policy apply
- Audit log of every routing change
- Apr 19, 2026·v3.2Observability
Prompt observability and search
Search every prompt in production by content, model, key, team, or status. Find regressions in minutes instead of hours.
- Full-text prompt search
- Saved views and shared traces
- Webhook export to Datadog and S3
- Apr 3, 2026·v3.1Models
Llama 4, DeepSeek R1, and 18 new models
Expanded model catalog. 100+ models live across 13 providers, all behind the OpenAI-compatible interface.
- meta/llama-4-405b
- deepseek/reasoner
- xai/grok-3 vision
- Mar 14, 2026·v3.0Major
Relay v3 — Intelligent routing
The biggest release in Relay history. Task classification, optimize-for goals, and region-aware routing — all in one engine.
- Task classifier
- Cost/latency/quality optimization
- Region-aware routing