Structured outputs are very underrated. It's often much easier to constrain LLM outputs to a JSON schema than asking for a tool call.

OpenRouter now normalizes structured outputs for
- 46 models
- 8 different model companies
- 8 free models!

Demo:

Llama 3.3 (shown in brown) is now 35% of Llama token traffic 👀
openrouter.ai/meta-llama

PydanticAI now supports OpenRouter!

You can now filter for LLM providers on our /models page

OpenRouter has prevented 13k Sonnet requests from failing in the last 2 days

Amazon Nova is now live on OpenRouter ☄️
...along with Bedrock! more coming soon

Only took 40 minutes

Llama 3.3 is live! 🦙🦙🦙
openrouter.ai/meta-llama/l...

Overall $ volume on OpenRouter is up by over 2300% 📈
even though LLM prices declined by 90% 📉
due to a lotta tokens:

QwQ 32B, an open-source model comparable with o1-preview and Claude 3.5 Sonnet, is now live!

Scores 50 on the AIME, compared to
- 44.6 for o1-preview
- 16 for Sonnet

Try it out here: openrouter.ai/qwen/qwq-32b...