Lars Grammel
@lgrammel.bsky.social
At React Universe Conference Wroclaw today - would love to chat with AI SDK users.
If you are around and want to give feedback or learn more about the AI SDK send me a DM.
If you are around and want to give feedback or learn more about the AI SDK send me a DM.
September 3, 2025 at 9:43 AM
At React Universe Conference Wroclaw today - would love to chat with AI SDK users.
If you are around and want to give feedback or learn more about the AI SDK send me a DM.
If you are around and want to give feedback or learn more about the AI SDK send me a DM.
AI SDK 5 prototype: custom UI data parts
You can define custom ui data parts and stream updates to them from the server:
You can define custom ui data parts and stream updates to them from the server:
May 14, 2025 at 5:44 PM
AI SDK 5 prototype: custom UI data parts
You can define custom ui data parts and stream updates to them from the server:
You can define custom ui data parts and stream updates to them from the server:
AI SDK 5 preview: ChatStore & ChatTransport
ChatStore synchronizes chat write operations and manages streaming state. You can use it directly or through framework integrations like useChat.
ChatTransport makes backend integrations more flexible, allowing for client-only usage.
ChatStore synchronizes chat write operations and manages streaming state. You can use it directly or through framework integrations like useChat.
ChatTransport makes backend integrations more flexible, allowing for client-only usage.
May 13, 2025 at 3:05 PM
AI SDK 5 preview: ChatStore & ChatTransport
ChatStore synchronizes chat write operations and manages streaming state. You can use it directly or through framework integrations like useChat.
ChatTransport makes backend integrations more flexible, allowing for client-only usage.
ChatStore synchronizes chat write operations and manages streaming state. You can use it directly or through framework integrations like useChat.
ChatTransport makes backend integrations more flexible, allowing for client-only usage.
AI SDK 5 preview: UI message persistance
We recommend storing UI messages, not model messages, if your application has a useChat component.
This ensures that the UI state can be correctly restored and helps integrating backends other than streamText (e.g. Langchain).
We recommend storing UI messages, not model messages, if your application has a useChat component.
This ensures that the UI state can be correctly restored and helps integrating backends other than streamText (e.g. Langchain).
May 11, 2025 at 12:26 PM
AI SDK 5 preview: UI message persistance
We recommend storing UI messages, not model messages, if your application has a useChat component.
This ensures that the UI state can be correctly restored and helps integrating backends other than streamText (e.g. Langchain).
We recommend storing UI messages, not model messages, if your application has a useChat component.
This ensures that the UI state can be correctly restored and helps integrating backends other than streamText (e.g. Langchain).
AI SDK 5 preview: UI message metadata
UI messages in AI SDK 5 will have a generic metadata property (instead of specific properties like createdAt).
This lets you send and show the message metadata that's important in your application:
UI messages in AI SDK 5 will have a generic metadata property (instead of specific properties like createdAt).
This lets you send and show the message metadata that's important in your application:
May 10, 2025 at 4:53 PM
AI SDK 5 preview: UI message metadata
UI messages in AI SDK 5 will have a generic metadata property (instead of specific properties like createdAt).
This lets you send and show the message metadata that's important in your application:
UI messages in AI SDK 5 will have a generic metadata property (instead of specific properties like createdAt).
This lets you send and show the message metadata that's important in your application:
UI messages != model messages
What you display to the user (ui messages) is different from what you want to send to the LLM (model messages).
UI messages contain additional information such as custom app data and metadata. Tools calls might be omitted. etc.
What you display to the user (ui messages) is different from what you want to send to the LLM (model messages).
UI messages contain additional information such as custom app data and metadata. Tools calls might be omitted. etc.
May 10, 2025 at 4:52 PM
UI messages != model messages
What you display to the user (ui messages) is different from what you want to send to the LLM (model messages).
UI messages contain additional information such as custom app data and metadata. Tools calls might be omitted. etc.
What you display to the user (ui messages) is different from what you want to send to the LLM (model messages).
UI messages contain additional information such as custom app data and metadata. Tools calls might be omitted. etc.
In AI SDK 5, UI messages will be composed of parts.
This is my current vision of how UI messages could look like - feedback welcome.
This is my current vision of how UI messages could look like - feedback welcome.
May 10, 2025 at 4:49 PM
In AI SDK 5, UI messages will be composed of parts.
This is my current vision of how UI messages could look like - feedback welcome.
This is my current vision of how UI messages could look like - feedback welcome.
And it autocompletes:
March 26, 2025 at 5:49 PM
And it autocompletes:
Combining the provider registry with custom providers and middleware is extremely powerful for setting up your models in one place:
March 26, 2025 at 5:48 PM
Combining the provider registry with custom providers and middleware is extremely powerful for setting up your models in one place:
The AI SDK now supports LLMs that generate file outputs, first example are images:
March 19, 2025 at 1:24 PM
The AI SDK now supports LLMs that generate file outputs, first example are images:
The granular useChat status messages make it easy to show a loading spinner (when status=submitted):
February 15, 2025 at 10:48 AM
The granular useChat status messages make it easy to show a loading spinner (when status=submitted):
Improve your chatbot UX with this simple one-line change:
December 12, 2024 at 4:22 PM
Improve your chatbot UX with this simple one-line change:
AI SDK 4.0.6
🧪 structured outputs with tool calling using generateText (experimental)
You can create structured outputs with generateText using the experimental_output setting. The object is available in the experimental_output result property.
🧪 structured outputs with tool calling using generateText (experimental)
You can create structured outputs with generateText using the experimental_output setting. The object is available in the experimental_output result property.
November 26, 2024 at 2:51 PM
AI SDK 4.0.6
🧪 structured outputs with tool calling using generateText (experimental)
You can create structured outputs with generateText using the experimental_output setting. The object is available in the experimental_output result property.
🧪 structured outputs with tool calling using generateText (experimental)
You can create structured outputs with generateText using the experimental_output setting. The object is available in the experimental_output result property.
Idea code: adding support for structured outputs to generateText
Would love feedback!
Would love feedback!
November 25, 2024 at 3:25 PM
Idea code: adding support for structured outputs to generateText
Would love feedback!
Would love feedback!
🧩AI SDK provider: TogetherAI
Using TogetherAI models has become even easier with the new provider for the AI SDK:
Using TogetherAI models has become even easier with the new provider for the AI SDK:
November 25, 2024 at 8:54 AM
🧩AI SDK provider: TogetherAI
Using TogetherAI models has become even easier with the new provider for the AI SDK:
Using TogetherAI models has become even easier with the new provider for the AI SDK:
AI SDK SolidJS UI 1.0.2
🆕 useObject hook
🆕 useAssistant hook
🔨 useChat update fixes for message annotations
Here is an example page that leverages useObject:
🆕 useObject hook
🆕 useAssistant hook
🔨 useChat update fixes for message annotations
Here is an example page that leverages useObject:
November 21, 2024 at 5:41 PM
AI SDK SolidJS UI 1.0.2
🆕 useObject hook
🆕 useAssistant hook
🔨 useChat update fixes for message annotations
Here is an example page that leverages useObject:
🆕 useObject hook
🆕 useAssistant hook
🔨 useChat update fixes for message annotations
Here is an example page that leverages useObject:
llms.txt ( llmstxt.org ) is great for providing AI SDK documentation to LLMs.
You can e.g. pass it to Cursor prompts, or to build dedicated LLM-based code generators for the AI SDK.
You can now download the AI SDK docs as txt from:
sdk.vercel.ai/llms.txt
You can e.g. pass it to Cursor prompts, or to build dedicated LLM-based code generators for the AI SDK.
You can now download the AI SDK docs as txt from:
sdk.vercel.ai/llms.txt
November 20, 2024 at 4:14 PM
llms.txt ( llmstxt.org ) is great for providing AI SDK documentation to LLMs.
You can e.g. pass it to Cursor prompts, or to build dedicated LLM-based code generators for the AI SDK.
You can now download the AI SDK docs as txt from:
sdk.vercel.ai/llms.txt
You can e.g. pass it to Cursor prompts, or to build dedicated LLM-based code generators for the AI SDK.
You can now download the AI SDK docs as txt from:
sdk.vercel.ai/llms.txt
AI SDK 4.0.1
🆕 access step messages in tools
You can now access the message that triggered the tool call in the tool execution options. This is particularly useful for multi-step executions with sequential tool calls.
Documentation: sdk.vercel.ai/docs/ai-sdk-...
🆕 access step messages in tools
You can now access the message that triggered the tool call in the tool execution options. This is particularly useful for multi-step executions with sequential tool calls.
Documentation: sdk.vercel.ai/docs/ai-sdk-...
November 20, 2024 at 9:58 AM
AI SDK 4.0.1
🆕 access step messages in tools
You can now access the message that triggered the tool call in the tool execution options. This is particularly useful for multi-step executions with sequential tool calls.
Documentation: sdk.vercel.ai/docs/ai-sdk-...
🆕 access step messages in tools
You can now access the message that triggered the tool call in the tool execution options. This is particularly useful for multi-step executions with sequential tool calls.
Documentation: sdk.vercel.ai/docs/ai-sdk-...
AI SDK xAI provider update
🆕 grok-vision-beta image support
You can now use image content parts in your messages with the xAI provider:
🆕 grok-vision-beta image support
You can now use image content parts in your messages with the xAI provider:
November 19, 2024 at 12:48 PM
AI SDK xAI provider update
🆕 grok-vision-beta image support
You can now use image content parts in your messages with the xAI provider:
🆕 grok-vision-beta image support
You can now use image content parts in your messages with the xAI provider:
AI SDK OpenAI provider update
🆕 Streaming for OpenAI o1-series models
The OpenAI provider v1.0.1 supports streaming reasoning model responses:
🆕 Streaming for OpenAI o1-series models
The OpenAI provider v1.0.1 supports streaming reasoning model responses:
November 19, 2024 at 10:59 AM
AI SDK OpenAI provider update
🆕 Streaming for OpenAI o1-series models
The OpenAI provider v1.0.1 supports streaming reasoning model responses:
🆕 Streaming for OpenAI o1-series models
The OpenAI provider v1.0.1 supports streaming reasoning model responses:
AI SDK OpenAI provider 0.0.72
🆕 predicted outputs support
You can use predicted outputs via the provider metadata:
🆕 predicted outputs support
You can use predicted outputs via the provider metadata:
November 5, 2024 at 10:03 AM
AI SDK OpenAI provider 0.0.72
🆕 predicted outputs support
You can use predicted outputs via the provider metadata:
🆕 predicted outputs support
You can use predicted outputs via the provider metadata:
November 5, 2024 at 8:26 AM
AI SDK Cohere provider 0.0.28
🆕 Update to Cohere v2 API & tool calling
You can now use tools with the Cohere provider.
🆕 Update to Cohere v2 API & tool calling
You can now use tools with the Cohere provider.
November 3, 2024 at 3:32 PM
AI SDK Cohere provider 0.0.28
🆕 Update to Cohere v2 API & tool calling
You can now use tools with the Cohere provider.
🆕 Update to Cohere v2 API & tool calling
You can now use tools with the Cohere provider.
AI SDK Anthropic Provider 0.0.54
🆕 PDF input support
You can send PDF inputs to claude-3-5-sonnet-20241022 as file parts:
🆕 PDF input support
You can send PDF inputs to claude-3-5-sonnet-20241022 as file parts:
November 2, 2024 at 1:08 PM
AI SDK Anthropic Provider 0.0.54
🆕 PDF input support
You can send PDF inputs to claude-3-5-sonnet-20241022 as file parts:
🆕 PDF input support
You can send PDF inputs to claude-3-5-sonnet-20241022 as file parts:
