github vercel/ai @ai-sdk/xai@4.0.0-canary.71

pre-release8 hours ago

Patch Changes

  • ce769dd: feat(provider): add experimental Realtime API support for voice conversations

    Adds first-class support for realtime (speech-to-speech) APIs:

    • Experimental_RealtimeModelV4 spec in @ai-sdk/provider with normalized event types and factory
    • OpenAI, Google, and xAI realtime provider implementations
    • openai.experimental_realtime() / google.experimental_realtime() / xai.experimental_realtime() work in both server and browser
    • .getToken() static method on each provider for server-side ephemeral token creation
    • experimental_getRealtimeToolDefinitions helper for provider session tool definitions
    • experimental_useRealtime hook in @ai-sdk/react returning UIMessage[] (aligned with useChat), with onToolCall and addToolOutput for client-driven tool execution
    • inputAudioTranscription session config for showing transcribed user audio messages when supported by the provider
  • Updated dependencies [ce769dd]

    • @ai-sdk/provider@4.0.0-canary.18
    • @ai-sdk/openai-compatible@3.0.0-canary.54
    • @ai-sdk/provider-utils@5.0.0-canary.46

Don't miss a new ai release

NewReleases is sending notifications on new releases.