What's Changed
- fix(google): improve handling of empty responses by @davidzhao in #4330
- Add support for audio frame processor by @lukasIO in #4145
- Update doc for min_endpointing_delay by @MonkeyLeeT in #4327
- force interruption when closing the session by @longcw in #4346
- add ProviderTool & support built-in tools for xai & gemini realtime by @theomonnom in #4344
- fix dynamic tool updates in llm_node by @davidzhao in #4355
- Proper support for V1 models for Google STT by @chenghao-mou in #4338
- Add Grok example by @ShayneP in #4363
- allow aws realtime to accept str tool results by @tinalenguyen in #4364
- (gemini realtime) check for vertexai for api version by @tinalenguyen in #4366
- Enable Soniox STT turn detection & metrics by @matejmarinko-soniox in #4332
Provider tools
This release brings the ability to use tools that are specific to model providers with provider tools. You can now mix & match function tools and provider tools in your agent by specifying Agent(tools=[..]).
For those that were using the experimental _gemini_tools parameter with Google LLMs, that experimental parameter has been removed in favor of provider tools. See usage example here.
New Contributors
- @MonkeyLeeT made their first contribution in #4327
Full Changelog: https://github.com/livekit/agents/compare/livekit-agents@1.3.9...livekit-agents@1.3.10