Introducing LiveKit Turn Detector v1.0

Determining when the agent should respond is a delicate balance: responding too early can interrupt the user, while responding too late introduces unnecessary latency and awkward silence. We solve this with our state-of-the-art turn detector, which leverages both audio and text semantics to identify the optimal moment to respond.

Read more about our turn detector in our blog.

What's Changed

• fix(ipc): close supervised process when start() is cancelled by @longcw in #6051
• simulation: participant-sync race, fake-job metadata fallback, no audio recording by @theomonnom in #6069
• fix(voice): deadlock when session closes while awaiting an AgentTask by @longcw in #6071
• fix(voice): add timeout fallback to transcript segment aclose by @longcw in #6029
• add codeowners by @davidzhao in #6072
• (phonic) Add headers to conversations made through livekit-agents-py by @arunwpm-work in #6023
• chore(ipc): increase memory warning threshold by @Bobronium in #6073
• chore(deps): update av to 17.1.0 by @kyle-livekit in #6091
• fix(clova): stop _recognize_impl from mutating instance language as a side effect by @adityajha2005 in #6097
• Drop unused agent_id kwarg from AgentConfigUpdate by @longcw in #6090
• fix(avatar): preserve audio wrappers across avatar hot-swaps by @longcw in #5863
• fix(deps): update livekit deps to v1.1.9 by @renovate[bot] in #6102
• inference(stt): remove cartesia/ink-2-latest from Cartesia STT type hints by @adrian-cowham in #6117
• fix: honor per-agent preemptive_generation options by @longcw in #6114
• fix(azure): flush buffered audio on end_input to avoid truncated STT by @jose-speak in #6118
• fix(worker): fix timeout option overrides and update initialize_process_timeout by @parkky21 in #6121
• fix(voice): include conversation items added during tool execution in reply context by @ShayneP in #6084
• feat(llm): list available tools in unknown-function error output by @ShayneP in #6085
• fix(workflows): normalize placeholder strings in GetNameTask arguments by @ShayneP in #6086
• fix(voice): skip end-of-turn metrics on stale/out-of-order speaking anchor by @anshulkulhari7 in #6098
• feat(eot): add audio models AGT-2520 by @chenghao-mou in #4722
• Improve hotel receptionist example: policies, card collection, richer DB by @ShayneP in #6087
• feat(core): allow non-primary sessions without job_ctx by @Bobronium in #6137
• Revert "feat(core): allow non-primary sessions without job_ctx" by @Bobronium in #6139
• livekit-agents@1.6.1 by @github-actions[bot] in #6140

New Contributors

• @kyle-livekit made their first contribution in #6091
• @parkky21 made their first contribution in #6121
• @anshulkulhari7 made their first contribution in #6098

Full Changelog: https://github.com/livekit/agents/compare/livekit-agents@1.6.0...livekit-agents@1.6.1