Core Release v1.16.0
- feat: baseten - new provider for Model APIs and dedicated deployments: chat, Responses, embeddings, transcription, decisions through System One, image generation on dedicated deployments (including
/predictURLs) and rerank on BEI deployments - feat: kimchi - new provider for chat, Responses, embeddings and list models (thanks @arnasnn!)
- feat: machgen - new provider for image generation, image edit and async video generation (submit, retrieve, download), with model listing (thanks @nishkarsh-machgen!)
- feat: soniox - new provider for async speech-to-text, text-to-speech with streaming, speech sessions and real-time transcription
- feat: sarvam - chat and model listing move to Token Factory v2, and Sarvam Prism serves decisions (thanks @vikashmaddi-sarvam!)
sarvam-30bis no longer served. Usesarvam-105b.
- feat: gemini - native decisions for
gemini-decision-*models and aninput_filepart for PDFs, audio and video; empty or mistyped input is rejected before the call (thanks @Xytronix!) - feat: realtime - Gemini Live on the Gemini API and Vertex, Vertex Live through the GenAI native protocol, ElevenLabs Scribe and Soniox real-time transcription
- feat: speech sessions -
SpeechSessionProviderinterface for incremental text-to-speech over a WebSocket, implemented by ElevenLabs and Soniox - feat: elevenlabs - passthrough and native WebSocket dialing for Scribe and text-to-dialogue, raw response kept for
with-timestamps - feat: vertex - text-to-speech through Cloud Text-to-Speech (Chirp) and Gemini TTS models
- feat: regex key aliases -
regex:alias names over the requested model withmodel_idtemplates that reuse capture groups - feat: usage estimation - cancelled or timed-out chat, text and Responses streams get missing usage estimated with a tokenizer, marked in
usage.estimation - feat: bedrock - native
outputConfigstructured output for supported models, with a one-time retry on the synthetic tool when Bedrock rejects the schema;supports_native_structured_outputdatasheet field - feat: custom tools - custom (freeform) tools are rewritten as function tools for every model without native support and restored as custom calls on chat and Responses, streaming included
- feat: anthropic - forward
thinking.block_bindingwith its beta header on the Claude API - feat: anthropic - fast mode for
claude-fable-5-2on Vertex - feat: databricks - OAuth M2M secrets limited to specific scopes work through a scope fallback, and scope errors show the provider's message
- feat: opencode - stable
x-opencode-sessionheader per virtual key, resolved from client headers (thanks @sstreichan!) - feat: files - Files API uploads stream from a
FileSourceinstead of a byte slice on OpenAI and Azure - feat: websocket stream hooks return the pre-hook request, so raw relays can forward plugin edits
- feat:
bifrost_provider_queue_wait_secondstiming on the attempt window - fix: anthropic - mid-conversation system reminders keep one form across turns, decided from the emitted messages, with placement controlled by the
supports_native_mid_conversation_systemdatasheet field; the<system-reminder>envelope drops its trailing newline and the cache breakpoint stays on the marked block - fix: vertex - Claude request bodies always end with
tools,system,messagesso prompt cache reads hit - fix: anthropic - streamed usage counts each cached prompt token once on chat, Responses and passthrough streams (thanks @is911 and @wangkanai!)
- fix: prompt cache auto-injection checks an alias's canonical model (thanks @bardrop!)
- fix:
prompt_cache_optionsreaches only models that accept it - fix: anthropic - a deferred web search is replayed without a made-up
web_search_tool_result, and its late result stays in place on replay, Responses and streams - fix: anthropic - history with MCP or server-tool blocks no longer sends a roleless message to OpenAI-compatible providers; Responses items with no chat equivalent are dropped on the Responses-to-Chat fallback (thanks @1AbdullahButt!)
- fix: bedrock -
/anthropic/v1/messageswithoutput_config.formatstreams one well-formed text block, and plain-text answers are no longer lost - fix: bedrock - honour
network_config.base_urland apply the dial-time address policy to the net/http client - fix: bedrock - a caller's
anthropic_betaon Converse is merged with derived betas (thanks @fus3r!) - fix: bedrock - InvokeModel keeps
tool_referenceblocks inside a clienttool_result(thanks @kunalgoesbyken!) - fix: bedrock - Claude Responses requests with computer tools go through InvokeModel, and replayed
tool_useblocks keeptoolset_name(thanks @davidelct!) - fix: vertex - Anthropic betas are sent in the
anthropic-betaheader, including on CountTokens - fix: bedrock mantle - unsupported effort-dependent sampling parameters are stripped for OpenAI models
- fix: logprobs survive conversion between Chat Completions and Responses
- fix: gemini - function calls without an ID get unique IDs and pair with responses in order
- fix: chat custom tools keep the
nameanddescriptionnested undercustom - fix: gemini - image
output_formatandoutput_compressionmap to Vertex image output options, and the Gemini API no longer receives options it rejects (thanks @carlreid!) - fix: mistral -
reasoning_effortfollows the model's datasheet ladder - fix: elevenlabs - speech
with_timestampsreturns character times instead of null (thanks @abmorrill4!)
Breaking for Go SDK users:SpeechAlignment.CharStartTimesMs/CharEndTimesMsare renamed toCharacterStartTimesSeconds/CharacterEndTimesSeconds(JSONchar_*_times_ms→character_*_times_seconds).
- fix: elevenlabs - non-streaming
wavspeech returns a real WAV file - fix: openai - empty
text,srtandvtttranscriptions are valid responses - fix: openai - streaming speech on
tts-1andtts-1-hdreturns a 400 - fix: gemini - audio
fileDataparts are no longer treated as transcription - fix: vertex - model listing on
usandeukeys uses the regional endpoint host, and token errors show the underlying cause - fix: streams cancelled before the upstream's first byte run their terminal post-hooks
- chore: brotli 1.2.8 and dependency updates
- chore: upgraded Go to 1.27.4
Installation
go get github.com/maximhq/bifrost/core@v1.16.0This release was automatically created from version file: core/version