maximhq/bifrost transports/v2.2.0

Bifrost HTTP v2.2.0

on GitHub

Bifrost HTTP Transport Release v2.2.0

✨ Features

• Claude Desktop and Cowork Marketplace - Skills stored in Bifrost can now be registered as a marketplace in Claude Desktop and Cowork, which reject the direct JSON URL and require a cloneable Git repository URL. A new /api/skills/serve/claude-code.git endpoint implements the two Git smart-HTTP requests used during a clone and serves a repository containing .claude-plugin/marketplace.json; the existing Claude Code flow is unchanged (#7152)
• Time-of-Day Peak and Off-Peak Pricing - Model pricing accepts off_peak_cost_multiplier and a peak_hours weekly schedule, so providers like DeepSeek that bill the same model at two rates are costed correctly. Base rates are treated as peak; the multiplier scales usage-based charges outside the declared windows. Flat per-request fees, per-search-query fees and guardrail/MCP AdditionalCost are never discounted. Windows use IANA timezones, weekday numbers and half-open HH:MM intervals that may wrap past midnight, and both fields are editable from the custom pricing override sheet (#6574, #6575, #6576, #6577, #6578, #6579, #7054)
• GA Realtime Transcription - OpenAI and Azure GA transcription sessions are served over both WebSocket and WebRTC with normal Bifrost authentication, routing, governance, guardrails, logging and transcription-aware pricing. These sessions carry only intent=transcription on the connection and deliver the routing model later in session.update (or in the initial multipart /v1/realtime/calls request for WebRTC), so Bifrost now routes on the nested transcription model while preserving realtime connection and turn semantics (#7089)
• Regex Model Allow and Block Lists - allowed_models / blacklisted_models on virtual keys and models / blacklisted_models on provider keys accept regex:<pattern> entries next to exact names. Patterns are compiled once as case-insensitive full matches, a pattern that is empty, * or does not compile is refused with 400, and list-models never surfaces a pattern as a model. Provider-key create and update now validate models the same way as blacklisted_models. This supersedes the separate *_patterns fields, which were added and then withdrawn before release (#6987, #6988, #6989, #6990, #7031, #7133, #7134)
• Governance Entity Names on MCP Tool Logs - mcp_tool_logs gains the same attribution shape the logs table has: user_name, team_name, customer_name and business_unit_name become real columns instead of transients, the multi-valued team_ids/team_names, customer_ids/customer_names and business_unit_ids/business_unit_names sets are stored as index-aligned JSON arrays, and budget_ids and rate_limit_ids are recorded. Names are written from the request context at ingestion, with nothing resolved on read, so the dashboard stops rendering raw UUIDs (#7154)
• Endpoint-Attributed MCP Inspections - Inspected MCP tool calls are logged with bounded identity sourced from the gateway rather than payload-supplied headers. A new MCPObservation carries device, app key, server label, tool name and decision onto both the pending and final log entry, and the MCP logs view falls back to app_key when app is absent so endpoint-attributed rows show the right app icon and name (#6959)
• Virtual MCP References by Name - Access profiles and governance projects reference Virtual MCPs through virtual_mcp_name, making config files portable across environments; names resolve on startup and a name matching nothing is refused. mcp_configs ({ mcp_client_id, tools_to_execute }) replaces the mcp_servers / mcp_tool_overrides include-exclude model with a single allowlist, where ["*"] grants all tools including future ones and [] grants none. virtual_mcp_id and the old keys are deprecated, still accepted, and folded into the new shape at load time (#7181)
• Normalized error_type Metric Label - bifrost_error_requests_total gains an error_type label with a closed, prefix-structured vocabulary (caller_*, policy_*, provider_*, bifrost_*, _OTHER) so a 429 from a governance rate limit is distinguishable from a 429 from an upstream, and a 503 Bifrost shed under queue pressure from an upstream overload. Classification resolves a declared ExtraFields.ErrorType first, then Bifrost's own markers, then the status code; it deliberately ignores provider error.type strings, which disagree across providers for the same condition (#7141)
• Bedrock OpenAI-Compatible Endpoint Routing - A use_openai_endpoints flag on Bedrock keys and aliases routes chat completions and responses through Bedrock's /openai/v1 surface instead of Converse, for models that support it. It is opt-in by design: Converse carries Bedrock Guardrails, performanceConfig and requestMetadata that the OpenAI-compatible surface silently ignores, so diverting automatically could stop a guardrail from being enforced with no visible error. The alias value wins over the key, matching use_anthropic_endpoints precedence (#7071, #7073)
• Anthropic Tool Search on Bedrock Claude - Anthropic tool search (tool_search_tool_*, defer_loading) is served on bedrock/ Claude models by routing those requests to InvokeModel / InvokeModelWithResponseStream, the only Bedrock API AWS allows it on; CountTokens counts such requests with the same InvokeModel body. Server-side tool search also survives the Bedrock-native invoke ingress end to end: the tool is carried as an ingress-only marker so the egress predicate can see it, results are returned as a server_tool_use plus tool_search_tool_result pair rather than a client tool_use (which the API rejects when echoed back), the streaming path emits the same pair, replayed blocks round-trip unchanged, and the Anthropic-native response path carries them too (#6900, #6908, #7162, #7163, #7164, #7165, #7166)
• Namespace Tool Support Across Providers - Responses namespace tools are flattened in core for every provider whose wire lacks the type, with nested functions renamed to <namespace>__<function> so two namespaces sharing a function name no longer collide into an upstream Tool names must be unique 400. Returned function_call items map back to the bare name plus namespace, prior-turn calls and tool_choice names are re-aliased, and a still-duplicate name is rejected with a clear 400 before reaching the provider. Flattened names honour each wire's documented tool-name limit, overridable per model through tool_name_max_length. The names a provider reserves for its own server tools come from the datasheet row reserved_tool_namespaces, and Codex's literal functions namespace is unwrapped to top-level tools for every provider (#7039, #7082, #7084, #7161)
• Trusted Networks for the SSRF Guard - A trusted_networks list of IP/CIDR entries the SSRF guard consults before outbound discovery calls, so a self-hosted IdP on an internal network can be reached by the generic provider's discover-endpoints and discover-claims flows. Declaring the key in config.json makes it own the whole list, an explicit empty array clears dashboard-added entries, and omitting it leaves the stored allowlist untouched. Hostnames are refused, since DNS would then decide which requests bypass SSRF protection (#7081)
• Prompt Cache Reload Through the Server - ReloadPromptCache moves onto ServerCallbacks so enterprise can gossip it across nodes. The prompts plugin's in-memory index was previously rebuilt only in the process that served the write, so on a multi-node deployment a prompt published on node A left node B resolving x-bf-prompt-id / x-bf-prompt-version against a stale index until restart: an unknown version errored and latest served the old content. OSS behaviour is unchanged (#7061)
• Guardrail Tool-Call Argument Redaction - Guardrail redaction covers LLM tool-call arguments (Chat function arguments, Responses function arguments and custom-tool input) across the Anthropic streaming and non-streaming paths, reading and writing delta.partial_json on input_json_delta events and collecting string-valued paths inside a tool_use block's input without touching tool names, IDs or definitions. A separate identity-based transformer path lets provider-managed rewrites (Model Armor, Bedrock) land in the correct native JSON field even when the same text appears in several fields, verifying Original before patching and the written value after (#6977, #7049)
• Regions and Service URLs in Plaintext - Regions and service URLs (Azure endpoint, Vertex/Bedrock/Bedrock Mantle region, vLLM/Ollama/SGL/Databricks URL, MCP connection string) are public identifiers, not credentials, and were being unconditionally redacted into unreadable values in the UI. A new SecretVar.RedactedIfSecret() returns a plain clone for a literal value and still masks anything sourced from an env var or vault reference (#7085)
• wait_for_usage for Custom Providers - A wait_for_usage flag on custom_provider_config tells Bifrost the upstream sends a trailing usage-only frame, so the read loop holds open past finish_reason until it arrives instead of synthesizing a zero-usage terminal chunk. Termination stays bounded by the usage chunk, two consecutive post-finish heartbeat comments, EOF, or stream_idle_timeout_in_seconds (#7187)
• Pinnable Log Search Mode - The logs search box gains a mode dropdown (Auto, Content, Request ID). Auto-detection treated UUID-shaped input as an ID lookup and everything else as a content scan, which breaks for request IDs that are not UUID-shaped and for UUID-shaped strings that should be searched as content. A pinned mode bypasses all sniffing and re-runs the current input immediately (#7149)
• MCP Usage Guide Auth Methods - The MCP usage guide generates client configs for Virtual key, OAuth and Identity provider authentication instead of requiring a virtual key for every config. Credential resolution is centralized in buildMCPHeaders(), so OAuth emits no headers, identity provider emits a Bearer placeholder, and virtual key keeps x-bf-vk (#7111)
• Chart Color System - Dashboard charts, status badges and components read a structured set of CSS custom properties instead of hard-coded hex values, so colors adapt correctly between light and dark themes. Tokens are grouped as semantic (hues 0 to 70 reserved so no category can look like an error), sequential, ordinal for percentile series, and categorical at matched chroma assigned by rank (#7113)

🐞 Fixed

• Client Disconnect Not Cancelling Requests - A client that closes its socket while Bifrost is still waiting on core (silent upstream header wait, retry backoff) now cancels the request. ConvertToBifrostContext starts a socket watcher that peeks the client connection every 500 ms with MSG_PEEK and cancels the context on FIN or RST, so upstream retries stop as soon as nobody is listening; previously fasthttp offered no per-request Done and a disconnect was only noticed when an SSE write failed. No-op on non-unix platforms and on in-memory test connections (#7035, #7106)
• Silent Upstream Never Timed Out - default_request_timeout_in_seconds now bounds the wait for response headers on streaming requests, and cancelling a request closes the upstream socket. Every fasthttp client runs through a Bifrost-owned RoundTripper that applies the client's read/write timeouts and the request context to the request write and the header wait, then lifts the socket deadline once headers are parsed so stream_idle_timeout_in_seconds remains the only bound on the body. An upstream that accepts the connection and never answers now fails with 504 RequestTimedOut and its fallbacks are used, instead of pinning the provider worker. Unary large-response downloads bound every body read the same way, gzip-encoded bodies are classified for large-response mode by decompressed size, and a mid-body connection drop is again reported as the retryable 502 completion-marker error instead of a generic unexpected EOF (#7034, #7104)
• Retry Storm After Client Disconnect - fasthttp-level stale-connection retries no longer multiply max_retries. contextTransport.RoundTrip reports a pre-header failure on a freshly dialed socket with retry=false, so StaleConnectionRetryIfErr only walks past pooled keep-alive sockets the upstream closed while idle; an upstream that closes a fresh connection without answering now costs exactly one attempt instead of up to four. Retry backoff also ends as soon as the request context is cancelled, freeing the worker immediately instead of after up to retry_backoff_max (#7035, #7105)
• Abandoned Request Billing Coin Flip - Non-streaming requests whose caller had already disconnected were billed and logged only about half the time. The worker's delivery select had two simultaneously ready cases, a send into a cap-1 channel and ctx.Done(), and Go picks uniformly among ready cases, so terminal post-hooks were skipped roughly 50% of the time. The worker now checks req.Context.Err() before the select and calls billAbandonedTerminal deterministically, keeping the 5-second timer guard for a caller that leaves between the check and the send (#6972, #7116)
• Stream Never Terminated Without [DONE] - An OpenAI-compatible upstream that omits [DONE] and then goes silent after finish_reason no longer fails the stream when stream_idle_timeout_in_seconds fires. The chat and text completion read loops treat an idle timeout after a terminal signal as a parked upstream, abandon the connection rather than drain it, and synthesize the final chunk with the buffered finish_reason; a stall before finish_reason still surfaces as the idle-timeout error (#7108, #7115)
• Dropped SSE Frames in raw_response - Role-only, finish-only and usage-only frames never entered the chunk-forwarding branch, so their bytes were discarded from the reconstructed raw_response, leaving the captured audit trail irreconcilable against a provider invoice since the usage frame carries the token counts Bifrost bills from. A pendingRawFrames buffer drains onto the next forwarded chunk or the synthetic terminal chunk, the Responses-over-Chat fallback no longer stamps one upstream frame onto every derived event, and delta.refusal and delta.annotations are forwarded instead of dropped entirely (#7144, #7184)
• Bedrock Mantle Trailing Usage - Bedrock Mantle chat streaming no longer drops the usage-only chunk that arrives after finish_reason; ProviderSendsDoneMarker now treats bedrock_mantle and the legacy Mantle route under the bedrock key as sending [DONE], so streamed usage and cost are recorded (#7065, #7076)
• Fallbacks Re-Ran the Primary for Image and Video Edits - Fallbacks for image edit, image variation and video edit requests now reach the configured fallback provider and model. prepareFallbackRequest had no arm for those three types, so the shallow copy kept the primary's sub-request pointer and the attempt was routed back to the primary while routing info, headers, the log row and the fallback_index metric label all reported it as a fallback. The helper now verifies the prepared request targets the fallback and skips it with a warning otherwise, so a future request type added without an arm fails loudly (#6966, #7118)
• Provider Response Headers Leaked Across Fallbacks - clearCtxForFallback missed BifrostContextKeyProviderResponseHeaders. Providers set that key before the status check so error paths can forward it, and when a fallback failed pre-flight (key selection failed, a plugin short-circuited, the queue was retiring) nothing overwrote it, so the client received a response attributed to provider B carrying provider A's Retry-After and rate-limit headers (#6973, #7021) (thanks @Huang-404-Q!)
• Credential-Bearing Response Headers Forwarded - The provider-response extractors filtered only against a fixed map of 28 exact names, so any credential-named header outside it was re-served to the inference caller in both the HTTP response and extra_fields.provider_response_headers. The path now also consults schemas.IsSensitiveHeader, which recognizes credential names by substring and suffix and already knew about cf-access-* and x-amzn-oidc-*; a fixed list cannot enumerate the space when network_config.extra_headers exists to carry custom auth headers and some upstreams echo request headers back (#7120, #7121) (thanks @Atharva-Kanherkar!)
• Nil Dereference on Incomplete Fallback Errors - A plugin returning a BifrostError whose nested Error field is nil crashed the request worker. Fallback processing now nil-checks the error and guards access to Error.Type, using the nil-safe GetErrorString() helper, and continues to the next fallback when allowed (#6967, #7110) (thanks @Constantine3!)
• Bedrock Duplicate Document Names - Every untitled document block was given the literal default name document, and Converse rejects duplicate document names, so any request with two or more untitled documents failed unconditionally with a ValidationException. A per-request document namer now disambiguates with numeric suffixes (document, document-2, and so on) and suffixes titled documents only on an actual collision, on both the Converse and Responses replay paths (#7003, #7027) (thanks @Huang-404-Q!)
• Bedrock Text Document Source - Converse rejects document blocks that use a text-only DocumentSource unless citations are explicitly enabled, so plain text formats (text/plain, text/markdown, text/csv, text/html) failed with must set one of the following keys: bytes, s3Location. All document content, including data URLs, percent-encoded payloads and file_data, now ships base64-encoded through source.bytes (#7072, #7079)
• Bedrock Tool Result Images - Some Bedrock-hosted models (OpenAI and Grok families) reject image blocks placed directly inside a toolResult in Converse, even though they accept images in tool output via Responses. A hoistToolResultImages pass moves images out of toolResult blocks and re-inserts them after the last tool result in the same message, leaving a placeholder text block so the now image-free result is not rejected for being empty. A datasheet row supports_converse_tool_result_images overrides the family-level default (#7150)
• gpt-oss Message Mistagging on Mantle - Claude Code replaying a prior assistant message through POST /anthropic/v1/messages at a Bedrock Mantle model was rejected with hundreds of validation errors: the Bedrock-grouped ingress converter tagged user and system input text as output_text (only input_text is valid on input messages) and omitted the required status on replayed assistant messages. Bedrock requests with no explicit max_tokens now also populate it from the model's known capacity instead of truncating silently (#7074, #7075)
• Azure Foundry Output Token Cap - Azure Foundry deployments of Fireworks-hosted models were silently capped at 4096 output tokens on /openai/v1/responses because Microsoft routes those models through chat completions internally. The Azure provider now checks the model's datasheet supported_endpoints and transparently serves both Responses and ResponsesStream through /openai/v1/chat/completions when /v1/responses is absent. Separately, a turn truncated by the output-token cap on any OpenAI-shaped Responses provider now reports stop_reason: max_tokens on the Anthropic egress instead of hiding the truncation as end_turn (#6782, #7142)
• Gemini Inline Image and Audio Dropped - Gemini image-generation output (inlineData) was silently dropped on /v1/chat/completions, both unary and streaming (#7032, #7033) (thanks @Atharva-Kanherkar!)
• Gemini Image Edit Misclassified - isImageEditRequest only checked contents[0].parts[0], so a request with the prompt text before the inlineData part, which is the ordering in Google's own REST edit sample, was misclassified as image generation: the image never reached Vertex and the model invented a picture from the prompt alone, returning HTTP 200. Detection now scans all parts across all contents. imageConfig.aspectRatio is also preserved as a typed parameter instead of being folded into a WxH size string that collapsed any unsupported ratio to 1:1 (#7173)
• Gemini Per-Part Media Resolution Dropped - Part was missing mediaResolution, which overrides generationConfig.mediaResolution for a single part, and because Part.UnmarshalJSON decodes into a closed alias the key was discarded before any conversion ran. Per-part image and PDF tokenization fell back to the model default, so an ULTRA_HIGH image billed about 21k prompt tokens through /genai instead of about 22.1k direct. The field now round-trips both spellings end to end and is stripped on the OpenAI wire path where it is unknown (#7156)
• Gemini generationConfig Lost Across Retries - convertParamsToGenerationConfigResponses deleted top_k, frequency_penalty, presence_penalty, stop_sequences and media_resolution from ExtraParams while mapping them into generationConfig, and that conversion runs once per attempt on the same request, so every retry or fallback after the first was sent without them. On Vertex the only visible signal was promptTokenCount halving on retried requests, making the downgrade silent (#7138) (thanks @VictorRequenaMaisa!)
• MCP Tool Schema Property Order - MCP tool schemas keep one property and $defs order across tool syncs, so prompt caching is not invalidated by reordering alone (#7169, #7170) (thanks @dougcalobrisi!)
• vLLM Alias Resolution During Key Selection - The generic allow and block lists correctly evaluated the user-facing alias, but vLLM key selection compared each key's physical model_name against the unresolved alias and rejected valid keys. The alias is now resolved per key before that comparison, so the same public alias can map to different physical model IDs across vLLM instances, while allow and block checks keep matching the original alias. Allowed Models, Blocked Models and Deployments/Aliases are now exposed on the vLLM key form (#6956) (thanks @Constantine3!)
• opencode-zen Responses Routing - opencode-zen Responses calls are routed through /v1/chat/completions, which its upstream serves, instead of /v1/responses, which it does not (#6778, #6819) (thanks @miguelchico!)
• DeepSeek max_completion_tokens Ignored - DeepSeek's chat-completions endpoint only recognizes the legacy max_tokens field and silently ignores max_completion_tokens, so the limit had no effect. The field is now remapped on the wire, matching the behaviour already in place for Opencode and Ollama (#7131)
• Anthropic Server Tools on Third-Party Endpoints - Fireworks' Anthropic-compatible endpoint returns 400 when a request includes Anthropic server tools such as web_search_20250305, because those run on Anthropic-operated infrastructure that does not exist on third-party hosts; clients whose built-in web search is always on hit this on every request. Unsupported server tools are now dropped before the request leaves Bifrost, the caller's function tools are kept, and the drops are reported on DroppedUnsupportedTools instead of failing the call. The same applies to vLLM and SGLang (#7090)
• Bedrock Guardrail Headers - Bedrock's OpenAI-compatible endpoints apply guardrails through request headers rather than the guardrailConfig body field Converse uses, so a configured guardrail was silently ignored there. guardrailIdentifier, guardrailVersion and trace are now mapped to the X-Amzn-Bedrock-Guardrail* headers on both chat completions and responses, streaming and non-streaming, and the key is consumed so it is not also emitted into the body. A half-formed config with only one of identifier or version is left untouched rather than sent (#7095)
• Responses SSE item: null - Responses stream events that carry no item payload no longer serialize "item": null, which strict OpenAI Responses clients reject as an invalid frame, breaking streamed /v1/responses usage (#6395) (thanks @ReStranger!)
• Responses action String Decode - image_generation_call items where OpenAI emits action as a bare JSON string failed to decode, because UnmarshalJSON immediately peeked at a .type field that cannot be read from a string. That silently dropped the response.output_item.done and response.completed events carrying the image, leaving the stream without a terminal event and surfacing as a bogus "provider closed the stream" truncation error. The completed item also keeps the generation settings OpenAI echoes back (#7060)
• Mid-Conversation System Messages Broke Prompt Caching - Mid-conversation role: "system" messages are inlined in place as <system-reminder> user turns on every converter with a top-level system field: Bedrock Converse (Responses and Chat Completions), Gemini Chat Completions, and the Anthropic wire shape used by DeepSeek, Fireworks and SGL. Previously only Claude on Bedrock and Anthropic inlined; everything else hoisted each reminder into the top-level system block. Claude Code appends a trailing <total_tokens> reminder after every turn, so the hoisted block grew the front of the prompt each turn and prefix-based caches reported a full cache write and zero cache reads on every turn (#7145)
• Unsupported reasoning.context Rejected the Request - A reasoning.context value the target model does not accept is dropped on the OpenAI and Azure Responses path, so all_turns on the original gpt-5 family including gpt-5-pro, gpt-5.1 to gpt-5.3 and the o-series runs under the model's own current_turn default instead of failing with Unsupported value. gpt-5.4, gpt-5.5 and gpt-5.6 keep it. Accepted values come from the datasheet row supported_reasoning_contexts (#7140)
• ClickHouse Retention Filled Replica Disks - ClickHouse log store deletes no longer run as heavyweight ALTER TABLE ... DELETE mutations. The retention cleaner issued one per 100 rows, each rewriting the whole current-month part, and the once-a-minute stale-processing sweeps issued one per table unconditionally. Every delete is now a single lightweight DELETE FROM ... WHERE per run, skipped when nothing matches. The table TTL derived from logs_store.retention_days is reconciled on every startup with a metadata-only MODIFY TTL, so changing the value reaches existing tables; 0 leaves an existing TTL untouched (#7098, #7103)
• Governance Cleanup Dump Race - UsageTracker.Cleanup() took its final budget and rate-limit snapshots before stopping the periodic reset worker, so trackerCancel() could cancel an in-flight dump and fail with context canceled. The worker is now cancelled and awaited before the final dumps, a queued ticker event cannot start another reset cycle during shutdown, and context.Canceled is treated as expected only when the tracker context was actually cancelled (#7099, #7100) (thanks @Constantine3!)
• OAuth Refresh Failed for Public Clients - Public OAuth2 clients registered against servers that only support token_endpoint_auth_method: none have no client secret, and unconditionally setting client_secret= in the refresh POST body sent an empty client_secret_post attempt. Strict authorization servers answered invalid_client, flipping the token row to needs_reauth even though the refresh token was valid. The parameter is now omitted when the secret is empty, matching the PKCE code-exchange path (#7042)
• Complexity Router Skipped Continuation Turns - When a turn is a continuation, such as a tool result following a prior user message, the complexity router discarded the extracted input and skipped classification entirely if no active session was found, leaving new or recovered sessions without a tier. Continuation turns now keep the populated ComplexityInput and fall back to classifying the recovered LastUserText; the skip path applies only when that is also empty (#7122)
• Runtime Responses-Compat Routing - Bedrock runtime models that serve the Responses API are routed to it through a dedicated surface resolver rather than falling back to Converse (#7071)
• Bedrock Mantle Base Path - Bedrock Mantle serves each model on exactly one of two base paths (v1 or openai/v1) and returns a 400 on the other. Hard-coded string matching in two packages covered only generations up to GPT-5 and Gemma 4, so GPT-6 and any future closed-generation model silently fell through to the wrong path. Resolution is centralized in ResolveBedrockMantleBasePath, backed by a bedrock_mantle_base_path datasheet field with family-name detection as the fallback, so a new generation needs a datasheet row rather than a code change (#7077)
• Virtual Key allowed_models: ["*"] Handling Reverted - The wildcard handling for governance virtual keys added in #6767 is reverted. Configurations relying on allowed_models: ["*"] with an empty synced catalog return to the previous behaviour (#7053)
• Helm perUserHeaderKeys Not Rendered - mcp.clientConfigs[].perUserHeaderKeys is mapped into the rendered config.json (#6033, #6034) (thanks @CallumWayve!)
• Helm Plural Access Profiles - Governance roles accept access_profiles as an array in the Helm and config schemas. Bifrost supports multiple access profiles but the schemas accepted only the deprecated singular access_profile. The singular form keeps rendering unchanged, the plural wins when both are present, and an explicitly empty plural list clears existing grants (#7044) (thanks @CarlosLanderas!)
• Sidebar Title Overflow - Long sidebar item titles are truncated instead of overflowing (#7069)
• MCP Logs App Icon - App icons in the MCP logs table render at 20x20 and no longer shrink when the column is narrow (#7167)

🗄️ Database Migrations

• add_use_openai_endpoints_column - Adds the use_openai_endpoints column to the provider keys table for Bedrock OpenAI-compatible endpoint routing. Reversible: the rollback drops the added column. Additive and nullable, so it is safe to run during a rolling upgrade.
• add_time_of_day_pricing_columns - Adds off_peak_cost_multiplier and peak_hours to governance_model_pricing for time-of-day pricing. Reversible: the rollback drops both added columns. Additive and nullable, so it is safe to run during a rolling upgrade.
• mcp_tool_logs_add_governance_snapshots - Adds twelve governance attribution columns to mcp_tool_logs: user_name, team_name, customer_name, business_unit_name, the team_ids/team_names, customer_ids/customer_names and business_unit_ids/business_unit_names pairs, plus budget_ids and rate_limit_ids. Reversible: the rollback drops all twelve in reverse order. Additive and nullable, so it is safe to run during a rolling upgrade. The twelve ALTER TABLEs run under a bounded DDL lock wait, so startup does not stall behind a long-running log transaction holding ACCESS EXCLUSIVE on a continuously written table.

🐙 Closed GitHub Issues

• #6033 - Helm chart: mcp.clientConfigs[].perUserHeaderKeys not rendered into config.json
• #6778 - opencode-zen Anthropic endpoint fails, zen upstream doesn't support /v1/responses
• #6782 - Azure Fireworks/Foundry models capped at 4096 output tokens on Responses + Anthropic ingress (chat completions is not); truncation reported as end_turn
• #6825 - Bedrock provider silently drops Anthropic compaction (compact_20260112), capability matrix says supported, but Claude egress is Converse-only
• #6966 - fallbacks silently re-target the primary provider for image edit / variation requests
• #6967 - shouldContinueWithFallbacks nil-derefs BifrostError.Error, crashing the process on a plugin-returned error
• #6972 - abandoned-request billing is a ~50% coin flip when a client disconnects mid-request
• #6973 - provider response headers leak across fallback boundaries (clearCtxForFallback misses ProviderResponseHeaders)
• #7003 - Bedrock Converse assigns duplicate default name "document" to untitled document blocks, ValidationException
• #7032 - Gemini image-generation output (inlineData) silently dropped on /v1/chat/completions, both unary and streaming
• #7034 - default_request_timeout_in_seconds and stream_idle_timeout_in_seconds do not fire while waiting for response headers, a silent upstream blocks the request until the upstream closes, and the fallback is never used
• #7035 - upstream retries continue after the client has disconnected, and go past max_retries, one abandoned request produced 10 upstream attempts over ~20 minutes
• #7048 - Compat namespace flattening creates duplicate tool names for DeepSeek 4.1 Flash
• #7065 - Bedrock Mantle chat streaming drops trailing usage after finish_reason
• #7072 - Bedrock Converse drops text-format document bytes, DocumentSource "must set one of the following keys: bytes, s3Location" (v1 to v2 regression)
• #7074 - openai.gpt-oss-120b via Bedrock Responses API mistags replayed history as output_text instead of input_text, breaks multi-turn Claude Code sessions
• #7098 - ClickHouse logs store: retention cleaner runs one ALTER TABLE ... DELETE mutation per 100 rows and fills replica disks
• #7099 - UsageTracker cleanup races the periodic rate-limit dump during shutdown
• #7108 - Custom-provider streaming never terminates when the upstream omits [DONE] (heartbeats mask stream_idle_timeout_in_seconds)
• #7120 - Provider response-header filter ignores IsSensitiveHeader, forwarding credential-named headers to inference callers
• #7143 - does_not_send_done_marker drops trailing Chat Completions usage and records zero cost
• #7144 - Chat Completions streaming raw_response omits usage-only and finish-only SSE frames
• #7155 - Bedrock-native invoke ingress silently drops Anthropic tool search (tool_search_tool_* / defer_loading), served eagerly over Converse
• #7169 - MCP tool schema property order changes between tool syncs, breaking prompt caching

Installation

Docker

docker run -p 8080:8080 maximhq/bifrost:v2.2.0

Binary Download

npx @maximhq/bifrost --transport-version v2.2.0

Docker Images

• maximhq/bifrost:v2.2.0 - This specific version
• maximhq/bifrost:latest - Latest version (updated with this release)

This release was automatically created with dependencies: core v1.9.0, framework v1.7.0. All plugins have been validated and updated.