michaelfeil/infinity v3.0.1-beta.3

Infinity v3.0.1-beta.3

on GitHub

Infinity V3 3.0.1-beta.3 includes configurable service-tier response headers and optional priority billing-token scaling.

• Set INFINITY_BILLING_HEADERS=x-baseten to emit x-baseten-input-tokens and x-baseten-service-tier (default or priority). Zero priority queue bonus reports default.
• Set INFINITY_EXPERIMENTAL_MULTIPLIER=1.2 to scale only effective-priority billing-token counts. It is unset by default. Decimal arithmetic is exact and results round up to integer tokens; actual token usage is unchanged.
• Also includes D3 Ultra checkpoint support and embedding tensor wire-contract clarifications since beta.2.

Images: ghcr.io/michaelfeil/infinity_v3:cpu-3.0.1-beta.3 and ghcr.io/michaelfeil/infinity_v3:nvidia-3.0.1-beta.3 (linux/amd64). Prerelease tags leave stable latest image aliases unchanged.

CPU images use Candle; the NVIDIA images use native LibTorch. Model support differs by backend. See V3 licensing and the scoped package notices.