github tashfeenahmed/freellmapi v0.13.9

2 hours ago

FreeLLMAPI v0.13.9 keeps retired models out of routing, tightens idempotent retries, fixes the CLI's default port and adds a Russian README.

Routing

  • Retired models stay retired after a restart. When a provider answers a model with 410 (end of life), FreeLLMAPI retires it. A restart used to undo that, so the dead model went back into rotation and failed again. Retirements now survive restarts and are only lifted by a newer catalog. Thanks @suantea, and @AlexQiu-coder for the report. (#1394, #1421)
  • Asking for a retired model by name no longer fails every time. A request that names a model the provider has retired now falls through to the next model in your chain. The X-Routed-Via header shows which model answered. (#1394, #1423)

API

  • Idempotent retries check every generation option. Retrying with the same Idempotency-Key but a different response_format, seed, stop or parallel_tool_calls now returns 409 idempotency_key_conflict instead of replaying the earlier answer. Keys stored before this update return a conflict once, then work as before. Thanks @ac1982. (#1440)

CLI

  • npx freellmapi defaults to port 3001, the gateway's port, when no --url or FREELLMAPI_URL is set. Published as freellmapi@0.8.1 on npm. Thanks @agammann. (#1437)
  • The CLI test suite now passes on Windows. Thanks @suantea. (#1424)

Keys

  • CSV key import handles line breaks inside quoted fields, so a label containing a line break no longer splits the row. Thanks @Claven07. (#1384)

Docs

Updating

Desktop users on v0.13.5 or later can update from inside the app: ⋯ → Check for updates. Docker: ghcr.io/tashfeenahmed/freellmapi:v0.13.9. The latest tag also points to this release.

Existing keys and profiles are retained. This release has no database migrations.

Full changelog


⭐ Like the free router? Go Premium, the live signed catalog, $19/yr, cancel anytime.

Don't miss a new freellmapi release

NewReleases is sending notifications on new releases.