github tashfeenahmed/freellmapi v0.16.24

one hour ago

PowerTokens provider

  • Add PowerTokens (api.powertokens.ai) as an OpenAI-compatible provider. Its glm-4.7-flash model is listed at $0 (0 Credits); chat, streaming and tool calling were tested through the app router.
  • PowerTokens is often overloaded and answers 429 (code 1305). The router cools the key down and moves on, so treat it as an extra fallback rather than a primary route.
  • Keys restricted to other models in the PowerTokens dashboard return 403 token_model_forbidden; allow glm-4.7-flash on the key.

The model arrives through the signed catalog. Premium receives the live catalog; Free receives the new row after the unchanged 30-day aging period. Thanks @PowerTokens for the original contribution (#1659).

Fixes

  • Custom endpoints with several keys now rotate image, speech, transcription and embedding requests across those keys when one is disabled, out of budget, rate limited or rejected (#1738, fixes #1737). Thanks @w21180239.
  • Free.ai is no longer offered for chat routing, and "Test" on a legacy non-chat model row explains that the platform does not support chat instead of reporting a missing key (#1769). Thanks @w21180239.
  • "Probe now" gives reasoning models room for their hidden thinking (#1862).
  • freellmapi setup-opencode stores the key in auth.json instead of an environment placeholder (#1861).

Docs

Don't miss a new freellmapi release

NewReleases is sending notifications on new releases.