github mnfst/llm-gateway manifest@5.14.0
v5.14.0

latest releases: manifest@6.28.10, manifest@6.28.9, manifest@6.28.8...
8 months ago

✨ Minor Changes

  • 5bc9f02: Harden blind proxy: per-user rate limiting (60 req/60s), concurrency control (max 10), client disconnect abort propagation, reduced provider timeout (3min), bounded telemetry sets
  • 4e36a94: Unify proxy: replace Google native adapter with OpenAI-compatible endpoint, merge blind proxy into single /v1/chat/completions endpoint with tier header

Don't miss a new llm-gateway release

NewReleases is sending notifications on new releases.