github diegosouzapw/OmniRoute v2.8.7
v2.8.7 — Bottleneck 429 drop, custom embedding fix

latest releases: v2.9.0, v2.8.9, v2.8.8...
9 hours ago

Bug Fixes

  • Bottleneck 429 infinite wait (PR #495 by @xandr0s): On 429, limiter.stop({ dropWaitingJobs: true }) immediately drops all queued requests. Prevents infinite hangs for long-window rate limits (e.g., Codex). Limiter is deleted and recreated on next request.
  • Custom embedding models (#496): POST /v1/embeddings now resolves custom embedding models from all provider_nodes (not just localhost). Fixes Unknown embedding provider error for models like google/gemini-embedding-001.

Issues Responded

# Title Status
#496 Custom embedding provider resolution ✅ Fixed
#452 Per-API-key request-count limits 📋 Roadmap
#464 Auto-issue API keys ❓ Needs detail
#488 Auto-update model lists 📋 Roadmap

What's Changed

  • fix: drop Bottleneck queue on 429 instead of infinite wait by @xandr0s in #495

Full Changelog: v2.8.6...v2.8.7

Don't miss a new OmniRoute release

NewReleases is sending notifications on new releases.