What's New
Configurable Account Selection Strategies
You can now choose how the proxy selects accounts from your pool:
- Sticky (
--strategy=sticky): Cache-optimized. Stays on the same account until rate-limited, maximizing prompt cache hits. - Round-Robin (
--strategy=round-robin): Load-balanced. Rotates to a new account on every request for maximum throughput. - Hybrid (
--strategy=hybrid): Smart distribution (default). Uses health scores, token buckets, and LRU freshness to pick the optimal account.
Configure via CLI flag:
npm start -- --strategy=sticky
npm start -- --strategy=round-robin
npm start -- --strategy=hybridOr change the strategy in the WebUI under Settings → Server Configuration.
Hybrid Strategy Details
The new hybrid strategy combines multiple signals:
- Health tracking: Monitors success/failure patterns with passive recovery
- Token buckets: Client-side rate limiting (50 tokens, 6/min regeneration)
- LRU freshness: Prefers accounts that have rested longer
This provides intelligent load distribution while avoiding rate-limited accounts.
Strategy implementation referenced from NoeFabris/opencode-antigravity-auth