Features
- Added per-account and per-key request concurrency limits, with separate queue size and wait time settings per provider.
- Requests beyond concurrency limits now return a 429 response with Retry-After and provider-specific error formatting.
- Added GUI controls to view and set account/key concurrency limits, queue size, and queue wait time.
- Added CLI commands:
magpie provider account-concurrencyandmagpie provider queue.
Improvements
- Routing groups now skip busy members once to spread requests across available keys or accounts before queueing.
- Concurrency slots are released when a response finishes, fails, or the client disconnects.
- Busy/queued status is now visible in the GUI for each account and key.
Install
Download from usemagpie.ai, or curl -fsSL https://usemagpie.ai/install.sh | sh. An installed magpie updates itself.
- macOS (Apple Silicon):
magpie-darwin-arm64.dmg - macOS (Intel):
magpie-darwin-amd64.dmg - Windows:
magpie-windows-amd64.exe(ARM:magpie-windows-arm64.exe) - Linux:
magpie-linux-amd64/magpie-linux-arm64(needs GTK 3 and WebKitGTK 4.1) - Terminal only:
magpie-cli-<os>-<arch>
Features
- 添加了按账户和按密钥的请求并发限制,并为每个提供商分别提供队列大小和等待时间设置。
- 超出并发限制的请求现在会返回 429 响应,并包含 Retry-After 和提供商特定的错误格式。
- 添加了 GUI 控件,用于查看和设置账户/密钥并发限制、队列大小和队列等待时间。
- 添加了 CLI 命令:
magpie provider account-concurrency和magpie provider queue。
Improvements
- 路由组现在会在排队前跳过繁忙成员一次,以便在可用密钥或账户之间分散请求。
- 当响应完成、失败或客户端断开连接时,并发槽位会被释放。
- 现在 GUI 中每个账户和密钥的繁忙/排队状态均可见。
安装
从 usemagpie.ai 下载,或运行 curl -fsSL https://usemagpie.ai/install.sh | sh。已安装的 magpie 会自动更新。