github yetone/magpie-releases v0.1.1009
magpie v0.1.1009

latest releases: v0.1.4668, v0.1.4667, v0.1.4666...
one month ago

Features

  • Added per-account and per-key request concurrency limits, with separate queue size and wait time settings per provider.
  • Requests beyond concurrency limits now return a 429 response with Retry-After and provider-specific error formatting.
  • Added GUI controls to view and set account/key concurrency limits, queue size, and queue wait time.
  • Added CLI commands: magpie provider account-concurrency and magpie provider queue.

Improvements

  • Routing groups now skip busy members once to spread requests across available keys or accounts before queueing.
  • Concurrency slots are released when a response finishes, fails, or the client disconnects.
  • Busy/queued status is now visible in the GUI for each account and key.

Install

Download from usemagpie.ai, or curl -fsSL https://usemagpie.ai/install.sh | sh. An installed magpie updates itself.

  • macOS (Apple Silicon): magpie-darwin-arm64.dmg
  • macOS (Intel): magpie-darwin-amd64.dmg
  • Windows: magpie-windows-amd64.exe (ARM: magpie-windows-arm64.exe)
  • Linux: magpie-linux-amd64 / magpie-linux-arm64 (needs GTK 3 and WebKitGTK 4.1)
  • Terminal only: magpie-cli-<os>-<arch>

Features

  • 添加了按账户和按密钥的请求并发限制,并为每个提供商分别提供队列大小和等待时间设置。
  • 超出并发限制的请求现在会返回 429 响应,并包含 Retry-After 和提供商特定的错误格式。
  • 添加了 GUI 控件,用于查看和设置账户/密钥并发限制、队列大小和队列等待时间。
  • 添加了 CLI 命令:magpie provider account-concurrency 和 magpie provider queue。

Improvements

  • 路由组现在会在排队前跳过繁忙成员一次,以便在可用密钥或账户之间分散请求。
  • 当响应完成、失败或客户端断开连接时,并发槽位会被释放。
  • 现在 GUI 中每个账户和密钥的繁忙/排队状态均可见。

安装

从 usemagpie.ai 下载,或运行 curl -fsSL https://usemagpie.ai/install.sh | sh。已安装的 magpie 会自动更新。

Don't miss a new magpie-releases release

NewReleases is sending notifications on new releases.