github yetone/magpie-releases v0.1.844
magpie v0.1.844

latest releases: v0.1.4657, v0.1.4656, v0.1.4655...
one month ago

Features

  • Added a “Slow to start” setting for groups. You can choose to wait as before, or automatically move on after 30 seconds, 1 minute, or 2 minutes if a member hasn’t started answering.
  • Request details now show separate timings for Magpie’s processing time and the vendor’s first token, so it’s easier to see where delays happen.

Improvements

  • When a slow-start timeout is set, the stalled request is cancelled before any partial output reaches the user, and the next member is asked automatically.
  • The last remaining member is always waited for, even if it is slow.
  • Slow starts are marked in the route and do not count against the member with a rest period.

Install

Download from usemagpie.ai, or curl -fsSL https://usemagpie.ai/install.sh | sh. An installed magpie updates itself.

  • macOS (Apple Silicon): magpie-darwin-arm64.dmg
  • macOS (Intel): magpie-darwin-amd64.dmg
  • Windows: magpie-windows-amd64.exe (ARM: magpie-windows-arm64.exe)
  • Linux: magpie-linux-amd64 / magpie-linux-arm64 (needs GTK 3 and WebKitGTK 4.1)
  • Terminal only: magpie-cli-<os>-<arch>

功能

  • 为群组新增了“启动缓慢”设置。你可以选择像之前一样等待,或者在成员尚未开始回答时,在 30 秒、1 分钟或 2 分钟后自动继续。
  • 请求详情现在会分别显示 Magpie 的处理时间和供应商的首个 token 时间,从而更容易看出延迟发生在哪里。

改进

  • 当设置了慢启动超时后,停滞的请求会在任何部分输出到达用户之前被取消,并自动询问下一位成员。
  • 即使最后一位成员启动缓慢,也始终会等待其响应。
  • 启动缓慢的情况会在路由中标记,并且不会计入该成员的休息期。

安装

从 usemagpie.ai 下载,或运行 curl -fsSL https://usemagpie.ai/install.sh | sh。已安装的 magpie 会自动更新。

Don't miss a new magpie-releases release

NewReleases is sending notifications on new releases.