Features
- Added a “Slow to start” setting for groups. You can choose to wait as before, or automatically move on after 30 seconds, 1 minute, or 2 minutes if a member hasn’t started answering.
- Request details now show separate timings for Magpie’s processing time and the vendor’s first token, so it’s easier to see where delays happen.
Improvements
- When a slow-start timeout is set, the stalled request is cancelled before any partial output reaches the user, and the next member is asked automatically.
- The last remaining member is always waited for, even if it is slow.
- Slow starts are marked in the route and do not count against the member with a rest period.
Install
Download from usemagpie.ai, or curl -fsSL https://usemagpie.ai/install.sh | sh. An installed magpie updates itself.
- macOS (Apple Silicon):
magpie-darwin-arm64.dmg - macOS (Intel):
magpie-darwin-amd64.dmg - Windows:
magpie-windows-amd64.exe(ARM:magpie-windows-arm64.exe) - Linux:
magpie-linux-amd64/magpie-linux-arm64(needs GTK 3 and WebKitGTK 4.1) - Terminal only:
magpie-cli-<os>-<arch>
功能
- 为群组新增了“启动缓慢”设置。你可以选择像之前一样等待,或者在成员尚未开始回答时,在 30 秒、1 分钟或 2 分钟后自动继续。
- 请求详情现在会分别显示 Magpie 的处理时间和供应商的首个 token 时间,从而更容易看出延迟发生在哪里。
改进
- 当设置了慢启动超时后,停滞的请求会在任何部分输出到达用户之前被取消,并自动询问下一位成员。
- 即使最后一位成员启动缓慢,也始终会等待其响应。
- 启动缓慢的情况会在路由中标记,并且不会计入该成员的休息期。
安装
从 usemagpie.ai 下载,或运行 curl -fsSL https://usemagpie.ai/install.sh | sh。已安装的 magpie 会自动更新。