Features
- Added FastAIToken support to usemagpie.ai and the app.
Improvements
- Hung GPU workloads now automatically move to the CPU.
- Failures now clearly indicate what caused pf-serve to stop.
- Requests are held back immediately when a model fails, preventing further issues.
Install
Download from usemagpie.ai, or curl -fsSL https://usemagpie.ai/install.sh | sh. An installed magpie updates itself.
- macOS (Apple Silicon):
magpie-darwin-arm64.dmg - macOS (Intel):
magpie-darwin-amd64.dmg - Windows:
magpie-windows-amd64.exe(ARM:magpie-windows-arm64.exe) - Linux:
magpie-linux-amd64/magpie-linux-arm64(needs GTK 3 and WebKitGTK 4.1) - Terminal only:
magpie-cli-<os>-<arch>
Features
- 为 usemagpie.ai 和该应用添加了 FastAIToken 支持。
Improvements
- 挂起的 GPU 工作负载现在会自动转移到 CPU。
- 现在，故障会明确指出导致 pf-serve 停止的原因。
- 当模型发生故障时，请求会立即被暂缓，以避免出现更多问题。
安装
从 usemagpie.ai 下载，或运行 curl -fsSL https://usemagpie.ai/install.sh | sh。已安装的 magpie 会自动更新。