github tashfeenahmed/freellmapi v0.13.10

4 hours ago

FreeLLMAPI v0.13.10 fixes the server crashing on every chat on older x86 CPUs, such as Synology NAS boxes.

Fixes

  • No more crash on older CPUs. The image-resizing library FreeLLMAPI bundles needs a CPU with SSE4.2, and the server loaded it on every chat request, text-only ones included. On CPUs without SSE4.2 (for example the Intel Atom in a Synology DS1512+, or pre-2008 Core 2 machines) that killed the server, so Docker restarted it on every message and the Playground showed "Failed to fetch". The library now only loads when a message carries an image that needs resizing, and never on a CPU that can't run it: those images go to the provider at their original size instead. Thanks @patelhe for the report and the logs. (#1469, #1481)

Development

  • The bootstrap script and the CLI test suite now pass on Windows, including from a PowerShell 7 shell. Thanks @sahiixx for the report. (#1392, #1476)

Updating

Desktop users on v0.13.5 or later can update from inside the app: ⋯ → Check for updates. Docker: ghcr.io/tashfeenahmed/freellmapi:v0.13.10. The latest tag also points to this release.

Existing keys and profiles are retained. This release has no database migrations.

Full changelog


⭐ Like the free router? Go Premium, the live signed catalog, $19/yr, cancel anytime.

Don't miss a new freellmapi release

NewReleases is sending notifications on new releases.