lemonade-sdk/lemonade v9.3.0 on GitHub

Headline

NPU enabled for Whisper models on the /audio/transcription endpoint (Windows only).
Kokoro TTS is available on the /audio/speech endpoint.
Desktop and web apps have backend selection, providing a ROCm option in the GUI for the first time.
Significant performance uplift on AMD devices using llamacpp Vulkan and FastFlowLM.
A lot more! This was a huge release.

Breaking Changes

The .deb now installs as a systemd service. See #1006 for details and migration info.
The inference_engines key has been removed from the /system-info endpoint response, replaced by a new recipes list.

Quick Install

Operating System	Server + App	Server Only
Windows	lemonade.msi	lemonade-server-minimal.msi
Ubuntu	lemonade_9.3.0_amd64.deb	lemonade-server-minimal_9.3.0_amd64.deb

Other platforms? See our Installation Options for Docker, Arch, Fedora, Debian, and more.

What's Changed

Thanks @Geramy, @LaurentChardin, @bitgamma, @choppu, @dennemark, @iswaryaalex, @jeremyfowers, @kenvandine, @ramkrishna2910, @sofiageo, @superm1 for your awesome contributions to this release!

Click to expand changelog

feat: Add status bar with server and system stats by @kenvandine in #927
Remove all trailing whitespace and apply black to all python files by @jeremyfowers in #966
enable /responses endpoint for llamacpp recipes by @bitgamma in #945
Add load options menu by @sofiageo in #880
Fix link to llm-debate.html in instructions by @jeremyfowers in #984
Rename SD label by @ramkrishna2910 in #986
fix: Don't attempt to preserve ownership when extracting backends by @kenvandine in #989
Add a helper script that uses Ninja build for building by @superm1 in #991
Add a new /api/v1/system-stats endpoint and use it by @superm1 in #970
Update the Installing Models section of the integration guide by @jeremyfowers in #993
Update CMake minimum version to use ... syntax by @superm1 in #999
Prevent a rare Windows model load bug by @jeremyfowers in #979
llamacpp: also reserve flag aliases/negatives by @bitgamma in #974
Create and distribute systemd service by @superm1 in #1002
Add more system information into about modal by @superm1 in #1005
Windows - fix some issues with buildscripts by @LaurentChardin in #1001
Add image generation docs openwebui by @dennemark in #994
Add connection settings in Electron app by @choppu in #1004
Re-do the system info code and endpoint by @jeremyfowers in #992
do not close the same stream multiple times by @bitgamma in #1014
Geramy/announce to lan by @Geramy in #988
feat: Add copy button to code blocks by @kenvandine in #969
Fix systemd service installation for non-/usr prefixes by @superm1 in #1007
Add Kokoro TTS backend by @bitgamma in #1000
Show --help output if no arguments to lemonade-server by @superm1 in #1017
Desktop app: llamacpp backend dropdown, build improvements by @jeremyfowers in #1013
Add support for lemonade-server hosting a Lemonade Web-App by @superm1 in #965
Add qwen-coder-next to the models list by @jeremyfowers in #1020
Add NPU support for whisper.cpp on Lemonade by @iswaryaalex in #956
Geramy/macosx support stg1 by @Geramy in #868
Look for snap.lemonade-server.daemon.service for systemd too by @superm1 in #1018
feat: Suppress logging system stats by @kenvandine in #1021
Add basic API key support to the webapp by @bitgamma in #1026
Remove snap connection from installation docs by @kenvandine in #1027
Open the web app from the windows tray by @jeremyfowers in #1032
Add whispercpp args to spec, CLI, system_info, and app by @jeremyfowers in #1030
Rev FLM to 0.9.31 by @jeremyfowers in #1034
Bug fix - whispercpp model manager by @iswaryaalex in #1041
Hardcode lib for systemd service under $PREFIX by @superm1 in #1039

New Contributors

@kenvandine made their first contribution in #927
@LaurentChardin made their first contribution in #1001
@dennemark made their first contribution in #994
@choppu made their first contribution in #1004
@iswaryaalex made their first contribution in #956

Full Changelog: v9.2.0...v9.3.0