lemonade-sdk/lemonade v10.5.0 on GitHub

Headline

Upgraded to ROCm 7.13 for llama.cpp and stable-diffusion.cpp!
macOS has graduated from beta with all major features fully supported.
Overhauled management of custom/imported models and recipes.

Breaking changes

room-preview has been deprecated because TheRock is now stable! You will be auto-migrated from rocm-preview to rocm-stable
audio has been renamed to transcription in the /v1//health endpoint
If you have *.args set in the global config and *_args set for a specific model, these options will be merged at load time. Previously, per-model args would completely replace global args. You can opt-out on a per-model basis by setting merge_args=False in a load request and/or saved model options.

Lemonade Server

Operating System	Downloads
Windows	lemonade.msi
Ubuntu 24.04+	Launchpad PPA
Fedora 44	lemonade-server-10.5.0.x86_64.rpm
macOS	Lemonade-10.5.0-Darwin.pkg

lemonade-server-minimal.msi and lemonade-server CLI are deprecated and will be removed in the next release.

Other platforms? See our Installation Guide for Docker, Snap, Arch, and more.

Embeddable Lemonade

Portable binaries for bundling into your own installer. Run lemond ./ as a subprocess.

Platform	Download
Ubuntu x64	lemonade-embeddable-10.5.0-ubuntu-x64.tar.gz
Windows x64	lemonade-embeddable-10.5.0-windows-x64.zip
macOS arm64	lemonade-embeddable-10.5.0-macos-arm64.tar.gz

What's Changed

Thanks @Geramy, @SorenDreano, @Tetramatrix, @bitgamma, @fl0rianr, @genrtul, @github-actions, @gunnarx, @jeremyfowers, @meghsat, @sawansri, @storm1er, @superm1 for your awesome contributions to this release!

Click to expand changelog

Fix website links by @jeremyfowers in #1855
Add the Development docs nav entry for philosophy.md by @Copilot in #1851
Device option sep by @genrtul in #1397
fix model resolution for sharded models on windows by @bitgamma in #1868
Update llama.cpp to b9095 by @github-actions[bot] in #1861
feat(setup.sh): add rpm-ostree support for Fedora Atomic/Desktop environments by @storm1er in #1797
fix link to the contribution guide in the README.md by @SorenDreano in #1877
Dockerfile: libxrt2 & libxrt-npu2 dependencies for fastflowlm by @gunnarx in #1801
Let vLLM choose model dtype automatically instead of forcing float16 by @SorenDreano in #1876
Fixing opencode unreachable on Windows bug by @meghsat in #1886
Set FLM_CONFIG_PATH for CI by @superm1 in #1889
Fix: Properly terminate child processes on systemd service stop by @superm1 in #1866
Remove stale cli options for lemonade launch by @sawansri in #1880
Restore sd-cpp:rocm channel fallback when rocm_channel=nightly by @Copilot in #1882
Build web app by default on Windows by @jeremyfowers in #1891
Add a getting started guide by @jeremyfowers in #1895
Merge arguments instead of replacing them. by @bitgamma in #1873
Rev FLM to 0.9.42 and fix transcription labeling system by @jeremyfowers in #1810
feat(macos): add macOS arm64 (Metal) support for whisper, kokoros, sd-cpp by @Geramy in #1777
Update ROCm to 7.13 by @superm1 in #1900
Canonical model IDs with friendly-name precedence by @jeremyfowers in #1899
Add embeddable Lemonade build for macOS by @jeremyfowers in #1892
macOS support GA by @jeremyfowers in #1893
Fix/http client low speed timeout by @Tetramatrix in #1860
GUI: render canonical display names in LLM Chat model dropdown by @jeremyfowers in #1906
Respect configured backend defaults by @jeremyfowers in #1905
Enable APC (prompt caching) in vLLM by @sawansri in #1898
feat: added model name copy button by @fl0rianr in #1904
remove redundant speech label and rename esrgan to upscaling by @bitgamma in #1901
Update llama.cpp to b9174 by @github-actions[bot] in #1910

New Contributors

@genrtul made their first contribution in #1397
@storm1er made their first contribution in #1797
@SorenDreano made their first contribution in #1877
@gunnarx made their first contribution in #1801

Full Changelog: v10.4.0...v10.5.0

Windows installers are signed. Free code signing provided by SignPath.io, certificate by SignPath Foundation. See our Code Signing Policy.