lemonade-sdk/lemonade v10.8.0 on GitHub

Headline

Live model management: auto-unload is available, along with the ability to pin models to prevent eviction.
LMX-Omni image generation gains fine-grained parameters, unified collection import/export, and Hugging Face distribution.
Cloud offload serves chat completions from any OpenAI-compatible provider alongside local models.
New MCP gateway and lemonade launch pi integrations let external tools and agents call local models.
Expanded platform support adds Moonshine speech-to-text, NVIDIA GB10 arm64, Debian 13, and ROCm for Radeon GPUs.

Breaking Changes

vLLM model IDs renamed from Qwen3.5-*-vLLM to Qwen3.5-*-FP16-vLLM.
The --flm-args CLI flag and flm_args API parameter have been removed.
Recipe-configuration environment variables have been removed.
The legacy GUI collection export bundle format can no longer be imported.
The default ctx_size changed from 4096 to -1 (auto-tuned).

Lemonade Server

Operating System	Downloads
Windows	lemonade.msi
Ubuntu 24.04+	Launchpad PPA
Debian 13	lemonade-server_10.8.0-debian13_amd64.deb
Fedora 43	lemonade-server-10.8.0-fc43.x86_64.rpm
Fedora 44	lemonade-server-10.8.0-fc44.x86_64.rpm
macOS	Lemonade-10.8.0-Darwin.pkg

Other platforms? See our Installation Options for Docker, Snap, Arch, Debian, and more.

Embeddable Lemonade

Portable binaries for bundling into your own installer. Run lemond ./ as a subprocess.

Platform	Download
Ubuntu x64	lemonade-embeddable-10.8.0-ubuntu-x64.tar.gz
Windows x64	lemonade-embeddable-10.8.0-windows-x64.zip
macOS arm64	lemonade-embeddable-10.8.0-macos-arm64.tar.gz

What's Changed

Thanks @Geramy, @Kushal1213, @abn, @anditherobot, @bitgamma, @blackdeathdrow, @ckuethe, @clemperorpenguin, @fl0rianr, @github-actions, @iswaryaalex, @jeremyfowers, @kenvandine, @neoblizz, @noamsto, @ramkrishna2910, @sawansri, @siavashhub, @superm1, @vgodsoe for your awesome contributions to this release!

Click to expand changelog

ci: wire HF_TOKEN into linux distro builds; drop Fedora by @jeremyfowers in #2169
Fix light theme persistence by @anditherobot in #2121
cli: group run/load recipe options by @anditherobot in #2144
docs: document pre-v10 legacy Linux config.json path by @anditherobot in #2145
fix(vllm): report streaming TTFT and TPS by @fl0rianr in #2009
Fix compat with vscode by @superm1 in #2146
trivial: Run pre-commit whitespace hook by @superm1 in #2140
feat(backends): add Moonshine streaming STT backend (#2115) by @Geramy in #2178
Rewrite heartbeat + monitor workflows by @vgodsoe in #1960
ci(windows): migrate Windows builds to Visual Studio 2026 by @jeremyfowers in #2199
fix: remove load options environment variable support from lemonade CLI by @superm1 in #2185
feat: auto-detect MTP capability from GGUF metadata by @blackdeathdrow in #2176
moonshine follow-ups: dedupe realtime docs (#2192), GUI label (#2193), platform list by @Geramy in #2196
fix(ui): connect log stream on main HTTP port instead of dedicated WebSocket port by @blackdeathdrow in #2191
Add support for launching pi.dev by @superm1 in #2198
fix: use Win32 API fallback for create_directories on symlinked Huggi… by @superm1 in #2184
fix: enable TheRock ROCm installation on Windows for Radeon RX GPUs by @anditherobot in #2093
Add triage dashboard with GitHub Pages auto-publish by @ramkrishna2910 in #2159
Fix CUDA backend on NVIDIA GB10 (sm_121) arm64 by @kenvandine in #2203
Refactor codebase to drop so much #ifdef _WIN32 by @superm1 in #2142
ci: narrow API key CLI smoke tests by @fl0rianr in #2149
Fix: recipe/backend status resolution for duplicated backend definition by @fl0rianr in #2206
docs: add LangChain integration guide for Lemonade Server by @Kushal1213 in #2038
vllm: rename built-in models with -FP16- suffix by @ramkrishna2910 in #2155
Enable ROCm on gfx1152 by @ckuethe in #2186
Show models of several backends in agent launch model picker by @sawansri in #2205
ci: add engine::moonshine to auto-labeling by @ramkrishna2910 in #2209
ci: grant pull-requests:read to triage dashboard workflow by @ramkrishna2910 in #2210
Add instructions about dkms conflict for users that run into that by @vgodsoe in #2208
feat(cli): add interactive chat in the terminal by @siavashhub in #2207
Fix AMD GPU architecture detection for CDNA datacenter parts by @neoblizz in #2182
feat(config): honor LEMONADE_DEFAULTS_PATH for non-FHS installs by @noamsto in #2220
fix(cli): lemonade launch claude fails to launch on Windows, throws Error 193 by @anditherobot in #2213
Fix download speed and ETA display at very low speeds by @fl0rianr in #2219
Cloud offload: provider-agnostic OpenAI-compat backend + UI by @ramkrishna2910 in #1785
Generate an artifact for Debian 13 by @superm1 in #2240
Add inotify to extra models directory by @superm1 in #2217
feat: Add backend watchdog for hung child servers by @fl0rianr in #2028
Update llama.cpp to b9632 by @github-actions[bot] in #2238
docs(config): document defaults.json seeding and LEMONADE_DEFAULTS_PATH by @noamsto in #2221
feat: opt-in dynamic VRAM management (auto-evict idle models) by @clemperorpenguin in #2183
fix(rocm): repair stable runtime when backend is update_required by @fl0rianr in #2003
Drop support for flm_args by @superm1 in #2015
fix: re-download missing checkpoint files automatically (no restart needed) by @blackdeathdrow in #2239
trivial: Update debian/copyright by @superm1 in #2244
cli: use long read timeout for pull and install streams by @abn in #2222
docs: add release process guide by @jeremyfowers in #2200
Fix(Omni): image tool options for Omni image generation by @fl0rianr in #1998
fix(windows): set safe cwd for backend child processes by @fl0rianr in #2246
ci: keep Windows inference cache outside workspace by @fl0rianr in #2148
ci: drop src/cpp from distro build triggers by @jeremyfowers in #2170
fix: align moonshine backend lifecycle with watchdog by @fl0rianr in #2252
test: pre-warm ROCm (TheRock) runtime before rocm-backend tests by @jeremyfowers in #2250
fix(server): handle Moonshine directory variants correctly by @fl0rianr in #2248
fix(ui): visual reload of cloud provider text by @fl0rianr in #2247
feat: implement safe model pinning to prevent auto-eviction by @abn in #2226
Remember downloaded-only model filter by @anditherobot in #2119
feat: Migrate whisper.cpp builds to whisper.cpp-rocm and add ROCm backend to Lemonade whisper by @iswaryaalex in #2188
Unified collection import/export format; LMX collections distributed via Hugging Face by @jeremyfowers in #2099
Automatically determine context size by @bitgamma in #2235
fix(server): prevent SIGPIPE crash in macOS DirectoryWatcher on kevent failure by @jeremyfowers in #2261
Add MCP gateway: drop Lemonade into Claude Desktop, VS Code or Cursor in 30 seconds by @siavashhub in #2131
Rev lemonade version to 10.8 by @ramkrishna2910 in #2271

New Contributors

@blackdeathdrow made their first contribution in #2176
@neoblizz made their first contribution in #2182
@clemperorpenguin made their first contribution in #2183

Full Changelog: v10.7.0...v10.8.0

Windows installers are signed. Free code signing provided by SignPath.io, certificate by SignPath Foundation. See our Code Signing Policy.