lemonade-sdk/lemonade v10.9.0 on GitHub

Headline

ARM64 (aarch64) Linux packages now ship for Debian, Fedora, the portable embeddable archive, and Docker.
Users can set custom system prompts for Lemonade omni models, as demonstrated in the new RPG-HaloTales-V1 narrative experience model.
A new OTLP telemetry subsystem exports traces using OpenInference and OpenTelemetry GenAI conventions, driven by a lemonade telemetry command.
The vLLM backend now works with Claude Code through the Anthropic Messages API, and adds Qwen3.6 and GLM-4.7-Flash models.

Breaking Changes

The Linux system tray is now disabled by default (REQUIRE_LINUX_TRAY=OFF), so Linux server packages ship headless; rebuild with the tray option enabled to restore it.

Lemonade Server

Operating System	Downloads
Windows	lemonade.msi
Ubuntu 24.04+	Launchpad PPA
Debian 13 (x86_64)	lemonade-server_10.9.0-debian13_amd64.deb
Debian 13 (ARM64)	lemonade-server_10.9.0-debian13_arm64.deb
Fedora 43 (x86_64)	lemonade-server-10.9.0-fc43.x86_64.rpm
Fedora 43 (ARM64)	lemonade-server-10.9.0-fc43.aarch64.rpm
Fedora 44 (x86_64)	lemonade-server-10.9.0-fc44.x86_64.rpm
Fedora 44 (ARM64)	lemonade-server-10.9.0-fc44.aarch64.rpm
macOS	Lemonade-10.9.0-Darwin.pkg

Other platforms? See our Installation Options for Docker, Snap, Arch, Debian, and more.

Embeddable Lemonade

Portable binaries for bundling into your own installer. Run lemond ./ as a subprocess.

Platform	Download
Ubuntu x64	lemonade-embeddable-10.9.0-ubuntu-x64.tar.gz
Ubuntu arm64	lemonade-embeddable-10.9.0-ubuntu-arm64.tar.gz
Windows x64	lemonade-embeddable-10.9.0-windows-x64.zip
macOS arm64	lemonade-embeddable-10.9.0-macos-arm64.tar.gz

What's Changed

Thanks @GabrielReusRodriguez, @SlawomirNowaczyk, @abn, @bitgamma, @blackdeathdrow, @bong-water-water-bong, @ckuethe, @clemperorpenguin, @eddierichter-amd, @fl0rianr, @gchriswill, @github-actions, @ianbmacdonald, @jeremyfowers, @kenvandine, @lucifer-vali, @ramkrishna2910, @sawansri, @siavashhub, @superm1, @volen-silo for your awesome contributions to this release!

Click to expand changelog

fix(packaging): don't auto-enable the per-user lemond.service (Closes #2125) by @ianbmacdonald in #2354
fix(config): accept flat backend keys like vllm_args in config set (#1824) by @ramkrishna2910 in #2394
test/ci: harden CLI endpoint suites against shared-server flakes by @fl0rianr in #2365
Lemonade cli list models with size in Gb by @GabrielReusRodriguez in #2329
Handle separate sd-cpp CUDA release pins by @fl0rianr in #2369
fix: refuse to start a second lemond when the port is already in use (#2255) by @siavashhub in #2258
Fix sd-cpp:metal install (resolve asset filename wildcard) by @jeremyfowers in #2402
Allow HTTP custom backends with warnings by @sawansri in #2370
Add comment and PR description guidelines to AGENTS.md by @superm1 in #2409
[Router] Interfaces + fixtures stub (foundation) by @ramkrishna2910 in #2408
fix: Prevent the Rosetta prompt on macOS installation by @clemperorpenguin in #2297
fix(cli): resolve option inheritance bug in launch help options by @abn in #2396
Move omni collection system prompt to per-model JSON by @ramkrishna2910 in #2395
fix: ROCm Support for RDNA2 Device Models by @gchriswill in #2410
feat: expand system stats with storage infos by @fl0rianr in #2436
test: fix whisper realtime macOS VAD flake by @abn in #2442
test: fix stale docstring and add VAD rationale comment by @bong-water-water-bong in #2447
feat(telemetry): add unified OTLP telemetry with OpenInference and OpenTelemetry GenAI support by @abn in #2330
Router/2378 2379 evaluator registry by @eddierichter-amd in #2440
test/ci: follow up on hosted Ollama tool-calling timeouts by @fl0rianr in #2399
website: Overhaul the front page by @jeremyfowers in #2427
refactor(backends): self-describing WrappedServer backends (#2287) by @jeremyfowers in #2320
Fix startup self-deadlock with a thread-local recursion guard (minimal alt to #2443) by @jeremyfowers in #2488
fix(launch): resolve npm .cmd launcher on Windows for pi and codex by @jeremyfowers in #2489
Fix three broken doc links found by zensical by @lucifer-vali in #2486
Enable vLLM + Messages API and per model family vLLM args by @sawansri in #2143
[Router] 2381 unified interface for semantic_similarity and model classifier by @SlawomirNowaczyk in #2483
Fix flaky Ollama tool-calling CI by disabling default thinking for tool requests by @fl0rianr in #2485
Merge release-v10.8.1 back to main for proper release tag handling by @kenvandine in #2493
fix(backends): fallback to installed backend when offline by @fl0rianr in #2393
Fix (#2412) : Added offline check before pulling a model on server.cpp by @GabrielReusRodriguez in #2434
Add arm64 builds to all Linux release packages and PPA by @kenvandine in #2430
fix(rocm): resolve backend assets to published gfx family names (#2415) by @superm1 in #2490
Add lemonade and lemond options to bug report template by @ckuethe in #2444
add per-architecture options by @bitgamma in #2496
Publish rolling :edge and immutable :sha- container images on merge to main by @siavashhub in #2397
Detect externally-installed ROCm before downloading TheRock by @volen-silo in #2498
docs(release): add step to reconcile release tag into main by @jeremyfowers in #2504
fix(server): recover stalled HF model downloads by @fl0rianr in #2421
[Router] Deterministic conditions: keywords / regex / min_chars / has_* / metadata (M4, #2380) by @ramkrishna2910 in #2491
fix(packaging): strip lemonade-tray from RPM by @lucifer-vali in #2484
Update stable-diffusion.cpp to master-721-8caa3f9 and CUDA master-726-db48014 by @github-actions[bot] in #2477
feat: detect HuggingFace model updates and show Update button in web UI by @blackdeathdrow in #2243
docs: list ARM64 Linux release artifacts left out by #2430 by @jeremyfowers in #2505
chore(release): bump version to v10.9.0 by @jeremyfowers in #2506
feat(models): add RPG-HaloTales-V1 omni collection by @jeremyfowers in #2509
Fix: Update CUDA version for llama.cpp by @fl0rianr in #2507

New Contributors

@gchriswill made their first contribution in #2410
@bong-water-water-bong made their first contribution in #2447
@SlawomirNowaczyk made their first contribution in #2483
@volen-silo made their first contribution in #2498

Full Changelog: v10.8.1...v10.9.0

Windows installers are signed. Free code signing provided by SignPath.io, certificate by SignPath Foundation. See our Code Signing Policy.