incoai/splash 1.6.1

Splash 1.6.1

on GitHub

Engine

• Faster model startup after an update. On M5 Pro, Flash-Next’s first start dropped from over 5 minutes to 49 seconds. The app and CLI now show warm-up progress.
• Faster prefill and decode. On M5 and later, Qwen3.8-27B MLX 4-bit saw about 25% lower TTFT. Bonsai decode is also faster, and streaming experts now overlaps with compute for 8–17% faster decode on tested Flash-Next and Qwen3.6-35B configurations.
• More room for long prompts and concurrent requests. Splash keeps KV in RAM while space is available and can spill it to SSD during prefill. Flash-Next streams its 28.8 GB PLE table by default, leaving more memory for context and cache.
• More reliable serving. Slow disk reads and blocked console output no longer interrupt requests. Disconnected clients release their slots, and agents can reuse tokenizer prefixes across 16 conversations.

Mac app

• Attach PDFs in desktop or web chat. Pin chats, delete several at once, and switch models from the composer.
• Update or delete individual models, choose a local vision projector or draft, and launch coding agents in the drawer.
• Track live requests and warm-up progress on the Server screen. Supported Qwen models now offer a 1M context option.

Upgrade

• App: choose Splash → Check for Updates… or download the latest DMG.
• Homebrew: run brew update, then brew upgrade splash for the CLI or brew upgrade --cask splash-app for the app.

On M5 and later, the new default --activations auto uses INT8 on selected paths, so outputs can differ from 1.6.0. For bf16 comparisons, use --activations bf16 with a fresh --cache-dir.

Thanks to @dmkjr, @zaiyang-zhang, @jma24, @linson007, @jiiim, @janhilgard, @fishy-ops, @mperreir, @rickhuizinga, @didikrm, and @nailarch.

Detailed changes and compatibility notes · Full changelog