github unslothai/unsloth v0.1.910-beta
MOSS-Image, Flint & NVIDIA Bolt E4B
on GitHub

5 hours ago

Recursive's Flint, MOSS-Image and NVIDIA's Nemotron Bolt 4B are here! Run them locally in Unsloth. Also new: a chat-only Unsloth Desktop install, MLX MoE models bigger than your Mac's memory and an OpenAI-compatible fine-tuning API.

Highlights

  • Bigger MoE models on Mac: MLX MoE models too big for memory keep experts on SSD, so Qwen3.8-Flash-Next runs on a 32 GB Mac.
  • Chat-only install: a much smaller Unsloth Desktop for GGUF chat; add training later in Settings.
  • Flint: Recursive's 40B coding-agent MoE, runs in 24 GB at 3-bit Guide
  • MOSS-Image: 5.1B image model designed for top-tier generation GGUF + FP8
  • NVIDIA Nemotron 3.5 Bolt E4B: NVIDIA's new Gemma 4 E4B fine-tune, 63.2 on Tau2-Bench vs the original's 38.7 Guide
  • MoE expert pruning: Export a smaller MoE model by removing 25% or 50% of its least useful experts with REAP.
  • UI overhaul: More consistent UI across Unsloth

Images + video

  • Generate images containing English or Chinese text with OpenMOSS's 5.1B MOSS-Image, SFT or Base. GGUF · Base GGUF
  • MOSS-Image, the new image model, runs on 16 GB GPUs; its GGUFs also run on Macs and computers without a supported GPU.
  • Most image and video models too big for one GPU now split across your NVIDIA GPUs, if they fit, instead of streaming from system memory.
  • The new Hires fix upscales and refines a render in one step on SDXL, FLUX.1, Qwen-Image and Z-Image.
  • The new Compare grid renders one prompt while varying up to three settings, such as seed, CFG or LoRA weight, in labelled grids.
  • SDXL safetensors get AUTOMATIC1111-style prompt weighting, CLIP skip, CFG rescale, variation seeds and textual inversion.
  • Pasted AUTOMATIC1111, Forge or Civitai parameter blocks fill in the Images page settings.
  • If SAM 3 isn't already downloaded, the Mask from text tool now uses SAM 3.1: smaller, with no Hugging Face login.

Chat + Desktop

  • Pick Chat only (GGUF) when first launching Unsloth Desktop for a much smaller install; add training later in Settings.
  • Settings > Chat now lets you view, edit, clear or turn off the memory notes Unsloth sends to every chat.
  • In document-search chats, Show passages lists the exact text the model got and opens each passage at its page.
  • The Audio page can speak and transcribe via a saved API connection, such as OpenAI or a local server.
  • Unsloth installs, updates and pip install -U unsloth now reject eMudhra's compromised emSign certificates, which let attackers impersonate websites. The optional vLLM and SGLang engines still trust them.

Flint

  • Run Recursive's Flint, a 40B MoE model with 2.5B active parameters for coding agents, with reasoning, tool use and 256K context. Guide · GGUF
  • At 3-bit, Flint fits in 24 GB at short contexts.
  • On SWE-bench Pro v2, Flint scores 89.7 vs Qwen 3.6's 73.8.

NVIDIA Nemotron 3.5 Bolt E4B

  • Run and fine-tune NVIDIA's Gemma Nemotron 4B, a Gemma 4 E4B reasoning tune for tool calling and instruction following.
  • Gemma Nemotron 4B beats Gemma 4 E4B on 16 of 21 NVIDIA tests, gaining most in tool use and multi-turn chat.
  • DPO on Gemma 4 E2B and E4B, including Gemma Nemotron 4B, no longer crashes.

Training

  • Fine-tuning Whisper, Canary, Moonshine, Dia and CTC speech models with FastModel no longer fails.
  • Parakeet, Canary and CTC speech training uses up to 55% less memory.
  • The new Books & Documents to Text recipe in Data Recipes turns ebooks and documents into a pretraining text dataset, no model needed.
  • On Windows and Linux, the Export page can now prune 25% or 50% of a MoE model's least useful experts with REAP, at some quality cost.
  • In Python, reap_prune runs REAP expert pruning up to 54x faster than llm-compressor's.
  • unsloth train now trains vision and, except on Mac, audio models.
  • Unsloth now supports OpenAI's fine-tuning API, so OpenAI's SDK can upload datasets and run supervised fine-tuning of local models.

Performance

  • MLX MoE models too big for your Mac keep experts on SSD, with slower replies. Qwen3.8-Flash-Next fits a 32 GB Mac; DeepSeek-V4-Flash and GLM-5.3-Flash need far less memory than their size.
  • DPO and other training that pads sequences runs up to 3.8x faster with less memory on NVIDIA Ampere or newer.
  • Qwen3-MoE, Gemma 3 and Gemma 4 training on GPUs without bf16 now uses up to 7x less attention memory with torch 2.13 or older.

Coding agents + API

  • In chat, models can now read text files and documents on connected MCP servers, not just use their tools.
  • When launching coding agents, unsloth start no longer sends its Unsloth API key in plain text through your HTTP proxy to a local Unsloth.
  • On Windows, unsloth start no longer breaks Claude Code hooks or Codex sign-in when launching them.
  • Requests with an Unsloth API key can no longer run Python and terminal tools unsandboxed; only the Unsloth UI can allow that.
  • The new Save for this model button in Chat settings makes your sampling settings that model's default for new chats and API requests.

Models + hardware

  • A BF16 gpt-oss checkpoint loaded with load_in_4bit = True no longer gets random expert and router weights.
  • The model picker again lets you run models on Ryzen AI 300-series and newer NPUs, with no environment variable.
  • On some Linux AMD PCs with a system-wide ROCm, GGUFs that ran on the CPU now run on the GPU again.

Download Unsloth Desktop

Unsloth Desktop is free and open source. Download it for:

Platform Link
Windows Download
macOS Download
Linux x64 / Ubuntu (deb) Download
Linux ARM64 / Ubuntu 24.04+ (deb) Download
Linux x64 (AppImage) Download
Windows ARM64 Download

What's Changed

New Contributors

Full Changelog: v0.1.909-beta...v0.1.910-beta

Check out latest releases or
releases around unslothai/unsloth v0.1.910-beta

Don't miss a new unsloth release

NewReleases is sending notifications on new releases.

Get notifications