github unslothai/unsloth v0.1.2-beta
First Release post Unsloth Studio!

3 hours ago

Hey guys, this is our first release since we launched Unsloth Studio last week. From now on you can directly access all our updates through our changelog here: https://unsloth.ai/docs/new/changelog

You can now update Unsloth Studio! Just use: unsloth studio update. Please update to use all the newest fixes and features.

  • Tool calling improved. Better llama.cpp parsing, no raw tool markup in chat, faster inference, a new Tool Outputs panel, timers.
  • Windows CPU or GPU now works seamlessly. Please reinstall!
  • App shortcuts. Once installed, you can now launch in Windows, MacOS and Linux via a shortcut icon in the Start / Launch and Desktop.
  • Pre-compiled llama.cpp binaries and mamba_ssm for finetuning - 6x faster installs! Also <300MB in size for binaries.
  • 50% reduced installation sizes (-7GB or more savings), 2x faster installs and faster resolving. 50% smaller pypi sizes.
  • Colab with free T4 GPUs with Unsloth Studio now fixed! Try it here. Due to pre-compiled binaries, it's also 20x faster!
  • You can now properly use old GGUFs from Hugging Face or LM Studio
  • MacOS and CPU now have Data Recipes enabled with multi-file uploading.
  • AMD support preliminary for Linux only machines - auto detects.
  • Settings sidebar redesign. Settings are now grouped into Model, Sampling, Tools, and Preferences
  • Context length now adjustable. Keep in mind this is not needed as llama.cpp smartly uses the exact context you need via --fit on
  • Persistent system prompts and presets. Custom system prompts and chat presets now persist across reloads and page changes.
  • Multi-file upload. Data recipes now support multiple drag-and-drop uploads for PDF, DOCX, TXT, and MD, with backend extraction, saved uploads, and improved previews.
  • Better chat observability. Studio now shows llama-server timings and usage, a context-window usage bar, and richer source hover cards.
  • Better UX overall - clickable links, better LaTeX parsing, tool / code / web tooltips for default cards and much more!
  • LiteLLM - Unsloth Studio and Unsloth were NOT affected by the recent LiteLLM compromise. Nemo Data Designer used LiteLLM only up to 1.80, not the affected 1.82.7 or 1.82.8, and has since removed it entirely.
  • We now have a new one line install command, just run: Copycurl -fsSL https://unsloth.ai/install.sh | sh

Fixes:

  • Windows/setup improvements. Fixed silent Windows exits, Anaconda/conda-forge startup crashes, broken non-NVIDIA Windows installs, and missing early CUDA/stale-venv setup checks.
  • System prompts fixed. They work again for non-GGUF text and vision inference.
  • GGUF export expanded. Full fine-tunes, not just LoRA/PEFT, can now export to GGUF. Base model resolution is more reliable, and unsupported export options are disabled in the UI.
  • Chat scroll/layout fixes. Fixed scroll-position issues during generation, thinking-panel layout shift, and viewport jumps when collapsing reasoning panels.
  • Smarter port conflict detection. Studio now detects loopback conflicts, can identify the blocking process when possible, and gives clearer fallback-port messages.

Example of automatic parameter settings for context length etc:

super.final.mp4

What's Changed

New Contributors

Full Changelog: b8475...v0.1.2-beta

Don't miss a new unsloth release

NewReleases is sending notifications on new releases.