github jundot/omlx v0.1.8
oMLX v0.1.8

latest releases: v0.3.8, v0.3.8rc1, v0.3.8rc2...
2 months ago

Highlights

Per-model chat_template_kwargs support

You can now configure chat_template_kwargs per model directly from the admin settings panel. This means you can freely adjust reasoning effort for gpt-oss models, toggle enable_thinking true/false for the new Qwen 3.5 models, and more — all without touching config files or restarting the server. Get the most out of your MLX models with just a few clicks.

chat_template_kwargs settings

What's New

Features

  • Add per-model and per-request chat_template_kwargs support
  • Show chat_template_kwargs badges in model list
  • Add Homebrew formula for CLI installation (#38)

Don't miss a new omlx release

NewReleases is sending notifications on new releases.