github jundot/omlx v0.1.15

latest releases: v0.3.7rc2, v0.3.7rc1, v0.3.6...
one month ago

What's New

Features

  • Persistent serving stats: All-time token usage stats now survive server restarts, saved to ~/.omlx/stats.json. Session and all-time stats are displayed separately in both the admin dashboard and menubar app. Includes confirmation dialog before clearing stats. (#51)
  • Configurable initial cache blocks: Allow setting initial_cache_blocks to control pre-allocated KV cache memory at startup. (#35)
  • Internationalization: Admin dashboard now supports English, Korean, Japanese, and Chinese with self-hosted Noto Sans CJK fonts and language-based switching. (#64, #67)
  • Claude Code mode toggle: Replace single model selector with mode (Cloud/Local) toggle and per-tier (Opus/Sonnet/Haiku) model selectors in the admin dashboard. (#66)

Bug Fixes

  • Fix build script error when using --skip-venv by using onerror callback instead of double rmtree with ignore_errors. (#65)
  • Fix Claude Code tier selectors layout to horizontal 3-column arrangement.
  • Restore scaling/target fields in Claude Code log output.

New Contributors

Thanks to @Heyjoy, @buftar, and @thornad for their contributions!

Don't miss a new omlx release

NewReleases is sending notifications on new releases.