github mudler/LocalAI v4.3.5

4 hours ago

What's Changed

Bug fixes 🐛

  • fix: tool-call JSON leaks into content with stream+tools on tokenizer-template models (#10052) by @localai-bot in #10057
  • fix(openai): stop streaming tool-call double-emission when autoparser is active by @bozhouDev in #10055
  • fix(application): stop backend processes synchronously on shutdown by @richiejp in #10058
  • fix(functions): validate auto-detected XML tool-call names — robust glm-4.5/Hermes guard (#9722, supersedes #9940) by @localai-bot in #10059
  • fix(model): track intentional stops, stop misreading clean shutdowns as crashes by @richiejp in #10060

Exciting New Features 🎉

  • feat(reasoning): honor per-request reasoning_effort on chat completions by @localai-bot in #10082

Other Changes

  • chore: ⬆️ Update mudler/rf-detr.cpp to ecf64d7f7f20d73ebd906a983f398ed287256320 by @localai-bot in #10035
  • docs: ⬆️ update docs version mudler/LocalAI by @localai-bot in #10046
  • chore: ⬆️ Update antirez/ds4 to 22393e770ea8eb7501d8718d6f66c6374004e03f by @localai-bot in #10047
  • chore: ⬆️ Update leejet/stable-diffusion.cpp to 0e4ee04488159b81d95a9ffcd983a077fd5dcb77 by @localai-bot in #10048
  • chore: ⬆️ Update ggml-org/llama.cpp to 751ebd17a58a8a513994509214373bb9e6a3d66c by @localai-bot in #10049
  • chore: ⬆️ Update ikawrakow/ik_llama.cpp to 6eff055a0cc0e427a6849cfcb5de531b4b82d667 by @localai-bot in #10050
  • chore: ⬆️ Update ggml-org/whisper.cpp to c932729a304f7d9eb5354afa38624cfa86a780cf by @localai-bot in #10051
  • test(react-ui): cover models gallery empty-state reset flow by @Oceankj in #10019
  • test(utils): cover path verification, sanitization, and unique naming by @TLoE419 in #9978
  • chore(model gallery): 🤖 add 1 new models via gallery agent by @localai-bot in #10061
  • chore: ⬆️ Update ikawrakow/ik_llama.cpp to 8960c5ba5ee9db30ba838304373aa4dbec9f7cbd by @localai-bot in #10077
  • chore: ⬆️ Update vllm-project/vllm cu130 wheel to 0.22.0 by @localai-bot in #10079
  • chore(model-gallery): ⬆️ update checksum by @localai-bot in #10081
  • docs: ⬆️ update docs version mudler/LocalAI by @localai-bot in #10074
  • chore: ⬆️ Update mudler/rf-detr.cpp to 65c0ffcc9a9bc9dae38252f63d0417c9845a6cf7 by @localai-bot in #10075
  • chore: ⬆️ Update ggml-org/whisper.cpp to f24588a272ae8e23280d9c220536437164e6ed28 by @localai-bot in #10078

New Contributors

Full Changelog: v4.3.4...v4.3.5

Don't miss a new LocalAI release

NewReleases is sending notifications on new releases.