I'm happy to announce the v2.12.0 LocalAI release is out!

🌠 Landing page and Swagger

Ever wondered what to do after LocalAI is up and running? Integration with a simple web interface has been started, and you can see now a landing page when hitting the LocalAI front page:

You can also now enjoy Swagger to try out the API calls directly:

🌈 AIO images changes

Now the default model for CPU images is https://huggingface.co/NousResearch/Hermes-2-Pro-Mistral-7B-GGUF - pre-configured for functions and tools API support!
If you are an Intel-GPU owner, the Intel profile for AIO images is now available too!

🚀 OpenVINO and transformers enhancements

Now there is support for OpenVINO and transformers got token streaming support now thanks to @fakezeta!

To try OpenVINO, you can use the example available in the documentation: https://localai.io/features/text-generation/#examples

🎈 Lot of small improvements behind the scenes!

Thanks for our outstanding community, we have enhanced several areas:

• The build time of LocalAI was speed up significantly! thanks to @cryptk for the efforts in enhancing the build system
• @thiner worked hardly to get Vision support for AutoGPTQ
• ... and much more! see down below for a full list, be sure to star LocalAI and give it a try!

📣 Spread the word!

First off, a massive thank you (again!) to each and every one of you who've chipped in to squash bugs and suggest cool new features for LocalAI. Your help, kind words, and brilliant ideas are truly appreciated - more than words can say!

And to those of you who've been heros, giving up your own time to help out fellow users on Discord and in our repo, you're absolutely amazing. We couldn't have asked for a better community.

Just so you know, LocalAI doesn't have the luxury of big corporate sponsors behind it. It's all us, folks. So, if you've found value in what we're building together and want to keep the momentum going, consider showing your support. A little shoutout on your favorite social platforms using @LocalAI_OSS and @mudler_it or joining our sponsors can make a big difference.

Also, if you haven't yet joined our Discord, come on over! Here's the link: https://discord.gg/uJAeKSAGDy

Every bit of support, every mention, and every star adds up and helps us keep this ship sailing. Let's keep making LocalAI awesome together!

Thanks a ton, and here's to more exciting times ahead with LocalAI!

What's Changed

Bug fixes 🐛

• fix: downgrade torch by @mudler in #1902
• fix(aio): correctly detect intel systems by @mudler in #1931
• fix(swagger): do not specify a host by @mudler in #1930
• fix(tools): correctly render tools response in templates by @mudler in #1932
• fix(grammar): respect JSONmode and grammar from user input by @mudler in #1935
• fix(hermes-2-pro-mistral): add stopword for toolcall by @mudler in #1939
• fix(functions): respect when selected from string by @mudler in #1940
• fix: use exec in entrypoint scripts to fix signal handling by @cryptk in #1943
• fix(hermes-2-pro-mistral): correct stopwords by @mudler in #1947
• fix(welcome): stable model list by @mudler in #1949
• fix(ci): manually tag latest images by @mudler in #1948
• fix(seed): generate random seed per-request if -1 is set by @mudler in #1952
• fix regression #1971 by @fakezeta in #1972

Exciting New Features 🎉

• feat(aio): add intel profile by @mudler in #1901
• Enhance autogptq backend to support VL models by @thiner in #1860
• feat(assistant): Assistant and AssistantFiles api by @christ66 in #1803
• feat: Openvino runtime for transformer backend and streaming support for Openvino and CUDA by @fakezeta in #1892
• feat: Token Stream support for Transformer, fix: missing package for OpenVINO by @fakezeta in #1908
• feat(welcome): add simple welcome page by @mudler in #1912
• fix(build): better CI logging and correct some build failure modes in Makefile by @cryptk in #1899
• feat(webui): add partials, show backends associated to models by @mudler in #1922
• feat(swagger): Add swagger API doc by @mudler in #1926
• feat(build): adjust number of parallel make jobs by @cryptk in #1915
• feat(swagger): update by @mudler in #1929
• feat: first pass at improving logging by @cryptk in #1956
• fix(llama.cpp): set better defaults for llama.cpp by @mudler in #1961

📖 Documentation and examples

• docs(aio-usage): update docs to show examples by @mudler in #1921

👒 Dependencies

• ⬆️ Update docs version mudler/LocalAI by @localai-bot in #1903
• ⬆️ Update ggerganov/llama.cpp by @localai-bot in #1904
• ⬆️ Update M0Rf30/go-tiny-dream by @M0Rf30 in #1911
• ⬆️ Update ggerganov/llama.cpp by @localai-bot in #1913
• ⬆️ Update ggerganov/whisper.cpp by @localai-bot in #1914
• ⬆️ Update ggerganov/llama.cpp by @localai-bot in #1923
• ⬆️ Update ggerganov/whisper.cpp by @localai-bot in #1924
• ⬆️ Update ggerganov/llama.cpp by @localai-bot in #1928
• ⬆️ Update ggerganov/whisper.cpp by @localai-bot in #1933
• ⬆️ Update ggerganov/llama.cpp by @localai-bot in #1934
• ⬆️ Update ggerganov/llama.cpp by @localai-bot in #1937
• ⬆️ Update ggerganov/llama.cpp by @localai-bot in #1941
• ⬆️ Update ggerganov/llama.cpp by @localai-bot in #1953
• ⬆️ Update ggerganov/whisper.cpp by @localai-bot in #1958
• ⬆️ Update ggerganov/llama.cpp by @localai-bot in #1959
• ⬆️ Update ggerganov/llama.cpp by @localai-bot in #1964

Other Changes

• ⬆️ Update ggerganov/whisper.cpp by @localai-bot in #1927
• ⬆️ Update ggerganov/llama.cpp by @localai-bot in #1960
• fix(hermes-2-pro-mistral): correct dashes in template to suppress newlines by @mudler in #1966
• ⬆️ Update ggerganov/whisper.cpp by @localai-bot in #1969
• ⬆️ Update ggerganov/llama.cpp by @localai-bot in #1970
• ⬆️ Update ggerganov/llama.cpp by @localai-bot in #1973

New Contributors

• @thiner made their first contribution in #1860

Full Changelog: v2.11.0...v2.12.0