github mudler/LocalAI v2.14.0
on GitHub

latest releases: v2.23.0, v2.22.1, v2.22.0...
6 months ago

🚀 AIO Image Update: llama3 has landed!

We're excited to announce that our AIO image has been upgraded with the latest LLM model, llama3, enhancing our capabilities with more accurate and dynamic responses. Behind the scenes uses https://huggingface.co/NousResearch/Hermes-2-Pro-Llama-3-8B-GGUF which is ready for function call, yay!

💬 WebUI enhancements: Updates in Chat, Image Generation, and TTS

Chat TTS Image gen
chatui ttsui image

Our interfaces for Chat, Text-to-Speech (TTS), and Image Generation have finally landed. Enjoy streamlined and simple interactions thanks to the efforts of our team, led by @mudler, who have worked tirelessly to enhance your experience. The WebUI interface serves as a quick way to debug and assess models loaded in LocalAI - there is much to improve, but we have now a small, hackable interface!

🖼️ Many new models in the model gallery!

local-ai-gallery

The model gallery has received a substantial upgrade with numerous new models, including Einstein v6.1, SOVL, and several specialized Llama3 iterations. These additions are designed to cater to a broader range of tasks , making LocalAI more versatile than ever. Kudos to @mudler for spearheading these exciting updates - now you can select with a couple of click the model you like!

🛠️ Robust Fixes and Optimizations

This update brings a series of crucial bug fixes and security enhancements to ensure our platform remains secure and efficient. Special thanks to @dave-gray101, @cryptk, and @fakezeta for their diligent work in rooting out and resolving these issues 🤗

✨ OpenVINO and more

We're introducing OpenVINO acceleration, and many OpenVINO models in the gallery. You can now enjoy fast-as-hell speed on Intel CPU and GPUs. Applause to @fakezeta for the contributions!

📚 Documentation and Dependency Upgrades

We've updated our documentation and dependencies to keep you equipped with the latest tools and knowledge. These updates ensure that LocalAI remains a robust and dependable platform.

👥 A Community Effort

A special shout-out to our new contributors, @QuinnPiers and @LeonSijiaLu, who have enriched our community with their first contributions. Welcome aboard, and thank you for your dedication and fresh insights!

Each update in this release not only enhances our platform's capabilities but also ensures a safer and more user-friendly experience. We are excited to see how our users leverage these new features in their projects, freel free to hit a line on Twitter or in any other social, we'd be happy to hear how you use LocalAI!

📣 Spread the word!

First off, a massive thank you (again!) to each and every one of you who've chipped in to squash bugs and suggest cool new features for LocalAI. Your help, kind words, and brilliant ideas are truly appreciated - more than words can say!

And to those of you who've been heros, giving up your own time to help out fellow users on Discord and in our repo, you're absolutely amazing. We couldn't have asked for a better community.

Just so you know, LocalAI doesn't have the luxury of big corporate sponsors behind it. It's all us, folks. So, if you've found value in what we're building together and want to keep the momentum going, consider showing your support. A little shoutout on your favorite social platforms using @LocalAI_OSS and @mudler_it or joining our sponsors can make a big difference.

Also, if you haven't yet joined our Discord, come on over! Here's the link: https://discord.gg/uJAeKSAGDy

Every bit of support, every mention, and every star adds up and helps us keep this ship sailing. Let's keep making LocalAI awesome together!

Thanks a ton, and.. exciting times ahead with LocalAI!

What's Changed

Bug fixes 🐛

  • fix: config_file_watcher.go - root all file reads for safety by @dave-gray101 in #2144
  • fix: github bump_docs.sh regex to drop emoji and other text by @dave-gray101 in #2180
  • fix: undefined symbol: iJIT_NotifyEvent in import torch ##2153 by @fakezeta in #2179
  • fix: security scanner warning noise: error handlers part 2 by @dave-gray101 in #2145
  • fix: ensure GNUMake jobserver is passed through to whisper.cpp build by @cryptk in #2187
  • fix: bring everything onto the same GRPC version to fix tests by @cryptk in #2199

Exciting New Features 🎉

  • feat(gallery): display job status also during navigation by @mudler in #2151
  • feat: cleanup Dockerfile and make final image a little smaller by @cryptk in #2146
  • fix: swap to WHISPER_CUDA per deprecation message from whisper.cpp by @cryptk in #2170
  • feat: only keep the build artifacts from the grpc build by @cryptk in #2172
  • feat(gallery): support model deletion by @mudler in #2173
  • refactor(application): introduce application global state by @dave-gray101 in #2072
  • feat: organize Dockerfile into distinct sections by @cryptk in #2181
  • feat: OpenVINO acceleration for embeddings in transformer backend by @fakezeta in #2190
  • chore: update go-stablediffusion to latest commit with Make jobserver fix by @cryptk in #2197
  • feat: user defined inference device for CUDA and OpenVINO by @fakezeta in #2212
  • feat(ux): Add chat, tts, and image-gen pages to the WebUI by @mudler in #2222
  • feat(aio): switch to llama3-based for LLM by @mudler in #2225
  • feat(ui): support multilineand style ul by @mudler in #2226

🧠 Models

📖 Documentation and examples

👒 Dependencies

Other Changes

New Contributors

Full Changelog: v2.13.0...v2.14.0

Check out latest releases or
releases around mudler/LocalAI v2.14.0

Don't miss a new LocalAI release

NewReleases is sending notifications on new releases.

Get notifications