1.8.0 (2024-03-03)

Features

• Local LLM & external provider support for AI Assistant (769b730)

Local LLM support

QuickAdd now supports multiple providers for LLMs.
The only requirement is that they are OpenAI-compatible, which means their API should be similar to OpenAIs.

Here are a few providers that are known to work with QuickAdd:

• OpenAI
• TogetherAI
• Groq
• Ollama (local)

I've added a guide on the official docs, including how to use local LLMs.