AnythingLLM v1.8.3 is live

Notable Changes

Mobile support

Now, currently under Experimental features, you can connect the AnythingLLM Mobile App - Android Beta to your instance to seamlessly blend an on-device and off-device experience. Leverage your instance Agent Skills and flows all within a single unified interface!

Chat with documents has been overhauled

When we first built AnythingLLM, the average context window was 4K - hardly anything to fit a full document. So we decided to always be RAG first. This has its drawbacks since RAG is semantically dependent on asking questions about content in the document. This leads to poor results for "Summarize this document," only to be told by the document, "what are you talking about".

Well, now we have the best of both worlds. Documents are scoped to a workspace thread & user and we will attempt to use the full document text when possible and your model can support it. If you overflow this amount, we can then ask you to embed the document so you can unlock that long-term memory.

You can also easily manage and see your context window to remove files that are no longer relevant, but retain the conversation history.

You can also still embed files directly in the workspace file manager too :)

What's Changed

• Add model field parameter for generic OpenAI TTS by @timothycarambat in #4171
• Clear cached docs on text splitter changes by @shatfield4 in #4163
• Update BARE_METAL.md by @buraktopalyn in #4175
• run jest by @timothycarambat in #4177
• Moonshot AI LLM & agent provider by @shatfield4 in #4178
• Fix multimodal chats via openai compat api by @shatfield4 in #4135
• Native Embedder model selection (incl: Multilingual support) by @timothycarambat in #3835
• fix: correct some typos and grammatical errors in translation strings and index.jsx by @antonharder in #4195
• Modify the PostgreSQL SQL connector to support querying tables from schemas other than the default public schema. by @romanwu10 in #4202
• Fix app version metrics endpoint by @shatfield4 in #4209
• Update writeToServerDocuments to take config object by @timothycarambat in #4213
• [Chore]: sendCommand non positional call signature by @timothycarambat in #4218
• Update check for validFuncCall to only check required args and for undefined options by @timothycarambat in #4214
• fix: API export-chats endpoint function import error by @naaa760 in #4220
• STT append spoken text by @timothycarambat in #4216
• Mobile sync support by @timothycarambat in #4173
• Add custom JWT TTL by @timothycarambat in #4234
• Fix password hint text by @timothycarambat in #4235
• Update common.js Hebrew language update by @start-life in #4241
• docs(i18n): Complete missing Spanish translations by @timothycarambat in #4263
• feat: add Romanian translation by @dpvue in #4247
• Workspace Chat with documents overhaul by @timothycarambat in #4261
• feat: Add Exa as a Search Provider by @naaa760 in #4258
• Update common.js by @dpvue in #4278
• Chroma Cloud vector db provider by @shatfield4 in #4273
• Update Security UI to match all other Settings by @AshikaAnand12 in #4274

New Contributors

• @buraktopalyn made their first contribution in #4175
• @antonharder made their first contribution in #4195
• @romanwu10 made their first contribution in #4202
• @naaa760 made their first contribution in #4220
• @start-life made their first contribution in #4241
• @dpvue made their first contribution in #4247
• @AshikaAnand12 made their first contribution in #4274

Full Changelog: v1.8.4...v1.8.5