A BIG update incoming!

• A more robust indexing module is introduced. Partitioned indexing can handle extremely large vaults now!
• LM Studio has been added as an embedding provider, it's lightning-fast!
• A "Verify Connection" button is added when you add a Custom Model, so you can check if it works before you add it! (This was first implemented by @Emt-lin, updated by @logancyang)

Check out the details below!

Improvements

• Big upgrade of indexing logic to have a more robust UX
• Enable incremental indexing. Now "refresh index" respects inclusion/exclusion filters
• Implement partitioning logic for large vaults

• Inclusion filters no longer eclipses exclusion filters.
• Add Stop indexing button

• Add the "Remove files from Copilot index" command that takes in the same list format from "List indexed files"

• Add confirmation modal for actions in settings that lead to reindexing

• Add LM Studio to embedding providers

• Add Verify Connection button for adding custom models.

• Update the max sources setting to 30 per user request. Be warned: a large number of sources may lead to bad answer quality with weaker chat models

• Add metadata to context, now you can directly ask "what files did i create/modified in (time period)"

Bug Fixes

• Fix safeFetch for 3rd party API with CORS on, including moonshot API and perplexity API, etc.
• Fix time-based queries for some special cases