TL;DR
Changes to SQL
- Document chunk handling has been improved, allowing for smoother data processing.
- Fixed use of caching in SQL Agent with Amazon S3 for optimized caching operations.
- Disabled the default project from getting dropped, ensuring important data isn't lost by mistake.
- Introduced a default LIMIT of 10 and a maximum LIMIT of 100 in WHERE clauses, improving query efficiency.
- The 'reranking_threshold' has been renamed to 'relevance_threshold' for improved clarity and ease of understanding.
Changes to Integrations
- Updated the AWS metadata method for better performance with AWS pipelines.
- Improved querying of embeddings from chromadb, offering more effective database interactions.
- Fixed the update of Knowledge Bases by chunk_id, allowing for efficient data updates.
Changes to Knowledge Bases
- Knowledge Base documentation has been updated, offering improved clarity and more detailed guidance.
- Unit test handlers have been improved, making it easier to carry out testing and identify issues more quickly.
- Query partitioning now uses ThreadPoolExecutor, resulting in better use of system resources.
- A default limit in Knowledge Base controller has been introduced to enhance the performance of Knowledge Base operations.
Changes to Documentation
- Updated documentation to include details for JSON file, offering users more comprehensive information.
Bug Fixes and Improvements
- The 'reranking_threshold' default has been changed to 0, offering optimized performance in scenarios where reranking isn't required.
What's Changed
- improve document chunk handling. by @dusvyat in #10690
- kb docs updates by @martyna-mindsdb in #10696
- Changed the reranking_threshold default to 0 by @ala12326571 in #10698
- docs for json file by @martyna-mindsdb in #10700
- Unit tests handlers by @ZoranPandovski in #10687
- Fixed Use of Caching in SQL Agent with Amazon S3 by @MinuraPunchihewa in #10644
- Disabled the Default Project from Getting Dropped by @MinuraPunchihewa in #10701
- Added default LIMIT of 10 and max LIMIt of 100 when there is WHERE co… by @ala12326571 in #10705
- Changed the reranking_threshold to relevance_threshold by @ala12326571 in #10710
- Update AWS metadata method by @hamishfagg in #10711
- Fix update KB by chunk_id by @ea-rus in #10704
- Query partitioning: use ThreadPoolExecutor by @ea-rus in #10694
- fixed querying embeddings from chromadb by @martyna-mindsdb in #10703
- Default limit in KB controller by @ea-rus in #10715
Full Changelog: v25.4.2.1...v25.4.3.0