Version 2.17.0.0 Release Notes
Compatible with OpenSearch 2.17.0
Features
- Integrate Lucene Vector field with native engines to use KNNVectorFormat during segment creation #1945
- k-NN query rescore support for native engines #1984
- Add support for byte vector with Faiss Engine HNSW algorithm #1823
- Add support for byte vector with Faiss Engine IVF algorithm #2002
- Add mode/compression configuration support for disk-based vector search #2034
- Add spaceType as a top level optional parameter while creating vector field. #2044
Enhancements
- Adds iterative graph build capability into a faiss index to improve the memory footprint during indexing and Integrates KNNVectorsFormat for native engines#1950
- Add model version to model metadata and change model metadata reads to be from cluster metadata #2005
Bug Fixes
- Corrected search logic for scenario with non-existent fields in filter #1874
- Add script_fields context to KNNAllowlist [#1917] (#1917)
- Fix graph merge stats size calculation #1844
- Disallow a vector field to have an invalid character for a physical file name. #1936
- Fix memory overflow caused by cache behavior #2015
- Use correct type for binary vector in ivf training #2086
- Switch MINGW32 to MINGW64 #2090
Infrastructure
Maintenance
- Fix a flaky unit test:testMultiFieldsKnnIndex, which was failing due to inconsistent merge behaviors #1924
Refactoring
- Introduce KNNVectorValues interface to iterate on different types of Vector values during indexing and search #1897
- Integrate KNNVectorValues with vector ANN Search flow #1952
- Clean up parsing for query #1824
- Refactor engine package structure #1913
- Refactor method structure and definitions #1920
- Refactor KNNVectorFieldType from KNNVectorFieldMapper to a separate class for better readability. #1931
- Generalize lib interface to return context objects #1925
- Restructure mappers to better handle null cases and avoid branching in parsing #1939
- Added Quantization Framework and implemented 1Bit and multibit quantizer#1889
- Encapsulate dimension, vector data type validation/processing inside Library #1957
- Add quantization state cache #1960
- Add quantization state reader and writer #1997