v2.3.2
Release date: Oct 26, 2023
| Milvus version | Python SDK version | Java SDK version | Go SDK version | Node.js SDK version |
|---|---|---|---|---|
| 2.3.2 | 2.3.2 | 2.3.2 | 2.3.2 | 2.3.3 |
We're thrilled to unveil Milvus 2.3.2, enriched with an array of novel features. Experience support for array data types, delve into intricate delete expressions, and celebrate the return of binary metric types such as SUBSTRUCTURE/SUPERSTRUCTURE.
This release promises enhanced performance through minimized data copying during loading and better bulk insertions. Coupled with heightened error messaging and handling, you're in for a smoother experience. Notably, our commitment to rolling upgrade stability ensures minimized service disruptions during updates.
Breaking Changes
New Features
- Array datatype now supported (#26369)
- Introduced complex delete expressions (#25752)
- Reintroduced binary metric types SUBSTRUCTURE/SUPERSTRUCTURE (#26766)
- Vector index mmap now available (#26750)
- CDC: Added capability to replicate mq messages (#27240)
- Facilitated renaming of database names within collections (#26543)
- Activated bulk insert of binlog data with partition keys (#27241)
- Enhanced support for multiple index engines (#27178)
- Introduced chunk cache to fetch raw vectors:
- Newly added ChunkCache facilitates vector retrieval from storage (#26142)
- Implemented Tikv as a distributed meta solution:
- Integrated Tikv (#26246)
- Rolled out float16 vector support (#25852)
Note: Index for float16 vector coming in the next version - Restful updates:
Performance Enhancements
- Optimized data loading by minimizing data copy operations (#26746)
- Streamlined bulk inserts with batched varchar reading (#26199)
- Improved handling of large structs using pointer receivers (#26668)
- Removed unnecessary offset checks during data fills (#26666)
- Addressed high CPU consumption linked to proto.size (#27054)
- Optimized scalar column data with MADV_WILLNEED (#27170)
Additional Enhancements
- Robust rolling upgrade capabilities:
- Significant improvement in system availability during rolling upgrades, ensuring minimal service interruptions.
- Upgraded error messaging and handling for a seamless experience.
- Optimized flushing processes:
- Addressed issues where delete commands weren't being saved during flush operations.
- Resolved slow flush-related issues.
- Segregated task queues for Flush and DDL to prevent mutual blockages.
- Improved RocksMQ seek speeds (#27646) and standalone recovery times.
- Streamlined compact tasks (#27899)
- Added a channel manager in DataNode (#27308)
- Refined chunk management:
- Integrated grpc compression (#27894)
- Decoupled client-server API interfaces (#27186)
- Transitioned etcd watch-related code to event manager (#27192)
- Displayed index details during GetSegmentInfo (#26981)
Bug Fixes
- Resolved concurrent string parsing expression issues (#26721)
- Fixed connection issues with Kafka under SASL_SSL (#26617)
- Implemented error responses for yet-to-be-implemented APIs, replacing panic reactions (#26589)
- Addressed data race concerns:
- Mended partition garbage collection issues (#27816).
- Rectified SIGSEGV errors encountered when operating within gdb (#27736).
- Addressed thread safety issues in glog for standalone mode (#27703).
- Fixed instances where segments were inadvertently retained post-task cancellations (#26685).
- Resolved loading failures for collections exceeding 128 partitions (#26763).
- Ensured compatibility with scalar index types such as marisa-trie and Ascending (#27638).
- Corrected issues causing retrieval to sometimes exceed specified result limits (#26670).
- Solved startup failures in rootcoord due to role number limits (#27361).
- Patched Kafka consumer connection leaks (#27224).
- Disabled the enlarging of indices for flat structures (#27309).
- Updated garbage collector to fetch metadata post-storage listing (#27203).
- Fixed instances of datanode crashes stemming from simultaneous compaction and delete processes (#27167).
- Ironed out issues related to concurrent load logic in querynodev2 (#26959).