milvus-io/milvus v2.0.0-rc5

milvus-2.0.0-rc5

on GitHub

Release date: 2021-08-30

Compatibility

Milvus 2.0.0-RC5 is a preview version of Milvus 2.0.0. It supports message queue data retention mechanism and etcd data cleanup, exposes cluster metrics through API, and prepares for delete operation support. RC5 also made great progress on system stability. We fixed a series of resource leakage, operation hang and the misconfiguration of standalone Pulsar under Milvus cluster.

Improvements

• #7226 Refactors data coord allocator.
• #6867 Adds connection manager.
• #7172 Adds a seal policy to restrict the lifetime of a segment.
• #7163 Increases the timeout for gRPC connection when creating index.
• #6996 Adds a minimum interval for segment flush.
• #6590 Saves binlog path in SegmentInfo.
• #6848 Removes RetrieveRequest and RetrieveTask.
• #7102 Supports vector field as output.
• #7075 Refactors NewEtcdKV API.
• #6965 Adds channel for data node to watch etcd.
• #7066 Optimizes search reduce logics.
• #6993 Enhances the log when parsing gRPC recv/send parameters.
• #7331 Changes context to correct package.
• #7278 Enables etcd auto compaction for every 1000 revision.
• #7355 Clean fmt.Println in util/flowgraph.

Features

• #7112 #7174 Imports an embedded etcdKV (part 1).
• #7231 Adds a segment filter interface.
• #7157 Exposes metrics of index coord and index nodes.
• #7137 #7157 Exposes system topology information by proxy.
• #7113 #7157 Exposes metrics of query coord and query nodes.
• #7134 Allows users to get vectors using memory instead of local storage.
• #6617 Supports retention for rocksmq.
• #7303 Adds query node segment filter.
• #7304 Adds delete API into proto.
• #7261 Adds delete node.
• #7268 Constructs Bloom filter when inserting.

Bug Fixes

• #7272 #7352 #7335 Failure to start new docker container with existing volumes if index was created: proxy is not healthy.
• #7243 Failure to create index in a new version of Milvus for data that were inserted in an old version.
• #7253 Search gets empty results after releasing a different partition.
• #7244 #7227 Proxy crashes when receiving empty search results.
• #7203 Connection gets stuck when gRPC server is down.
• #7188 Incomplete unit test logics.
• #7175 Unspecific error message returns when calculating distances using collection IDs without loading.
• #7151 Data node flowgraph does not close caused by missing DropCollection.
• #7167 Failure to load IVF_FLAT index.
• #7123 Timestamp go back for timeticksync.
• #7140 calc_distance returns wrong results for binary vectors when using TANIMOTO metrics.
• #7143 The state of memory and etcd is inconsistent if KV operation fails.
• #7141 #7136 Index building gets stuck when the index node pod is frequently killed and pulled up.
• #7119 Pulsar msgStream may get stuck when subscribed with the same topic and sub name.
• #6971 Exception occurs when searching with index (HNSW).
• #7104 Search gets stuck if query nodes only load sealed segment without watching insert channels.
• #7085 Segments do not auto flush.
• #7074 Index nodes wait for index coord to start to complete.
• #7061 Segment allocation does not expire if data coord does not receive timetick message from data node.
• #7059 Query nodes get producer leakage.
• #7005 Query nodes do not return error to query coord when loadSegmentInternal fails.
• #7054 Query nodes return incorrect IDs when topk is larger than row_num.
• #7053 Incomplete allocation logics.
• #7044 Lack of check on unindexed vectors in memory before retriving vectors in local storage.
• #6862 Memory leaks in flush cache of data node.
• #7346 Query coord container exited in less than 1 minute when re-installing Milvus cluster.
• #7339 Incorrect expression boundary.
• #7311 Collection nil when adding query collection.
• #7266 Flowgraph released incorrectly.
• #7310 Excessive timeout when searching after releasing and loading a partition.
• #7320 Port conflicts between embedded etcd and external etcd.
• #7336 Data node corner cases.