milvus-io/milvus v2.0.0-rc4

milvus-2.0.0-rc4

on GitHub

Release date: 2021-08-13

Compatibility

Milvus 2.0.0-RC4 is a preview version of Milvus 2.0.0. It mainly focuses on fixing stability issues, it also offers functionalities to retrieve vector data from object storage and specify output field by wildcard matching.

Improvements

• #6984 #6772 #6704 #6652 #6536 #6522 Unit test improvements.

• #6859 Increases the MaxCallRecvMsgSize and MaxCallSendMsgSize of gRPC client.

• #6796 Fixes MsgStream exponential retry.

• #6897 #6899 #6681 #6766 #6768 #6597 #6501 #6477 #6478 #6935 #6871 #6671 #6682 Log improvements.

• #6440 Refactors segment manager.

• #6421 Splits raw vectors to several smaller binlog files when creating index.

• #6466 Separates the idea of query and search.

• #6505 Changes output_fields to out_fields_id for RetrieveRequest.

• #6427 Refactors the logic of assigning tasks in index coord.

• #6529 #6599 Refactors the snapshot of timestamp statistics.

• #6692 #6343 Shows/Describes collections/partitions with created timestamps.

• #6629 Adds the WatchWithVersion interface for etcdKV.

• #6666 Refactors expression executor to use single bitsets.

• #6664 Auto creates new segments when allocating rows that exceeds the maximum number of rows per segment.

• #6786 Refactors RangeExpr and CompareExpr.

• #6497 Looses the lower limit of dimension when searching on a binary vector field.

Features

• #6706 Supports reading vectors from disk.

• #6299 #6598 Supports query vector field.

• #5210 Extends the grammar of Boolean expressions.

• #6411 #6650 Supports wildcards and wildcard matching on search/query output fields.

• #6464 Adds a vector chunk manager to support vector file local storage.

• #6701 Supports data persistence with docker compose deployments.

• #6767 Adds a Grafana dashboard .json file for Milvus.

Bug fixes

• #5443 CalcDistance returns wrong results when fetching vectors from collection.

• #7004 Pulsar consumer causes goroutine leakage.

• #6946 Data race occurs when a flow graph close() immediately after start().

• #6903 Uses proto marshal instead of marshalTextString in querycoord to avoid crash triggered by unknown field name crash.

• #6374 #6849 Load collection failure.

• #6977 Search returns wrong limit after a partition or collection is dropped.

• #6515 #6567 #6552 #6483 Data node BackGroundGC does not work and causes memory leak.

• #6943 The MinioKV GetObject method does not close client and causes goroutine leaking per call.

• #6370 Search is stuck due to wrong semantics offered by load partition.

• #6831 Data node crashes in meta service.

• #6469 Search binary results are wrong with metrics of Hamming when limit (topK) is bigger than the quantity of inserted entities.

• #6693 Timeout caused by segment race condition.

• #6097 Load hangs after frequently restarting query node within a short period of time.

• #6464 Data sorter edge cases.

• #6419 Milvus crashes when inserting empty vectors.

• #6477 Different components repeatedly create buckets in MinIO.

• #6377 Query results get incorrect global sealed segments from etcd.

• #6499 TSO allocates wrong timestamps.

• #6501 Channels are lost after data node crashes.

• #6527 Task info of watchQueryChannels can't be deleted from etcd.

• #6576 #6526 Duplicate primary field IDs are added when retrieving entities.

• #6627 #6569 std::sort does not work properly to filter search results when the distance of new record is NaN.

• #6655 Proxy crashes when retrieve task is called.

• #6762 Incorrect created timestamp of collections and partitions.

• #6644 Data node failes to restart automatically.

• #6641 Failure to stop data coord when disconnecting with etcd.

• #6621 Milvus throws an exception when the inserted data size is larger than the segment.

• #6436 #6573 #6507 Incorrect handling of time synchronization.

• #6732 Failure to create IVF-PQ index.