milvus-logo

Release Notes

Find out what’s new in Milvus! This page summarizes information about new features, improvements, known issues, and bug fixes in each release. You can find the release notes for each released version after v2.2.0 in this section. We suggest that you regularly visit this page to learn about updates.

2.2.2

Release date: 22 December, 2022

Milvus version Python SDK version Java SDK version Go SDK version Node.js SDK version
2.2.2 2.2.1 2.2.1 2.2.0 2.2.1

Milvus 2.2.2 is a minor fix of Milvus 2.2.1. It fixed a few loading failure issues as of the upgrade to 2.2.1 and the issue that the proxy cache is not cleaned upon some types of errors.

Bug Fixes

  • Fixed the issue that the proxy doesn't update the cache of shard leaders due to some types of errors. (#21320)
  • Fixed the issue that the loaded info is not cleaned for released collections/partitions. (#21321)
  • Fixed the issue that the load count is not cleared on time. (#21314)

v2.2.1

Release date: 15 December, 2022

Milvus version Python SDK version Java SDK version Go SDK version Node.js SDK version
2.2.1 2.2.1 2.2.1 2.2.0 2.2.1

Milvus 2.2.1 is a minor fix of Milvus 2.2.0. It supports authentication and TLS on all dependencies, optimizes the performance ludicrously on searches and fixes some critical issues. With tremendous contribution from the community, this release managed to resolve over 280 issues, so please try the new release and give us feedback on stability, performance and ease of use.

New Features

  • Supports Pulsa tenant and authentication. (#20762)
  • Supports TLS in etcd config source. (#20910)

Performance

After upgrading the Knowhere vector engine and changing the parallelism strategy, Milvus 2.2.1 improves search performance by over 30%.

Optimizes the scheduler, and increases merge tasks probability. (#20931)

Bug Fixes

  • Fixed term filtering failures on indexed scalar fields. (#20840)
  • Fixed the issue that only partial data returned upon QueryNode restarts. (#21139)(#20976)
  • Fixed IndexNode panic upon failures to create an index. (#20826)
  • Fixed endless BinaryVector compaction and generation of data on Minio. (#21119) (#20971)
  • Fixed the issue that meta_cache of proxy partially updates. (#21232)
  • Fixed slow segment loading due to staled checkpoints. (#21150)
  • Fixed concurrently loaded Casbin model causing concurrent write operations. (#21132)(#21145)(#21073)
  • Forbade garbage-collecting index meta when creating an index. (#21024)
  • Fixed a bug that the index data can not be garbage-collected because ListWithPrefix from Minio with recursive is false. (#21040)
  • Fixed an issue that an error code is returned when a query expression does not match any results. (#21066)
  • Fixed search failures on disk index when search_list equals to limit. (#21114)
  • Filled collection schema after DataCoord restarts. (#21164)
  • Fixed an issue that the compaction handler may double release and hang. (#21019)
  • [restapi] Fixed precision loss for Int64 fields upon insert requests. (#20827)
  • Increased MaxWatchDuration and make it configurable to prevent shards with large data loads from timing out. (#21010)
  • Fixed the issue that the compaction target segment rowNum is always 0. (#20941)
  • Fixed the issue that IndexCoord deletes segment index by mistake because IndexMeta is not stored in time. (#21058)
  • Fixed the issue that DataCoord crushes if auto-compaction is disabled. (#21079)
  • Fixed the issue that searches on growing segments even though the segments are indexed. (#21215)

Improvements

  • Refined logs and the default log level is set to INFO.
  • Fixed incorrect metrics and refined the metric dashboard.
  • Made TopK limit configurable (#21155)

Breaking changes

Milvus now limits each RPC to 64 MB to avoid OOM and generating large message packs.

v2.2.0

Release date: 18 November, 2022

Milvus version Python SDK version Java SDK version Go SDK version Node.js SDK version
2.2.0 2.2.0 2.2.1 2.2.0 2.2.0

Milvus 2.2.0 introduces many new features including support for Disk-based approximate nearest neighbor (ANN) algorithm, bulk insertion of entities from files, and role-based access control (RBAC) for an improved security. In addition, this major release also ushers in a new era for vector search with enhanced stability, faster search speed, and more flexible scalability.

Breaking changes

Since metadata storage is refined and API usage is normalized, Milvus 2.2 is not fully compatible with earlier releases. Read this guide to learn how to safely upgrade from Milvus 2.1.x to 2.2.0.

Features

  • Support for bulk insertion of entities from files

Milvus now offers a new set of bulk insertion APIs to make data insertion more efficient. You can now upload entities in a Json file directly to Milvus. See Insert Entities from Files for details.

  • Query result pagination

To avoid massive search and query results returned in a single RPC, Milvus now supports configuring offset and filtering results with keywords in searches and queries. See Search and Query for details.

  • Role-based access control (RBAC)

Like other traditional databases, Milvus now supports RBAC so that you can manages users, roles and privileges. See Enable RBAC for details.

  • Quotas and limits

Quota is a new mechanism that protects the system from OOM and crash under a burst of traffic. By imposing quota limitations, you can limit ingestion rate, search rate, etc. See Quota and Limitation Configurations for details.

  • Time to live (TTL) at a collection level

In prior releases, we only support configuring TTL at a cluster level. Milvus 2.2.0 now supports configuring collection TTL when you create or modify a collection. After setting TTL for a collection, the entities in this collection automatically expires after the specified period of time. See Create a collection or Modify a collection for details.

  • Support for disk-based approximate nearest neighbor search (ANNS) indexes (Beta)

Traditionally, you need to load the entire index into memory before search. Now with DiskANN, an SSD-resident and Vamana graph-based ANNS algorithm, you can directly search on large-scale datasets and save up to 10 times the memory.

  • Data backup (Beta)

Thanks to the contribution from Zilliz, Milvus 2.2.0 now provides a tool to back up and restore data. The tool can be used either in a command line or an API server for data security.

Bug fixes and stability

  • Implements query coord V2, which handles all channel/segment allocation in a fully event-driven and asynchronous mode. Query coord V2 address all issues of stuck searches and accelerates failure recovery.
  • Root coord and index coord are refactored for more elegant handling of errors and better task scheduling.
  • Fixes the issue of invalid RocksMQ retention mechanism when Milvus Standalone restarts.
  • Meta storage format in etcd is refactored. With the new compression mechanism, etcd kv size is reduced by 10 times and the issues of etcd memory and space are solved.
  • Fixes a couple of memory issues when entities are continuously inserted or deleted.

Improvements

  • Performance

    • Fixes performance bottleneck to that Milvus can fully utilize all cores when CPU is more than 8 cores.
    • Dramatically improves the search throughput and reduce the latency.
    • Decreases load speed by processing load in parallel.
  • Observability

    • Changes all log levels to info by default.
    • Added collection-level latency metrics for search, query, insertion, and deletion.
  • Debug tool

    • BirdWatcher, the debug tool for Milvus, is further optimized as it can now connect to Milvus meta storage and inspect the part of the internal status of the Milvus system.

Others

  • Index and load
    • A collection can only be loaded with an index created on it.
    • Indexes cannot be created after a collection is loaded.
    • A loaded collection must be released before dropping the index created on this collection.
  • Flush
    • Flush API, which forces a seal on a growing segment and syncs the segment to object storage, is now exposed to users. Calling flush() frequently may affect search performance as too many small segments are created.
    • No auto-flush is triggered by any SDK APIs such as num_entities(), create_index(), etc.
  • Time Travel
    • In Milvus 2.2, Time Travel is disabled by default to save disk usage. To enable Time Travel, configure the parameter common.retentionDuration manually.
Is this page helpful?
On this page