Milvus Roadmap
Welcome to the Milvus Roadmap! Join us on our continuous journey to enhance and evolve Milvus. We are thrilled to share our accomplishments, future plans, and our vision for what lies ahead. Our roadmap is more than a list of upcoming features—it reflects our commitment to innovation and our dedication to working with the community. We invite you to delve into our roadmap, provide your feedback, and help shape the future of Milvus!
Roadmap
| Category | Milvus 2.4.0 (Recently Achieved) | Milvus 2.5.0 (Upcoming in Mid-CY24) | Future Roadmap (Milvus 3.0 Expected within CY24) |
|---|---|---|---|
| AI-developer Friendly A developer-friendly technology stack, enhanced with the latest AI innovations |
Multi-Vectors & Hybrid Search Framework for multiplex recall and fusion GPU Index Acceleration Support for higher QPS and faster index creation Model Library in PyMilvus Integrated embedding models for Milvus |
Sparse Vector (GA) Local feature extraction and keyword search Milvus Lite (GA) A lightweight, in-memory version of Milvus Embedding Models Gallery Support for image and multi-modal embeddings and reranker models in model libraries |
Original Data-In and Data-Out Support for Blob data types Data Clustering Data co-locality Scenario-oriented Vector Search e.g. Multi-target search & NN filtering Support Embedding & Reranker Endpoint |
| Rich Functionality Enhanced retrieval and data management features |
Support for FP16, BF16 Datatypes These ML datatypes can help reduce memory usage Grouping Search Aggregate split embeddings Fuzzy Match and Inverted Index Support for fuzzy matching and inverted indexing for scalar types like varchar and int |
Inverted Index for Array & JSON Indexing for array and partial support JSON Bitset Index Improved execution speed and future data aggregation Truncate Collection Allows data clearance while preserving metadata Support for NULL and Default Values |
Support for More Datatypes e.g. Datetime, GIS Advanced Text Filtering e.g. Match Phrase Primary Key Deduplication |
| Cost Efficiency & Architecture Advanced systems emphasizing stability, cost efficiency, scalability, and performance |
Support for More Collections/Partitions Handles over 10,000 collections in smaller clusters Mmap Optimization Balances reduced memory consumption with latency Bulk Insert Optimazation Simplifies importing large datasets |
Lazy Load Data is loaded on-demand through read operations Major Compaction Re-distributes data based on configuration to enhance read performance Mmap for Growing Data Mmap files for expanding data segments |
Memory Control Reduces out-of-memory issues and provides global memory management LogNode Introduction Ensures global consistency and addresses the single-point bottleneck in root coordination Storage Format V2 Universal format design lays the groundwork for disk-based data access |
| Enterprise Ready Designed to meet the needs of enterprise production environments |
Milvus CDC Capability for data replication Accesslog Enhancement Detailed recording for audit and tracing |
New Resource Group Enhanced resource management Storage Hook Support for Bring Your Own Key (BYOK) encryption |
Dynamic Replica Number Adjustment Facilitates dynamic changes to the number of replicas Dynamic Schema Modification e.g., Add/delete fields, modify varchar lengths Rust and C# SDKs |
- Our roadmap is typically structured into three parts: the most recent release, the next upcoming release, and a mid-to-long term vision within the next year.
- As we progress, we continually learn and occasionally adjust our focus, adding or removing items as needed.
- These plans are indicative and subject to change, and may vary based on subscription services.
- We steadfastly adhere to our roadmap, with our release notes serving as a reference.
How to contribute
As an open-source project, Milvus thrives on community contributions. Here’s how you can be a part of our journey.
Share feedback
Issue reporting: Encounter a bug or have a suggestion? Open an issue on our GitHub page.
Feature suggestions: Have ideas for new features or improvements? We’d love to hear them!
Code contributions
Pull requests: Contribute directly to our codebase. Whether it’s fixing bugs, adding features, or improving documentation, your contributions are welcome.
Development guide: Check our Contributor’s Guide for guidelines on code contributions.
Spread the word
Social sharing: Love Milvus? Share your use cases and experiences on social media and tech blogs.
Star us on GitHub: Show your support by starring our GitHub repository.