GPU-enabled Milvus
Indexes for GPU-enabled Milvus
Milvus maps different embedding types with different index types. Click the tab below to view the index types supporting your embedding type.
| Index type |
Indexing with CPU |
Indexing with GPU |
Search with CPU |
Search with GPU |
| FLAT |
N/A |
N/A |
✔️ |
✔️ |
| IVF_FLAT |
✔️ |
✔️ |
✔️ |
✔️ |
| IVF_SQ8 |
✔️ |
✔️ |
✔️ |
✔️ |
| IVF_SQ8H |
✔️ |
✔️ |
✔️ |
✔️ |
| IVF_PQ |
✔️ |
✔️ |
✔️ |
✔️ |
| RNSG |
✔️ |
❌ |
✔️ |
❌ |
| HNSW |
✔️ |
❌ |
✔️ |
❌ |
| Annoy |
✔️ |
❌ |
✔️ |
❌ |
- An index built with GPU is identical to built with CPU. The only difference is the time to build the index: GPU usually takes less time.
- If
top_k > 2048, Milvus switches from GPU search to CPU search.
- If
nprobe > 2048, Milvus switches from GPU search to CPU search.
| Index type |
Indexing with CPU |
Indexing with GPU |
Search with CPU |
Search with GPU |
| FLAT |
N/A |
N/A |
✔️ |
❌ |
| IVF_FLAT |
✔️ |
❌ |
✔️ |
❌ |
