Conduct a Vector Similarity Search
This topic describes how to search entities with Milvus.
A vector similarity search in Milvus calculates the distance between query vector(s) and vectors in the collection with specified similarity metrics, and returns the most similar results. By specifying a boolean expression that filters the scalar field or the primary key field, you can perform a hybrid search or even a search with Time Travel.
The following example shows how to perform a vector similarity search on a 2000-row dataset of book ID (primary key), word count (scalar field), and book introduction (vector field), simulating the situation that you search for certain books based on their vectorized introductions. Milvus will return the most similar results according to the query vector and search parameters you have defined.
Load collection
All search and query operations within Milvus are executed in memory. Load the collection to memory before conducting a vector similarity search.
from pymilvus import Collection
collection = Collection("book") # Get an existing collection.
collection.load()
await milvusClient.collectionManager.loadCollection({
collection_name: "book",
});
err := milvusClient.LoadCollection(
context.Background(), // ctx
"book", // CollectionName
false // async
)
if err != nil {
log.Fatal("failed to load collection:", err.Error())
}
milvusClient.loadCollection(
LoadCollectionParam.newBuilder()
.withCollectionName("book")
.build()
);
load -c book
Prepare search parameters
Prepare the parameters that suit your search scenario. The following example defines that the search will calculate the distance with Euclidean distance, and retrieve vectors from ten closest clusters built by the IVF_FLAT index.
search_params = {"metric_type": "L2", "params": {"nprobe": 10}}
const searchParams = {
anns_field: "book_intro",
topk: "2",
metric_type: "L2",
params: JSON.stringify({ nprobe: 10 }),
};
sp, _ := entity.NewIndexFlatSearchParam( // NewIndex*SearchParam func
10, // searchParam
)
final Integer SEARCH_K = 2; // TopK
final String SEARCH_PARAM = "{\"nprobe\":10}"; // Params
search
Collection name (book): book
The vectors of search data(the length of data is number of query (nq), the dim of every vector in data must be equal to vector field’s of collection. You can also import a csv file without headers): [[0.1, 0.2]]
The vector field used to search of collection (book_intro): book_intro
Metric type: L2
Search parameter nprobe's value: 10
The max number of returned record, also known as topk: 10
The boolean expression used to filter attribute []:
The names of partitions to search (split by "," if multiple) ['_default'] []:
timeout []:
Guarantee Timestamp(It instructs Milvus to see all operations performed before a provided timestamp. If no such timestamp is provided, then Milvus will search all operations performed to date) [0]:
Travel Timestamp(Specify a timestamp in a search to get results based on a data view) [0]:
Parameter | Description |
---|---|
metric_type |
Metrics used to measure similarity of vectors. See Simlarity Metrics for more information. |
params |
Search parameter(s) specific to the index. See Vector Index for more information. |
Parameter | Description |
---|---|
anns_field |
Name of the field to search on. |
topk |
Number of the most similar results to return. |
metric_type |
Metrics used to measure similarity of vectors. See Simlarity Metrics for more information. |
params |
Search parameter(s) specific to the index. See Vector Index for more information. |
Parameter | Description | Options |
---|---|---|
NewIndex*SearchParam func |
Function to create entity.SearchParam according to different index types. | For floating point vectors:
|
searchParam |
Search parameter(s) specific to the index. | See Vector Index for more information. |
Parameter | Description | Options |
---|---|---|
TopK |
Number of the most similar results to return. | N/A |
Params |
Search parameter(s) specific to the index. | See Vector Index for more information. |
Option | Full name | Description |
---|---|---|
--help | n/a | Displays help for using the command. |
Conduct a vector search
Search vectors with Milvus. To search in a specific partition, specify the list of partition names.
Milvus supports setting consistency level specifically for a search or query (only on PyMilvus currently). The consistency level set in the search or query requests overwrites the one set while creating the collection. In this example, the consistency level of the search request is set as Strong
, meaning Milvus will read the most updated data view at the exact time point when a search or query request comes. Without specifying the consistency level during a search or query, Milvus adopts the original consistency level of the collection.
results = collection.search(
data=[[0.1, 0.2]],
anns_field="book_intro",
param=search_params,
limit=10,
expr=None,
consistency_level="Strong"
)
const results = await milvusClient.dataManager.search({
collection_name: "book",
expr: "",
vectors: [[0.1, 0.2]],
search_params: searchParams,
vector_type: 101, // DataType.FloatVector
});
searchResult, err := milvusClient.Search(
context.Background(), // ctx
"book", // CollectionName
[]string{}, // partitionNames
"", // expr
[]string{"book_id"}, // outputFields
[]entity.Vector{entity.FloatVector([]float32{0.1, 0.2})}, // vectors
"book_intro", // vectorField
entity.L2, // metricType
2, // topK
sp, // sp
)
if err != nil {
log.Fatal("fail to search collection:", err.Error())
}
List<String> search_output_fields = Arrays.asList("book_id");
List<List<Float>> search_vectors = Arrays.asList(Arrays.asList(0.1f, 0.2f));
SearchParam searchParam = SearchParam.newBuilder()
.withCollectionName("book")
.withMetricType(MetricType.L2)
.withOutFields(search_output_fields)
.withTopK(SEARCH_K)
.withVectors(search_vectors)
.withVectorFieldName("book_intro")
.withParams(SEARCH_PARAM)
.build();
R<SearchResults> respSearch = milvusClient.search(searchParam);
# Follow the previous step.
Parameter | Description |
---|---|
data |
Vectors to search with. |
anns_field |
Name of the field to search on. |
param |
Search parameter(s) specific to the index. See Vector Index for more information. |
limit |
Number of the most similar results to return. |
expr |
Boolean expression used to filter attribute. See Boolean Expression Rules for more information. |
partition_names (optional) |
List of names of the partition to search in. |
output_fields (optional) |
Name of the field to return. Vector field is not supported in current release. |
timeout (optional) |
A duration of time in seconds to allow for RPC. Clients wait until server responds or error occurs when it is set to None. |
round_decimal (optional) |
Number of decimal places of returned distance. |
consistency_level (optional) |
Consistency level of the search. |
Parameter | Description |
---|---|
collection_name |
Name of the collection to search in. |
search_params |
Parameters (as an object) used for search. |
vectors |
Vectors to search with. |
vector_type |
Pre-check of binary or float vectors. 100 for binary vectors and 101 for float vectors. |
partition_names (optional) |
List of names of the partition to search in. |
expr (optional) |
Boolean expression used to filter attribute. See Boolean Expression Rules for more information. |
output_fields (optional) |
Name of the field to return. Vector field is not supported in current release. |
Parameter | Description | Options |
---|---|---|
ctx |
Context to control API invocation process. | N/A |
CollectionName |
Name of the collection to load. | N/A |
partitionNames |
List of names of the partitions to load. All partitions will be searched if it is left empty. | N/A |
expr |
Boolean expression used to filter attribute. | See Boolean Expression Rules for more information. |
output_fields |
Name of the field to return. | Vector field is not supported in current release. |
vectors |
Vectors to search with. | N/A |
vectorField |
Name of the field to search on. | N/A |
metricType |
Metric type used for search. | This parameter must be set identical to the metric type used for index building. |
topK |
Number of the most similar results to return. | N/A |
sp |
entity.SearchParam specific to the index. | N/A |
Parameter | Description | Options |
---|---|---|
CollectionName |
Name of the collection to load. | N/A |
MetricType |
Metric type used for search. | This parameter must be set identical to the metric type used for index building. |
OutFields |
Name of the field to return. | Vector field is not supported in current release. |
Vectors |
Vectors to search with. | N/A |
VectorFieldName |
Name of the field to search on. | N/A |
Expr |
Boolean expression used to filter attribute. | See Boolean Expression Rules for more information. |
Check the primary key values of the most similar vectors and their distances.
results[0].ids
results[0].distances
console.log(results.results)
fmt.Printf("%#v\n", searchResult)
for _, sr := range searchResult {
fmt.Println(sr.IDs)
fmt.Println(sr.Scores)
}
SearchResultsWrapper wrapperSearch = new SearchResultsWrapper(respSearch.getData().getResults());
System.out.println(wrapperSearch.getIDScore(0));
System.out.println(wrapperSearch.getFieldData("book_id", 0));
# Milvus CLI automatically returns the primary key values of the most similar vectors and their distances.
Release the collection loaded in Milvus to reduce memory consumption when the search is completed.
collection.release()
await milvusClient.collectionManager.releaseCollection({ collection_name: "book",});
err := milvusClient.ReleaseCollection(
context.Background(), // ctx
"book", // CollectionName
)
if err != nil {
log.Fatal("failed to release collection:", err.Error())
}
milvusClient.releaseCollection(
ReleaseCollectionParam.newBuilder()
.withCollectionName("book")
.build());
release -c book
Limits
Feature | Maximum limit |
---|---|
Length of a collection name | 255 characters |
Number of partitions in a collection | 4,096 |
Number of fields in a collection | 256 |
Number of shards in a collection | 256 |
Dimensions of a vector | 32,768 |
Top K | 16,384 |
Target input vectors | 16,384 |
What’s next
Learn more basic operations of Milvus:
Explore API references for Milvus SDKs: