BGE

Milvus 透過BGERerankFunction class 支援BGE reranker 模型。此功能可讓您有效地評分查詢與文件對的相關性。

要使用此功能，請安裝必要的相依性：

pip install --upgrade pymilvus
pip install "pymilvus[model]"

然後，實體化BGERerankFunction ：

from pymilvus.model.reranker import BGERerankFunction

# Define the rerank function
bge_rf = BGERerankFunction(
    model_name="BAAI/bge-reranker-v2-m3",  # Specify the model name. Defaults to `BAAI/bge-reranker-v2-m3`.
    device="cpu" # Specify the device to use, e.g., 'cpu' or 'cuda:0'
)

參數

• model_name (字串)

  要使用的模型名稱。您可以指定任何可用的 BGE reranker 模型名稱，例如BAAI/bge-reranker-base,BAAI/bge-reranker-large 等。如果您不指定此參數，則會使用BAAI/bge-reranker-v2-m3 。如需可用模型的清單，請參閱模型清單。

• device （字串）

  可選。用於執行模型的裝置。如果未指定，模型將在 CPU 上執行。您可以指定cpu 為 CPU，cuda:n 為第 n 個 GPU 裝置。

然後，使用下列程式碼根據查詢結果重新排序文件：

query = "What event in 1956 marked the official birth of artificial intelligence as a discipline?"

documents = [
    "In 1950, Alan Turing published his seminal paper, 'Computing Machinery and Intelligence,' proposing the Turing Test as a criterion of intelligence, a foundational concept in the philosophy and development of artificial intelligence.",
    "The Dartmouth Conference in 1956 is considered the birthplace of artificial intelligence as a field; here, John McCarthy and others coined the term 'artificial intelligence' and laid out its basic goals.",
    "In 1951, British mathematician and computer scientist Alan Turing also developed the first program designed to play chess, demonstrating an early example of AI in game strategy.",
    "The invention of the Logic Theorist by Allen Newell, Herbert A. Simon, and Cliff Shaw in 1955 marked the creation of the first true AI program, which was capable of solving logic problems, akin to proving mathematical theorems."
]

results = bge_rf(
    query=query,
    documents=documents,
    top_k=3,
)

for result in results:
    print(f"Index: {result.index}")
    print(f"Score: {result.score:.6f}")
    print(f"Text: {result.text}\n")

預期的輸出與以下相似：

Index: 1
Score: 0.991162
Text: The Dartmouth Conference in 1956 is considered the birthplace of artificial intelligence as a field; here, John McCarthy and others coined the term 'artificial intelligence' and laid out its basic goals.

Index: 0
Score: 0.032697
Text: In 1950, Alan Turing published his seminal paper, 'Computing Machinery and Intelligence,' proposing the Turing Test as a criterion of intelligence, a foundational concept in the philosophy and development of artificial intelligence.

Index: 3
Score: 0.006515
Text: The invention of the Logic Theorist by Allen Newell, Herbert A. Simon, and Cliff Shaw in 1955 marked the creation of the first true AI program, which was capable of solving logic problems, akin to proving mathematical theorems.