milvus-logo
LFAI
Home
  • Administration Guide

mq-related Configurations

Milvus supports four MQ: rocksmq(based on RockDB), natsmq(embedded nats-server), Pulsar and Kafka.

You can change your mq by setting mq.type field.

If you don’t set mq.type field as default, there is a note about enabling priority if we config multiple mq in this file.

  1. standalone(local) mode: rocksmq(default) > natsmq > Pulsar > Kafka

  2. cluster mode: Pulsar(default) > Kafka (rocksmq and natsmq is unsupported in cluster mode)

mq.type

Description Default Value
  • Default value: "default"
  • Valid values: [default, pulsar, kafka, rocksmq, natsmq]
  • default

    mq.enablePursuitMode

    Description Default Value
    Default value: "true" true

    mq.pursuitLag

    Description Default Value
    time tick lag threshold to enter pursuit mode, in seconds 10

    mq.pursuitBufferSize

    Description Default Value
    pursuit mode buffer size in bytes 8388608

    mq.mqBufSize

    Description Default Value
    MQ client consumer buffer length 16

    mq.dispatcher.mergeCheckInterval

    Description Default Value
    the interval time(in seconds) for dispatcher to check whether to merge 1

    mq.dispatcher.targetBufSize

    Description Default Value
    the lenth of channel buffer for targe 16

    mq.dispatcher.maxTolerantLag

    Description Default Value
    Default value: "3", the timeout(in seconds) that target sends msgPack 3