milvus-logo
LFAI
Home
  • Reference

Data Coordinator-related Configurations

This topic introduces the data coordinator-related configurations of Milvus.

Data coordinator (data coord) manages the topology of data nodes, maintains metadata, and triggers flush, compact, and other background data operations.

Under this section, you can configure data coord address, segment settings, compaction, garbage collection, etc.

dataCoord.address

Description Default Value
  • TCP/IP address of data coordinator.
  • Data coordinator monitors all IPv4 addresses if this parameter is set as 0.0.0.0.
    		•  localhost

    dataCoord.port

    Description Default Value
    TCP port of data coordinator. 13333

    dataCoord.grpc.serverMaxRecvSize

    Description Default Value
  • The maximum size of each RPC request that the data coord can receive.
  • Unit: Byte
    		•  2147483647

    dataCoord.grpc.serverMaxSendSize

    Description Default Value
  • The maximum size of each respond the data coord can send when receiving an RPC request.
  • Unit: Byte
    		•  2147483647

    dataCoord.grpc.clientMaxRecvSize

    Description Default Value
  • The maximum size of each respond that the data coord can receive when sending an RPC request.
  • Unit: Byte
    		•  104857600

    dataCoord.grpc.clientMaxSendSize

    Description Default Value
  • The maximum size of each RPC request that the data coord can send.
  • Unit: Byte
    		•  104857600

    dataCoord.enableCompaction

    Description Default Value
  • Switch value to control if to enable segment compaction.
  • Compaction merges small-size segments into a large segment, and clears the entities deleted beyond the rentention duration of Time Travel.
    		•  true

    dataCoord.enableGarbageCollection

    Description Default Value
    Switch value to control if to enable garbage collection to clear the discarded data in MinIO or S3 service. false

    dataCoord.segment.maxSize

    Description Default Value
  • The maximum size of a segment.
  • Unit: MB
  • datacoord.segment.maxSize and datacoord.segment.sealProportion together determine if a segment can be sealed.
    		•  512

    dataCoord.segment.sealProportion

    Description Default Value
  • The minimum proportion to datacoord.segment.maxSize to seal a segment.
  • datacoord.segment.maxSize and datacoord.segment.sealProportion together determine if a segment can be sealed.
    		•  0.75

    dataCoord.segment.assignmentExpiration

    Description Default Value
  • Expiration time of the segment assignment.
  • Unit: ms
    		•  2000

    dataCoord.compaction.enableAutoCompaction

    Description Default Value
  • Switch value to control if to enable automatic segment compaction during which data coord locates and merges compactable segments in the background.
  • This configuration takes effect only when dataCoord.enableCompaction is set as true.
    		•  true

    dataCoord.gc.interval

    Description Default Value
  • The interval at which data coord performs garbage collection.
  • Unit: Second
  • This configuration takes effect only when dataCoord.enableGarbageCollection is set as true.
    		•  3600

    dataCoord.gc.missingTolerance

    Description Default Value
  • The retention duration of the unrecorded binary log (binlog) files.
  • Setting a reasonably large value for this parameter avoids erroneously deleting the newly created binlog files that lack metadata.
  • Unit: Second
  • This configuration takes effect only when dataCoord.enableGarbageCollection is set as true.
    		•  86400

    dataCoord.gc.dropTolerance

    Description Default Value
  • The retention duration of the binlog files of the deleted segments before they are cleared.
  • Unit: Second
  • This configuration takes effect only when dataCoord.enableGarbageCollection is set as true.
    		•  86400
    Table of contents

    Try Managed Milvus for Free

    Zilliz Cloud is hassle-free, powered by Milvus and 10x faster.

    Get Started
    Feedback

    Was this page helpful?