Configure Milvus with Docker Compose

This topic describes how to configure Milvus components and its third-party dependencies with Docker Compose.

In current release, all parameters take effect only after Milvus restarts.

Download a configuration file

Download milvus.yaml directly or with the following command.

$ wget https://raw.githubusercontent.com/milvus-io/milvus/v2.1.4/configs/milvus.yaml

Modify the configuration file

Configure your Milvus instance to suit your application scenarios by adjusting corresponding parameters in milvus.yaml.

Check the following links for more information about each parameter.

Sorted by:

Components or dependencies Configuration purposes

Dependencies	Components
etcd MinIO or S3 Pulsar RocksMQ	Root coord Proxy Query coord Query node Index coord Index node Data coord Data node Local storage Log Message channel Common Knowhere

Purpose	Parameters
Performance tuning	`queryNode.gracefulTime` `rootCoord.minSegmentSizeToEnableIndex` `dataCoord.segment.maxSize` `dataCoord.segment.sealProportion` `dataNode.flush.insertBufSize` `queryCoord.autoHandoff` `queryCoord.autoBalance` `localStorage.enabled`
Data and meta	`common.retentionDuration` `rocksmq.retentionTimeInMinutes` `dataCoord.enableCompaction` `dataCoord.enableGarbageCollection` `dataCoord.gc.dropTolerance`
Administration	`log.level` `log.file.rootPath` `log.file.maxAge` `minio.accessKeyID` `minio.secretAccessKey`

Download an installation file

Download the installation file for Milvus standalone or cluster, and save it as docker-compose.yml.

You can also simply run the following command.

# For Milvus standalone
$ wget https://github.com/milvus-io/milvus/releases/download/v2.1.4/milvus-standalone-docker-compose.yml -O docker-compose.yml

# For Milvus cluster
$ wget https://github.com/milvus-io/milvus/releases/download/v2.1.4/milvus-cluster-docker-compose.yml -O docker-compose.yml

Modify the installation file

In docker-compose.yml, add a volumes section under each Milvus component, i.e. root coord, data coord, data node, query coord, query node, index coord, index node, and proxy.

Map the local path to your milvus.yaml file onto the corresponding docker container paths to the configuration files /milvus/configs/milvus.yaml under all volumes sections.

...
proxy:
    container_name: milvus-proxy
    image: milvusdb/milvus:v2.1.0-20220928-9122e34c
    command: ["milvus", "run", "proxy"]
    volumes:       # Add a volumes section.
      - /local/path/to/your/milvus.yaml:/milvus/configs/milvus.yaml   # Map the local path to the container path
    environment:
      ETCD_ENDPOINTS: etcd:2379
      MINIO_ADDRESS: minio:9000
      PULSAR_ADDRESS: pulsar://pulsar:6650
    ports:
      - "19530:19530"
...

Data are stored in the /volumes folder according to the default configuration in docker-compose.yml. To change the folder to store data, edit docker-compose.yml or run $ export DOCKER_VOLUME_DIRECTORY=.

Start Milvus

Having finished modifying the configuration file and installation file, you can then start Milvus.

$ sudo docker-compose up -d

What's next

Learn how to manage the following Milvus dependencies with Docker Compose or Helm: