Technical Sharing:Apply Configuration Changes on Milvus 2.0 using Docker Compose
Jingjing Jia, Zilliz Data Engineer, graduated from Xi’an Jiaotong University with a degree in Computer Science. After joining Zilliz, she mainly works on data pre-processing, AI model deployment, Milvus related technology research, and helping community users to implement application scenarios. SHe is very patient, likes to communicate with community partners, and enjoys listening to music and watching anime.
As a frequent user of Milvus, I was very excited about the newly released Milvus 2.0 RC. According to the introduction on the official website, Milvus 2.0 seems to outmatch its predecessors by a large margin. I was so eager to try it out myself.
And I did. However, when I truly got my hands on Milvus 2.0, I realized that I wasn’t able to modify the configuration file in Milvus 2.0 as easily as I did with Milvus 1.1.1. I couldn’t change the configuration file inside the docker container of Milvus 2.0 started with Docker Compose, and even force change wouldn’t take effect. Later, I learned that Milvus 2.0 RC was unable to detect changes to the configuration file after installation. And future stable release will fix this issue.
Having tried different approaches, I’ve found a reliable way to apply changes to configuration files for Milvus 2.0 standalone & cluster, and here is how.
Note that all changes to configuration must be made before restarting Milvus using Docker Compose.
Modify configuration file in Milvus standalone
First, you will need to download a copy of milvus.yaml file to your local device.
Then you can change the configurations in the file. For instance, you can change the log format as .json
.
1.1.png
Once milvus.yaml file is modified, you will also need to download and modify in docker-compose.yaml file for standalone by mapping the local path to milvus.yaml onto the corresponding docker container path to configuration file /milvus/configs/milvus.yaml
under the volumes
section.
1.2.png
Lastly, start Milvus standalone using docker-compose up -d
and check if the modifications are successful. For instance, run docker logs
to check the log format.
1.3.png
Modify configuration file in Milvus cluster
First, download and modify the milvus.yaml file to suit your needs.
1.4.png
Then you will need to download and modify the cluster docker-compose.yml file by mapping the local path to milvus.yaml onto the corresponding path to configuration files in all components, i.e. root coord, data coord, data node, query coord, query node, index coord, index node, and proxy.
1.5.png
1.6.png 1.7.png
Finally, you can start Milvus cluster using docker-compose up -d
and check if the modifications are successful.
Change log file path in configuration file
First, download the milvus.yaml file, and change the rootPath
section as the directory where you expect to store the log files in Docker container.
1.8.png
After that, download the corresponding docker-compose.yml file for Milvus standalone or cluster.
For standalone, you need to map the local path to milvus.yaml onto the corresponding docker container path to configuration file /milvus/configs/milvus.yaml
, and map the local log file directory onto the Docker container directory you created previously.
For cluster, you will need to map both paths in every component.
1.9.png
Lastly, start Milvus standalone or cluster using docker-compose up -d
and check the log files to see if the modification is successful.
- Modify configuration file in Milvus standalone
- Modify configuration file in Milvus cluster
- Change log file path in configuration file
Content
Try Managed Milvus for Free
Zilliz Cloud is hassle-free, powered by Milvus and 10x faster.
Get StartedLike the article? Spread the word