Installing Conduktor to connect to MSK on AWS

Albert Wong
Nov 5, 2024

--

TL-DR; There are instructions to do this manually, but it’s much, much easier to use the cloud formation template.

  1. Create a 4GB AWS Linux EC2 instance with a public IP. Make sure that Conduktor is installed in the same VPC as your MSK cluster.
  2. Follow https://saturncloud.io/blog/how-to-install-dockercompose-on-amazon-ec2-linux-2-and-run-a-9kb-dockercompose-file/ to install docker compose. The slight change from the quickstart install of Conduktor is that you’ll be using “docker-compose” instead of “docker compose”.
  3. Change the network rules to allow 8080.
  4. Create the SASL/SCRAM_SHA_512 or IAM roles needed to connect to the MSK cluster.

--

--

Albert Wong
Albert Wong

Written by Albert Wong

#eCommerce #Java #Database #k8s #Automation. Hobbies: #BoardGames #Comics #Skeet #VideoGames #Pinball #Magic #YelpElite #Travel #Candy