Real time change data capture (CDC) using Debezium and Aiven’s JDBC Sink Connector for Apache Kafka® to insert data into StarRocks
One of the most common use cases for our users is the ability to perform real-time CDC from a source database into StarRocks. One of the ways is to use Debezium and Apache Kafka. Debezium has the ability to source the data from mysql, mongodb, postgresql, oracle, sql server, db2, cassandra, vitess, spanner, and nearly any database that supports JDBC and put the data into a Kafka topic. Once there, you can use a Kafka Connector can sink it into your target database. For this tutorial we will use the Aiven’s open source JDBC Sink Connector for Apache Kafka (https://github.com/aiven/jdbc-connector-for-apache-kafka) to sink the data into StarRocks.