Real time change data capture (CDC) using Debezium and Aiven’s JDBC Sink Connector for Apache Kafka® to insert data into StarRocks

Albert Wong
Jun 15, 2023

--

Apache Kafka + StarRocks

One of the most common use cases for our users is the ability to perform real-time CDC from a source database into StarRocks. One of the ways is to use Debezium and Apache Kafka. Debezium has the ability to source the data from mysql, mongodb, postgresql, oracle, sql server, db2, cassandra, vitess, spanner, and nearly any database that supports JDBC and put the data into a Kafka topic. Once there, you can use a Kafka Connector can sink it into your target database. For this tutorial we will use the Aiven’s open source JDBC Sink Connector for Apache Kafka (https://github.com/aiven/jdbc-connector-for-apache-kafka) to sink the data into StarRocks.

https://github.com/StarRocks/starrocks/discussions/25338

Sign up to discover human stories that deepen your understanding of the world.

Free

Distraction-free reading. No ads.

Organize your knowledge with lists and highlights.

Tell your story. Find your audience.

Membership

Read member-only stories

Support writers you read most

Earn money for your writing

Listen to audio narrations

Read offline with the Medium app

--

--

Albert Wong
Albert Wong

Written by Albert Wong

#eCommerce #Java #Database #k8s #Automation. Hobbies: #BoardGames #Comics #Skeet #VideoGames #Pinball #Magic #YelpElite #Travel #Candy

No responses yet

Write a response