Best way to migrate from one database to another? Apache Flink CDC

Albert Wong
Jan 5, 2024

--

Update: I like Sling more now…. check out the article on wrote.

At StarRocks (think open source version of snowflake/big query/redshift), I get a lot of question about how to migrate data from one database to another. Although there are many methods, the preferred method for StarRocks is to use Apache Flink CDC 3.0 and the next best is to just use StarRocks’ mysql wire compatible protocol to write into the database.

This tutorial is to show how to quickly build a Streaming ELT job from MySQL to StarRocks using Flink CDC 3.0 including the feature of sync all table of one database, schema change evolution and sync sharding tables into one table.

Check it out at https://ververica.github.io/flink-cdc-connectors/master/content/quickstart/mysql-starrocks-pipeline-tutorial.html

--

--

Albert Wong
Albert Wong

Written by Albert Wong

#eCommerce #Java #Database #k8s #Automation. Hobbies: #BoardGames #Comics #Skeet #VideoGames #Pinball #Magic #YelpElite #Travel #Candy

No responses yet