Albert WongHow to use VS code java debugger and Kafka Connect inside of Docker ComposeYou need to bind *:5005 and KAFKA_DEBUG=y won't do this. I found out the hard way and found this…1 min read·Apr 25, 2024----
Albert WonginDev GeniusStreamlining Analytics: Kappa Architecture with StarRocks for Big DataThe ever-growing volume of data in today’s world demands real-time insights for effective decision making. Big data analytics has become…3 min read·Apr 5, 2024----
Albert WonginData Engineer ThingsQuickstart on Open Data Lakehouse with StarRocks + S3 + Delta LakeDelta Lake, the open-source storage layer on top of data lakes like S3, brings reliability and structure to your data. But querying that…2 min read·Apr 3, 2024----
Albert WonginData Engineer ThingsWhat is real time analytics, and who are the top players in this OLAP space?Imagine a world where your data insights are as fresh as this morning’s coffee. That’s the magic of real-time analytics, where you analyze…2 min read·Apr 1, 2024----
Albert WongWhat is user-facing analytics and who are the popular OLAP databases in this space?User-facing analytics is all about putting the power of data analysis directly in the hands of the people who use an application or…2 min read·Apr 1, 2024----
Albert WongTop Open Source Alternatives to OLAP Query Engines TrinoDB, PrestoDB, AWS Athena and StarBurstTrinoDB, PrestoDB, AWS Athena and StarBurst are all popular open-source OLAP (Online Analytical Processing) query engines that allow you to…2 min read·Mar 26, 2024----
Albert WonginDev GeniusOptions on Kafka sink to open table Formats: Apache Iceberg and Apache HudiApache Kafka reigns supreme when it comes to real-time data pipelines. But where does that data go for further processing and analysis…3 min read·Mar 23, 2024----
Albert WonginDev GeniusData Mesh: Fad or Future? Why Open Data Lakehouses Might Be the AnswerThe world of data architecture is constantly evolving. Just a few years ago, data lakes were hailed as the solution to all our data woes…3 min read·Mar 22, 2024--1--1
Albert WonginDev GeniusMedallion Architecture Tarnished? Data Lakehouses Offer a New PathThe medallion architecture, championed for its focus on data quality and flexibility, might be losing its shine. In a world overflowing…3 min read·Mar 19, 2024--1--1
Albert WongHow to register Delta Lake open table format files into Apache Hive Metastore (HMS)In my open data lakehouse tutorial at https://github.com/StarRocks/demo/tree/master/documentation-samples/datalakehouse, you can see that I…1 min read·Mar 14, 2024----