Albert Wong – Medium

Albert Wong

FastAvro doesn’t work with Confluent AVRO and here’s how to get it working

You’ll get an error like Unknown magic byte when using the python FastAVRO library to send messages to a kafka topic.

Nov 22, 2024

Nov 22, 2024

Connecting AWS Athena to Preset.io

You would think that https://docs.preset.io/docs/aws-athena is enough to get it working, but it’s not.

Nov 14, 2024

Connecting AWS Athena to Preset.io

Nov 14, 2024

Installing DataHub Core (docker compose) with personal tokens

DataHub does not provide a free managed solution, so you need to install DataHub Core. DataHub Core is the open source version of DataHub…

Nov 14, 2024

Nov 14, 2024

Python Client for AWS MSK and AWS Glue Schema Registry and AVRO message payload

While Python is a powerful language for working with AWS MSK, there’s currently a gap in official documentation and examples for…

Nov 13, 2024

Nov 13, 2024

Python Client with AWS MSK and Confluent Schema Registry and AVRO message payload

Download the official Python Client at https://github.com/confluentinc/confluent-kafka-python/blob/master/examples/avro_producer.py.

Nov 13, 2024

Nov 13, 2024

Creating and Connecting an AWS MSK cluster using SASL

Create an AWS Secret in AWS Secrets Manager (other type of secret, 2 key/value rows of username and password; need to create a new…

Nov 6, 2024

Nov 6, 2024

Installing Conduktor to connect to MSK on AWS

TL-DR; There are instructions to do this manually, but it’s much, much easier to use the cloud formation template.

Nov 5, 2024

Nov 5, 2024

Debunking the Myth: Club Soccer Referees Are Independent Contractors

Are Club Soccer Referees Biased?

Oct 3, 2024

Debunking the Myth: Club Soccer Referees Are Independent Contractors

Oct 3, 2024

The Dark Side of Club Travel Soccer: Borrowing Players for a Quick Win

Oct 3, 2024

The Dark Side of Club Travel Soccer: Borrowing Players for a Quick Win

Oct 3, 2024

Universal data lakehouse: The most vendor/tool neutral data architecture.

What is a Universal Data Lakehouse?

Sep 30, 2024

Universal data lakehouse: The most vendor/tool neutral data architecture.

Sep 30, 2024

Albert Wong

Albert Wong

#eCommerce #Java #Database #k8s #Automation. Hobbies: #BoardGames #Comics #Skeet #VideoGames #Pinball #Magic #YelpElite #Travel #Candy

Following

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams