Albert Wong – Medium

Albert Wong

FastAvro doesn’t work with Confluent AVRO and here’s how to get it working

You’ll get an error like Unknown magic byte when using the python FastAVRO library to send messages to a kafka topic.

Nov 22

Nov 22

Connecting AWS Athena to Preset.io

You would think that https://docs.preset.io/docs/aws-athena is enough to get it working, but it’s not.

Nov 14

Connecting AWS Athena to Preset.io

Nov 14

Installing DataHub Core (docker compose) with personal tokens

DataHub does not provide a free managed solution, so you need to install DataHub Core. DataHub Core is the open source version of DataHub…

Nov 14

Nov 14

Python Client for AWS MSK and AWS Glue Schema Registry and AVRO message payload

While Python is a powerful language for working with AWS MSK, there’s currently a gap in official documentation and examples for…

Nov 13

Nov 13

Python Client with AWS MSK and Confluent Schema Registry and AVRO message payload

Download the official Python Client at https://github.com/confluentinc/confluent-kafka-python/blob/master/examples/avro_producer.py.

Nov 13

Nov 13

Creating and Connecting an AWS MSK cluster using SASL

Create an AWS Secret in AWS Secrets Manager (other type of secret, 2 key/value rows of username and password; need to create a new…

Nov 6

Nov 6

Installing Conduktor to connect to MSK on AWS

TL-DR; There are instructions to do this manually, but it’s much, much easier to use the cloud formation template.

Nov 5

Nov 5

Debunking the Myth: Club Soccer Referees Are Independent Contractors

Are Club Soccer Referees Biased?

Oct 3

Debunking the Myth: Club Soccer Referees Are Independent Contractors

Oct 3

The Dark Side of Club Travel Soccer: Borrowing Players for a Quick Win

Oct 3

The Dark Side of Club Travel Soccer: Borrowing Players for a Quick Win

Oct 3

Universal data lakehouse: The most vendor/tool neutral data architecture.

What is a Universal Data Lakehouse?

Sep 30

Universal data lakehouse: The most vendor/tool neutral data architecture.

Sep 30

Albert Wong

Albert Wong

#eCommerce #Java #Database #k8s #Automation. Hobbies: #BoardGames #Comics #Skeet #VideoGames #Pinball #Magic #YelpElite #Travel #Candy

Following

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams