Trino Connector file for Apache Hudi + AWS Glue + S3

Albert Wong
2 days ago

--

Here are example commands to run on mysql cli to connect to AWS Glue Catalog and Apache Hudi files stored in AWS S3.

drop catalog hudi_catalog_glue;
CREATE EXTERNAL CATALOG hudi_catalog_glue PROPERTIES ( “type” = “hudi”, “hive.metastore.type” = “glue”, “aws.glue.use_instance_profile” = “false”, “aws.glue.region” = “us-west-2”, “aws.glue.access_key” = “XXXX”, “aws.glue.secret_key” = “YYYYY”, “aws.s3.use_instance_profile” = “false”, “aws.s3.region” = “us-west-2”, “aws.s3.access_key” = “XXXXXXX”, “aws.s3.secret_key” = “YYYYYY”);
SHOW CATALOGS;
SHOW DATABASES from hudi_catalog_glue;
set CATALOG hudi_catalog_glue;
use nyctaxi_onehouse;
show tables;
select * from taxi_green_rt;

--

--

Albert Wong

#eCommerce #Java #Database #k8s #Automation. Hobbies: #BoardGames #Comics #Skeet #VideoGames #Pinball #Magic #YelpElite #Travel #Candy