Using the latest as of Sept 2024 (Spark 3 drivers) for DBeaver

DBeaver ships with a very old version of Spark and Hadoop (spark 2 and hadoop 1.2) for the Hadoop / Spark Driver. Since it’s so old, I decided to see if I could upgrade it to the latest version.

It says Spark 2

And hadoop 1.2

Here’s the github to ask for the upgrade. https://github.com/dbeaver/dbeaver/issues/35521

What I had to do is compile the libraries that DBeaver uses under the hood (https://github.com/dbeaver/dbeaver/wiki/Apache-Hive and https://github.com/timveil/hive-jdbc-uber-jar) and it gave me hive-jdbc-uber-3.1.2.jar.

Deleted all my existing entries and used hive-jdbc-uber-3.1.2.jar in DBeaver and it seems like all is working!

Now using much newer libraries from Spark and Hive and Hadoop!