Using the latest as of Sept 2024 (Spark 3 drivers) for DBeaver
DBeaver ships with a very old version of Spark and Hadoop (spark 2 and hadoop 1.2) for the Hadoop / Spark Driver. Since it’s so old, I decided to see if I could upgrade it to the latest version.
Here’s the github to ask for the upgrade. https://github.com/dbeaver/dbeaver/issues/35521
What I had to do is compile the libraries that DBeaver uses under the hood (https://github.com/dbeaver/dbeaver/wiki/Apache-Hive and https://github.com/timveil/hive-jdbc-uber-jar) and it gave me hive-jdbc-uber-3.1.2.jar.
Deleted all my existing entries and used hive-jdbc-uber-3.1.2.jar in DBeaver and it seems like all is working!