docker-zeppelin icon indicating copy to clipboard operation
docker-zeppelin copied to clipboard

Unable to instantiate SparkSession with Hive support because Hive classes are not found.

Open emptyr1 opened this issue 7 years ago • 2 comments

Hi, I'm having issues with this command:

val spark = (SparkSession
          .builder()
          .appName("interfacing spark sql to hive metastore without configuration file")
          .config("hive.metastore.uris", "thrift://hive-metastorerver-201227-ro-001:903,thrift://hive-metasteserver-201727-ro-002:9083,thrift://hive-metastoreser-201727-ro-003:9083")
          .enableHiveSupport()
          .getOrCreate())

I get error: java.lang.IllegalArgumentException: Unable to instantiate SparkSession with Hive support because Hive classes are not found. I've added . the jars via the interpreter and restarted it, but still getting the issue. Any idea how to solve this? I added org.apache.spark:spark-hive_2.11:2.1.0 under "jdbc"

emptyr1 avatar Jun 05 '18 17:06 emptyr1

I think this problem maybe because some confict between the version of spark-sql and spark-hive when I use the same version, this problem solved

YunFeng0817 avatar Dec 12 '18 07:12 YunFeng0817

@Mark-Fenng, This should be an acceptable answers.

drehi440 avatar Jan 20 '20 12:01 drehi440