bigdata-docker-compose
bigdata-docker-compose copied to clipboard
Spark is not connected to Hive correctly.
I have already create a new database in Hive, however, when I excute the following code in spark-shell, it seems that spark goes to the wrong metastore_db as shown in this this page Spark Documentation
scala> spark.sql("show databases").show()
+---------------+
|databaseName|
+---------------+
| default |
+---------------+
hive> show databases;
OK
default
sparkda
Time taken: 0.984 seconds, Fetched: 2 row(s)