Alice Sayutina
Alice Sayutina
Some technical details: gentoo, cdm version = "0.6.1_pre20130419"
`DatabricksSession.builder.getOrCreate()` with fallback to `SparkSession.builder.getOrCreate()` in case of import error should be good implementation. `DatabricksSession` supports configuration by `SPARK_REMOTE` exactly as in SparkSession, while also supporting additional configuration mechanics and...
I can confirm that not using quotes in PASSWORD_HASH=$$blablabla works. There is also $ -> $$ replacement step which is not super clear.