sbt-databricks

sbt-databricks copied to clipboard

does this work on Azure databricks?

1

the requirement says that a databricks account is needed, I have an azure hosted instance of databricks where the login is done via active directory, Can this be used to...

PKHeb

This is a very useful project, but unfortunately it's impossible to use without 2.0 API support. (All we get now is bad request). I notice that we have some old...

EnriqueSampaio

Plugin for sbt v1.x is missing

1

I was trying to migrate one of my projects to latest sbt version and databricks plugin couldn't be resolved.

ivanobulo

dbcDeploy works fine if no jar exists. However, for some reason dbcUpload/dbcDeploy will not overwrite jar files which have already been deployed even for snapshot versions. This appears to be...

dgaray-acorns

[WIP] Porting dbcDeploy on API v2.0

8

The uploadJar() and attachToCluster() methods are overwritten and ported on REST API v2.0.

MaxGekk

Upgrading to use Databricks API v2.0

5

Hey @brkyvz ! I know the Databricks 2.0 API doesn't support all of the functionality of the 1.2 API, but would a PR that implemented some 2.0 functionality be welcome?...

the-jackalope

The DBC 1.2 REST API has been deprecated and some of the functionality stopped working. Some of the endpoints that used to return 4xx unauthorized responses, now may return 500....

assiotis

If you are running Databricks version 2.18 or greater you must use sbt-databricks version 0.1.5 If you are running Databricks version 2.8 or greater you must use sbt-databricks version 0.1.3...

rlgarris

dbcUpload/Deploy fails with NoSuchElementException: cannot find node with id <id>

5

I think this is the same issue reported in #35, but I may have narrowed down when it happens. If I attach a jar to a cluster and then delete...

justinmills

A very long classpath including user jars is loaded when a Spark node starts. Instead of users having to figure out which jars are in memory whenever they change a...

omervk