databricks
WIP - deploying without terraform
Changes
Add new deployment method: “direct” which deploys without terraform. It can be enabled with new env var DATABRICKS_CLI_DEPLOYMENT set to “direct”.
This is a prototype with many features, resources and test coverage missing, not intended for any actual use.
Why
This is going to be first developed into feature matching "terraform" and then (after deprecation period) become the only method of deployment of DABs. This deployment method addresses issues with relying on terraform such as license of terraform, having to download terraform binary and provider from the internet and in general will give us more control over deployment.
Tests
All acceptance tests by default are now run with two settings of DATABRICKS_CLI_DEPLOYMENT: “terraform” and “direct”. Tests that do not pass on 'direct' mode yet, override this.
Running all tests within a single github job caused the job time to grow non-linearly, so I’ve split each job in two - one for terraform and one for direct deployment.
The acceptance test runner will now use DATABRICKS_CLI_DEPLOYMENT as a filter: if set, it’ll only run tests matching the environment setting. Github workflow makes use of this.
