bundle-examples

bundle-examples copied to clipboard

Inaccurate reference to Databricks.yml?

3

Hi, I'm working on deploying a DBT project trough Databricks Asset bundles, but somewhat confused on how to get environment variables into the task. [In this example](https://github.com/databricks/bundle-examples/blob/c84828779b8c1976ce6da1a1789133b8cc11d5cf/dbt_sql/dbt_profiles/profiles.yml#L19), how is {{...

johalnes

Inner dev loop fixes

1

1. Add `dlt` typing 2. Add auto reload to the notebook 3. Pass in `spark` object to library so it works better with DBConnect in the IDE

fjakobs

Example of a job with tasks that run other jobs

6

Note: this requires https://github.com/databricks/cli/pull/1219.

pietern

I was running the instructions in the README under `mlops_stack/resources` and ran into an error when running `databricks bundle validate`. This fix allowed me to validate the bundle successfully.

rt-databricks

Example to show how bundle variables work

1

pietern

pietern

Define all-purpose job clusters

2

Is there a way to define all-purpose job clusters? Looking at `default_python_job`, it seems that the clusters are defined per job. I don't see any way to reference the cluster...

ryanhubbell

The fixtures folder has a basic .gitkeep, however no further details. Connotation of fixtures seems to indicate test fixtures, not reusable helper code. Including some integration tests in the template...

asears

The `pyproject.toml` file can be used as the default configuration for tools such as pytest, flake8, ruff, mypy, sphinx, black, isort and build tooling. https://docs.pytest.org/en/stable/reference/customize.html https://setuptools.pypa.io/en/latest/userguide/pyproject_config.html https://setuptools.pypa.io/en/latest/userguide/entry_point.html https://github.com/cjolowicz/cookiecutter-hypermodern-python/ This would...

asears

Note: this requires an unreleased version of the CLI, hence the v0.226.0 requirement.

pietern