Lewis Hemens
Lewis Hemens
Should be possible to set a view as materialized in Snowflake. It would also be good to support cluster by for Snowflake in general too, as these can boost materialized...
In BigQuery, when starting a run, the first thing we do is attempt to create a dataset in the default location provided when connecting to a warehouse. If a dataset...
Currently BigQuery can only be authorized through a service account, which adds significant overhead to setting up a BQ project. It should be possible to provide oauth credentials when executing...
Athena is quite different from the existing warehouses we support and will require a few more settings to be added, e.g setting s3 file locations. https://aws.amazon.com/athena/ - [ ] Write...
Merge performance can be increased significantly when using clustered tables. To do this you need to be able to specify additional `on` clauses in the merge statement, however there is...
Similar to BigQuery, you can tag queries for easier cost and performance analysis. https://docs.snowflake.com/en/sql-reference/sql/alter-session.html Using the tags from the config block, eg: ``` config { type: "table" tags: ["tag1"] }...
For SQLX files. When applying the same pre/post operations to many files, it's cleaner to be able to use JavaScript for advanced uses cases, e.g. when applying the same grant...
When running `dataform run --dry-run`, Dataform prints out a list of all actions (tables, views, operations etc) that will be created. It doesn't consider whether these outputs already exist however,...
There should be a way to tell Dataform to remove any tables from schemas that no longer exist. This is complicated by the fact that a run may not always...
``` bigquery error: Cannot replace a table with a different partitioning spec. Instead, DROP the table, and then recreate it. ``` Current workaround is to manually delete the table from...