Raymond Cheng
Raymond Cheng
### What is it? genTables fails silently, so that the CI shows green check marks We should - Update genTables to fail loudly if we don't get a DBT_TARGET -...
* This needs to wait until Hasura/pipeline redeploy
### What is it? In the future, we may have data spread out among a bunch of places (e.g. BigQuery, Clickhouse, Postgres, random files, IPFS). Trino seems like an interesting...
### What is it? We've been having all sorts of issues with the Airbyte connector. See this issue for a summary https://github.com/opensource-observer/oso/issues/1229 Dagster seems to have built-in support for ELT...
### What is it? I believe it is currently IP restricted, this would open it up to other admins Run this in GKE
### What is it? https://docs.dagster.io/_apidocs/cli See —read-only
### What is it? https://github.com/cloudquery/cq_dagster_embedded_elt
### What is it? We can probably use either the BQ data transfer service or Airbyte. Probably want to do this as a Dagster asset
### What is it? https://docs.dagster.io/concepts/assets/multi-assets
### What is it? Pretty useful ETL product, and free from what i can tell. i manually configured it so far, will need to terraform this after the fact