Steinthor Palsson

Interval type column raises TypeError on record access

4

Hi I found an issue when selecting from a table with an [`Interval`](https://docs.sqlalchemy.org/en/13/core/type_basics.html#sqlalchemy.types.Interval) column, this should parse to a `timedelta` object. When used with databases, sqlalchemy raises a `TypeError` when...

Feature request: exit on child failure

7

First off, thanks for this tool! It's been super reliable and easy to use. My one issue with it is that the watchexec can hang indefinitely when the child process...

### Problem description Load files are always saved with the extension of the file format, regardless of whether compression is enabled. I.e. `s3://path/to/load/file.jsonl` may or may not be compressed. This...

Add recommended_file_size cap to limit data writer file size

1

### Description Adds a destination capability `recommended_file_size`. Set to 1GB for bigquery. Couldn't find any upper limit for databricks, snowflake, synapse so leaving it at `None` ### Related Issues -...

New "refresh" mode and "dev_mode"

3

### Description Still needs some cleanup and testing. * `full_refresh arg` replaced with `dev_mode` * Deprecation warning when `full_refresh=True` * Add `refresh: "full" | "replace"` arg to pipeline * `full`...

sql_database: Add flag to include views with reflected tables

1

### Tell us what you do here - Add flag `include_views` to `sql_database` source to enable reflecting views - Test for the flag - Test for `sql_table` works when the...

Add `references` table hint

1

### Description Adds new `references` table hint. Can be added via `@resource` decorator and `apply_hints` Takes a list of "foreign key" references. SQLAlchemy database source automatically generates the hint from...

Sqlalchemy merge support

1

### Description ### Related Issues - Fixes #... - Closes #... - Resolves #... ### Additional Context