chriscomeau79

"Table schema does not match schema used to create file" when incrementally writing parquet with batches from fetcharrowbatches if using strings_as_dictionary=True

2

This worked on previous version: Arrow 0.9, Turbodbc 2.7 Current version: Arrow 0.11, Turbodbc 3.0 Workaround: I used strings_as_dictionary=False instead. ``` for batch in cursor.fetcharrowbatches(strings_as_dictionary=True): if schema == None: schema...

Use compression in insert_arrow, with example ArrowStream

3

I noticed insert_arrow is about 10x slower that this equivalent code which does the insert over HTTP using zstandard compression. Maybe something else is going on, but from looking at...

AutoMaterialize "cooldown": AutoMaterializePolicy.eager(cooldown_seconds=300), with SKIP instead of DISCARD

1

### What's the use case? Rate-limiting eager AutoMaterializations. Materialize as soon as conditions are met, but at most once per N seconds. AutoMaterializePolicy.eager(cooldown_seconds=300) If cooldown hasn't elapsed yet, Automaterialize decision...