Ed Andrews

Results 2 issues of Ed Andrews

My team uses iam credential passthrough on our clusters to access data that sits in s3. This requires us to call `SET spark.databricks.credentials.assumed.role=` as a pre-hook to models to be...

enhancement
Stale

[Polars](https://github.com/pola-rs/polars) is a single-machine columnar dataframe library built on top of pyarrow Tables with both a eager and lazy API. While the default pickle serialization works fine for eagerly-created dataframes,...