Tarek Samhan

icon company Bank of Canada icon location Ottawa, Ontario

Results 1 issues of Tarek Samhan

Appending a local Pandas dataframe to a Delta table in Azure is slow

1 comment

I followed the instructions on [this](https://docs.databricks.com/en/dev-tools/sqlalchemy.html#language-SQL%C2%A0warehouse) page to create a SQLAlchemy engine and used it with the Pandas `to_sql()` method. It's taking around 2 seconds to append one data point...