Theodore Morley
Theodore Morley
Ah, I forgot to include those: - python: version 3.10.9 - pyarrow: version 14.0.1 - databricks-sql-connector: version 3.0.0 Thanks for the quick reply! Let me know if there's any other...
Hi @andrefurlan-db, I've just rerun my pipeline and the issue is stil occurring, its very consistent in always duplicating the header line so that's an easy way for me to...
For example, I've just pulled a file in this manner which has an individual's ID, and a couple of summary variables such as the most recent date associated with that...
Checking in to update that this issue is still occurring April 2024, and am curious if anyone has replicated it.
Some extra context I noticed today -- generally there has very consistently been an extra header column generated as an indicator that rows were duplicated, one of the files I...
@kravets-levko I just ran my pipeline with that argument in the `sql.connect()` method, and it actually seems to have worked completely, they don't seem to have any duplicates when that...
Unfortunate, but thank you for the help in identifying the source of the error! The pipeline I'm using is run daily so I will keep you updated as to the...