Stefan Bauer
Stefan Bauer
PyArrow version 12 and just tried version 14 but same issue. Somehow I cannot install version 13 for some reason (need to investigate why when I have more time). Fyi,...
> @roeap it seems the issue was already flagged by @stefnba. > > Since it works fine with PyArrow directly I would guess it's the delta filesystem handler. @stefnba can...
> But you are seeing partition directories being made? @wjones127 In some cases 1-2 partition dirs are created and a couple of sub dirs, in other cases none are created....
> Ok then two temp workarounds are to pass a AzureBlobFileSystem to write_deltalake, since that is than passed to pyarrow dataset or you limit the max_files_open Thanks for the suggestion....
I have the same issue but not with posgres but with a FastAPI docker compose application. The postgres was automatically added to network "coolify" but not the FastAPI app. After...
Hi, is there any update on this topic? Thanks.
Maybe this helps. A PyArrow Dataset can be initiated from a list of file paths: Create a FileSystemDataset from explicitly given files. The files must be located on the same...