William Roberts comments

Repositories
Issues
Comments

Results 3 comments of


                                            William Roberts

Opening fsspec s3 file twice results in invalid start byte

Note that the second example fails on the first open_dataset, which I assume is expected since it's not mode `mode='rb'`

Opening fsspec s3 file twice results in invalid start byte

Adding `filename_or_obj.seek(0)` fixes this, but I am not sure if it poses a security risk? ``` def read_magic_number_from_file(filename_or_obj, count=8) -> bytes: # check byte header to determine file type if...

Opening fsspec s3 file twice results in invalid start byte

@djhoese Is that not already an existing problem since `filename_or_obj.seek(0)` is called in the existing code after reading the magic number?