datasets icon indicating copy to clipboard operation
datasets copied to clipboard

Cannot download wiki40b on Windows

Open elda27 opened this issue 4 years ago • 2 comments

There are not working on Windows because filesep is not "/". Is this library is not supported on the client-side such as desktop computers? or bags?

https://github.com/tensorflow/datasets/blob/74a60f94dbc4ffc385a18d6653b9fa829ff2d092/tensorflow_datasets/text/wiki40b.py#L118-L137

elda27 avatar Mar 04 '21 14:03 elda27

I tried to run test codes that are failing too many cases. Who does know the maintainer around the processing path concatenation?

I can contribute to fix the error of this case on Windows. (Already edited on my local code and work it.) But the same or similarity issue is found in too many positions. So I'm worried that my opinion is wrong

elda27 avatar Mar 09 '21 13:03 elda27

As of Dec 2023, I managed to download the wiki40b dataset using the following script in colab: https://github.com/mahrukhS/Tensorflow-A-to-Z/blob/main/wiki40b.ipynb

mahrukhS avatar Dec 27 '23 18:12 mahrukhS