datasets icon indicating copy to clipboard operation
datasets copied to clipboard

My Private Dataset doesn't exist on the Hub or cannot be accessed

Open wangguan1995 opened this issue 1 year ago • 7 comments

Describe the bug

  File "/root/miniconda3/envs/gino_conda/lib/python3.9/site-packages/datasets/load.py", line 1852, in dataset_module_factory
    raise DatasetNotFoundError(msg + f" at revision '{revision}'" if revision else msg)
datasets.exceptions.DatasetNotFoundError: Dataset 'xxx' doesn't exist on the Hub or cannot be accessed
>>> dataset = load_dataset("xxxx", token=True)

404 error 404 Client Error. (Request ID: Root=xxxx)

Repository Not Found for url: https://huggingface.co/api/datasets/xxx/xxx.
Please make sure you specified the correct `repo_id` and `repo_type`.
If you are trying to access a private or gated repo, make sure you are authenticated.
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/root/miniconda3/envs/gino_conda/lib/python3.9/site-packages/datasets/load.py", line 2593, in load_dataset
    builder_instance = load_dataset_builder(
  File "/root/miniconda3/envs/gino_conda/lib/python3.9/site-packages/datasets/load.py", line 2265, in load_dataset_builder
    dataset_module = dataset_module_factory(
  File "/root/miniconda3/envs/gino_conda/lib/python3.9/site-packages/datasets/load.py", line 1910, in dataset_module_factory
    raise e1 from None
  File "/root/miniconda3/envs/gino_conda/lib/python3.9/site-packages/datasets/load.py", line 1852, in dataset_module_factory
    raise DatasetNotFoundError(msg + f" at revision '{revision}'" if revision else msg)
datasets.exceptions.DatasetNotFoundError: Dataset 'xxx' doesn't exist on the Hub or cannot be accessed

Steps to reproduce the bug

123

Expected behavior

123

Environment info

123

wangguan1995 avatar Jun 06 '24 06:06 wangguan1995

I can load public dataset, but for my private dataset it fails

wangguan1995 avatar Jun 06 '24 06:06 wangguan1995

https://huggingface.co/docs/datasets/upload_dataset

wangguan1995 avatar Jun 06 '24 06:06 wangguan1995

I have checked the API HTTP link. Repository Not Found for url: https://huggingface.co/api/datasets/xxx/xxx.

image

It just works fine.

wangguan1995 avatar Jun 06 '24 07:06 wangguan1995

It seems that everything is in a mass huh....

image

wangguan1995 avatar Jun 06 '24 07:06 wangguan1995

https://huggingface.co/datasets/rajpurkar/squad/blob/main/squad.py fails again

wangguan1995 avatar Jun 06 '24 07:06 wangguan1995

https://github.com/huggingface/datasets/blob/main/templates/new_dataset_script.py#L81 can not use this, too complex. I just need a def to load my file to a dict

wangguan1995 avatar Jun 06 '24 07:06 wangguan1995

I am facing the same issue. Did you find a fix?

fabrahman avatar Jun 12 '24 16:06 fabrahman

You should authenticate to be able to access private or gated repos: https://huggingface.co/docs/hub/datasets-gated#access-gated-datasets-as-a-user

albertvillanova avatar Jul 01 '24 11:07 albertvillanova