narugo1992

I just create a dataset which contains 25k images for this training: https://huggingface.co/datasets/deepghs/nsfw_detect

Ok, I may contribute code in the future as well.

I identified an issue with the mentioned code related to the function `os.path.getsize()`. For instance, on both Linux and macOS platforms, the size of the example file `example_text.txt` that can...

@Wauplin Can you provide additional information about this new API? I received a temporary 405 error when trying to access https://huggingface.co/api/datasets/deepghs/few_shots/paths-info/main . As this error seems to be not reproducible,...

> @narugo1992 `/paths-info` endpoint is a POST route. I have implemented a wrapper (not yet merged) in `huggingface_hub` (see #1435). You can have a look at the implementation [here](https://github.com/huggingface/huggingface_hub/pull/1435/files#diff-71a3e23532e1355e79edd51b351bd514f0aa55b946e4c530b0c95f647773ac5dR1891-R1900). Not...

@Wauplin No problem, I'm happy to contribute my code to the huggingface repository. Regarding the `paths-info` part, it has been verified to be reliable through actual usage, but the problem...

> If you use hf_hub_download, that translates to: > > try: > hf_hub_download(repo_id, filename, local_dir="path/to/local") > # file exists > except huggingface_hub.utils.EntryNotFoundError: > # file does not exist > ......

@julien-c In essence, the idea (detailed in the `hfutils.index` module) is to create an index for tar files, including offsets, sizes, and file hashes of all files within the tar....

> While I attempted to read the response body, it appears to have a certain format internally. However, the format varies across different runtime environments for the same request, sometimes...

I just create a dataset with 25k images for this training: https://huggingface.co/datasets/deepghs/nsfw_detect