hf_transfer
hf_transfer copied to clipboard
huggingface
Including these links in the project file will ensure that pypi.org links from the project page to the github page. This makes it easier for someone discovering the project on...
### System Info python3.12 huggingface_hub v0.23.0 ### Reproduction HF_ENDPOINT="https://mirrorxxxxx.com" HF_HUB_ENABLE_HF_TRANSFER=1 huggingface-cli download $ORG/$DATA --include "*.parquet" --repo-type dataset --token xxxxxxx ### Expected behavior work as no `HF_HUB_ENABLE_HF_TRANSFER=1` enabled
**Is your feature request related to a problem? Please describe.** hf_transfer is very fast for individual files, but for models with many split files, it's not quite as fast as...
### System Info > [!Important] > The issue only exists in MacOS Hi there 👋 If I want to install `hf-transfer` (0.1.6) in a venv with Python 3.9.19 I have...
### System Info hf_transfer = 0.1.6 huggingface_hub = 0.21.4 ### Reproduction We have not been able to reproduce and it is hard to really give details, since it happens very...
Implement in-memory download in `hf_transfer`. Output type would be a byte array. @Narsil is this something feasible? Context: would allow in-memory download in `HfFileSystem` for example when doing `HfFileSystem().read_bytes("hf://models/my-model/model.safetensors")` without...
Just a couple of small typos, style fixes, and even a minor possible performance improvement around header map generation.
### System Info When using HF_HUB_ENABLE_HF_TRANSFER, I still see my python huggingface_hub uploading as LFS file ### Reproduction import os os.environ["HF_HUB_ENABLE_HF_TRANSFER"] = "1" from huggingface_hub import HfApi, logging api.upload_file(/information here/)...
### System Info hf_transfer==0.1.6, Windows 11, Python version 3.10.9, huggingface_hub==0.23.4 While having the environment variable 'HF_HUB_ENABLE_HF_TRANSFER' set to 1 the upload speeds attempted by hf_transfer completely chokes my connection and...
