ZhangYang
ZhangYang
ulimit -n 8192 can solve this problem
> > ulimit -n 8192 can solve this problem > > Would there be a systematic way to do this ? The data loading is part of the [MTEB](https://github.com/embeddings-benchmark/mteb) library...
netstat command
Changing the supplier of the proxy will solve this problem, or you can visit and follow the instructions in https://hf-mirror.com
@albertvillanova @KennethEnevoldsen
add remove_unused_columns=False to training_args https://github.com/huggingface/datasets/issues/6535#issuecomment-1874024704