ZhangYang

Results 9 comments of ZhangYang

ulimit -n 8192 can solve this problem

> > ulimit -n 8192 can solve this problem > > Would there be a systematic way to do this ? The data loading is part of the [MTEB](https://github.com/embeddings-benchmark/mteb) library...

Changing the supplier of the proxy will solve this problem, or you can visit and follow the instructions in https://hf-mirror.com

@albertvillanova @KennethEnevoldsen

add remove_unused_columns=False to training_args https://github.com/huggingface/datasets/issues/6535#issuecomment-1874024704