Unknown-Body
Unknown-Body
you can download pretrained model from this link http://download.tensorflow.org/models/resnet_v2_101_2017_04_14.tar.gz
I try to modify subgraph_size to less than 5, for example ,used 4.
the same issue occurs to me. And I find the demo can not support tif format, when i try to upload the RS image and choose Everthing to cut out...
接着这个话题，7b模型我发现很多answer没说完就结束了。另外13b模型的token.model 方便提供一下，谢谢
python pretrain.py --pretrained_model_path /home/pretrain_models/LLaMA-zh-7b-hf --dataset_path dataset.pt --spm_model_path /home/pretrain_models/LLaMA-zh-7b-hf/tokenizer.model --config_path /home/pretrain_models/LLaMA-zh-7b-hf/config.json --output_model_path output/llama_zh_7b --world_size 1 --data_processor alpaca --total_steps 20000 --save_checkpoint_steps 100 --batch_size 24 This is the command I want to pretrain...
Ok, when I download the Chinese-LLaMA-7B ,then another error occurs, `FileNotFoundError: [Errno 2] No such file or directory: '/home/pretrain_models/Chinese-LLaMA-7B/pytorch_model.bin.index.json'`
Yeah, I can run it ,thanks a lot. Actually, i want to know how many GPU and CPU memories occupied by Chinese-LLaMA-7B mode when use deepspeed.