Rui Pan

Thanks for your interest in LMFlow! Looks like the installation of `deepspeed` is not well-supported in Windows 10, as [an exactly same issues](https://github.com/microsoft/DeepSpeed/issues/1631) have been mentioned under deepspeed's official repository...

In that case, you may replace your model names with your local model paths, for example, ``` ./scripts/run_finetune.sh \ --model_name_or_path output_models/your-baichuan-model \ --dataset_path data/alpaca/train \ --output_model_path output_models/finetuned-baichuan-7b ``` By the...

Thanks for your interest in LMFlow! Could you please check `log/finetune/train.err` to see the detailed error message? Also, it would be nice if you could provide the hardware settings of...

Thanks for providing the detailed information! For single-GPU card issues, my guess is that it was caused by OOM (out of RAM). Since processing dataset and loading model normally requires...

Thanks for your interest in LMFlow! You may check this [issue](https://github.com/OptimalScale/LMFlow/issues/357) for reference 😄

Thanks for your interest in LMFlow! Could you please provide the full error message so that we may check that for you? Looks like the current error message is incomplete....

It would be nice if you could be more specific, so we could check that for you? Thanks~

Thanks for your interest in LMFlow! We have run experiments in cuda12, and it works fine. Here's my settings: ``` NVIDIA-SMI 525.105.17 Driver Version: 525.105.17 CUDA Version: 12.0 torch version:...

Hi, you may try our latest script, or use http://107.23.182.175:5000/ instead. Thanks for your understanding 🙏

Thanks for your interest in LMFlow! I think `configs/ds_config_zero3.json` provides model parallelism (which also uses cpu offload for optimizer states and model parameters) and can be used for your case....