Trace Miracle
Trace Miracle
> So, on windows 10, when I do: > > ``` > pip install deepspeed > Collecting deepspeed > Using cached deepspeed-0.8.3.tar.gz (765 kB) > Preparing metadata (setup.py) ... error...
Of course you can. The finetuning aims to adjust the actor-model for better performance. If the DeepSpeed team opensource the model parameters, you can just download the model and use...
> Which model is this? The 1.3B? Yes, 1.3B actor-model with 350M reward model. I retrained it, but it still performs almost the same.
> @Trace2333 @loonxi We just pushed an update (#346) to the scripts to train the models and also provide a bit more detail about the settings we are using and...
Same problem. Is something in the training process went wrong?
same problem