Joey Sanchez
Joey Sanchez
would be good to have a solution to this. I'm using even smaller image sizes and getting this.
> @csris correction: I fixed `pretrained/GPT-NeoX-20B/prepare.py` not `data/OIG/prepare.py`. `data/OIG/prepare.py` ran just fine for me. > > Every time I ran `pretrained/GPT-NeoX-20B/prepare.py`, it ran for a couple minutes and just gave...
had the same issue. Try running this `pip3 install --upgrade protobuf==3.20.0` to solve it
I've had marginal luck using a 4090 with 24gb of ram. The trick was to not give it ALL of your memory because it will need some for data load...
 Some output from the 4090