limerenceaid

training memory usage

1

Could you please provide some information about gpus you use for training and the duration of your training stages? As you kindly plan to open source your training code soon,...

Question about training memory usage

4

Could anyone share their GPU configuration for training the model? I'm using six 4090s, but I'm running into a "CUDA out of memory" error right at stage 1, step 1....