Tengfei9228

My single card graphics memory is 16GB and cannot accommodate the 13B model. I plan to use multiple cards for training now. When I actually call 4 cards for finetune,...

Can't this model be trained using multi nodes and multiple cards ?

2

My machine has a single node 4-card 16G graphics memory, and running the 16B model with multiple nodes will result in OOM regardless of how the number of nodes is...