llamazing

Results 1 issues of llamazing

It costs about 130G memory training model but when to save model it occurs oom error(total memory 195G). Is there extra memory allocation when saving the model?