xtuner icon indicating copy to clipboard operation
xtuner copied to clipboard

[Fix] Fix OOM when qlora converting

Open fanqiNO1 opened this issue 1 year ago • 0 comments

If the LLM is too big to be loaded in a single GPU, we need device_map = 'auto' to avoid OOM.

According to the issue #715.

fanqiNO1 avatar Sep 12 '24 17:09 fanqiNO1