window GPU选择最小规格

[NingBoHao]

window 10 成功安装lmflow 目前GPU RTX2060s 能运行那个模型，怎么运行？

[ylz123]

同问，3060 12G是否可以

[shizhediao]

如果是inference的话，7B模型需要14GB 显存。 如果是finetune的画，需要的显存会更多。 可以试用一下较小的模型，比如Galactica-1.3B

---

If it's inference, the 7B model requires 14GB of memory. If it's fine-tuning, more memory will be needed. You could try using a smaller model like Galactica-1.3B.

[shizhediao]

This issue has been marked as stale because it has not had recent activity. If you think this still needs to be addressed please feel free to reopen this issue. Thanks