MiniCPM-V
MiniCPM-V copied to clipboard
combine dtype and device to save CPU memory
Original code will load model to CPU memory in float32, and will require 36GB+ CPU memory. My modification will use less CPU memory (< 20GB).