OmniQuant icon indicating copy to clipboard operation
OmniQuant copied to clipboard

Lazy loading

Open Ar57m opened this issue 2 years ago • 0 comments

can you guys implement it on the app mlcchat as llama.cpp? cause in low ram devices it crashes instantly when trying to generate text

Ar57m avatar Sep 08 '23 00:09 Ar57m