pangguoqing

Results 3 comments of pangguoqing

> 量化模型已经发布,见README.md 威武

Mac OS M1没能把量化后的模型跑起来。根据https://github.com/LianjiaTech/BELLE/tree/main/gptq提到的安装过程,依赖 nvidia 提供的CUDA,但MacOS没有nvidia显卡,所以也就没有对应的工具。https://developer.nvidia.com/cuda-downloads MacOS 是否还有其它方式跑量化后的模型?另外我有一台windows 10,有Nvidia显卡,但显卡比较初级,显存只有5G。但内存有32G。 是否有办法在内存中跑?

Thank you very much for your reply. I am familiar with 'page break.' However, I am looking for more advanced features, such as the ability to set page size, headers,...