chensiyao12

Results 4 comments of chensiyao12

量化int4遇到的问题

没有，你也遇到这个问题吗？

量化int4遇到的问题

> 大佬怎么解决的？

`TypeError: not a string` after pressing to special characters use delete

> ASSISTANT: Traceback (most recent call last): File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main return _run_code(code, main_globals, None, File "/usr/lib/python3.10/runpy.py", line 86, in _run_code exec(code, run_globals) File "/home/FastChat/fastchat/serve/cli.py", line 280, in...

量化成int4后爆cpu内存

可以分享一下量化后的模型吗？