Xu-Chen
Xu-Chen
> If possible please test ^ Thank you, i will test on 4*A800-80GB
https://github.com/AutoGPTQ/AutoGPTQ/pull/625
@maziyarpanahi You can try https://github.com/turboderp/exllamav2/issues/388#issuecomment-2028517860
> 什么报错哇 SyntaxError: invalid character '、' (U+3001) row['context'] = ast.literal_eval(row['context']) File "/opt/conda/lib/python3.10/ast.py", line 64, in literal_eval node_or_string = parse(node_or_string.lstrip(" \t"), mode='eval') File "/opt/conda/lib/python3.10/ast.py", line 50, in parse return compile(source, filename,...
> > > > > > > > > SyntaxError: invalid character '、' (U+3001) row['context'] = ast.literal_eval(row['context']) File "/opt/conda/lib/python3.10/ast.py", line 64, in literal_eval node_or_string = parse(node_or_string.lstrip(" \t"), mode='eval') File "/opt/conda/lib/python3.10/ast.py",...
> > 从当前源码安装的 > > 没能复现。尝试从最新分支安装或者重新安装一个环境看看能不能复现？ 好的
方便透露下在验证集上的结果吗？
> 7b的话一张A800 40G就可以启动训练 70b呢，有示例吗
我这边想问下，T5 模型训练时，如何用多块卡
> Thank you for your interest in our work. We are aware of the challenges in implementing KV compression on current open-source code and are actively working on it. The...