luoyangen
luoyangen
@simontite-capita-ti to the new version of sklearn(0.18.1), DeprecationWarning comes out and yalign doesn't works now. do you have any tips
Yeah, the reason is memory not enough, After I decreased the hidden layer of both encoder and decoder to 800, and the word embedding to 500, It won't throw that...
@semoal thx for sharing the code. Would you share the reranker class? Thanks again~
@semoal newer to llamaindex, Thanks for the sharing. :-)
@irexyc 求助下，为什么我这边使用同样语句去量化minicpm会报错，运行环境是官方的docker，lmdeploy==0.5.0 File "/opt/conda/lib/python3.12/site-packages/lmdeploy/cli/entrypoint.py", line 43, in run args.run(args) File "/opt/conda/lib/python3.12/site-packages/lmdeploy/cli/lite.py", line 139, in auto_awq auto_awq(**kwargs) File "/opt/conda/lib/python3.12/site-packages/lmdeploy/lite/apis/auto_awq.py", line 148, in auto_awq save_vl_model(vl_model, model_path, work_dir) File "/opt/conda/lib/python3.12/site-packages/lmdeploy/lite/apis/auto_awq.py", line 45, in...
@irexyc 把transformers的版本降到4.40.0可用了