Maria Samorodova
Maria Samorodova
+1 for OpenAI API support
Has this problem been solved? I have the same error when using a quantized mixtral model
Hi @nv-guomingz I run the following command for the quantized model `python3 /tensorrt_llm/examples/llama/convert_checkpoint.py --model_dir /model --output_dir /engine --load_model_on_cpu` I am using the latest version of `tensorrt_llm==0.9.0` My model has the...
@dongs0104 It really works! Thank you very much! And maybe do you know why special tokens are displayed in the generated text? And also the text is never generated until...
Hi @eugen-ajechiloae-clearml ! I also get an error on earlier versions of clearml if the dataset has more than one parent.
This only works if the dataset has only one parent. So there will be no error if you download datasets recursively.