c3-moutasem
c3-moutasem
Same issue here
I am having the same issue when trying to load a local checkpoint model = AutoModelForCausalLM.from_pretrained( "./training_checkpoints/new_model", quantization_config=quant_config, device_map='cuda:0' ) New_model contains the screenshot attached
@byshiue is the workaround to force the script to run on cpp runtime ? I just cloned the repo and I still have the same issue with the python runtime
This is resolved. Thanks! It seems like using the latest stable version helped