Daniel J. Parente

icon indicating a website link http://biophysengr.net

icon location I am a scientist and family physician interested in machine learning, genomics, bioinformatics, clinical informatics and preventive care.

Results 1 comments of Daniel J. Parente

[Bug]: Problem loading EXL2 in rc_054

I've been working on this same problem with a Llama-3.1 exl2 model against rc054. I think part of the problem is that the model.safetensors.index.json file is pointing at files that...