Jonathon Palmieri

icon indicating a website link www.rexrecruiting.com

icon company Rex Recruiting icon location Connecticut icon location Technology leads us to a future of people doing meaningful engaging work! Work is mostly private, please request access.

Results 3 comments of Jonathon Palmieri

Cuda mismatch between installed and PyTorch causing AutoGPTQ error

You may have too new of a cuda for auto-gptq to build the wheel. You should install cu118 or cu117, depending on the version of Cuda you choose. ` pip3...

any tutorial on how to use Infinity?

@michaelfeil, some examples of how to load a model would be nice. Examples in general, are nice in the readme.

Documentation?

Yeah, I am having issues. If I understand correctly it almost appears like it's pointing to the wrong api url. But without any documentation I don't really have the time...