Parsa comments

Results 7 comments of


                                            Parsa

Do you mind sharing the source code of https://dsm.quantizr.repl.co/lowestbin.json?

Seems like OP fixed it, but didn't provide much detail on how. I tried the script he mentioned and did not have any luck.

If you ended up getting this working I would appreciate the code. I'm currently trying the same thing as you and running into this issue.

Hi, Now it works, but I run out of vram. I have 20 gb of vram, how much is necessary?

I'm getting the same issue.

So did you manage to fix the error with ggml_type 18?

> > So did you manage to fix the error with ggml_type 18? > > Hi, the error should not occur if using correct yaml and IQ1S weights. And what's...