Nexes the Elder

Excellent idea, I wanted to see such a feature but am unable to do it myself. I will use it.. a lot! All the possibles improvements you mention are pertinent....

Well, ideally the whole pattern would be definable so the system can be universally applied, there's no premade recipe which makes consensus nor should it be, because we are still...

Hey! I have the exact same problem as the OP has, this with the last version of lollms-webui (which is my first version, I just discovered your tool), under Windows...

Well, ain't the batch supposed to do everything required, as mentioned in the "Easy Install" part of the readme? Here's the relevant part of my log : Launching application... Configuration...

> Doesn't this sort of supersede #6844? I wouldn't claim to supersede anything, #6844 is more complex and use external config files, while my PR simply replicates exactly the CL...

> Sure, just fix the [EditorConfig](https://github.com/ggerganov/llama.cpp/actions/runs/10291422698/job/28483631617?pr=8917) failures first. :) > I just saw, and I fixed the bad indent and trailing whitespaces. :)

@jukofyork : this is quite an undertaking for me, for if the tensors of the models you mention are not effected by my PR, it means that they are also...

Considering the informations given by Compilade, I don't think there's anything more to do for the present PR, Jukofyork. The discussions in #8736 will likely end-up in a PR refactoring...

@slaren: I agree with your reasoning. This is a stopgap measure indeed, and I neglected to consider the mess it could create with people sharing vastly modified quants without proper...

@slaren : I created the required FTYPE. The custom quants work only with the FTYPE "CQS", and will simply be bypassed if the user quantizing a model selects a regular...