maddes8cht

Its even starnger: if you select another area in the settings and then switch back again, the language options become available.

Regarding multiline input: Can't we simply use `Shift-Return` for having a new line without sending control back to Llama? This would be kind of standard behaviour. Doing shift-return to submit...

I know basic c/c++, and the main.cpp doesn't look really complicated at first sight (except for the fact that everything is in a rather unstructured queue). However, I find it...

> I think that the "partial offloading" feature is complicating the implementation a lot for little to no benefit vs > Let me be frank: that feature is the whole...

it's the shell ending the program on sigint. it's the developers decision to use sigint to give control back to the user. I think it should be done with aother...

Actually, in some ways i prefer the simple console ui over the webUIs out there. While koboldcpp is somehow fast in output, it always feeds back in a lot of...

Thanks for the insights. Yes, it would be really nice to have a conso,le based interface for could support any ggml -supported llms. I would be glad to see something...

The roadmap still tells me about "up next in the terminal" what i migth get in an upcoming version 1.19, which was ouf of preview thre months ago. There's something...

SO sad noone seems to work on this. Having a more sophisticated fk/ik rig should be a key feature. Maybe additional or other advanced rigs to be implemented could be...

In the original Llama, there where the sizes * 7B with 32 Layers * 13B with 40 Layers * 30B with 60 Layers * 65B with 80 Layers As we...