Nicolas Iglesias
Nicolas Iglesias
I partially solved this but it's generating a bunch of **A:** ```sh ❯ ./build/bin/gpt-j -m ./ggml-model-f16.bin -p "A continuación hay una instrucción que describe una tarea. Proporciona una respuesta que...
> 8-bit and 4-bit quantization without `groupsuze=128` works. 2-bit quantization does not and return garbage output. `groupsize=128` in each case causes garbage output too. I used groupsize 128 for 4...
I'm using https://github.com/cyqlelabs/mcp-dual-cycle-reasoner
> This project solely relies on LLM to figure out the coordinates. I'm working on a fork: [bytebot-hawkeye](https://github.com/zhound420/bytebot-hawkeye) Nice job there. It's incredible YCombinator has backed this project, which is...