Jeffrey Wang

Support Vue template.

Programming Language Support for Documents

2

_Originally posted by @sime2408 in https://github.com/PromtEngineer/localGPT/issues/151#issuecomment-1597633918_ This ticket is to support different methods of Document splitting. Specifically for different programming languages. Currently, Documents are loaded and then split with vanilla...

ggml quant cpu mps support

2

To use MPS, you have to install llama-cpp-python with these env vars: ```bash export CMAKE_ARGS="-DLLAMA_METAL=on" export FORCE_CMAKE=1 ``` otherwise run this to upgrade from current: ```bash CMAKE_ARGS="-DLLAMA_METAL=on" FORCE_CMAKE=1 pip install...

Support Quantized GGML models for CPU and MPS

2

Hey, is it worth it to support GGML quantized models for cpu and mps? I've done some testing of TheBloke's GGML models. Most of them are supported by llama-cpp, which...