Sachin Panicker
Sachin Panicker
> Here is what I did to run Alpaca 30b on my system with llama.cpp. I would assume it would work with Alpaca 13b as well. > > 1. Downloaded...
Does anyone have a converted Alpaca 13B model bin file that you could share so I could download it please? I am getting the below error no matter what. I...
can someone share the converted alpaca 13b model bin file ?
> Use this script `convert-unversioned-ggml-to-ggml.py` that comes with the llama.cpp. > > For example: > > `python convert-unversioned-ggml-to-ggml.py models/13B/oldggml/ggml-model-q4_0.bin models/13B/ggml-model-q4_0.bin` And just to confirm, the file that I should be...
> > > Use this script `convert-unversioned-ggml-to-ggml.py` that comes with the llama.cpp. > > > For example: > > > `python convert-unversioned-ggml-to-ggml.py models/13B/oldggml/ggml-model-q4_0.bin models/13B/ggml-model-q4_0.bin` > > > > > >...
> > > Use this script `convert-unversioned-ggml-to-ggml.py` that comes with the llama.cpp. > > > For example: > > > `python convert-unversioned-ggml-to-ggml.py models/13B/oldggml/ggml-model-q4_0.bin models/13B/ggml-model-q4_0.bin` > > > > > >...
Optimized the code for GPU
There are plenty dependencies missing in the list, which are not there in colab. I recommend running it locally. First, run the pip install requirements.txt, and thereafter execute the rest...
**av package is part of the pytorchvideo lib. Just install pytorchvideo-0.1.5 in your colab and you will be all set. I tested it on colab and works.** !pip install iopath...