imwide

Killed while loading model.

2

 No further information is given. i dont know how to fix it. there is no error message which could be helpful :(

I want to buy the nessecary hardware to load and run this model on a GPU through python at ideally about 5 tokens per second or more. What GPU, ram,...

Killed while loading. No error message

3

 How do i fix this?

How to use GPU?

21

I run llama cpp python on my new PC which has a built in RTX 3060 with 12GB VRAM This is my code: ``` from llama_cpp import Llama llm =...