llama-cpp-swift

llama-cpp-swift copied to clipboard

Hello, Is this library able to load LLava models? Thanks

hassanzadeh

Running crash by llama_tokenize

1

Platform: MacOS13.6.1 Xcode 15.0 ScreenShot: I download the model(https://hf-mirror.com/NikolayKozloff/DeepSeek-R1-Distill-Qwen-1.5B-Multilingual-Q8_0-GGUF) in local, then runnning as same as the simple. ```swift let modelPath = "/Users/xxx/Documents/xxx/DeepSeek-R1-Distill-Qwen-1.5B-Multilingual-Q8_0-GGUF/deepseek-r1-distill-qwen-1.5b-multilingual-q8_0.gguf" let model = try Model(modelPath: modelPath) let...

linxi5547371

Can't use the library succefully due to file can't import

1

Hi. Hope you are doing well. I have tried to use the library following your doc. in a swfit ui project -- ios However, when I put the sample code...

shanzhengliu