llama_cpp_dart
llama_cpp_dart copied to clipboard
dart binding for llama.cpp
I want to use the Qwen3 module on my app. It requires a minimal LLama version `b5401`. Can we update the repo to use a supported version?.
Here us my function, Can anyone give me any pointers on why the context is coming back not initalized? ``` // Load the path to the model file in assets...
After 2 days finally I managed to configure the project according to this package but when I called LlamaParent.init() it is taking soooo much time. here is my code snippet:...
### Steps to Reproduce 1. Make flutter app. 2. install library flutter pub add llama_cpp_dart 3. Download llama.cpp and make a shared library for me this is .libllama.dylib and add...
I asked ai a bit and it seems I would need to compile? I dont much about this. I am using android studio, with Flutter (dart), and really wish to...
I have this project: https://github.com/EnderRobber101/ai_test_2_app which i am trying to start on. All it has is the packages added and i can't figure out how to compile it. Or is...
Preferably on android studio? Something like that? Are there any examples?
Please update the project to make it compatible again with the latest releases. I already created a script which updated the ffi code, but my knowledge about llama.cpp is too...
I don't find any bugs in the project. I just want to ask some questions regarding .so files . I am developing a flutter app which transcribes audio files with...
The real trigger is that the binary dependency cannot be found, but since in the cleanup is a variable not initialized the error message is not visible. Fixes #51