llama_cpp_dart icon indicating copy to clipboard operation
llama_cpp_dart copied to clipboard
verified publisher icon netdur

App crashed when loading a model

Open Vinayak006 opened this issue 1 year ago • 2 comments

Description

The application crashed when i tried to load a model.

Environment

  • Platform: Android 11
  • Architecture: ARM64
  • Dart SDK Version: 3.5.3
  • Flutter SDK Version: 3.24.3
  • Library Version: 0.0.7

Steps to Reproduce

  1. Build libllama.so from llama.cpp and place it in the project’s root folder.
  2. Attempt to load the model.
  3. Observe the fatal signal error when attempting to call the function.

Logs

F/libc    (15982): Fatal signal 11 (SIGSEGV), code 1 (SEGV_MAPERR), fault addr 0x117 in tid 16717 (DartWorker), pid 15982 (le.llamacppdart)
Process name is com.example.llamacppdart, not key_process
*** *** *** *** *** *** *** *** *** *** *** *** *** *** *** ***
Build fingerprint: 'Realme/RMX1851/RMX1851:11/RKQ1.201217.002/1645426024988:user/release-keys'
Revision: '0'
ABI: 'arm64'
Timestamp: 2024-10-30 11:52:12+0530
pid: 15982, tid: 16717, name: DartWorker  >>> com.example.llamacppdart <<<
uid: 12687
signal 11 (SIGSEGV), code 1 (SEGV_MAPERR), fault addr 0x117
Cause: null pointer dereference
    x0  000000756647ade0  x1  0000000000000000  x2  0000000000000040  x3  000000756647ae30
    x4  000000756647ae20  x5  000000757d892c00  x6  0000007406dfffe8  x7  00000075d9d1c800
    x8  0000000000000001  x9  000000756647ade0  x10 0000007406da8470  x11 0000000000000000
    x12 0000000000000000  x13 00000075d9d1f000  x14 0000000000000000  x15 000000756647ae38
    x16 0000007400000000  x17 00000075de5a5198  x18 000000756325e000  x19 0000007565ead468
    x20 000000756647b600  x21 00000075de5a4a00  x22 0000007400008081  x23 000e888dba1de47b
    x24 0000007400008081  x25 0000007566399000  x26 00000075de5a4a00  x27 00000000000000ff
    x28 0000000800000074  x29 000000756647ae60
    lr  0000007565ead45c  sp  0000007566399000  pc  0000007565ead4d0  pst 0000000060000000
backtrace:
      #00 pc 000000000002d4d0  [anon:dart-code]
Lost connection to device.

Exited.

Vinayak006 avatar Oct 30 '24 06:10 Vinayak006

I'm running into the same problems (including the issue #39 )

Now I have this problem and I suspect that the libllama.so is not found where it is expected to be. Did you manage to make it work?

talelamira avatar Dec 18 '24 21:12 talelamira

Might be you used the wrong commit hash? I got the 0.0.8 working with a very specific build: https://github.com/ggerganov/llama.cpp/releases/tag/b4138 in the changelog is the commit hash 42ae10bbcd7b56f29a302c86796542a6dadf46c9 mentioned. I hope that will help you too

rekire avatar Jan 18 '25 17:01 rekire