support for android and enable opencl
Is your feature request related to a problem? Please describe.
Support for Android devices using termux. I tried to compile llama.cpp for Android and enabled opencl(gpu acceleration), and I got a good result). I now know two questions. 1.The tmp directory needs to be redirected to /data/data/com.termux/files/usr/tmp 2.Compile llama.cpp with opencl support(Adreno) enabled for Android. Describe the solution you'd like
add android support 1.The tmp directory needs to be redirected to /data/data/com.termux/files/usr/tmp 2.Compile llama.cpp with opencl support(Adreno) enabled for Android. Describe alternatives you've considered
Use the proot container, but it is difficult to enable gpu support and some performance will be lost. Additional context
./loaclai 11:45AM INF Setting logging to info 11:45AM INF Starting LocalAI using 8 threads, with models path: /data/data/com.termux/files/home/models 11:45AM INF LocalAI version: v2.25.0 (07655c0c2e0e5fe2bca86339a12237b69d258636) WARNING: /sys/class/drm does not exist on this system (likely the host system is a virtual machine or container with no graphics). Therefore, GPUInfo.GraphicsCards will be an empty array. 11:45AM FTL Error running the application error="failed basic startup tasks with error unable to create ImageDir: "mkdir /tmp/generated: permission denied""