LLMUnity Add Android support

Purpose of this features is to add support of LLMUnity for Android

Issues:

llamafile does not support Android, the llama.cpp server binary will need to be separately compiled
Android needs separate implementation for starting and possibly communicating to the server

An experimental WIP branch is feature/android_support

Jan 22 '24 11:01 amakropoulos

Yes please add android that would be awesome !

Mar 14 '24 19:03 al3dv2

I don't see the experimental branch, where I can download it ? thanks "feature/android_support"

Mar 15 '24 21:03 al3dv2

Ah I was trying something but deleted it, didn't really progress.

Mar 16 '24 12:03 amakropoulos

Oh ok do you thinks it's possible to have unity LLM on android ? thks

Mar 16 '24 16:03 al3dv2

At some point, but I think it's going to need implementation effort

Mar 16 '24 16:03 amakropoulos

At some point, but I think it's going to need implementation effort

Hello! Do you have this plan for android support?

Apr 03 '24 09:04 yumianhuli2

Yes! I'm actually doing some tests right now, but can't yet promise on dates

Apr 03 '24 09:04 amakropoulos

Yes! I'm actually doing some tests right now, but can't yet promise on dates

Oh, thanks my God

Apr 04 '24 02:04 yumianhuli2

Hi @amakropoulos can you give us the high level stuff on how would you implemented this? I see that your using a process to start a server from llamafile-0.6.2.exe which is from this repository. But how would this be implemented on android? thanks.

May 21 '24 02:05 ropenrom24

Sure, this feature will be built after #141 which will replace llamafile with directly integrated DLLs. Android is supported by llama.cpp so after that I'll build a DLL specific for Android to serve the functionality. And then fingers crossed :)!

May 21 '24 08:05 amakropoulos

closed by #197

Aug 08 '24 14:08 amakropoulos