LLMUnity icon indicating copy to clipboard operation
LLMUnity copied to clipboard

Add support for Phi-3

Open Maskusa opened this issue 1 year ago • 3 comments

Describe the feature

Add support for Phi-3 and Llama-3

Maskusa avatar May 04 '24 05:05 Maskusa

Llama 3 support is implemented already in the latest version (v1.2.7). I haven't tested yet phi3, will do that.

amakropoulos avatar May 04 '24 06:05 amakropoulos

hello there! any news? i tested and it was not supported in this version, i tried the new version of llama cpp and it run phi-3. i tried to update the version on the plugin but without any result.

Gabri94x avatar May 13 '24 10:05 Gabri94x

hi, I'll look into it tomorrow! I'll need to implement the phi-3 chat template as well.

amakropoulos avatar May 14 '24 14:05 amakropoulos

hello @amakropoulos, can you address me to understand how to add phi-3 support? i really need this to have this model works, i tested the native llamafile.cpp and it works well. if you can give some tips, i can make the implementation and share with the community :D

Gabri94x avatar May 27 '24 07:05 Gabri94x

Sorry for the huge delay, I was deep into some DLL issues for another PR. I'll release it today!

amakropoulos avatar May 27 '24 07:05 amakropoulos

@amakropoulos i'm sorry, i did not mean to interfere with your work. let me know if i can help you in any way! btw thanks a lot for all of your work, you are doing really great job!

Gabri94x avatar May 27 '24 07:05 Gabri94x

not at all, thanks for pinging :)!

amakropoulos avatar May 27 '24 07:05 amakropoulos

@Gabri94x @Maskusa phi-3 support is now integrated and released, thank you for your patience!

amakropoulos avatar May 27 '24 11:05 amakropoulos

@amakropoulos thank you for your work. really appreciated!

Gabri94x avatar May 27 '24 12:05 Gabri94x