llama-cpp-python icon indicating copy to clipboard operation
llama-cpp-python copied to clipboard
verified publisher icon abetlen

Improve function calling (auto selection, parallel functions)

Open themrzmaster opened this issue 1 year ago • 2 comments

Following:https://github.com/abetlen/llama-cpp-python/pull/1347

themrzmaster avatar Apr 17 '24 13:04 themrzmaster

@themrzmaster thank you, will review over the weekend. Additionally I'd like to add support for the Hermes 2 Pro format so I may add a few commits over this.

abetlen avatar Apr 20 '24 04:04 abetlen

cool! I added llama 3 initial support. I am having trouble making it work with 70B, 8B is fine.

themrzmaster avatar Apr 23 '24 00:04 themrzmaster