SciSharp
[Feature]: Support for Function Calling or Tools
Background & Description
Function calling is a feature supported by many open source models, like Mistral.
Function calling feature would allow developers to use LlamaSharp in a more dynamic way, enabling them to perform complex tasks directly within the LlamaSharp environment.
Are there plans to include function calling / tools in LLamaSharp?
API & Usage
No response
How to implement
No response
Yes, it is important for using LLM to handling complex works. I'll start making this feature after about 1 month. :)
It's pretty easy to hack together your own function calling. I used Hermes-2-Theta-LLama-3-8B and got acceptable results. What would be nice is C# native annotations that translate functions into OpenAI JSON, which the "function calling method" meta seems to have standardized around. Semantic Kernel also provides this feature if you really need it with their "planner" functionality, I chose to roll my own for resource constraint reasons
It's pretty easy to hack together your own function calling. I used Hermes-2-Theta-LLama-3-8B and got acceptable results. What would be nice is C# native annotations that translate functions into OpenAI JSON, which the "function calling method" meta seems to have standardized around.
That's inspiring! May I ask whether you work is open-source? I wonder if I can take a look of your implementation if it's possible. :)
Not yet! I'm currently working out kinks, but I hope to get it done ASAP