HillPhelmuth

Results 7 comments of HillPhelmuth

Does this include support for streams created and used only inside a service? The service I'm attempting to run inside a worker uses roslyn to compile code and emit a...

I have a Windows Arm device. The latest llama.cpp releases have two options for Windows arm64: `llama-b3510-bin-win-llvm-arm64.zip` and `llama-b3510-bin-win-msvc-arm64.zip` **`llama-b3510-bin-win-llvm-arm64.zip`**: Build has `llama.dll`, which when loaded using `NativeLibraryConfig.All.WithLibrary` in [Llama.Examples](https://github.com/SciSharp/LLamaSharp/blob/master/LLama.Examples/Program.cs)...

> The current LLamaSharp version (0.15.0) is compatible with llama.cpp [b3479](https://github.com/ggerganov/llama.cpp/releases/tag/b3479). You need to make sure you're using that version if you're loading custom binaries. Good to know, thank you....

> @HillPhelmuth do you have any clue when the merge will be completed, and/or do you have a workaround for this issue perhaps? I'm currently completely blocked by this issue...

@markwallace-microsoft is there something else I need to do to get this merged? The associated bug is still a problem for a few of us.

@ShreyasJejurkar Unless something's changed recently, I believe you can still use function calling with the Google Gemini connector, but `FunctionChoiceBehavior` doesn't work. Instead, I've had to use the old `ToolCallBehavior`...