Lyrcaxis
Lyrcaxis
Awesome! Thanks.
Neat I wasn't aware of that library. I'll give it a try over the weekend and post back!
I do have a satisfying example where speech is automatically being recognized and sent to the LLM to invoke responses, resulting in speech-text chat, but it requires adding the Whisper.NET...
👌Yup, both are cross platform! I'll add them and make a PR later today, then!
> Since this didn't fix the bug shall we close this PR? I think it’s still a decent improvement — potentially huge performance-wise depending on use case (e.g.: batching). But...
These are some quick benchmarks from release (ctrl+F5): ``` Starting test with 1000000 iterations. Testing EOS access EOS access - PR's way: 1 EOS access - Current way: 10 Testing...
Btw all tests passed on my PC even after updating from upstream/master. 