S. Dale Morrey
S. Dale Morrey
So is this just a "all circuits are busy, try again later" type of issue? If so, then I could probably stand up an instance or two. We've got gigabit...
Hey @2color I can see you're working on a lot of things and I just want to say thanks. Before deciding to use this library I explored piggy backing the...
Hmm, I was just thinking the same thing. It would also give the ability to "revert to last known good" if things get caught in a loop. @Grigorij-Dudnik Let me...
One issue seems to be how hard it's hitting ollama. ollama doesn't support batch inference in CPU mode but it keeps trying on batches and will open up hundreds of...