hidden1nin
hidden1nin
Great! Good opportunities, from a developer perspective everyone loves to dive into the code. I would love to help but don't know where to start, is there a list of...
Is there a pull request or open development on-going for this?
Made a pull request to your pull request, probably didn't do it right but I wanna help!
Would this just be checking if options changes inside this method? `func (runner *runnerRef) needsReload(ctx context.Context, req *LlmRequest) bool {` Does `!reflect.DeepEqual(optsExisting, optsNew) || // have the runner options changed?`...
Following up are we still planning on implementing this functionality?
I would love to help swell but what needs to be done?
> Hello guy. I have a freaking software that use, ollama, vLLM, and LLama.cpp. It is more like Talend but instead of database, it is LLMs. It support distributed inference...
I can make further edits if needed.