Gabe Goodhart
Gabe Goodhart
Hi @lordofthejars! Sorry this one slipped through the cracks. It looks like the cause of the error is using [`extra="forbid"` in the model_config](https://github.com/caikit/caikit/blob/main/caikit/runtime/http_server/pydantic_wrapper.py#L73). The note here suggests that this is...
@dependabot rebase
@dependabot rebase
In this proposal, would it be possible to add net-new attributes to the object that were not automatically discovered during `import` by the `validation` schema? We're running into issues where...
[logs_2354.zip](https://github.com/caikit/caikit/files/12033080/logs_2354.zip)
Context from @joerunde: hah, but I think we just injected it by removing a wait from that one test. The erroneous log is: ``` {"channel": "DESTROY-THRD", "exception": null, "level": "info",...
One thought on naming: > GRPC: > > caikit.runtime.SampleLib.SampleLibJobService.StartPredictionJob - create job > caikit.runtime.SampleLib.SampleLibJobService.PredictionJobStatus - get status > caikit.runtime.SampleLib.SampleLibJobService.GetPredictionJobResult - get results > caikit.runtime.SampleLib.SampleLibJobService.CancelPredictionJob - cancel I think we should...
This sounds suspiciously similar to #7656 (solved via #7749). That turned out to be an uninitialized value in the CGO interface that was introduced with `0.4` and the transition to...
That makes sense. I haven't totally wrapped my head around the prompt template changes from `0.3` -> `0.4`, but I do see that in [the library](https://ollama.com/library/llama3.1/blobs/948af2743fc7), the `llama3.1` template has...
Ahh, sorry, I had not looked at the requests themselves and didn't realize that the message sequence has the last message from the `assistant`. You're spot on that this is...