eval-dev-quality icon indicating copy to clipboard operation
eval-dev-quality copied to clipboard
verified publisher icon symflower

Test for pulling Ollama model is flaky

Open zimmski opened this issue 1 year ago • 2 comments

https://github.com/symflower/eval-dev-quality/actions/runs/9139604580/job/25132073770#step:9:841

zimmski avatar May 18 '24 12:05 zimmski

Not sure if directly related but when I try to run make test localy on our main branch the following test fails: cmd/eval-dev-quality/cmd TestEvaluateExecute/Model_filter/Ollama/Pulled_Model

Local version of ollama is 0.1.34 will update and try again

Munsio avatar May 21 '24 13:05 Munsio

Running make install-all did solve the problem for me locally. Will take a look at this Bug.

Munsio avatar May 21 '24 13:05 Munsio