Jędrzej Maczan

Hello, I've added open source full stack AI voice chatbot to the list. I hope I've picked a proper place, if not please let me know so I can adjust...

It seems like the repo was renamed, but paths to images were not updated. I fixed that

Asynchronous test runs are sometimes not completed correctly

20

**Describe the bug** When running `evaluate()` with `run_async=True`, sometimes tests are not completed (so any job/task/pipeline that relies on exit code will fail). Results are neither printed nor emitted. The...

Hallucination metric score is set to 0.0 in one run and 1.0 in another run, despite having the same input values

1

**Describe the bug** Hallucination metric seems to have low repeatability, in terms of what values it assigns to the same input values **To Reproduce** Steps to reproduce the behavior: 1....

Hallucination metric assigns only either 0.0 or 1.0 score

1

**Describe the bug** Hallucination metric score is being set to either 0.0 or 1.0. It never sets a score to a value in between of 0.0 and 1.0 **To Reproduce**...