Jędrzej Maczan comments

Repositories
Issues
Comments

Results 5 comments of


                                            Jędrzej Maczan

Asynchronous test runs are sometimes not completed correctly

@penguine-ip I have about 20 test cases, I use literally the same set of metrics as @rjiangnju. `run_async=False` solves the issue, but to me it's a no-go since I run...

Asynchronous test runs are sometimes not completed correctly

I have similar experiences, it fails for me in Azure Pipelines, but seems to work fine locally

Asynchronous test runs are sometimes not completed correctly

Unfortunately it doesn't work for me, I keep having the same issue. I'm also running pipeline on Ubuntu and I'm using deepeval 1.5.0

Asynchronous test runs are sometimes not completed correctly

@rjiangnju could you share all other parameters you use in evaluate(), along with 'write_cache=False'?

Asynchronous test runs are sometimes not completed correctly

Hey @penguine-ip, is there any chance you will prioritize fixing this soon?