Andrés
Andrés
Helloo @coco98 ! is there any progress on this one?
cclif/core counterpart https://github.com/oclif/core/issues/503
@kitsonk do you mind posting more documentation on how subdirectories work? My plan is to publish many deno modules based on different folders in a single github repo
Hopefully they're working on it. I made a PR for it but I couldn't get passed this signing point: https://github.com/oclif/core/pull/504#issuecomment-1262365040
@penguine-ip I've looked at the code changes, looks good! I haven't had time to test it out yet but I will soon!
I updated the description, but by evaluators I meant the LLMs that get called. Some LLM SDKs support batch requests like Azure's. Let me complement the description with some reference...
@penguine-ip I'm actually trying out all of them, and for Custom LLM I'm inheriting deepeval's `DeepEvalBaseLLM` class and implementing it with Google Vertex AI Models. Now, for example OpenAI SDKs...
Interesting question on threads: So Im not 100% sure that OpenAI uses threads behind the scenes, I believe that they, and Vertex AI as well, may be using an async_client...
/reopen