Akim Tsvigun
Akim Tsvigun
Hi, the current implementation of smooth-BLEU contains a bug: it smoothes unigrams as well. Consequently, when both the reference and translation consist of totally different tokens, it anyway returns a...
Hi, thanks for a great implementation! I wanted to clarify one thing that mismatches with the code, proposed in the article itself. In your code, you pre-normalize inputs, so that...
Hi, I am inspecting the fields of application of BatchBald. I am using the `get_batchbald_batch` function from https://github.com/BlackHC/batchbald_redux/blob/master/01_batchbald.ipynb Here is an example: we have 3 samples with 2 mc inferences...
Great job, mate! I will have a look at your implementation thoroughly a bit later, for now it seems outstanding for me 🤙🏻
Hi, the current implementation of smooth-BLEU contains a bug: it smoothes unigrams as well. Consequently, when both the reference and translation consist of totally different tokens, it anyway returns a...
Hey team, Thanks for a great framework! Adding integration with Nebius AI Studio, which provides access to state-of-the-art models.
### Description Added Nebius AI Studio to the list of supported providers. ### Test Procedure I added a new test related to Nebius AI Studio ### Type of Change -...
Hey team, When my CodeActAgent needs to search for some information, it always starts searching in Google. However, every time it encounters the Captcha: ``` **Browsing completed** URL: https://www.google.com/sorry/index?continue=https://www.google.com/search%3Fq%3Dbuild%2Bchat%2Bapplication%2Bwith%2Bcustom%2BLLM%2Busing%2BVercel%26sei%3DpsapZ_6BLcuOi-gP-ujF4Qc&q=EgRN-t32GKaNp70GIjCGSEPa0WmfKJ-BvwH--9qOpuCRj2OC7qmzVYpYo2oHqlfE0bTl_evQMPRKZ_OqF34yAXJaAUM **Output:**...
### Description Added Nebius AI Studio to the list of supported providers. ### Test Procedure I added a new test related to Nebius AI Studio ### Type of Change -...
**Describe the issue** Hey team, I noticed a critical bug in open-source models evaluation. Precisely, they never use the `tools` / `response_format` / `guided_json` arguments even for FC (native support...