Somshubra Majumdar
Somshubra Majumdar
# Scope Adds the support for passing a batch of prompts (as a list) in the request, so as to process and enqueue all generations at once, improving throughput. It...
Decode beams method right now returns a tuple of info, and that includes the decoded text. However, for many purposes detailed below, we require the actual token ids that instead...
Thanks for the great implementation of SM3! It seems the License file for this codebase is not correctly filled - year of license and your name should be filled here...
## 🚀 Feature While the current container tests are run against bare python, there are many important libraries that require conda to be available to properly install dependencies. Therefore conda...
## 🚀 Feature Nemo tests it's own CI on a Pytorch container from NGC (versioned as YY.MM) and these are generally available on other cloud providers too. Note that -...
# What does this PR do ? Adds NeMo run support to ASR and common utilities for Run to common collections **Collection**: [ASR, Common] # Changelog - Add specific line...
First, thank you for providing your implementation, it is quite instructive. I had a question regarding what normalization was done for MSE during evaluation - was the normalization denominator the...
### What does this PR do? Fixes #7535 This pull request introduces a new trace logging feature for LLM request-response pairs, allowing users to save detailed traces of model interactions...
### Feature hasn't been suggested before. - [x] I have verified this feature I'm about to request hasn't been suggested before. ### Describe the enhancement you want to request It...