Aman Srivastava

icon company VIT,Vellore icon location Vellore, India

Results 3 comments of Aman Srivastava

Improve warmup checking for max new tokens when using speculative decoding

Is this issue still unresolved/valid? If it is still unresolved/valid, I would like to work on it.

[Bug] LiteLLMConversation unused exception

That validation is there because it could be the case that someone has set their API key in an environment variable, but something went wrong while setting the environment variables,...

Add liteLLM for LLM requests

I can work on this along with one of my friends (having bioinformatics background). Can you please assign this task to us? I am working as an LLM engineer right...