user-0a

Enable Raw Prompting

3

Hey, thank you so much for making this! Have had a blast using it so far. Would it be possible to add another parameter "disable_system_prompt", which causes the prompt to...

[Feature request] Cohere Family of Models (Command-R, Command-R-Plus, Aya23-8B, Aya23-35B, Aya101)

12

Hello, I am creating this issue for the purpose of requesting support for the Cohere family of models: Command-R: https://huggingface.co/CohereForAI/c4ai-command-r-v01 Command-R-Plus: https://huggingface.co/CohereForAI/c4ai-command-r-plus Aya23-8B: https://huggingface.co/CohereForAI/aya-23-8B Aya23-35B: https://huggingface.co/CohereForAI/aya-23-35B Aya101: https://huggingface.co/CohereForAI/aya-101 Thank you

Suggestion: Reliability Metrics

1

Hello, Thank you for the amazing project! Since the `min-p` update, we've been using llgtrt in production across all of our deployments. One unforeseen positive side-effect we have noticed is...