here4dadata

Results 5 comments of here4dadata

Support for Cohere Command-R

+1 for even more visibility

[Feature request] Cohere Family of Models (Command-R, Command-R-Plus, Aya23-8B, Aya23-35B, Aya101)

+1

Invalid argument: unable to find backend library for backend '${triton_backend}'

Set triton_backend to 'tensorrtllm' in the config.pbtxt for tensorrt_llm and it should work. I think this was introduced because there is now a model.py file in `tensorrt_llm/1` as of v0.10.0,...

[Question] Understanding Generation Logits & Context Logits

Thanks for that clarification @byshiue.

[Question] Understanding Generation Logits & Context Logits

Re-opening based on @VsonicV 's post