TanaroSch comments

Repositories
Issues
Comments

Results 3 comments of


                                            TanaroSch

Distributed package doesn't have NCCL / The requested address is not valid in its context.

@Inserian I encounter the same error on ubuntu 20.04 with nvidia-hpc-sdk module enabled. Do you know if there might be another error preventing llama from using nccl?

change max_tokens type to int

> can you make the same change for litellm.acompletion on main > > (otherwise our ci/cd will fail tests) Done. Also fixed other occurrences of max_tokens with float type. Edit:...

[Bug]: AzureException - The embeddings operation does not work with the specified model, Cohere-embed-v3-multilingual.

@ChristianPejrup I think the issue is only with embedding models. I managed to deploy R1 and Phi-4 as well, using the same /models endpoint without the error messages. I just...