PhenixZhang comments

Repositories
Issues
Comments

Results 3 comments of


                                            PhenixZhang

Yi34B's 8k context capability on dify doesn't work

> Have you tried the `OpenAI compatible API` model provider? Yes， This is the config screenshot ![image](https://github.com/langgenius/dify/assets/26118845/2b678bea-9763-4ca1-b617-eae71497dda6) And using openai server directly without dify is no problem.

Yi34B's 8k context capability on dify doesn't work

> Can you try changing the `max_tokens` parameter to 4K or larger and see if it works? Of course~ I set the maximum number of tokens to 8K at the...

ValueError: Some specified arguments are not used by the HfArgumentParser: ['--local-rank=0']

> 另请注意，它`torch.distributed.launch`已被弃用，并且`torchrun`在 PyTorch 2.0 中是首选。 Thanks for this tip.