xqun3 comments

Results 16 comments of


                                            xqun3

CSL摘要数据集没达到效果。

请问你们用的CSL是哪个数据集呢？是训练样本只有3000条的那个吗？数据集能分享下吗？

支持更多的中文模型：Qwen、Baichuan、InternLM、ChatGLM2等多卡部署

这是来自QQ邮箱的自动回复邮件。您好~您发送的邮件我已收到。谢谢您的邮件~

Can't use human_prefix and ai_prefix with agent

Still got this issue with langchian 1.1.14.

multi-gpus with max_batch_size > 1 with ddp

这是来自QQ邮箱的自动回复邮件。您好~您发送的邮件我已收到。谢谢您的邮件~

Support SageMaker Endpoint Message API

Hi @krrishdholakia, thanks for your quick reply, here is the sample code for deploying LLM on SageMaker Endpoint,https://github.com/aws-samples/llm_deploy_gcr/blob/main/sagemaker/deepseek_coder_6.7_instruct.ipynb

Support SageMaker Endpoint Message API

Hey @krrishdholakia, have you tested the codes? What should i do to help you validate it?