xd-Nanan comments

Results 5 comments of


                                            xd-Nanan

[BUG] Error `raise RuntimeError(f"still have inflight params "` when doing IDEFICS inference

> **Describe the bug** Hi, I am having a bug with traceback > > ``` > Invalidate trace cache @ step 2: expected module 4, but got module 2 >...

使用 test_prompt.txt 输入，但生成后有很多额外的题和代码

> 你好，继续生成额外内容是正常的，这是自回归预训练目标导致的结果。在实际使用中，往往会对生成结果做截断。您好，请问这个截断是可以什么办法处理呢？

codegeex2 model

> 测试其他语言（除了 python），也许生成 python 代码您好，我也是这样，请问您有好的控制办法嘛

最新版本（2023年7月31日）中，Output参数似乎失效了

> hi，我从[https://huggingface.co/THUDM/codegeex2-6b-int4/tree/main下载的codegeex2-6b-int4；然后在V100](https://huggingface.co/THUDM/codegeex2-6b-int4/tree/main%E4%B8%8B%E8%BD%BD%E7%9A%84codegeex2-6b-int4%EF%BC%9B%E7%84%B6%E5%90%8E%E5%9C%A8V100) GPU机器上加载模型，输出结果完全不对，请问这是什么原因？[Stanislas0](https://github.com/Stanislas0) > > ![image](https://private-user-images.githubusercontent.com/42996988/281598857-88bd937c-6c55-439e-abb7-c2bc2f178573.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTEiLCJleHAiOjE3MDExNTk3ODksIm5iZiI6MTcwMTE1OTQ4OSwicGF0aCI6Ii80Mjk5Njk4OC8yODE1OTg4NTctODhiZDkzN2MtNmM1NS00MzllLWFiYjctYzJiYzJmMTc4NTczLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFJV05KWUFYNENTVkVINTNBJTJGMjAyMzExMjglMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjMxMTI4VDA4MTgwOVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTM1ZDMxMDY0NzQxNDc4M2FkODQ5NjUwNWYxNGU0ZjFlZWE5M2IxMTllNzlhMzNhMjc1MjVkOGYxNmM5ZDRmNjcmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.cl-sdVmFd84VvC86NWJCmx3GzSIUDWZzaz6TBqbTN1w) ![image](https://private-user-images.githubusercontent.com/42996988/281598977-696b6b30-5aa2-4af4-8126-99969b793d1d.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTEiLCJleHAiOjE3MDExNTk3ODksIm5iZiI6MTcwMTE1OTQ4OSwicGF0aCI6Ii80Mjk5Njk4OC8yODE1OTg5NzctNjk2YjZiMzAtNWFhMi00YWY0LTgxMjYtOTk5NjliNzkzZDFkLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFJV05KWUFYNENTVkVINTNBJTJGMjAyMzExMjglMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjMxMTI4VDA4MTgwOVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTRkMjM0MjMzNjcxYTk0M2RjZWE0MWZiMjdmNDkwYmNkZDk1YmZlOTE4NmNmNmRlMGVlYmY4M2M0N2E4YmUxNTQmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.A-fb_bYSkySMCKFNPdU8d49VDP3hCOvoBTZsNFzZksg) 我的测试也频繁出现此问题，而且无法控制输出，请问有解决嘛？