怪猎糕手 comments

Results 6 comments of


                                            怪猎糕手

offline_inference.py occurs error that append_paged_kv_cache() missing 1 required positional argument: 'kv_last_page_len'

Hi I also encounter this issue when running code in **examples** folder, so did u have solution to fix it?

offline_inference.py occurs error that append_paged_kv_cache() missing 1 required positional argument: 'kv_last_page_len'

> Hi I also encounter this issue when running code in **examples** folder, so did u have solution to fix it? I think it's fixed by degrading the version of...

[REQUEST]Inference Optimized Pipeline Parallelism

Hi！I am also interesting in this feature described in this paper, is there any demo or tutorial for 'hybrid pipeline inference schedule'?

[BUG] cannot capture your model as a full graph

I encounter the same problem, so is there any solution to fix it?

子目录文献数量还是无法显示

> ![image](https://private-user-images.githubusercontent.com/41810347/380652770-b9324517-7410-4168-8b26-79a11f695d5c.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzY3MzgwNDYsIm5iZiI6MTczNjczNzc0NiwicGF0aCI6Ii80MTgxMDM0Ny8zODA2NTI3NzAtYjkzMjQ1MTctNzQxMC00MTY4LThiMjYtNzlhMTFmNjk1ZDVjLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTAxMTMlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwMTEzVDAzMDkwNlomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWRlNmRlOGQ1YzcyMThhOWMxZmQ0ZmQyMjIyOTA5MmU2ZWFhNWZmNDFkN2ZiN2ZmNWFmNThkNjdlNzM4OTFiOGYmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.5FEYzSKJIsGxYo8TYFnDZvUbg1l3v_v8F9mzZv8rjPE) > > 我的也是zorero7，父目录数量一直是0，您是在什么位置设置的呢您好，我也是使用zotero7，也遇到了您这样的问题，并且setting里没有Collection number mode这个选项，请问您怎么解决的啊

[BUG] num_stages incorrect and some assertions

I also have this problem when run this scripts on a server with multi GPUs. But I can run successfully for GPT example. Do u have any solution for this?...