liaoduoduo

Results 8 comments of liaoduoduo

> > 你好,我也遇到这个问题了,请问解决了吗 > > 请问你也是用的wsl环境么? 我用的是windows环境

> 那感觉就不是我们讨论的那个问题,可能还在别处。@irexyc @lzhangzz 能不能麻烦把 log-level 设置为 INFO,把日志结果贴出来? 我们手头没有 windows + 24G显卡的机器,debugging这个问题比较棘手 好的,以下是我的日志,推理输出结果为空 ![PixPin_2024-05-09_13-12-12](https://github.com/InternLM/lmdeploy/assets/78495847/f7cabecc-52a9-48a0-a7a5-0f66ccf2889b) ![PixPin_2024-05-09_13-12-42](https://github.com/InternLM/lmdeploy/assets/78495847/84ce7853-4647-4662-8e05-90f467bf7d25)

> 那感觉就不是我们讨论的那个问题,可能还在别处。@irexyc @lzhangzz 能不能麻烦把 log-level 设置为 INFO,把日志结果贴出来? 我们手头没有 windows + 24G显卡的机器,debugging这个问题比较棘手 加载llama2模型却可正常推理 ![PixPin_2024-05-09_13-17-21](https://github.com/InternLM/lmdeploy/assets/78495847/97e246b3-a2e5-4ab7-9394-e764114840b3)

**Environment** sys.platform: win32 Python: 3.10.14 | packaged by Anaconda, Inc. | (main, Mar 21 2024, 16:20:14) [MSC v.1916 64 bit (AMD64)] CUDA available: True MUSA available: False numpy_random_seed: 2147483648 GPU...

> > > 那感觉就不是我们讨论的那个问题,可能还在别处。@irexyc @lzhangzz 能不能麻烦把 log-level 设置为 INFO,把日志结果贴出来? 我们手头没有 windows + 24G显卡的机器,debugging这个问题比较棘手 > > > 好的,以下是我的日志,推理输出结果为空 > > > ![PixPin_2024-05-09_13-12-12](https://private-user-images.githubusercontent.com/78495847/329133494-f7cabecc-52a9-48a0-a7a5-0f66ccf2889b.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTUyMzUwMjEsIm5iZiI6MTcxNTIzNDcyMSwicGF0aCI6Ii83ODQ5NTg0Ny8zMjkxMzM0OTQtZjdjYWJlY2MtNTJhOS00OGEwLWE3YTUtMGY2NmNjZjI4ODliLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA1MDklMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNTA5VDA2MDUyMVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWVlMTA1NzI5NmQ3MDYwYjk2YjFjNzBlODQ3YWIwNzk3NjJiNTJhYmYxYWIyNTEwYWQ4YzhmNzY4M2VkZDY2NzkmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.JcBAX7VHfXQJaHR7CWf987HDMcsiufEszZ2d0nIohrg) > > > ![PixPin_2024-05-09_13-12-42](https://private-user-images.githubusercontent.com/78495847/329133506-84ce7853-4647-4662-8e05-90f467bf7d25.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTUyMzUwMjEsIm5iZiI6MTcxNTIzNDcyMSwicGF0aCI6Ii83ODQ5NTg0Ny8zMjkxMzM1MDYtODRjZTc4NTMtNDY0Ny00NjYyLThlMDUtOTBmNDY3YmY3ZDI1LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA1MDklMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNTA5VDA2MDUyMVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTJhM2I0Mzk0ODY2ZmI3ZTg2NTg1M2U3OTA3ZDJhOWMyMWI2YzEwYzZkYWI5ZWJmOWUyOTM1ZGJhOWMzNDA0MDkmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.jYz4iW-0mgmAqTysjSNy3PQA3fjOQ3B25qKvXWhU9nw) > > 这个日志中显示 invalid infer...