Ye Ting

Results 4 comments of Ye Ting

I have refactored this library, and maybe you can refer to it : https://github.com/TING2938/matplotlibcpp ```c++ #include #include "matplotlib.hpp" int main() { auto plt = matplotlibcpp::PLT(); int n = 100; std::vector...

我基于这个库做了一些重构,或许你可以看一下: https://github.com/TING2938/matplotlibcpp

> Hi, I think your conversation code has some potential bugs: > > #703 I try it with vicuna 7b model, the inference is ok ![image](https://github.com/NVIDIA/Megatron-LM/assets/43649849/f0aa8b37-f6c3-454f-a75f-978b2d2a7d72) ![image](https://github.com/NVIDIA/Megatron-LM/assets/43649849/a4f5cebf-a46e-4724-b056-5e90e9342a5b) you can add...

> Finally, I figured it out that I have to set `parallel_output=False` to make inference work with tensor parallel. Thanks for your tests, text_generation_server on main branch does not support...