Noah Nisbet

https://www.linkedin.com/in/noah-nisbet/ [email protected]

Clemson University

Results 4 comments of


                                            Noah Nisbet

Unnecessary assertion in cpp implementation of worldConfig.cpp

Hi is there any update on this?

The system hangs when I use multiple GPUs to perform streaming inference

+1

Unable to run benchmark of mixtral

You need to raise your max token size. 2309 >= your max token size here.

Increasing max_new_tokens drastically slows down inference

@kaiyux Hi, is there any update on this? Thanks!