Zejia LIN

icon indicating a website link zejia-lin.github.io

icon company Sun Yat-sen University icon location Guangzhou icon location Ph.D student @sysu @arcsysu. GPU, Compiler, MLSys. φ(^∇^*) 🎶

Results 2 issues of Zejia LIN

[QST] Question on customize epilogue reduction

5 comment

**What is your question?** Hello, I found that many epilogues are element-wise. I wondered if it could be customized to sum up a `2*2` tile instead of an element-wise operation....

question
inactive-30d

[Feat] add usage info in stream request

6 comment

## Motivation Fix https://github.com/sgl-project/sglang/issues/3743. When `"stream":true,"stream_options": {"include_usage": true}` is set in the request, the usage info only returns in the last chunk, instead of every chunk. ### Before ``` data:...