Xin Zhang
Results
2
issues of
Xin Zhang
Hi Yuke, thanks for your excellent work! I have a question about the selection of `ngs` parameter. In the Section 6 of the paper, I only find some constrains for...
The old `subtract_num_batched_tokens` cannot update the cached tokens' statistic. This PR makes `subtract_num_batched_tokens` and `add_num_batched_tokens` symmetric.