Bar Admoni comments

Repositories
Issues
Comments

Results 4 comments of


                                            Bar Admoni

[BUG] repeat_every doesn't close the task on shutdown

Hi, this issue has been open since 2020, and we still see this happening - Are there any updates?

Feature - support stream for `ChatCompletion`

Hi @kfatehi ! 1. I ran the `format.sh` file, as recommended 2. I added `fastchat/serve/test_stream.py` as per the standard to have a file to test a new flow 3. Using...

when will add the stream feature in api？

Hi, I've started to work on this issue.

when will add the stream feature in api？

The PR is ready and tested: https://github.com/lm-sys/FastChat/pull/858 Feel free to review!