Bar Admoni

icon location Tel Aviv, Israel icon location Just another full stack web developer that believes in DevOps and unicorns.

Results 1 issues of Bar Admoni

Feature - support stream for `ChatCompletion`

2 comment

Adding support for stream for `ChatCompletion` in the client and in the API. ## How to use? ### Async ```python from fastchat import client async def async_main(): model_name = "vicuna-7b"...