kushshrivastava

Results 2 comments of kushshrivastava

I managed to run the API on one colab notebook and use it in another colab notebook using these steps **In first colab notebook** Clone text-generation-webui and install all requirements...

`deepspeed --include localhost:4,5 --master_port=29501 inference.py` works for me