What is the Minimum RAM required for running the V2

Open eran-sefirot opened this issue 3 years ago • 2 comments

Hey,

Thank you for releasing this great model and making this publicly available.

We are able to run the 1.5 model on an EC2 instance G5XL with 16GB RAM, However when trying to deploy V2 on the same instance the process is killed - I tried deploying on an instance with larger RAM and it deployed ok. So, my question is: is the minimum memory size increased in V2? what is the minimal RAM required? is there a recommended EC2 instance for running the mode?

Nov 28 '22 08:11 eran-sefirot

Same question. @eran-sefirot which v2 model are you deploying?

Dec 06 '22 18:12 nguyenmeteorops

We are deploying the 768 model we had to switch to larger RAM servers (g5-xl -> g5-2xl) to support the new model

Dec 07 '22 09:12 eran-sefirot