galai
galai copied to clipboard
Anyone know the easiest way to run Galactica?
Either locally or using a cloud-based service. I want to demo it using the least amount of effort possible : )
I used oobabooga text generation UI to run the 1.3b model. I selected transformers from the drop-down and it works fine. I'm sure you can run the bigger models too if you have enough VRAM