Just some ideas

[philogicae]

Hi guys, First of all, great video and funny project ! There are 3 ideas that could be nice to implement:

1. Model selector, to be able to easily download and switch between models.
2. Bloom Petals integration. It's a distributed version of Bloom (also Bloomz), that is an open-source equivalent of GPT-3 (176 billions parameters, so 1b more), allowing you to only download a small part of the model and then to act as a node to share/leverage/use the GPU power of the whole p2p network. Yes, that's amazing !
3. Adding some buttons for the parameters : max length, temperature, top k, top p, repetition penalty, etc. What do you think ?

[Vincent-Stragier]

Hi @philogicae,

For BLOOMZ, there is already an interface that is being developed there. BLOOMZ seems terrible as a chatbot, but it has a huge potential. And BLOOM as a chatbot is even worse than BLOOMZ, since it's trained to do mainly text completion and not to receive commands, unlike BLOOMZ.

Still, the use of Petals with BLOOMZ/BLOOM could be interesting.