Results 16 comments of k4d

Any info on running 7B model with Langchain?

still having this issue after installing latest xformers.

> @MarkWuNLP would also be very nice if you can share your weights and code. Not everyone has access to the ridiculous amount of computational power required to train such...

> > > @MarkWuNLP would also be very nice if you can share your weights and code. Not everyone has access to the ridiculous amount of computational power required to...

> Can we crowdfund the training of this? I can pitch in a few hundred. On Vast 8X A100 is $8.746/hr. yes, happily, happy to coordinate on discord

> That doesn't work either. I managed to run it in a docker image, but that's just a workaround. Unfortunately even that doesn't work for what I want to do....

> I managed to find a workaround (It requires a bit of Linux knowledge). Install Ubuntu 22.04 from the Microsoft Store, then open it and follow the installation process for...

like, where are the linux setup instructions? is it the same instructions once i have followed the WSL setup? how do i use the VSCode build tools in linux?

ah yeah, it didn't work for me on linux, but it worked on python 3.10 with the [alternate install](https://github.com/oobabooga/text-generation-webui/issues/177#issuecomment-1464844721) workaround. it gave me a "CUDA extension not installed" message, but...