waan1

will it work with Nvidia P40 24GB on Linux?

29

I'm developing AI assistant for fiction writer. As openai API gets pretty expensive with all the inference tricks needed, I'm looking for a good local alternative for most of inference,...