gpt-j-6b-gpu-docker icon indicating copy to clipboard operation
gpt-j-6b-gpu-docker copied to clipboard
verified publisher icon devforth

A4000 not supported

Open CoWayger opened this issue 3 years ago • 1 comments

Hello, anyone know how to edit Dockerfile to support for newer GPUs? Will this need to also update code somehow?

CoWayger avatar Feb 22 '23 21:02 CoWayger

You might want to try changing the first line in the docker file from FROM nvidia/cuda:11.1-base
to FROM nvidia/cuda:12.1.0-base-ubuntu20.04 Hopefully that will ensure the latest version of pytorch gets installed which should support newer GPUs.

aleks648 avatar Apr 22 '23 19:04 aleks648