Open-Assistant icon indicating copy to clipboard operation
Open-Assistant copied to clipboard
verified publisher icon LAION-AI

Optimise safety dockerfile

Open olliestanley opened this issue 2 years ago • 2 comments

Close #2579. This runs a bit faster on my local machine. Unfortunately I think the main holdup is the PyTorch/CUDA install (also slows down the inference worker image build) which we cannot do much about

olliestanley avatar Apr 30 '23 08:04 olliestanley

Yes, I tried hard to optimize it, but besides Pytorch/Cuda install, I think, also that LAION-AI/blade2blade installation takes the most time.

Aslo copying whole files in command:

COPY --chown="${APP_USER}:${APP_USER}" --from=build /build/lib ${APP_LIBS}.

DeanChugall avatar Apr 30 '23 08:04 DeanChugall

Yes, I tried hard to optimize it, but besides Pytorch/Cuda install, I think, also that LAION-AI/blade2blade installation takes the most time.

Aslo copying whole files in command:

COPY --chown="${APP_USER}:${APP_USER}" --from=build /build/lib ${APP_LIBS}.

I hope blade2blade installation will be faster since yesterday's merge of #2505. Previously pip had to build it from the Git repo but now it is on PyPI so we can pip install directly from there

olliestanley avatar Apr 30 '23 09:04 olliestanley