Jonas Schweizer

icon company EPFL icon location Lausanne / Paris icon location Computer Science master student at EPFL, after a master at Ecole Polytechnique (X) in Paris. This profile only contains EPFL projects.

Results 2 comments of Jonas Schweizer

推理时报错RuntimeError: CUDA error: device-side assert triggered

一样的问题

High Peak GPU Memory with ZeRO Stage 3

Hi all! I'm experimenting the same when trying to load `dolly-12B` into 4x A100 40GB for zero3 training. I'm using the `transformers` Trainer, and it seems that each process is...