maxmaier59

Multi-node training reports "stop_waiting response required" and "connection reset by peer"

2

**Describe the bug** I would like to use remote machines in the cloud for finetuning. I am using a hostfile and have configured ssh for passwordless connection Using the command...

When I run this example in Jupyter Lab and start finetuning the codeparrot example I get the following error message: RuntimeError: Output 0 of DequantizeAndLinearBackward is a view and is...

When setting CPU memory to offload, model doesn't get loaded onto GPU

1

### Describe the bug When setting CPU memory to offload, model won't get loaded onto GPU. Screenshot with no CPU memory to offload shows model gets loaded to GPU ###...