gchlodzinski

'Connection Interrupted' problem

6

Hi, I am problem with Lab: the screen shows 'Connection Interrupted' and agent stops esponding to any command (passed via env.step function). Here is how it looks like: https://youtu.be/vL842dKvG0k Here...

Unable to stop agents after a while

5

I am having an issue when stopping clearml agent that is running for a while in detached mode. Here is how I start the agent: `CLEARML_WORKER_NAME=my_worker CLEARML_WORKER_ID=my_worker clearml-agent daemon --detached...

NaN loss during training (again)

3

Hi, training SMALL model works fine but BASE model ends up with NaN loss. I tried decreasing learning rate to 1e-4 but it did not help (and it could not...