Aranxtonel

> I pushed something earlier today that may help address the hanging you're seeing. To get the latest version of `openpipe-art`: > > ``` > uv add 'git+https://github.com/OpenPipe/ART.git#egg=openpipe-art[backend]' > ```...

> Are you trying to run this on a B200? I'm not sure we support Blackwell yet. Haha, I wish I had a B200. No, I use an NVIDIA RTX...

> As far as i can tell, in my cases it results from LLMEngine crashes. I think you might have a different problem. I just checked my vllm.log and there...

I've rechecked this issue with ART 0.4.9, just in case, but there is no improvement so far. I also tried running the new [2048 notebook](https://colab.research.google.com/github/openpipe/art-notebooks/blob/main/examples/2048/2048.ipynb) **unmodified** in Colab (on a...

> Appears to be a OOM error, but it's failing silently. Interesting - but why? This model doesn't use that much VRAM, and reducing gpu_memory_utilization also doesn't seem to help....

Well, after trying the new 0.5.0 version with the old notebook (which still supports local execution), I can say it *somewhat* works. Training no longer freezes, and I managed to...