Eric Tang
Eric Tang
What's the exact status on torch.compile compatibility with Liger at the moment? I checked the ordering of operations and I'm currently running into similar issues with constexpr as in this...
Hmm yeah good call actually, seems like that specific error has to do with some issue with Torch 2.3.1 and Liger 0.3.1 -> realized that if you upgrade to Torch...
would it be possible to provide pre-built pytorch wheels? Still seeing ~10-15 minute build time for working with transformer-engine-torch (installing via uv), and pre-built wheels would be very helpful. Otherwise,...
It's more like ~8 minutes actually, which is still quite long - logs here: https://gist.github.com/erictang000/b03880e22ca2fe1d35db03fd6ef0ba93 this is with running the following commands (which we are using in SkyRL to use...
bump here! would also like this to be merged
yes! not specifying `ray_storage_filesystem` and just specifying ```yaml ray_run_name: llama3_8b_sft_lora ray_storage_path: ``` will still work on the local filesystem as before!