btrude

> --lr_decay=0.9 @ObscuraDK This means you are only invoking the lr decay for the last fraction of a step during training (ie, this is essentially doing nothing unless you are...

@perlman-izzy What's your email address? Sounds like you are using my docker image so I am happy to keep helping you. I also completely understand the desire to do so...

> @btrude Any chance you can make those changes available? I'd like to roll that stuff into the google Colab I've been using. @bsturk Possibly... I'm not at all familiar...

>you'd be 48gb / and could handle fine tuning larger model @johndpope This is unfortunately not true. Jukebox as released here uses distributed data parallel which requires the model be...

> @btrude - I stand corrected. So, to train on aws /ec2 with (SPOT PRICING / can terminiate at any instant) p3.8xlarge (64GB of VRAM) is $3-4 /hr in N....

> @btrude I'm using the colab located here > > #72 > > and yeah, I'm not sure I could utilize the 5b changes you've made in Colab, I'd be...

@bsturk I went ahead and just made it, you can load it through github in colab with the link below https://gist.github.com/btrude/72c788b8ce8c8b2f8bc8ecf309a04f24 this is only for sampling, but has all of...

@bsturk `--sample_length_in_seconds` = the length of the sample you're generating/continuing/truncating/upsampling (you have to increment this as you continue sampling, etc) `--total_sample_length_in_seconds` = total intended length of the song, though you...

> @btrude Sorry, this is a noob question, but is it already possible to generate samples with your modified notebook or is it only theoretical at this point? I seem...

> @btrude Just tried again, 1b works fine but 5b just kinda stops (runs out of memory?). Sorry if this has been established before in this thread, it's all a...