Tom
Tom
I'd strongly recommend having more descriptive shard names. Even if you put them into separate directories, I'd call it "something_train_00001.tar" and "something_val_00001.tar". I'll look into forwarding the argument to make...
It would be useful to figure out where that memory leak comes from. Can you look with a memory tracing tool to see what objects are increasing in number? It...
I'll push a new update in the next few days. (I was installing six new machines in my home server and upgrading to 24.04)
Sorry, not sure what happened. I'll try to get this out ASAP.
WebDataset has been quite stable for years. It is routinely used by many people. The main development of the WebDataset library is happening in the refactored branch; you can install...
Sure, I'd be happy to look into it. What kinds of hooks do you think you need?
What I'd recommend is the following: - compute an integer hash `h` from the sample key - during training, for cross-validation step i in range(k), drop samples for which `h...
Oh, sorry, I need to update that example. Generally speaking, though, I think that length is there because Lightning requires a length for its progress bars. I'll have a look.
For presentations, HTML is often used for simple things like different font sizes/colors/styles, specific layouts, etc. Usually, nothing more complicated than that. The thing is, a lot of other tools...
I'm not sure what you mean. If I wanted to spend a lot of time on rewriting presentations, I would simply remove the HTML. The point is that I have...