h8907283

Using batch_size * num_gpus as batch_size in exponential_decay calculation?

5

Hi guys, I've been reading benchmark_cnn.py and trying to figure out what batch_size really is in a multi-GPU setup when using it to calculate num_batches_per_epoch and decay_steps. num_batches_per_epoch = (float(num_examples_per_epoch)...

Runtime error when calling freeze_transformer_layers

2

### System Info PyTorch version: 2.2.0.dev20230911+cu118 CUDA used to build PyTorch: 11.8 Python version: 3.8.10 (default, May 26 2023, 14:05:08) [GCC 9.4.0] (64-bit runtime) GPU models and configuration: GPU 0:...