Yzx835

convert_to_float8_training and torch.compile make model slow

12

NOTE: I retest the times | Configuration | Training Time 1 (s) | Training Time 2 (s) | Training Time 3 (s) | Mean (s) | |----------------------------------------------|--------------------|--------------------|--------------------|----------| | **Without `convert_to_float8_training`...