yerimChoi

[BUG] AttributeError: 'PipelineEngine' object has no attribute '__flops__'

2

I've tried to use Flops Profiler on running Megatron-LM-DeepSpeed in model training workflow, (https://github.com/microsoft/Megatron-DeepSpeed) outside the DeepSpeed Runtime as shown below in https://www.deepspeed.ai/tutorials/flops-profiler/#example-megatron-lm I defined Flopsprofiler as `prof = FlopsProfiler(model[0])`...