Is your feature request related to a problem? Please describe. Both national labs, internal customers, and others are asking for a Mi300 based roofline analysis. In v2.0 release this was temporarily disabled.

The microbenchmark has been adjusted with help from @rwvo . However, I still want to stress test the arithmetic intensity calculation and put the model through the wringer with some test applications.

Describe the solution you'd like

Start by working with @nwolfey21 to check in on status. His expertise could help inform any adjustments required on arithmetic intensity
Initial tests on the beta-version, iterate, and adjust
Select test suite and verify results

Feb 28 '24 19:02 coleramos425

Happy to help. Let me know what you need. I'm good at breaking things ;)

Feb 29 '24 15:02 nwolfey21

Add me to this as well. @coleramos425 you want to set something up ?

Mar 01 '24 14:03 skyreflectedinmirrors

I'll add you to the meeting @skyreflectedinmirrors

Mar 01 '24 15:03 coleramos425

hi @coleramos425 is mi300 roofline enabled in omniperf? get similar request, thanks!

Jun 04 '24 17:06 lizamd

@lizamd we're still developing roofline support. If you ping me on Teams I can provide more detail.

Jun 04 '24 17:06 coleramos425

cool, thanks for the quick response, will ping you!

Jun 04 '24 17:06 lizamd

Hi @coleramos425, I am also trying to use roofline for bench-marking llama.cpp. Any workarounds or temporary solutions to get it to work would be of great help. Thanks in advance!!

Jul 15 '24 18:07 itej89

Update 8/16

Just received a beta version of microbenchmark from Rene. @cfallows-amd will be working to validate that work while myself and others work on adjustments to the arithmetic intensity calculation

Aug 16 '24 16:08 coleramos425

Enable Mi300 Roofline

Update 8/16