Nick Curtis
Nick Curtis
I would be very interested in what comes out the other side of this :)
Nice! that's a pleasant surprise @jrmadsen :+1:
https://gist.github.com/arghdos/1132b39c116cc7dbe46a89b71b831274
It looks like there's some weird interplay between gotcha and MPI here.
A thought here. Right now (AFAIK), omnitrace requires `PrgEnv-gnu` to compile on Crusher. However, loading this changes the MPI library: ``` $ module load PrgEnv-gnu Lmod is automatically replacing "cce/14.0.0"...
I haven't tried this recently, but I'm fairly sure I tried w/ partial MPI support. But, I did notice another one of these types of load conflicts tonight: I am...
~Ok, the HSA thing is definitely not Omni's rpath related...~ Edit: spoke too soon, I had to remove some more stuff from LD_LIBRARY_PATH. However, after doing so I see: ```...
could really be coming from any of these: https://github.com/AMDResearch/omnitrace/blob/main/cmake/Packages.cmake#L172
I ended up commenting out all of the "set(CMAKE_INSTALL_RPATH" commands, which appears to have done what I want: ``` $ readelf -d /ccs/home/nicurtis/sw/omnitrace-devel/lib/libomnitrace.so Dynamic section at offset 0x2035d38 contains 45...
I think I never tried again, as my debug went elsewhere but I I'm fairly confident the rpath changes would have resolved it. The issue was that libfabric was ldopen'ing...