CDash icon indicating copy to clipboard operation
CDash copied to clipboard

DartMeasurement in testing stdout fails to update image

Open MTCam opened this issue 5 years ago • 7 comments

Hi,

I have been trying to use a <DartMeasurementFile> tag to add performance plots to my dashboard. It seems to work great the first time, however the images do not update. It appears that regardless of how my image changes on the testing platform, the CDash server always sees the same image.

For example the submission here: https://my.cdash.org/testDetails.php?test=57268991&build=1820699

The image is identical to this previously submitted image here: https://my.cdash.org/testDetails.php?test=57268991&build=1820693

The images created on the testing platform are different, but somehow they link the same file on the CDash server-side. Do I need to randomize the image filename to get this to work properly?

Thanks (in advance) for your help!

Cheers, -Mike

MTCam avatar May 06 '20 18:05 MTCam

I am seeing this issue too with "prebuilt" 5be65db5903c846f39b5b008568b0af424a53190 using PostgreSQL.

ngladitz avatar Jun 09 '20 08:06 ngladitz

I tried using content hashes for the filenames but that doesn't change anything. The images still don't get updated. I suppose the input file name might not even get transmitted to CDash and this is just tied to the name of the measurement (which I don't really want to randomize / make unique).

ngladitz avatar Jun 09 '20 09:06 ngladitz

I'm looking into this now. You shouldn't have to fuss with the filename to get CDash to recognize that they are different files.

zackgalbreath avatar Jun 25 '20 14:06 zackgalbreath

Thanks! To resolve the issue in the short term - I've been sticking a portion of the git revision onto the filename and this works for my purposes. I have not yet tested whether multiple tests on the same revision yield colliding images on CDash server.

MTCam avatar Jun 25 '20 15:06 MTCam

Fixed in #1031 . I'll close this issue when my.cdash.org is updated with this fix.

zackgalbreath avatar Jul 03 '20 17:07 zackgalbreath

Thanks a ton!

MTCam avatar Aug 19 '20 13:08 MTCam

@zackgalbreath I'm seeing what I suspect is a related issue on open.cdash.org where the graph shown adds all the measurements for a build instead of just the one selected to display the graph for.

chuckatkins avatar Sep 03 '20 19:09 chuckatkins