DartMeasurement in testing stdout fails to update image
Hi,
I have been trying to use a <DartMeasurementFile> tag to add performance plots to my dashboard. It seems to work great the first time, however the images do not update. It appears that regardless of how my image changes on the testing platform, the CDash server always sees the same image.
For example the submission here: https://my.cdash.org/testDetails.php?test=57268991&build=1820699
The image is identical to this previously submitted image here: https://my.cdash.org/testDetails.php?test=57268991&build=1820693
The images created on the testing platform are different, but somehow they link the same file on the CDash server-side. Do I need to randomize the image filename to get this to work properly?
Thanks (in advance) for your help!
Cheers, -Mike
I am seeing this issue too with "prebuilt" 5be65db5903c846f39b5b008568b0af424a53190 using PostgreSQL.
I tried using content hashes for the filenames but that doesn't change anything. The images still don't get updated. I suppose the input file name might not even get transmitted to CDash and this is just tied to the name of the measurement (which I don't really want to randomize / make unique).
I'm looking into this now. You shouldn't have to fuss with the filename to get CDash to recognize that they are different files.
Thanks! To resolve the issue in the short term - I've been sticking a portion of the git revision onto the filename and this works for my purposes. I have not yet tested whether multiple tests on the same revision yield colliding images on CDash server.
Fixed in #1031 . I'll close this issue when my.cdash.org is updated with this fix.
Thanks a ton!
@zackgalbreath I'm seeing what I suspect is a related issue on open.cdash.org where the graph shown adds all the measurements for a build instead of just the one selected to display the graph for.