hermes icon indicating copy to clipboard operation
hermes copied to clipboard

Systematic Analysis of Extraction Functionalities

Open sferenz opened this issue 6 months ago • 3 comments

When using HERMES in SMECS, we discovered that HERMES does not work for all github and gitlab repositories without errors. While most of the errors are the results of our GitLabHub plugin some are also resulting from some other plugins.

Therefore, a systematic test with a large number of repositories would be interesting to find different bugs and problems.

sferenz avatar Aug 14 '25 08:08 sferenz

It would be interesting to know which kinds of errors you run into. Is it crashes of the program? Or does it fail to find certain metadata or gets it wrong?

By the way: Would you be interested in adding your plugin to the HERMES "Marketplace"? You can file an issue here or add it to plugins.json via a pull request. :-)

zyzzyxdonta avatar Aug 25 '25 09:08 zyzzyxdonta

Thanks for opening this issue @sferenz!

  • Indeed, knowing the exact errors you run into would be great (perhaps as sub-issues to this one).
  • Adding your plugin to the Marketplace as suggested by David would also be great, and would help us 1) test the marketplace "integration", and 2) figure out some things about setting up the "hermes ecosystem", how plugins should be integrated, etc.

As an additional point, we're currently working towards consolidating the data model and API, and perhaps we can address your specific issues in tests to make sure we don't regress in the future.

Thanks!

sdruskat avatar Sep 03 '25 08:09 sdruskat

Different errors when testing harvesting locally and remotely (through SMECS):

  • #257
  • #275
  • #325
  • #436
  • #437
  • #448
  • #450

Aidajafarbigloo avatar Oct 24 '25 13:10 Aidajafarbigloo