Systematic Analysis of Extraction Functionalities
When using HERMES in SMECS, we discovered that HERMES does not work for all github and gitlab repositories without errors. While most of the errors are the results of our GitLabHub plugin some are also resulting from some other plugins.
Therefore, a systematic test with a large number of repositories would be interesting to find different bugs and problems.
It would be interesting to know which kinds of errors you run into. Is it crashes of the program? Or does it fail to find certain metadata or gets it wrong?
By the way: Would you be interested in adding your plugin to the HERMES "Marketplace"? You can file an issue here or add it to plugins.json via a pull request. :-)
Thanks for opening this issue @sferenz!
- Indeed, knowing the exact errors you run into would be great (perhaps as sub-issues to this one).
- Adding your plugin to the Marketplace as suggested by David would also be great, and would help us 1) test the marketplace "integration", and 2) figure out some things about setting up the "hermes ecosystem", how plugins should be integrated, etc.
As an additional point, we're currently working towards consolidating the data model and API, and perhaps we can address your specific issues in tests to make sure we don't regress in the future.
Thanks!
Different errors when testing harvesting locally and remotely (through SMECS):
- #257
- #275
- #325
- #436
- #437
- #448
- #450