DataBiosphere
Generate CWL compliance information for the CWL website
Would be great for Toil to make a "Self-Reported Compliance" statement about their support for CWL v1.0, v1.1, v1.2 in various configurations (single node, AWS, GCP, Slurm, etc. ; with Docker or with Singularity)
Context: in https://groups.google.com/g/common-workflow-language/c/Dn73A6eBv7Q/m/AmeUmH_qAQAJ I write
Dear CWL community
As part of a recent change to the CWL website, I added a column to the CWL Implementations table for "Self Reported Compliance" https://www.commonwl.org/#Implementations
Here we see that ep3 reports that they pass 98% of the CWL v1.0 compliance tests marked "required" via a badge that links to a more detailed report giving the percent breakdown for each optional feature of CWL v1.0.
I invite every system capable of running CWL tools and/or workflows to also self-report their level of compliance with the CWL conformance tests (including the version(s) of the CWL standards supported: v1.0, v1.1, and/or v1.2) by sending a pull request to update https://github.com/common-workflow-language/cwl-website/blob/main/content/_includes/home/implementations.html
Ideally this information would be updated upon every release. For service providers I ask that the day the conformance test was run is made clear.
You may find the badge generating capabilities of cwltest useful, though using cwltest is not required: https://github.com/common-workflow-language/cwltest/#generate-conformance-badges-using-cwltest
┆Issue is synchronized with this Jira Story ┆friendlyId: TOIL-1088
@DailyDreaming @adamnovak I've got a repo ready for this, shall we transfer this to the DataBiosphere GitHub organization?
https://github.com/mr-c/toil_badges
@mr-c Thanks a bunch for doing this! Yes, I support moving it there. If you make me an owner of the repo I can transition it.
