externalize audits so they can be run locally and/or within target library CI/CD

[dariuszkuc]

Story

As a GraphQL library maintainer I would like to be able to run HTTP spec audit locally to ensure my client/server remains compliant with the spec.

Acceptance criteria

• GraphQL library maintainer is able to run HTTP spec audit locally

Related

• https://github.com/graphql/graphql-http/issues/8
• Apollo Federation Spec Compliance Tools

[enisdenjo]

You already can, see the "Audit for servers usage in Jest environment" recipe.

[dariuszkuc]

Its doable but somewhat clunky -> it implies folks have to write Javascript to run tests (and many libraries are not Javascript based). Ideally they could just run some executable script that gives them the results*.

*Looks like we would also need to generate the report matrix manually as well (example auto generated report https://github.com/apollographql/federation-jvm/pull/290#issuecomment-1397915584).

[enisdenjo]

Ah yes, a CLI. Makes sense! I'll see what I can do.