nifi icon indicating copy to clipboard operation
nifi copied to clipboard

NIFI-12855: Add more information to provenance events to facilitate full graph traversal

Open mattyb149 opened this issue 1 year ago • 1 comments

Summary

NIFI-12855 This PR augments the provenance capabilities to include the following features:

  • A reference in a provenance event to any parent events ("previousEventIds")
  • Add methods to GraphClientService to generate queries/statements in popular graph languages such as Tinkerpop/Gremlin, Cypher, and SQL
  • Add ArcadeDB service as reference implementation for SQL generation

Tracking

Please complete the following tracking steps prior to pull request creation.

Issue Tracking

Pull Request Tracking

  • [x] Pull Request title starts with Apache NiFi Jira issue number, such as NIFI-00000
  • [x] Pull Request commit message starts with Apache NiFi Jira issue number, as such NIFI-00000

Pull Request Formatting

  • [x] Pull Request based on current revision of the main branch
  • [x] Pull Request refers to a feature branch with one commit containing changes

Verification

Please indicate the verification steps performed prior to pull request creation.

Build

  • [x] Build completed using mvn clean install -P contrib-check
    • [x] JDK 21

Licensing

  • [ ] New dependencies are compatible with the Apache License 2.0 according to the License Policy
  • [ ] New dependencies are documented in applicable LICENSE and NOTICE files

Documentation

  • [ ] Documentation formatting appears as expected in rendered files

mattyb149 avatar Mar 13 '24 19:03 mattyb149

The graph client stuff has been removed, I'll do a separate PR but not yet in case the reviews here affect the clients. Once this is in it will facilitate more clients such as perhaps an RDF/SPARQL client. Thanks for the inputs!

mattyb149 avatar Mar 15 '24 19:03 mattyb149

@mattyb149 It is important to undo all the whitespace changes to improve the reviewer efficiency and avoid the whitespace in general.

joewitt avatar May 03 '24 17:05 joewitt