Command-line interface

[dgoldenberg1234]

You'll want a command-line interface for the ETL framework in order to make it usable by DevOps and for ease of integration and testing in general, as an alternative to any GUI's.

Some of the functions to consider there:

• list -- ability to enumerate all the deployed pipelines
• start -- ability to kick off a given pipeline
• status -- ability to get a status summary on a pipeline, if running
• stop -- ability to kill a pipeline, if running

Some more advanced functions could be e.g. get the listing of all the data provenance (FTI) log entries for a given pipeline run or the latest N entries; perhaps a tail type of function for those entries.

[nsoft]

This makes sense once we have a file format for plans/steps that can be consumed.

[nsoft]

This would likely leverage a REST interface to avoid duplication of effort since we will certainly want monitoring capabilities too. Authentication will need to be handled somehow.