emma icon indicating copy to clipboard operation
emma copied to clipboard

Stream target language

Open gaborhermann opened this issue 9 years ago • 0 comments

As stream processing engines differ and none of them seem to suit all of our needs, we need to define a target language. We can plug in backends (Flink, Storm, Samza etc.), as all of them are close to our needed set of features. However, this should be as lightweight as possible, as it is not the main concern of the current research.

Needed features:

  • Building dataflow DAG of operators
  • Separate event handlers for separate inputs of an operator
  • Setting number of parallel operator instances
  • Custom partitioning
  • Custom configuration passing
  • Managed operator state

gaborhermann avatar May 04 '16 11:05 gaborhermann