emma
emma copied to clipboard
Stream target language
As stream processing engines differ and none of them seem to suit all of our needs, we need to define a target language. We can plug in backends (Flink, Storm, Samza etc.), as all of them are close to our needed set of features. However, this should be as lightweight as possible, as it is not the main concern of the current research.
Needed features:
- Building dataflow DAG of operators
- Separate event handlers for separate inputs of an operator
- Setting number of parallel operator instances
- Custom partitioning
- Custom configuration passing
- Managed operator state