StreamBench

StreamBench copied to clipboard

What is the output ?

2

gongshijun

Throughout and latency

4

How to get throughout and latency information? Throughout could be get at the latest step(operation), simply log how many data received in a period of time.

0x7aF777

Flink streaming word count loses data window().groupBy(0).reduceWindow().flatten().groupBy(0).reduce()

0x7aF777

Flink window and Spark window

2

Flink need do group operation first before window. Spark doesn't need. What's more, spark should avoid groupByKey. https://databricks.gitbooks.io/databricks-spark-knowledge-base/content/best_practices/prefer_reducebykey_over_groupbykey.html

0x7aF777

Flink managed memory is much lower than configure

1

0x7aF777