[STORM-3782] Refactor KafkaOffsetMetric to use V2 metrics

Open RuiLi8080 opened this issue 4 years ago • 0 comments

What is the purpose of the change

Refactor KafkaOffsetMetric to use V2 metrics

How was the change tested

Ran KafkaSpoutTopologyMainNamedTopics with org.apache.storm.metrics2.reporters.ConsoleStormReporter


2021-07-19 06:28:17.889 c.c.m.ConsoleReporter metrics-console-reporter-1-thread-1 [INFO] storm.topology.storm-kafka-client-spout-test-59-1626675397.openstorm3blue-n6_blue_ygrid_yahoo_com.kafka_spout.4.6703-kafkaOffset.kafka-spout-test-1/totalSpoutLag
2021-07-19 06:28:17.890 c.c.m.ConsoleReporter metrics-console-reporter-1-thread-1 [INFO]              value = 33295786
--
2021-07-19 06:28:17.895 c.c.m.ConsoleReporter metrics-console-reporter-1-thread-1 [INFO] storm.topology.storm-kafka-client-spout-test-59-1626675397.openstorm3blue-n6_blue_ygrid_yahoo_com.kafka_spout.4.6703-kafkaOffset.kafka-spout-test-2/partition_0/spoutLag
2021-07-19 06:28:17.897 c.c.m.ConsoleReporter metrics-console-reporter-1-thread-1 [INFO]              value = 399498
--
2021-07-19 06:28:17.898 c.c.m.ConsoleReporter metrics-console-reporter-1-thread-1 [INFO] storm.topology.storm-kafka-client-spout-test-59-1626675397.openstorm3blue-n6_blue_ygrid_yahoo_com.kafka_spout.4.6703-kafkaOffset.kafka-spout-test-2/totalSpoutLag
2021-07-19 06:28:17.898 c.c.m.ConsoleReporter metrics-console-reporter-1-thread-1 [INFO]              value = 33281809
--
2021-07-19 06:28:17.904 c.c.m.ConsoleReporter metrics-console-reporter-1-thread-1 [INFO] storm.topology.storm-kafka-client-spout-test-59-1626675397.openstorm3blue-n6_blue_ygrid_yahoo_com.kafka_spout.4.6703-kafkaOffset.kafka-spout-test/partition_0/spoutLag
2021-07-19 06:28:17.905 c.c.m.ConsoleReporter metrics-console-reporter-1-thread-1 [INFO]              value = 399539
--
2021-07-19 06:28:17.906 c.c.m.ConsoleReporter metrics-console-reporter-1-thread-1 [INFO] storm.topology.storm-kafka-client-spout-test-59-1626675397.openstorm3blue-n6_blue_ygrid_yahoo_com.kafka_spout.4.6703-kafkaOffset.kafka-spout-test/totalSpoutLag
2021-07-19 06:28:17.906 c.c.m.ConsoleReporter metrics-console-reporter-1-thread-1 [INFO]              value = 33285065
--
2021-07-19 06:28:27.886 c.c.m.ConsoleReporter metrics-console-reporter-1-thread-1 [INFO] storm.topology.storm-kafka-client-spout-test-59-1626675397.openstorm3blue-n6_blue_ygrid_yahoo_com.kafka_spout.4.6703-kafkaOffset.kafka-spout-test-1/partition_0/spoutLag
2021-07-19 06:28:27.887 c.c.m.ConsoleReporter metrics-console-reporter-1-thread-1 [INFO]              value = 399183
--
2021-07-19 06:28:27.889 c.c.m.ConsoleReporter metrics-console-reporter-1-thread-1 [INFO] storm.topology.storm-kafka-client-spout-test-59-1626675397.openstorm3blue-n6_blue_ygrid_yahoo_com.kafka_spout.4.6703-kafkaOffset.kafka-spout-test-1/totalSpoutLag
2021-07-19 06:28:27.889 c.c.m.ConsoleReporter metrics-console-reporter-1-thread-1 [INFO]              value = 33694969
--
2021-07-19 06:28:27.895 c.c.m.ConsoleReporter metrics-console-reporter-1-thread-1 [INFO] storm.topology.storm-kafka-client-spout-test-59-1626675397.openstorm3blue-n6_blue_ygrid_yahoo_com.kafka_spout.4.6703-kafkaOffset.kafka-spout-test-2/partition_0/spoutLag
2021-07-19 06:28:27.896 c.c.m.ConsoleReporter metrics-console-reporter-1-thread-1 [INFO]              value = 399008
--
2021-07-19 06:28:27.898 c.c.m.ConsoleReporter metrics-console-reporter-1-thread-1 [INFO] storm.topology.storm-kafka-client-spout-test-59-1626675397.openstorm3blue-n6_blue_ygrid_yahoo_com.kafka_spout.4.6703-kafkaOffset.kafka-spout-test-2/totalSpoutLag
2021-07-19 06:28:27.898 c.c.m.ConsoleReporter metrics-console-reporter-1-thread-1 [INFO]              value = 33680817
--
2021-07-19 06:28:27.904 c.c.m.ConsoleReporter metrics-console-reporter-1-thread-1 [INFO] storm.topology.storm-kafka-client-spout-test-59-1626675397.openstorm3blue-n6_blue_ygrid_yahoo_com.kafka_spout.4.6703-kafkaOffset.kafka-spout-test/partition_0/spoutLag
2021-07-19 06:28:27.905 c.c.m.ConsoleReporter metrics-console-reporter-1-thread-1 [INFO]              value = 399049
--
2021-07-19 06:28:27.907 c.c.m.ConsoleReporter metrics-console-reporter-1-thread-1 [INFO] storm.topology.storm-kafka-client-spout-test-59-1626675397.openstorm3blue-n6_blue_ygrid_yahoo_com.kafka_spout.4.6703-kafkaOffset.kafka-spout-test/totalSpoutLag
2021-07-19 06:28:27.907 c.c.m.ConsoleReporter metrics-console-reporter-1-thread-1 [INFO]              value = 33684114

Jul 19 '21 15:07 RuiLi8080