Xu Guang Lv

> @ShubhamGupta29 every spark job, I suspect it's beacuse of this. > https://github.com/songgane/dr-elephant/blame/feature/support_spark_2.x/app/org/apache/spark/deploy/history/SparkDataCollection.scala#L178 > > That `info.memUsed` is only available when the job is running, but I am not sure...

> @mareksimunek @xglv1985 need one help from you guysin debugging the issue, can you confirm if the value of ` memUsed` is Non-Zero in the response for [REST API endpoint](https://spark.apache.org/docs/2.3.0/monitoring.html#rest-api)...

> @mareksimunek @xglv1985 thanks for the prompt response, I am able to support Spark2.3 and will make the changes public soon. I am debugging this `memUsed = 0` issue as...

> @mareksimunek @xglv1985 thanks for the prompt response, I am able to support Spark2.3 and will make the changes public soon. I am debugging this `memUsed = 0` issue as...

> @xglv1985 no this is not normal. Can you tell me which branch or source code are you using? @ShubhamGupta29 dr-elephant_987

> Can you provide the link as `linkedin/dr-elephant` doesn't have any branch named `dr-elephant_987` @ShubhamGupta29 I forked my own dr-elephant from linkedin/dr-elephant master. I only put "SparkFetcher" in my conf...

> @xglv1985 if you are using current master, you can't see any metrics from spark 2.3+ > More in: > #389 > Check your logs there will be some parsing...

ok I saw it yesterday and I will fill the survey today. | | hikari | | 邮箱：[email protected] | Signature is customized by Netease Mail Master On 04/30/2020 10:08, Shubham...

sure, I will try your personal branch, and will feedback to you during May 1st to 5th. At 2020-04-30 14:37:06, "Shubham Gupta" wrote: @xglv1985 did you get a chance to...

> @mareksimunek and @xglv1985 I have made some more changes for Spark 2.3 support, kindly try this [branch](https://github.com/ShubhamGupta29/dr-elephant/tree/feature_spark2.3) whenever you guys have time. Also for memory heuristics, there is a...