HIVE-29340: Restore Hive ATSHook to populate the Tez View Queries tab

[Aggarwal-Raghav]

This is revert of HIVE-20078

What changes were proposed in this pull request?

Check the attachements under HIVE-29340

Why are the changes needed?

Does this PR introduce any user-facing change?

Yes, Users will starts seeing rows/fields in tez-view

How was this patch tested?

On local setup

[Aggarwal-Raghav]

Have made few minor custom changes:

1. Added underscore in config name ATSHOOKQUEUECAPACITY
2. removed numSparkJobs

[Aggarwal-Raghav]

There seems to be a behaviour changes in parsing of fields in tez. For instance, in callerId the User is getting appended. In hive3 its not there. I'll investigate this and raise another PR in Hive or Tez.

[sonarqubecloud[bot]]

Quality Gate passed

Issues
63 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud

[zhangbutao]

Regarding ATSHook, in my impression, it tends to have two issues: one is that it easily causes HS2 OOM, although some fixes were made in HIVE-15541; the other is that if the Yarn timeline server becomes unavailable, ATSHook also seems to be easily affected.

However, if ATSHook is added back as an optional hook specifically for use with Yarn, I am in favor of it. Some users still wanto to use this hook. And, adding it back would not affect the use of other hooks.