[WIP][Spark 44646] Reduce usage of log4j core

[mucharafal]

What changes were proposed in this pull request?

Reducing usage of Log4j2 core classes, and moving this usage to isolated classes which won't be loaded unless log4j2 is on classpath. For now Spark strongly needs log4j-core library, what may conflicts with other libraries.

Why are the changes needed?

To let user decide which framework for logging he/she can use.

Does this PR introduce any user-facing change?

Seems that no, but please verify.

How was this patch tested?

I tested builded spark-common-utils package locally against my test project.

Was this patch authored or co-authored using generative AI tooling?

No.