spark icon indicating copy to clipboard operation
spark copied to clipboard

[SPARK-52020][TEST] Build hive-test-udfs.jar from source

Open vrozov opened this issue 9 months ago • 2 comments

What changes were proposed in this pull request?

Remove hive-test-udfs.jar from the source control, add java sources for Hive UDFs and build hive-test-udfs.jar as part of HiveUDFDynamicLoadSuite using Maven.

Why are the changes needed?

  • Building UDFs during testing using the same Hive version as what Spark uses guaranties correctness of UDFs
  • It is against ASF policy to have jar files in the source release.

Does this PR introduce any user-facing change?

No, it impacts tests only

How was this patch tested?

It was tested using maven build and running HiveUDFDynamicLoadSuite.

Was this patch authored or co-authored using generative AI tooling?

No

vrozov avatar May 05 '25 14:05 vrozov

@HeartSaVioR, @dongjoon-hyun, @HyukjinKwon, @cloud-fan Please review. Similar approach can be applied to other jars.

vrozov avatar May 05 '25 19:05 vrozov

@HeartSaVioR, @dongjoon-hyun, @HyukjinKwon, @cloud-fan Please review

vrozov avatar May 12 '25 14:05 vrozov

@cloud-fan Please take a look

vrozov avatar Jul 28 '25 17:07 vrozov

We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue manageable. If you'd like to revive this PR, please reopen it and ask a committer to remove the Stale tag!

github-actions[bot] avatar Nov 06 '25 00:11 github-actions[bot]