hive icon indicating copy to clipboard operation
hive copied to clipboard

HIVE-28956 : Use msdb.alterPartitions() API and implement batching for alter table add column cascade command

Open vikramahuja1001 opened this issue 8 months ago • 3 comments

What changes were proposed in this pull request?

Currently Alter table add column cascade uses msdb.alterPartition API. This API only JDO based implementation. Instead of this use msdb.alterPartitions which supports both DirectSql and JDO Implementation and use batching as well.

Why are the changes needed?

DirectSql bein more optimized than JDO can improve performance for tables with very high number of partitions and very high number of columns.

Does this PR introduce any user-facing change?

No

How was this patch tested?

Tested this on a 3 node cluster on a table with 5000+ partitions and 900+ columns.

vikramahuja1001 avatar May 14 '25 15:05 vikramahuja1001

@deniskuzZ , i have made the necessary changes. Could you please check the PR once again?

vikramahuja1001 avatar May 26 '25 06:05 vikramahuja1001

Cc @zhangbutao , @chinnaraolalam

vikramahuja1001 avatar May 26 '25 06:05 vikramahuja1001