Lin Liu

[HUDI-8178] Fix CI failures for partition-stats enablement

1

### Change Logs Enable partition stats index by default, and fix test failures caused. Root causes include: 1. Test setup. 2. UTF8 to String casting. 3. Date to LocalDate casting....

[HUDI-9395] Validation schema evolution

1

### Change Logs Test three cases: 1. Different base file schema; 2. Different log file schema; 3. Different base and log file schema. With extra primitive column and extra nested...

[HUDI-9395] Remove unnecessary constraints on compactor

1

### Change Logs Remove constraints: 1. Virtual Key 2. Bootstrap files ### Impact Make FG reader based compactor more general. ### Risk level (write none, low medium or high below)...

[HUDI-9395][DNM] Remove FG reader flag Usage

1

### Change Logs Remove the FG reader flag usage to see if any functionalities would fail. ### Impact No impact. ### Risk level (write none, low medium or high below)...

[HUDI-8401] Add merger class LegacyMySqlDebeziumAvroMerger

1

### Change Logs This change adds the merger class to deprecate `MySqlDebeziumAvroPayload`. ### Impact `MySqlDebeziumAvroPayload` is not initialized in Hudi. ### Risk level (write none, low medium or high below)...

[HUDI-9360] Deprecate builtin Avro payloads with mergers

3

### Change Logs 1. Create EventTimeBasedAvroRecordMerger for event time ordering merge mode. 2. Update the place where HoodieAvroRecordMerger is called. ### Impact Remove some payloads. ### Risk level (write none,...

[HUDI-8401] Add merger classes for CDC payloads.

1

### Change Logs Add merger classes for CDC payloads. ### Impact These classes will replace the usage of CDC payload classes. ### Risk level (write none, low medium or high...

[HUDI-9361] Use merger to replace spark ExpressionPayload

1

### Change Logs 1. Create a merger class to replace ExpressionPayload ### Impact Existing tests should be sufficient to demonstrate the merger. ### Risk level (write none, low medium or...

[HUDI-8746] Introduce SparkFileReader for general base file format

1

### Change Logs This PR 1. introduces SparkFileReader that could be extended to readers for different base file formats. 2. passes a map of [HoodieFileFormat, SparkFileReader] into Spark ReaderContext for...

[HUDI-8746] Support multi base file formats through fg reader

1

### Change Logs Created a new file format `HoodieFileGroupReaderBasedFileFormat` to support multiple base file formats, which is guarded by the existing configuration. The main change that we do is to...