amoro icon indicating copy to clipboard operation
amoro copied to clipboard

[Improvement][AMS] keyed change table don't delete TTL files in time when expire

Open hzluting opened this issue 3 years ago • 0 comments

Now, keyed change table has 2 properties to control files change.data.ttl.minutes: check change table data file whether in valid time, if not then delete from iceberg snapshot snapshot.change.keep.minutes:check change table snapshot whether in valid time, if not then delete snapshot from file system(include deleted data files and metadata files)

so, the data files will keep ttlTime + expireTime.

hzluting avatar Aug 17 '22 06:08 hzluting