matrixone icon indicating copy to clipboard operation
matrixone copied to clipboard

[Bug]: gc should consume persistent metadata in checkpoint rather than the in-memory metadata

Open XuPeng-SH opened this issue 2 years ago • 7 comments

Is there an existing issue for the same bug?

  • [X] I have checked the existing issues.

Branch Name

main,1.1-dev

Commit ID

7d9ca8fbd14c3f8019e15661acaaa6e2570d5d70

Other Environment Information

- Hardware parameters:
- OS type:
- Others:

Actual Behavior

gc consumes the in-memory metadata and it may miss the deletion of many data files

Expected Behavior

No response

Steps to Reproduce

1. make some checkpoints with at least one global checkpoint
2. restart 
3. check the gc files and files should be gc'ed

Additional information

No response

XuPeng-SH avatar Jan 15 '24 10:01 XuPeng-SH

暂时在做cache release的开发

LeftHandCold avatar Jan 18 '24 10:01 LeftHandCold

暂时在做cache release的开发

LeftHandCold avatar Jan 23 '24 15:01 LeftHandCold

暂时在做backup的开发

LeftHandCold avatar Jan 26 '24 10:01 LeftHandCold

暂时在做backup的开发

LeftHandCold avatar Jan 31 '24 10:01 LeftHandCold

gc修改中

LeftHandCold avatar Feb 29 '24 10:02 LeftHandCold

gc修改中

LeftHandCold avatar Mar 05 '24 11:03 LeftHandCold

gc修改中

LeftHandCold avatar Mar 13 '24 11:03 LeftHandCold

gc修改中

LeftHandCold avatar Mar 18 '24 10:03 LeftHandCold

gc修改中

LeftHandCold avatar Mar 21 '24 13:03 LeftHandCold