Jie Yao

Results 37 comments of Jie Yao

thanks @symious for the work! i have a patch for this issue earlier #2765 @hanishakoneru left a comment to explain why this should not be done. https://github.com/apache/ozone/pull/2765#issuecomment-952091699 i suggest we...

see @siddhantsangwan has already completed this work, so this patch just add the handler to RM. @adoroszlai @sodonnel @umamaheswararao please take a look! i will create another jira to implement...

> We have left this new handler out of the RM chain deliberately for now, as its not really complete without the deleting handler. The plan is to implement the...

thanks @errose28 for the review! the main motivation behind this change is the SCM memory usage. i originally thought it will take too much RAM if there are two many...

thanks @sodonnel for the comments, i agree with your opinion. >Then the SCM memory will get used with not just empty container references, but far more containers than we expected...

Another question comes to my mind. suppose we have contianer c1 and three replicas r1, r2,r3 on datanode d1, d2,d3 ,respectively. if d3 is dead, r3 will lost, so RM...

@sodonnel i have updated this patch, please take a look!

@sodonnel @errose28 do you have any other comments ?

**1 No clear problem statement** the main purpose of this patch is to reduce memory usage. in some scenario, like spark , hive and mapreduce, a large number of temporary...