LiuNeng

Results 28 comments of LiuNeng

Nearly 20% decompression performance degradation

@alexey-milovidov @nikitamikhaylov @kssenii

Nearly 20% decompression performance degradation

code ```c++ #include #include #include #include #include #include #include #include #include #include #include #include #include #include #include #include #include #include namespace DB { class FasterCompressedReadBufferBase { protected: ReadBuffer * compressed_in;...

Nearly 20% decompression performance degradation

data: https://1drv.ms/u/s!AjK3WtSMQ0kokhDc_1ThSIoUa_3H?e=l57NM6

Nearly 20% decompression performance degradation

@kitaisreal You can use the code above to reproduce, by modifying the code of the decompression algorithm for comparison.

Nearly 20% decompression performance degradation

The above statement does not explain my variable control over the decompression algorithm code, I made sure that only the decompression code was different between the control groups, and the...

Nearly 20% decompression performance degradation

> (in order of 1..5%; higher percentiles should be ignored because it was tested on laptop with running Slack and YouTube) The SQL I tested only had simple aggregations, and...

Nearly 20% decompression performance degradation

I don't have a solution to this problem, and I don't have any other ideas, the problem doesn't seem to have much impact in other types of queries

Nearly 20% decompression performance degradation

My test is corrected 😹😂

Why there have a coefficient "2" in the loss self.TVLoss_weight*2*(h_tv/count_h+w_tv/count_w)/batch_size?

h_tv and w_tv are quadratic sum, their derivative is 1/2, in the backward, 2 * 1/2 =1 , many loss function use this tip.

Why there have a coefficient "2" in the loss self.TVLoss_weight*2*(h_tv/count_h+w_tv/count_w)/batch_size?

应该是个中国人,导数1/2乘以2能抵消掉这样能减少小数计算.