RetinaNet_Tensorflow_Rotation icon indicating copy to clipboard operation
RetinaNet_Tensorflow_Rotation copied to clipboard

Fix rbbox_overlaps kernel

Open fellhorn opened this issue 5 years ago • 0 comments

Hi,

I am working on a custom skew IOU kernel for tensorflow (https://github.com/fellhorn/tensorflow_rotated_iou_op) to be used in my master thesis.

And I think I found an error how you calculate the point in rectangle check. You actually have the correct code in libs/box_utils/rotate_polygon_nms_kernel.cu, so I think it should look the same in the rbbox_overlaps kernel.

Thanks a lot for your repo and keep up the great work :)

fellhorn avatar Apr 15 '20 12:04 fellhorn