RetinaNet_Tensorflow_Rotation
RetinaNet_Tensorflow_Rotation copied to clipboard
Fix rbbox_overlaps kernel
Hi,
I am working on a custom skew IOU kernel for tensorflow (https://github.com/fellhorn/tensorflow_rotated_iou_op) to be used in my master thesis.
And I think I found an error how you calculate the point in rectangle check. You actually have the correct code in libs/box_utils/rotate_polygon_nms_kernel.cu, so I think it should look the same in the rbbox_overlaps kernel.
Thanks a lot for your repo and keep up the great work :)