gtsfm
gtsfm copied to clipboard
Improving data association
Data association is the association of features into tracks before bundle adjustment. Currently this is done with Union-find.
We currently observe the following problems with data association:
- Too many small tracks
- Wrong correspondences may cause two different tracks to be merged into one track.
- Once a track is triangulated, if the mean reprojection error is high, all observations are discarded.
- The reprojection error threshold used to make this work is too high.
- We don't refine tracking with better poses after bundle adjustment.
Creating a high level issue to address these problems. Feel free to add to the list any discrepancies you observe and add yourself to assignees when contributing. :)
Initial directions to investigate:
- Force tracks to have minimum length 3
- Remove only outliers from the track after triangulation.
- Try creating more tracks from outliers and merging them after bundle adjustment.
#281 to address 3.
- [ ] Use RANSAC by default in triangulation
- [ ] Reduce reprojection error threshold <100 in triangulation