JunHeum
Question about the SBMNet.
Hi,
As what mentioned in the paper, the reliability map Z is computed by
where I think, Z is related to the difference about the interped frame in time t by V_(t->0) and V_(t->1).
However, in the code,
where frame2_1 is compute by the flow SBM_ * (-1)， which I think is flow from 0 to 1, not time t to 1.
In
'''frame2_1, Mask2_1 = warp(frame1_, SBM_ * (-1), return_mask=True)''', frame2_1 will be a warpped frame from frame1 to frame3, not frame2.
Hope I have maken a clear statement of my question.
Hi, @JerryLeolfl.
SBM_ is the symmetric bilateral motion vector field from t to 1.
Under the linear motion assumption, we developed the bilateral cost volume layer, which computes matching costs between two feature maps F_0 and F_1, yielding the bilateral cost volume in time t. Consequently, it makes the SBMNet estimate V_t_1.
If you want to know in detail how to estimate V_t_1 as the SBM, BMBC which is our previous method would be helpful to understand it.
