How to calc (vx, vy) given extrinsics?

[Ranqing]

I adjust manually (vx, vy) when stitching undistorted depths/images in matterport3d dataset. After several times, it doesn't work well. Can anyone explain that how to calculate (vx,vy) for each view precisely.