I found a bug in code,and the "shuffle" should be set to "Fasle", it leads to the mismatch between image and the extrinsic parameter.