PersFormer_3DLane icon indicating copy to clipboard operation
PersFormer_3DLane copied to clipboard

Questions about TF

Open nickle-fang opened this issue 3 years ago • 1 comments

  1. There are three coordinate systems you mention: camera_coord, vehicle_coord and ground_coord. In JSON file the "xyz" are on vehicle_coord, and the output of the model is on ground_coord, so you need to transform using "R_vg" and "R_vc". Am I right? If I am right, how do you define the vehicle_coord?
  2. What is # transformation from apollo camera to openlane camera code used for?
  3. What is the code cam_extrinsics[0:2, 3] = 0.0 used for?
  4. Could you please draw a picture to explain all the coordinate you used in the code? Thanks very much!

nickle-fang avatar Jul 27 '22 10:07 nickle-fang

I visualize the data in JSON file and found it contradict to the explanation in issue #4. In the first picture below, the blue points are the raw points in JSON file, the red points are points transformed from the blue one with the extrinsics matrix in JSON file. So according to issue #4 the blue points are under the vehicle coordinate and the red points are under the camera coordinate. But that isn't a standard camera coordinate system, whose z-axis points up. The second picture below is the RGB image where the red points are drawed according to 'uv' information in JSON file. image image

nickle-fang avatar Jul 28 '22 08:07 nickle-fang

Please refer to https://github.com/OpenPerceptionX/OpenLane/issues/24. It should answer your question.

RicardLee avatar Aug 25 '22 13:08 RicardLee

We will close this issue, if you still have the same questions, please reopen this.

RicardLee avatar Sep 20 '22 06:09 RicardLee