StereoPi-ROS-depth-map-test icon indicating copy to clipboard operation
StereoPi-ROS-depth-map-test copied to clipboard

Usage on CM4 and RPI camera 3 wide noir

Open roy-Rik99 opened this issue 1 year ago • 3 comments

Can I use this on a RPI CM4 with two RPI Camera 3 wide noir with 1280x720, fps=60-90?

I am building an uav with this setup to do simple object tracking. I am also thinking of using vl53l0x sensor for 3D mapping.

roy-Rik99 avatar Nov 18 '24 09:11 roy-Rik99

The hardware part is a bottleneck: 1280x720 at 60 FPS is hard to achieve. Even if you tune it, the CPU won't be able to process this amount of data. The only way is to stream the video to a powerful PC for post-processing.

realizator avatar Nov 18 '24 14:11 realizator

What if I used the latest AI camera and the upcoming CM5? Would it be possible?

roy-Rik99 avatar Nov 19 '24 08:11 roy-Rik99

I believe CM5 will let you capture HD@60, but I'm not sure about processing power. AI camera is a very specific thing; it won't help in this case. You can "emulate" this test using RPi5. Main point: CM5 and RPi5 do not support old video subsystem MMAL/raspivid/raspistill. This means you need to use two libcamera instances, which are hard to synchronize (until you go with the hardware cameras to sync).

realizator avatar Nov 20 '24 14:11 realizator