✨ Need Help Capturing Camera Output During WebRTC Call

[JahagirDS0]

What feature or enhancement are you suggesting?

Hi Team,

I'm using react-native-webRTC to build a video call app, and both front and back cameras are already in use during the call. I want to capture the current camera frame—whatever is being displayed—so I can analyze or process the image.

I tried using react-native-view-shot to capture the frame, but the result is an invalid image or just a black screen. For ios this is working fine.

Can this library be used for this purpose, or is there a better solution you recommend? I'd appreciate any suggested approaches or best practices for capturing the current camera frame in this context.

Thank you!

What Platforms whould this feature/enhancement affect?

Android

Alternatives/Workarounds

Get camera frame for the image

Additional information

• [x] I agree to follow this project's Code of Conduct
• [x] I searched for similar feature requests in this repository and found none.

[maintenance-hans[bot]]

Guten Tag, Hans here!

Thanks for your detailed request. Capturing camera frames during a WebRTC call can be a bit tricky, especially on Android. You mentioned using react-native-view-shot, but it sounds like you're encountering issues with getting a valid image.

Before we can assist further, could you please provide logs? For Android, you can gather logs with adb logcat while trying to capture the frame. That would help us diagnose what might be going wrong in your setup.

In the meantime, you might want to check if you are using any specific settings for react-native-webRTC that could affect the capture.

Also, if you'd like a more thorough response and quicker assistance, consider supporting the project by becoming a sponsor.

Looking forward to your logs! 🍻

Note: If you think I made a mistake, please ping @mrousavy to take a look.

[JahagirDS0]

hi @jkaufman @ChristophGr @manuelbieh @beebe4 Would anyone be able to help?

[no-1ne]

https://github.com/react-native-webrtc/react-native-webrtc/pull/1681