WLED-Native-iOS icon indicating copy to clipboard operation
WLED-Native-iOS copied to clipboard

AVFoundation Capture Screen Audio Control Lights

Open MicahKimel opened this issue 1 year ago • 1 comments

I'm interested in contributing an implementation of AVFoundation to enable audio capture and sound effect synchronization with lights. I'd like to inquire about your interest in this feature and any specific guidelines for contributing to the project.

Please let me know your thoughts on the best approach to integrate this functionality within the current app structure.

Thank you for your time and consideration!

MicahKimel avatar Dec 05 '24 18:12 MicahKimel

I started updating the leds from audio with the already implemented json interface. Currently I'm updating the effect speed and color by audio intensity. I Forgot ScreenCaptureKit is only available for macos, so went with AVFoundation instead to capture audio intensity. Results look decent with the chase effect, I'll continue to think about the effect integration because I would like it to still update quickly, but to appear a little smoother on the leds before making a pull request.

I like the idea of adding an effect to the WLED project to create a stack like chase effect where it does a chase like a linked list by continuing to append the current color until the color changes. This would mean there would be far less api calls, yet it would be more responsive and smoother at the same time.

My current implementation technically captures audio and works to adjust all the effects, it just doesn't look very good in my personal opinion.

MicahKimel avatar Dec 07 '24 16:12 MicahKimel