Auto Cropping using TalkNet (like Opus.pro)

[mvoodarla]

Hey folks! I posted here a while back about a demo of TalkNet which is now linked in the repository README. We took that demo and turned it into a full-fledged functionality that's been hot lately with products like Opus.

Basically, we take in any content and can reformat it to a given aspect ratio based on who's actively speaking, how many people are in the scene, etc. This automates a lot of video creation processes that people take for granted when it comes to publishing social content.

Check it out here: https://www.sievedata.com/functions/sieve/autocrop

Here's an example video which we "reformated": https://www.youtube.com/watch?v=4xACV5qm0Io

https://github.com/TaoRuijie/TalkNet-ASD/assets/11367688/2bd79938-8ed2-4f15-9e94-82de3e81d655

Thanks again Tao for your great contributions! We're really happy to be building on top of it :)

[lyra-white]

@mvoodarla Is source code available for this? It'd be sick to experiment with this.