flowty icon indicating copy to clipboard operation
flowty copied to clipboard

Support video resizing before computing flow

Open willprice opened this issue 6 years ago • 8 comments

When computing flow it is useful to be able to resize the video frame before input into the algorithm

willprice avatar May 24 '19 10:05 willprice

This would be super helpful to have, thanks in advance

ir0nt0ad avatar May 12 '20 02:05 ir0nt0ad

Hi @sh0gg0th , Just a heads up I probably won't work on this for quite a while. Also, it's worth noting that if you want to use flowty for TVL1 it's very slow. OpenCV has a serious performance regression in v4 (bug logged here). I have an alternate optical flow tool (with a not so nice UX) here that uses OpenCV 2 which is substantially faster for TVL1.

willprice avatar May 12 '20 08:05 willprice

Hi @willprice - thanks a lot! Yeah I noticed the same problem with speed and was wondering if it had something to do with my CUDA/Docker/drivers setup. Does your furnari-flow build support the latest architectures such as Turing (7.5)?

ir0nt0ad avatar May 12 '20 17:05 ir0nt0ad

I don't believe it's an issue with yours (or my) setup, but a performance regression with OpenCV itself sadly :( My CUDA chops aren't good enough to debug it sadly. The docker images for furnari-flow have binaries up to compute 6.1 or so, so not the newest, however there are PTXs inside too so it'll JIT compile for your architecture on the first run (which will take an age) but then these are cached in further invocations (I've got the nvidia PTX cache set up as a docker volume for this purpose--check the dockerfile for details).

willprice avatar May 12 '20 18:05 willprice

Understood, thank you. Could you please point me to your dockerfile for willprice/opencv2-cuda8 ?

ir0nt0ad avatar May 12 '20 18:05 ir0nt0ad

Sure, here it is: https://github.com/dl-container-registry/opencv2

willprice avatar May 12 '20 18:05 willprice

Excellent, and thanks for all your work!

ir0nt0ad avatar May 12 '20 18:05 ir0nt0ad

No problem :) let me know if you have any problems

willprice avatar May 12 '20 18:05 willprice