Pbatch
Performance optimization
On my Pixel 7 pro I get roughly 4 FPS, which sometimes feel not stable enough compared to the 40+ FPS on a desktop. Certainly not if I try to use X2 or X4 mode.
I'm considering trying to take a shot and see if there is an opportunity for CPU performance optimization. Was that done? Will such contribution will be accepted?
Not a typescript/client side person, but willing to take an attempt.
That matches what I get on my Pixel, it is indeed annoyingly slow compared to the desktop speed.
I tried TFLite before (with int8 quant) but couldn't make any speed improvements on mobile.
Help in this area would be incredibly useful. I can make a fork which strips out all the code except model benchmarking if that interests you?
I've pruned the model so you should get around 1.5x the FPS you were getting before :)