ImageBind
ImageBind copied to clipboard
IMU input and asset example
Really great work! I'm particularly interested by the IMU and audio modalities. Can you guys add some IMU data examples? I don't see any in the .assets folder. It would really be great to know more about the expected format so people can play around with this and explore new possibilities.
Thanks!
They suggested in their paper you use a 6 x T dimension IMU data involving the X, Y, Z for both the accelerometer and gyroscope data values with T representing the time steps. You can calculate the time step by multiplying the sampling frequency with your preferred fixed running time. I will recommend you use a T of 2000 since that's what they used in the paper.