ImageBind icon indicating copy to clipboard operation
ImageBind copied to clipboard

IMU input and asset example

Open aelimame opened this issue 2 years ago • 1 comments

Really great work! I'm particularly interested by the IMU and audio modalities. Can you guys add some IMU data examples? I don't see any in the .assets folder. It would really be great to know more about the expected format so people can play around with this and explore new possibilities.

Thanks!

aelimame avatar May 13 '23 14:05 aelimame

They suggested in their paper you use a 6 x T dimension IMU data involving the X, Y, Z for both the accelerometer and gyroscope data values with T representing the time steps. You can calculate the time step by multiplying the sampling frequency with your preferred fixed running time. I will recommend you use a T of 2000 since that's what they used in the paper.

Blessing988 avatar Aug 12 '23 11:08 Blessing988