Make a smaller ModifiedResnet model

[justlike-prog]

Hi,

The R50 image encoder is around 250MB in size. Was anyone here able to reduce the size drastically (to around 20MB)? I was thinking about doing knowledge distillation with a student model that has also ModifiedResnet architecture, but with fewer layers, filters and so on.

Any ideas and experiences are welcome :)