AutoSTR
AutoSTR copied to clipboard
Network always choise big kernel size and expansion factor t always is 6
The arch I search is as following:
=> saving checkpoint ./logs/proxyless/IIIT5K/seed_1996_3/checkpoint.pth.tar
0. (Mix(5x5_MBConv6, 0.770), None) # ['0.000', '0.230', '0.770', '0.000', '0.000', '0.000']
1. (Mix(5x5_MBConv6, 0.998), Identity) # ['0.000', '0.000', '0.998', '0.000', '0.000', '0.001', '0.000']
2. (Mix(5x5_MBConv6, 0.942), Identity) # ['0.000', '0.038', '0.942', '0.001', '0.000', '0.015', '0.003']
3. (Mix(5x5_MBConv6, 0.768), None) # ['0.042', '0.100', '0.768', '0.040', '0.007', '0.043']
4. (Mix(5x5_MBConv6, 0.831), Identity) # ['0.009', '0.019', '0.831', '0.005', '0.001', '0.066', '0.069']
5. (Mix(5x5_MBConv6, 0.456), Identity) # ['0.017', '0.020', '0.456', '0.016', '0.110', '0.015', '0.366']
6. (Mix(5x5_MBConv6, 0.583), None) # ['0.074', '0.261', '0.583', '0.018', '0.008', '0.056']
7. (Mix(5x5_MBConv6, 0.801), Identity) # ['0.006', '0.151', '0.801', '0.000', '0.006', '0.036', '0.000']
8. (Mix(5x5_MBConv6, 0.384), Identity) # ['0.000', '0.354', '0.384', '0.000', '0.258', '0.004', '0.000']
9. (Mix(5x5_MBConv6, 0.483), None) # ['0.025', '0.366', '0.483', '0.009', '0.010', '0.106']
10. (Mix(5x5_MBConv6, 0.500), Identity) # ['0.000', '0.419', '0.500', '0.000', '0.044', '0.037', '0.000']
11. (Mix(5x5_MBConv6, 0.418), Identity) # ['0.000', '0.332', '0.418', '0.000', '0.003', '0.248', '0.000']
12. (Mix(5x5_MBConv6, 0.469), None) # ['0.002', '0.337', '0.469', '0.004', '0.018', '0.169']
13. (Mix(5x5_MBConv3, 0.421), Identity) # ['0.000', '0.421', '0.412', '0.000', '0.003', '0.163', '0.000']
14. (Mix(5x5_MBConv3, 0.468), Identity) # ['0.000', '0.468', '0.428', '0.000', '0.001', '0.103', '0.000']
We can see that network always choise big kernel size and most expansion factor t is 6. Is it normal ?
Any suggestions ?