Run on Firebase test lab or Google Play publish

[mastef]

Recently when uploading APKs to Google Play we noticed that they're now automatically tested in the Firebase test lab on 10 devices with different app versions. That was very useful as we caught some java issues from lower versions.

Then we followed the path down the road and saw that in the Firebase test lab you can also just upload the APK and let it run on all these real & virtual devices :

The test lab then records a 2-5 minutes video per device + screenshots and adb logs - and notifies you if there were any crashes. Might be perfect for short cut badger in this case. There are some limitations for the amount of simultaneous devices on the free account, but this might be a nice start to test the library on the most common devices and/or to weed out the most troublesome ones.

Could either make one apk version that automatically clicks the buttons with timer delays, or simply add it to the current apk and detect if the apk is run in a testlab with :

String testLabSetting = Settings.System.getString(context.getContentResolver(), "firebase.test.lab");
if ("true".equals(testLabSetting)) {
  // Do something when running in Test Lab
}

( From https://firebase.google.com/docs/test-lab/android-studio )

Very useful

[mastef]

@leolin310148 what do you think?

[leolin310148]

@mastef this is an good idea, I will try it.