At each commit to master, automatically build an APK and send it to Google Play alpha

[nicolas-raoul]

Since we are using branches, the master branch should always work. In other words, if a bug appears in the master branch then we want to know it immediately.

We have a good number of beta testers (Commons users with no development skills), but betas are rather rare because building and uploading them wastes a lot of the maintainer's time.

Solution:
Whenever something is committed to master:

• Increase the beta minor version number
• Build the APK
• Sign it with the real keys
• Upload it to Google Play's beta

It might sound a bit challenging, but I believe all of the pieces to set this up exist:

• Use Travis to build and save an APK: https://gist.github.com/domenic/ec8b0fc8ab45f39403dd
• Use Google's API to upload the APK: https://developers.google.com/android-publisher/#publishing

[misaochan]

Wow, interesting. I had no idea we could automate that! If we could get it to work, indeed it would benefit us tremendously - less work for me uploading betas and easier testing of the master branch.

The only issue I'm seeing with this is that there will be a LOT of versions being uploaded without changelogs so it may be difficult to keep track of all of them?

[misaochan]

Edit: Also, if we decide to do this we will probably need to ask WMF if they will be okay with the very frequent releases. I know it notifies me in the dev console every time the Wikipedia app is updated, so they might find themselves getting spammed by our updates if they don't adjust their notifications (and I'm not sure if it's possible to turn off notifications for one particular app).

[nicolas-raoul]

With a beta for each commit, the changelog is available without any effort: It is just the list of Git commits.
It makes it very easy to spot what commit introduced a bug. Testers can proceed by dichotomy and tell us exactly what commit triggers the problem, that too saves a lot of developer time.

I don't see any problem with "too many" releases. https://en.wikipedia.org/wiki/Release_early,_release_often

[maskaravivek]

We don't use Crashlytics for beta releases but otherwise Crashlytics is a very good option for such frequent beta releases. I guess using Crashlytics would have privacy concerns, right?

[psh]

Using Fabric Beta to distribute the app is different than using the Crashlytics crash reporting tool. The privacy concerns are different in this case and offer people a clear opt-in / opt-out - users can still use the real app, but if they have concerns about getting test builds then they have a clear path for avoiding them.

There would be no runtime component baked into the Commons app if we used Beta for distribution. That said, there's a minimal build.gradle change to give you the crashlyticsUploadDistributionDebug build task that does the work and some keys to manage.

My current project team uses Fabric Beta to distribute QA builds of the app as it's a one-stop-shop for comparing different built versions and simple for the QA team to receive builds. Plus it plays nice with CI servers for automated builds (we use Bitrise). Prior to production releases we push to the Google Play "alpha channel" to smoke test the app before it rolls out to anyone external. Finally, the Google Play "beta channel" is used for friends & family beta testing before a wide release goes out containing newsworthy new features.

[maskaravivek]

Yes, I was also suggesting usage of Fabric Beta for distribution of test builds. If we get a go ahead that it wont violate any of our privacy policies for users then the integration would be quite simple and can be automated.

[tshradheya]

Can I take this up?

[misaochan]

@psh Interesting! Fabric Beta doesn't actually use the Google Play channels, right? The entire system appears to be self-contained. I would personally be OK with this, but would probably need to check with WMF.

If we don't use Fabric Beta, and elect to use a script to upload to Google Play Store instead... I wonder if we should create an alpha testing group for this purpose? There are a few reasons why I think this might be preferable to uploading to the Play Store's beta:

• We have 300+ beta testers, and master is not always stable. Theoretically it SHOULD be, but realistically not always. :) I always try to thoroughly test manually-released versions, so there is an extra check between master and the users in manually-released versions. I'm not sure if we really want to release code that hasn't been double-checked to 300 users (10% of our userbase)?

• Such frequently-released betas will result in no single version getting more than a day or two of testing time. I think ideally we would like to have the 300 beta testers as a buffer between the alpha users (who will get almost-daily builds) and production users.

So if we go with alpha testing, I figured we can invite people within our close group to join that, and do the automatic build/upload with that. That will still help us hugely with testing, as it will allow the non-devs to help us test the current master, and is also easier than building from master all the time. Then I will do the beta and production releases as per normal. @nicolas-raoul what do you think?

[nicolas-raoul]

Yes, Google Play's alpha is perfect for this use :-)
Personally I would choose the alpha even if it means constants updates, but most testers would probably choose beta.

[misaochan]

Reposting from @ujjwalagrawal17 at #1482

We can also add Fastlane for automatic deployment of the beta App. (Maybe on successful merge to release branch or master branch)
Link: https://docs.fastlane.tools/getting-started/android/beta-deployment/

[maskaravivek]

Google Play provides API access to automate the release process. Here's the documentation for the same: https://developers.google.com/android-publisher/

To work on this task I would require Release Manager access to the Google Play developer console. Would it be possible to grant me the access?

[misaochan]

As mentioned in our conversation earlier, I doubt WMF will grant it. The last time I asked for access for Neslihan, not only did we not get access, but also we ended up all needing to sign NDAs, attempt OAuth for the app, etc. ;)

Please feel free to test the API on a dummy app as you suggested, and I will handle the integration with the dev console.

[maskaravivek]

I was trying to make required changes for this task but we just ran into a blocker. @misaochan Doesn't have access to enable Google Play console API access that is required for automatic publishing setup. This was the error message:

Only the account owner can configure API access. Please contact them to update API settings

In @misaochan's words, this leaves us with 2 options:

1. ask for permission and we pray real hard
2. We use an external service for the alpha distributions

(1) I really doubt that WMF will grant us API access for the Play account. The keys are sensitive and someone else having access to those keys won't make them feel comfortable. With those keys, potentially anyone can upload a newer version of the Commons app. Even if they give us access, I guess the turnaround time would be too high.

Considering the above, I feel it would be appropriate to go with (2) given the time constraints that we have. With alpha track, we are anyways targeting very few users(mostly contributors and testers), and they should be okay using an external service for alpha builds.

As suggested above, Fabric looks to be a decent option that we can use for alpha releases. Just to add, Fastlane is a CI just like Travis and Jenkins that would enable us to automate the process. We don't need to use Fastlane in particular as Travis or any other CI would serve the purpose.

@misaochan @nicolas-raoul @VojtechDostal Would it be okay if we use Fabric for automatic publishing? It would be great if we could take an early call on this as it would give us more time to actually implement the integration.

As of now, one unresolved issue with this task is:

• managing the signing keys for the project. We can't put the keys in the repo as its public and the CI would need these keys for making a release(even Fabric releases are signed APKs). I still need to figure out how to manage these keys.

[misaochan]

Yeah, sorry guys, I was unaware that this required additional permissions that I do not have. :/

I vote for using an external service like Fabric for automated builds. If we go with (1), we would likely require permission from Legal before the account owner can allow us access. The last time I tried to get Neslihan read-only access just for her to read the crash logs, it was denied, so with something this sensitive I am not optimistic about our chances.

An additional benefit of an external service is that testers can uninstall the test build and use the official build whenever they desire without needing to have their account removed or added to the list of alpha testers, which would be more convenient for them. If it doesn't break policy, this would be ideal IMO.

managing the signing keys for the project. We can't put the keys in the repo as its public and the CI would need these keys for making a release(even Fabric releases are signed APKs). I still need to figure out how to manage these keys.

If we go with Fabric, can't we just use different keys? For instance our distribution on F-Droid does not use my key.

@nicolas-raoul What do you think?

[nicolas-raoul]

Can we set up auto-update with an external service, though?

…

On Sat, Dec 8, 2018, 02:30 Josephine Lim ***@***.*** wrote: Yeah, sorry guys, I was unaware that this required additional permissions that I do not have. :/ I vote for using an external service like Fabric for automated builds. If we go with (1), we would likely require permission from Legal before the account owner can allow us access. The last time I tried to get Neslihan read-only access just for her to read the crash logs, it was denied, so with something this sensitive I am not optimistic about our chances. An additional benefit of an external service is that testers can have both the alpha build AND the beta/prod build on the same device, which would be more convenient for them. If it doesn't break policy, this would be ideal IMO. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#1056 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AAGFBik7z6GI9z4yvKOm5eC6A47TiLrDks5u2qWlgaJpZM4RajZ5> .

[maskaravivek]

Yes. If from auto update you mean build triggers whenever a commit is made to master, then yes it can be done. The gradle task can be triggered on a variety of actions.

Also, if from auto update you mean, can the user have the app automatically updated whenever a new build is available, then too the answer is yes. The Beta Crashlytics can be configured to have the latest build installed over your existing app.

[nicolas-raoul]

I meant the second. Play Store updates apps in the background, and all I see is a notification such as "2 applications updated":

I don't know any other app store that can do this (update apps in the background whenever a new APK is available on the server). The F-Droid client app has started implementing this, but as far as I know it is quite complex to set up and requires having root on your phone.

[ashishkumar468]

@nicolas-raoul Any other app would not be able to do that, play store would ban any such app which tries to download apk. The user has to manually do it

[nicolas-raoul]

Then it is a very severe drawback of not hosting alphas on Play Store.
Telling alpha testers to install an APK from an external website would probably be counter-productive, as they will forget about it after a few weeks, and maybe most of the alpha users will keep using old versions even after a beta or stable version is released.

Or we could implement (in externally-hosted alpha APKs only) a version check inside the app, that checks the newest version on the external server and notifies the user that they should either update or uninstall and then install from Play Store.

[maskaravivek]

Then it is a very severe drawback of not hosting betas on Play Store.
Telling beta testers to install an APK from an external website would probably be counter-productive, as they will forget about it after a few weeks, and maybe most of the beta users will keep using old versions even after a stable version is released.

Or we could implement (in externally-hosted beta APKs only) a version check inside the app, that checks the newest version on the external server and notifies the user that they should either update or uninstall and then install from Play Store.

Am I missing something here? Won't we continue hosting beta versions on the play store? I suppose beta versions would be uploaded manually and would be relatively stabler and are tested end to end before pushing to play store.

The automatic releases were supposed to be alpha releases and would happen at each commit on master. This would not be as stable as beta releases.

Fabric notifies the user automatically whenever a new build is available. Also, a user can see all the new builds available with its changelog and choose to install any of those. It won't automatically update. :(

So basically we will have 3 tracks:

• Production via play store
• Beta via play store [many people have already signed up for this]
• Alpha via fabric [people will have to follow a link to opt in][IMO only contributors and testers might want to opt in for a potentially unstable version]

If we finalize Fabric, I can start working on it(there are a couple of challenges that needs to be worked upon). If we really need Play Store for the alpha track, we will have to initiate a conversation with WMF. Please advice on next steps. @misaochan @nicolas-raoul @VojtechDostal

[nicolas-raoul]

@maskaravivek Sorry I meant alphas, I edited my comment.

[maskaravivek]

Telling alpha testers to install an APK from an external website would probably be counter-productive, as they will forget about it after a few weeks, and maybe most of the alpha users will keep using old versions even after a beta or stable version is released.

If the production, beta, alpha track all use the same package name and signature, the user will automatically get updated to the latest beta/prod app even if he didn't update using the alpha track.

Our plan is to use the same signature.

[nicolas-raoul]

Clicking on "Alpha":

[maskaravivek]

Awesome! So automatic releases work perfectly. Every time a commit is pushed to master, a new alpha release would be made automatically. :)

[maskaravivek]

@nicolas-raoul Can you also verify if multiple alpha releases were made. After I integrated the Gradle play publisher yesterday, one more commit was made to master today. So ideally there should be 2 alpha releases.

@misaochan I suppose we will have to manually append the versionCode when we are making beta releases. After an automatic release, our gradle file is not updated automatically to reflect the latest version code. (For eg. our gradle file still has 94 but the latest released version code is already 96.)

[nicolas-raoul]

I see only what the screenshots show. 😓

…

On Sun, Dec 16, 2018, 00:54 Vivek Maskara ***@***.*** wrote: @nicolas-raoul <https://github.com/nicolas-raoul> Can you also verify if multiple alpha releases were made. After I integrated the Gradle play publisher yesterday, one more commit was made to master today. So ideally there should be 2 alpha releases. @misaochan <https://github.com/misaochan> I suppose we will have to manually append the versionCode when we are making beta releases. After an automatic release, our gradle file is not updated automatically to reflect the latest version code. (For eg. our gradle file still has 94 but the latest released version code is already 96.) — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#1056 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AAGFBukKXNh0eI40h8HAfllu3-0Bg0NUks5u5RtHgaJpZM4RajZ5> .

[maskaravivek]

You can check the Archived artifacts in the Artifact library section. It would have an APK with version code 95 as well 96.

[nicolas-raoul]

Ah sorry:

[maskaravivek]

@nicolas-raoul Thanks for checking. :)

IMO, as an enhancement, we should also add release notes. Will create a new issue for it.

[nicolas-raoul]

Strangely About still shows 2.9.0 I think I am not using the alpha despite belonging to the mailing list https://groups.google.com/d/forum/commons-alpha
Play Store notified me about an update this morning but tapping the update button did nothing special it seems.
Maybe I have to leave the beta so that alphas start coming?

[maskaravivek]

@nicolas-raoul It seems that after joining the Google Group, users need to manually opt in for Alpha. Similar to beta, the play console would have a link that the users can use to opt it.

[nicolas-raoul]

Oh you are right the URL is https://play.google.com/apps/testing/fr.free.nrw.commons

[nicolas-raoul]

I am a member of https://groups.google.com/d/forum/commons-alpha and at https://play.google.com/apps/testing/fr.free.nrw.commons I see "You are a tester". I uninstalled then reinstalled, and it still got me 2.9.0.
Strangely the Google Play app tells me "You're a beta tester for this app. Awesome!" so something is definitely wrong.

[misaochan]

I switched the alpha testers method to using email lists instead, just to see if that's the problem. I also deactivated the old (unused) alpha thread.

For the long term Google Groups would be ideal (because AFAIK people can join that without me manually adding them), but for now this will help us figure out what the problem is. If anyone wants to help solve this, feel free to post your email and I'll add you.

[nicolas-raoul]

Thanks for adding me to the list, still 2.9.0 here, I will check again tomorrow.
If it still does not work it might be worth posting a question on StackOverflow explaining the whole thing.

[misaochan]

I signed myself up for alpha testing and downloaded the app from Play Store. Testing Nearby shows "search this area" when I move the map. This means that I am actually using an automated release from master branch, because that feature #2051 does not exist in the real 2.9.0. :)

So what this means is that:

• It works!!! Yay!!!!
• About shows the wrong version name. Should we fix that?
• Users need to be reminded that it's normal for them to see "You're a beta tester for this app. Awesome!" in the app listing even if they are an alpha tester. I think it's a Play Store bug. We can ask around but I doubt it will ever say "alpha tester".
• Once others (@maskaravivek and @nicolas-raoul ) can confirm that this works for them, we should try switching back to using a google group so people can join by themselves.

[nicolas-raoul]

I also have that "search this area" :-)

[nicolas-raoul]

Going smoothly now :-) (the bottleneck just being Google Play which takes time to roll out releases)

[misaochan]

I made the switch to Google Groups using the address commons-alpha@googlegroups.com . I am a bit worried though, because I was not able to search for that address in the dev console (whereas our other google group addresses were searchable). If someone who wasn't in the list (maybe @ashishkumar468 or @neslihanturan ) could join the group and see if the alpha works for them, that would be great.

[domdomegg]

I've tried joining the alpha group - was in the beta previously, which I've now left. While Google Play says I'm a tester I think I've still got the beta as none of the recent changes seem to present in the app.

EDIT - Just tried waiting a bit longer and reinstalling. On alpha now

Just to confirm, is the process?

1. Join the Google group at https://groups.google.com/forum/#!forum/commons-alpha
2. Sign up to be a tester at https://play.google.com/apps/testing/fr.free.nrw.commons/join

[misaochan]

Yes, that is the process. :) Does it work for you? You would likely not have the LATEST change (releases take a few hours to propagate) but you should have "Search this area" when you go to a new place on the Nearby map.

[domdomegg]

Yep, all working here.

Interestingly, ARCA does know what build I'm using (2.9.0.113) so it must be possible to get it on the about page.

[misaochan]

Fantastic! Thanks @domdomegg . :)

[jidanni]

Hmm, #3976, as beta is same as main (Play Store version), might as well make alpha beta. I.e., instead of three things, two of which are the same... Just offer two things, on Play store.

[misaochan]

Beta is not always the same as production, as I mentioned. Alpha and beta serve 2 different purposes, beta is tested by thousands of users and is already mostly stable (we are just ferreting out the final few bugs), alpha is tested by very few users who have been warned that it may be unstable.