diff --git a/incidents/2020/2020-02-07_v1-app-prelaunch-release.md b/incidents/2020/2020-02-07_v1-app-prelaunch-release.md index b956ce0..99c8992 100644 --- a/incidents/2020/2020-02-07_v1-app-prelaunch-release.md +++ b/incidents/2020/2020-02-07_v1-app-prelaunch-release.md @@ -13,10 +13,10 @@ Corey Petty ## Summary -The Status app was published to v1.0.0 on the Android Play Store +The Status app was published to v1.0.0 on the Android Play Store before it was intended. ## The Impact -Descripiton of impact +At the point of writing this, there were This affects users in a multitude of ways, and violates the Status principles in the following ways: - **principle 1** - @@ -26,19 +26,27 @@ This affects users in a multitude of ways, and violates the Status principles in ## Trigger ## Resolution +- Removal of the application from production in both iOS and Android Play app stores. ## Action Items -| Action Item | Type | Owner | Reference | -| ----------- | ---- | ----- | --- | -| Item 1 | | | **TODO** | - +| Action Item | Type | Owner | Reference | Notes | +| ----------- | ---- | ----- | --------- | ----- | +| Development of Release Process | prevent | ??? | **TODO** | description here | +| Remove publication from app stores | mitigate | Andre | **DONE** | descripton here | +| Figure out auto-update process | prevent | jakubgs | **DONE** | see [Jakub's recovery process](#jakub-building-auto-update-recovery) | +| ... another item | mitigate/prevent | ?? | **TODO** | descripton here | +| explore future beta channel options | improve | andre | **TODO** | descripton here | ## Lessons Learned ### What went well +- ### What went wrong +- 500+ users were upgraded from beta to V1 potentially without knowledge of potential breakage and time to back up appropriate material +- There was a lack of coordination on the release process. ### Where we got lucky +- we have a relatively low userbase ## Timeline @@ -71,4 +79,21 @@ This affects users in a multitude of ways, and violates the Status principles in | 2020-02-06 11:03 | Android set to `Developer Removed From Sale` by `me@andremedeiros.info` | | 2020-02-06 11:05 | @fizzgig says `It's unfortunate, I'm sorry to point this out because everyone has been working so hard, the app looks fantastic and feels solid, but this should be a valuable lesson to those who argued against doing a migration strategy. I hope it's clear we can't have these things happen moving forward. Accidents happen, and thank you everyone for your response.` | -## Other Mitigation Actions \ No newline at end of file +## Other Mitigation Actions + +### Jakub building auto-update recovery +conversation taken from `core-infra` of discord: +``` +jakubgsToday at 8:57 AM +well, there's no PR +I just rebuilt and old APK +for 0.13.1 +with new build number +so someone can get that APK +and install it on top of 1.0.0 +and recover their old account +which used a different db schema/file +http://status-im.ams3.digitaloceanspaces.com/StatusIm-200211-140000-7f38c5-release.apk +this is the APK +because it's versionCode is higher than that of v1.0.0 we accidentally released a user that has lost access to their old account can recover it installing that APK over the v1.0.0 +``` \ No newline at end of file diff --git a/incidents/2020/Install_events_and_Device_updates_by_app_version_Tue_Feb_4_2020_Tue_Feb_11_2020.csv b/incidents/2020/Install_events_and_Device_updates_by_app_version_Tue_Feb_4_2020_Tue_Feb_11_2020.csv new file mode 100644 index 0000000..06e9592 --- /dev/null +++ b/incidents/2020/Install_events_and_Device_updates_by_app_version_Tue_Feb_4_2020_Tue_Feb_11_2020.csv @@ -0,0 +1,20 @@ +"im.status.ethereum - Install events (All events, Per interval, Daily) and Device updates (All events, Per interval, Daily), by app version for 2020-02-04 - 2020-02-11 and 2020-01-27 - 2020-02-03" +,,Metric,"Install events (All events, Per interval, Daily)","Install events (All events, Per interval, Daily)","Device updates (All events, Per interval, Daily)","Device updates (All events, Per interval, Daily)",Notes +,,Dimension,All app versions,1.0.0 (2020020414),All app versions,1.0.0 (2020020414) +Period,Date +2020-02-04 - 2020-02-11,2020-02-04,,41,4,19,12 +2020-02-04 - 2020-02-11,2020-02-05,,57,7,2,-,Rollout of release - Started rollout of 1.0.0 at 100% +2020-02-04 - 2020-02-11,2020-02-06,,153,64,"2,009","2,009" +2020-02-04 - 2020-02-11,2020-02-07,,51,29,"1,686","1,681" +2020-02-04 - 2020-02-11,2020-02-08,,16,7,592,591 +2020-02-04 - 2020-02-11,2020-02-09,,9,9,376,376 +2020-02-04 - 2020-02-11,2020-02-10,,19,13,216,212 +2020-02-04 - 2020-02-11,2020-02-11,,-,-,-,- +2020-01-27 - 2020-02-03,2020-01-27,,56,-,8,- +2020-01-27 - 2020-02-03,2020-01-28,,63,-,2,- +2020-01-27 - 2020-02-03,2020-01-29,,33,-,3,- +2020-01-27 - 2020-02-03,2020-01-30,,33,-,5,- +2020-01-27 - 2020-02-03,2020-01-31,,47,-,1,- +2020-01-27 - 2020-02-03,2020-02-01,,33,-,2,- +2020-01-27 - 2020-02-03,2020-02-02,,49,-,3,- +2020-01-27 - 2020-02-03,2020-02-03,,-,-,-,-