QA/Fennec/18/Release/18.0.2
«Fennec 18 RC 1 | Fennec 18.0.2 | Fennec 19 Beta 1 »
Fennec (Firefox for Android) 18.0.2 Crash-Fix Release Test Plan
- Release: February 7th, 2012
- QA Contact: Aaron Train; Kevin Brosnan
- IRC: irc://irc.mozilla.org#qa ping AaronMT; kbrosnan; ioanachiorean;
- Builds: Fennec (Firefox for Android) 18.0.2 | changeset | pushlog
Firefox for Android 18.0.2 Crash-Fix Testing & Verification
This test-plan is focused around the patch applied to mozilla-release (18), mozilla-beta (19), mozilla-aurora (20), mozilla-central (21) in bug 838603 that fixes a startup crash introduced by a an issue with the Android blocklist mechanism.
- HG change-sets:
- mozilla-inbound: https://hg.mozilla.org/integration/mozilla-inbound/rev/e65517972de2
- mozilla-central:
- mozilla-aurora: https://hg.mozilla.org/releases/mozilla-aurora/rev/a903b918e169
- mozilla-beta: https://hg.mozilla.org/releases/mozilla-beta/rev/0d42c11c4220
- mozilla-release: https://hg.mozilla.org/releases/mozilla-release/rev/912b9ffcbaad
- Steps to Reproduce the start-up crash
- bug 838603 [comment #28] (please replace with equivalent mozilla-release builds)
- Primarily going from Fennec 16 (Crash) →Fennec 17 (Crash) → Fennec 18 (Fixed)
- References for testing against blocklist staging
- Changing Block-listing Staging URL: https://wiki.mozilla.org/Blocklisting/Testing#Testing_Staged_Blocklist
- Changing Block-listing preferences on Android: https://wiki.mozilla.org/Blocklisting/Testing#Testing_on_Android
Results
Bug | Tester | Device | Build | Verification Test | Result |
bug 824118 | Aaron Train (:AaronMT) | Asus Nexus 7 (Android 4.2) | mozilla-beta (19) | No start-up crash; layers.acceleration.force-enabled, true | PASS |
bug 824118 | Aaron Train (:AaronMT) | Samsung Galaxy Note (Android 4.0) | mozilla-aurora (20) | No start-up crash; layers.acceleration.force-enabled, true | PASS |
bug 824118 | Aaron Train (:AaronMT) | LGE Nexus 4 (Android 4.2) | mozilla-central (21) | No start-up crash; layers.acceleration.force-enabled, true | PASS |
bug 824118 | Aaron Train (:AaronMT) | Samsung Galaxy Note II (Android 4.1) | mozilla-central (21) | No start-up crash; layers.acceleration.force-enabled, true | PASS |
bug 824118 | Aaron Train (:AaronMT) | Samsung Galaxy Nexus (Android 4.2) | mozilla-central (21) | No start-up crash; layers.acceleration.force-enabled, true | PASS |
bug 824118 | Aaron Train (:AaronMT) | Samsung Galaxy SII (Android 4.0.4) | mozilla-central (21) | No start-up crash; layers.acceleration.force-enabled, true | PASS |
bug 824118 | Aaron Train (:AaronMT) | Asus Transformer Prime TF201 (Android 4.0) | mozilla-central (21) | No start-up crash; layers.acceleration.force-enabled, true | PASS |
bug 824118 | Aaron Train (:AaronMT) | HTC Status (ARMv6) (Android 2.3) | mozilla-central (21) | No start-up crash; layers.acceleration.force-enabled, true | PASS |
bug 824118 | Kevin Brosnan (:kbrosnan) | Asus Transformer TF101 (Android 3.2) | mozilla-central (21) | No start-up crash; layers.acceleration.force-enabled, true | PASS |
bug 824118 | Ioana Chiorean (:ioanachiorean) | Samsung Galaxy Nexus (Android 4.1.1) | mozilla-release (21) | No start-up crash; layers.acceleration.force-enabled, true | PASS |
bug 824118 | Aaron Train (:AaronMT) | Asus Nexus 7 (Android 4.2) | mozilla-release (18) | No start-up crash; layers.acceleration.force-enabled, true | PASS |
bug 824118 | Aaron Train (:AaronMT) | Samsung Galaxy Tab 2 (Android 4.0) | mozilla-release (18) | No start-up crash; layers.acceleration.force-enabled, true | PASS |
bug 824118 | Aaron Train (:AaronMT) | HTC Nexus One (Android 2.3) | mozilla-release (18) | No start-up crash; layers.acceleration.force-enabled, true | PASS |
bug 824118 | Aaron Train (:AaronMT) | Samsung Nexus S (Android 4.1) | mozilla-release (18) | No start-up crash; layers.acceleration.force-enabled, true | PASS |
bug 824118 | Ioana Chiorean (:ioanachiorean) | Samsung Galaxy Nexus (Android 4.1.1) | mozilla-release (18) | No start-up crash; layers.acceleration.force-enabled, true | PASS |
bug 824118 | Adrian Tamas | Motorola Droid 3 (Android 2.3) | mozilla-release (18) | No start-up crash; layers.acceleration.force-enabled, true | PASS |
bug 824118 | Andreea Pod | Samsung Galaxy Tab 10.1 (Android 3.1) | mozilla-release (18) | No start-up crash; layers.acceleration.force-enabled, true | PASS |
bug 824118 | mozilla-release (18) |
A pass can be given when there is no start-up crash [1]; and tester has verified the about:config preference [2] value
- [1] ###!!! ABORT: OpenGL-accelerated layers are a hard requirement on this platform. Cannot continue without support for them.: file ../../../widget/xpwidgets/nsBaseWidget.cpp, line 829
- [2] layers.acceleration.force-enabled
Negative Testing
- On a working build; toggle layers.acceleration.force-enabled to false; what is the output?
- Reverting the force enable; re-triggers the crash (build pointing at bad blocklist)
- New profile (build pointing at fixed blocklist), builds work as expected
Smoketests
QA Task | Person/Group | How Often? |
Smoketests | Softvision | Every point release |
Light verification tests (or smoketests) will be first run when the builds are ready. Tests are available on Mozilla Moztrap under the 18.0 smoketest suite. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.
Assigned | Device | Completed | Results |
Adrian Tamas | Motorola Droid 3 (Android 2.3) | 2013-02-07 | PASS |
Paul Feher | Asus Transformer TF101 (Android 4.0.3) | 2013-02-07 | PASS |
Andreea Pod | Samsung Galaxy Tab 10.1 (Android 3.1) | 2013-02-07 | PASS |
Ioana Chiorean | Acer Iconia A500 (Android 3.1) | 2013-02-07 | PASS |
AppThwack Automation
QA Task | Person/Group | How often? |
Runs against ARMv6 and ARMv7 | Ioana | Alternating |
Automated installation, uninstallation, and Android Monkeyrunner tests against uploaded ARM6 and ARMv7 builds; primarily useful for detecting startup crashes, incompatibilities, install-times and UI oddities
Assigned | Build | Completed | Results |
Ioana Chiorean | fennec-18.0.2.multi.android-arm.apk | February 7th, 2012 | PASS - 1 crash/app died |