QA/Fennec/Presentation API
From MozillaWiki
Contents
Overview
Purpose
The purpose of this wiki is to serve as a general test plan for verifying that Presentation API is correctly implemented.
Ownership
Developer contact: Shih-Chiang Chien (:schien)
Overall Status
[AT RISK] Nightly 53: it's going to be prefed on, on 15-11-2016
- At risk due to bug 1313368 - [Presentation API] Fennec stalls when trying to load a page (This is reproducing only on particular devices and on Presentation API pages, so we don't know exactly how many users this issue is affecting)
Testing Summary
Scope of testing
The testing will be focusing on:
- Verify that the manual tests made by W3C for presentation API pass
- Monitor crash rate, stability, and power consumption
- Check that no important issues are regressing from the feature work
Environments
Testing will be performed on following devices:
- Nexus Player
- Chromecast
- Phones and Tablets
- Android 4.4+
Specifications
User stories
- Use cases and requirements for Presentation API
Acceptance Criteria
- The feature does not introduce new regressions that affect performance and stability
- All w3c tests pass
- No negative feedback from users
Testing details
- Environment:
- Receiver (Presentation Display): "Nexus Player + TV" or "Chromecast +TV" - Sender: Android device with Android 4.4 or higher - Fennec Build: https://people-mozilla.org/~schien/presentation-api/fennec-52.0a1.en-US.android-arm.apk
- Test cases(Latest test result: 14.11.2016):
- https://docs.google.com/spreadsheets/d/1uub8yabL0-_7TUaBPZ7sbhqYNcn936IYQSU6vNhMULY/edit#gid=1378915478 - All tests passed except a known w3c issue, and 2 tests are Not Applicable - https://docs.google.com/spreadsheets/d/1xfbFJw2nfSAL3Bd4LIXMkdUseI1Cq3aZW8ZrDmU5Hc4/edit#gid=284504573 - 11/12 tests PASSED
Bug Work
Tracking bugs
- Bugs to track the Presentation API feature
- Dependencies
- meta bug: bug 1184036 - (1-UA_Presentation_API) [meta] 1-UA support for Presentation API
ex:
84 Total; 1 Open (1.19%); 78 Resolved (92.86%); 5 Verified (5.95%);
Signoff
Criteria
- All test cases should be executed
- All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed
Results
Nightly testing
- Not landed yet
Aurora testing
- Not landed yet
Beta testing
- Not landed yet