TestEngineering/UI/AMO/Test Plan
From MozillaWiki
< TestEngineering | UI
AMO (addons.mozilla.org) Test Plan
Purpose: this document was written to engage community, better foster WebDev/WebQA communication, and (most importantly) to help ensure higher quality releases
Contents
- 1 List of releases
- 2 Project Page
- 3 Lead QA Engineer(s)
- 4 Release Management
- 5 How you can help with this release (More general Contribute Page)
- 6 IRC Channel (real-time chat)
- 7 Servers
- 8 Litmus (manual testcases)
- 9 Bugs to verify
- 10 Automation (Selenium Python)
- 11 Security
- 12 Accessibility
- 13 Localization
- 14 Feature Specific
- 15 Sanity check for Prod
- 16 Resources
- 17 Archives
List of releases
- AMO 6.0.12
- AMO 6.0.10
- AMO 6.0.9
- AMO 6.0.8
- AMO 6.0.7
- AMO 6.0.6
- AMO 6.0.5
- AMO 6.0.3
- AMO 6.0.2
- AMO 6.0.1
- AMO 6.0
Project Page
https://wiki.mozilla.org/AMO:Meeting_Notes
Lead QA Engineer(s)
- Krupa Raj, kraj@mozilla.com
- Nickname "krupa" on IRC (via Mibbit.com)
- Stephen Donner, stephend@mozilla.com
- Nickname "stephend" on IRC (via Mibbit.com) Mibbit]
Release Management
Information related to entry/exit criteria,criteria to block or revert a release is provided here
Information about how we use Bugzilla is available here
Sanity check
Please do these quick checks after every release
How you can help with this release (More general Contribute Page)
- Run listed testruns for AMO
- We need help with this from the QA start date until the day before the push (generally)
- Verify Resolved Fixed bugs
- This can (and in most cases should) begin as soon as development fixes bugs by marking them as Resolved FIXED, up until the push
- Ad-hoc test
- Write automated/manual tests
IRC Channel (real-time chat)
irc://irc.mozilla.org/#amo (New to IRC? Check out http://irc.mozilla.org/ to get started quickly!)
Servers
- Staging server: https://preview.addons.mozilla.org
- Production server: https://addons.mozilla.org
- RC server:https://next.addons.mozilla.org
Litmus (manual testcases)
Available testruns:
- Discovery Pane
- Developer Tools
- Tagging
- Collections
- Search
- Public Pages
- Add-on Collector
- Add-on Button states
- Sanity test-to be run after a push
- AMO Statistics Dashboard
- API on Windows
- API on MACOSX
- API on Linux
- AMO Personas
- AMO Sort
- AMO Themes
Bugs to verify
Automation (Selenium Python)
- A smokeTest suite which will run after every commit
- A BFT which will run on a schedule
- FFT which needs to run manually(click on RUN)at the end of every release
- Feature specific testsuites which can also be run to test specific features like Collections,Personas,Search etc
Security
- XSS testing on new inputs?
- SQL Injection testing ("SQL Injection" add-on, which can be used to test this)
- Also see https://wiki.mozilla.org/WebAppSec/Secure_Coding_QA_Checklist
Accessibility
Describe scope here
Localization
Describe scope here
Feature Specific
Sanity check for Prod
Resources
Archives
- AMO 5.12.12
- AMO 5.12.11
- AMO 5.12.10
- AMO 5.12.9
- AMO 5.12.9
- AMO 5.12.8
- AMO 5.12.7
- AMO 5.12.6
- AMO 5.12.4
- AMO 5.12.3
- AMO 5.12.2
- AMO 5.12.1
- AMO 5.12
- AMO 5.11.9
- AMO 5.11.8
- AMO 5.11.7
- AMO 5.11.6
- AMO 5.11.5
- AMO 5.11.4
- AMO 5.11.3
- AMO 5.11.2
- AMO 5.11.1
- AMO 5.11
- AMO 5.10
- AMO 5.9
- AMO 5.8
- AMO 5.7
- AMO 5.6
- AMO 5.5