QA/Automation/Projects/Test Creation
From MozillaWiki
< QA | Automation | Projects
Contents
Overview
Given the continuous increasing number of features and changes made from a version to another in firefox, manual testing over and over again off all this could be difficult and time consuming. Test automation can automate some repetitive but necessary tasks in a formalized testing process already in place, or add additional testing that would be difficult to perform manually.
Our goal is to increase the number of automated tests and low down the human work done when testing.
| Name: | Test Creation |
| Leads: | Andreea Matei, Mihaela Velimiroviciu |
| Contributors: | n/a |
| Tracking Bug: | bug 1035848 |
| Repository: | mozilla-central, mozmill tests |
| Etherpad: | https://etherpad.mozilla.org/tests-to-automate |
Roadmap
| Date | Version | Details |
| June 30th, 2014 | - | 10 new automated tests |
| September 30th, 2014 | - | 5 new automated tests |
| Q4 | Using Sprints | 4 new automated tests so far |
How To Contribute
If you are interested in helping us on creating new tests, please follow this tutorials and get in contact with the project leads (you can most likely find us on the #automation channel on irc).
- mozmill tests: https://developer.mozilla.org/en-US/docs/Mozilla/QA/Mozmill_tests
- browser chrome tests: https://developer.mozilla.org/en-US/docs/Browser_chrome_tests
- mochitests: https://developer.mozilla.org/en-US/docs/Mochitest
- If it's something you don't understand from this tutorials please contact us.
List of Tasks
List of tasks to be done for this goal. Will be updated every week.
| Test | Assigner | Status |
| Send email to ask for information about geolocation & tps automated tests | Daniel Gherasim | Done |
| Log bugs for corresponding tests (by importance: geolocation, tps, new features, other) | Mihaela Velimiroviciu | Done |
| Q4 - Map moztrap testcases against automated tests, sorted by type or features | Mihaela Velimiroviciu, Andreea Matei,Cosmin Malutan | Done - https://docs.google.com/spreadsheets/d/1qEaldgqa0MbFOjI4MITkvJ0yZvt7HdIe7pb9ICqBwbc/edit#gid=324233979 |
| Q4 - Start with regression testcases, log bugs and create new tests | Mihaela Velimiroviciu, Cosmin Malutan | In progress |
List of Tests
In the following table you can find all the tests we decide that have to be done for this goal.
- Q2 tests - tracking bug 1007559
| Test | Assigner | Status |
| bug 967568 Create Mozmill test for Firefox's safebrowsing feature | Mihaela Velimiroviciu | Landed |
| bug 1008913 Add test to verify geolocation sharing option "Always Share Location" | Daniel Gherasim | Landed |
| bug 1008914 Add test to verify geolocation sharing option "Never Share Location" | Daniel Gherasim | Landed |
| bug 1008919 Add test to verify geolocation sharing option "Not Now" | Daniel Gherasim | Landed |
| bug 1008941 Add test to verify dismissing the geolocation sharing hanger | Mihaela Velimiroviciu | Deferred to Q3 |
| bug 1008953 Add test to verify geolocation doesn't return a location when wifi is disabled | None | Deferred to Q3 |
| bug 1009441 Add automated test to verify the UI and preferences of a signed in account | Mihaela Velimiroviciu | Deferred to Q3 |
| bug 1009446 Add automated test to verify the UI and preferences of a disconnected account | Catalin Suciu | Deferred to Q3 |
| bug 1009460 Add automated test to verify the UI and preferences after forgetting the email for unverified user | Cosmin Malutan | Deferred to Q3 |
| bug 1018927 Add automated test to verify that sync prefs are saved after restart | Daniel Gherasim | Deferred to Q3 |
| bug 1018931 Add automated test to verify that sync options specified at sign in are persisted after restart | Daniel Gherasim | Deferred to Q3 |
| bug 991877 Add a test for PeerConnection.close() | Nils Ohlmeier | Landed |
- Q3 tests - tracking bug 1035848
| Test | Assigner | Status |
| bug 1008941 Add test to verify dismissing the geolocation sharing hanger | Mihaela Velimiroviciu | Landed |
| bug 1008953 Add test to verify geolocation doesn't return a location when wifi is disabled | None | Not started |
| bug 1009441 Add automated test to verify the UI and preferences of a signed in account | Mihaela Velimiroviciu | In Progress |
| bug 1009446 Add automated test to verify the UI and preferences of a disconnected account | Catalin Suciu | Not started |
| bug 1009460 Add automated test to verify the UI and preferences after forgetting the email for unverified user | Cosmin Malutan | In progress |
| bug 1018927 Add automated test to verify that sync prefs are saved after restart | Daniel Gherasim | In progress |
| bug 1018931 Add automated test to verify that sync options specified at sign in are persisted after restart | Daniel Gherasim | In progress |
- Q4 tests - tracking in the sprint documents below
- Sprint 1: https://docs.google.com/spreadsheets/d/1osGKNhEAfVXp01o4ajCFrqaM0s9TgSxjc5P1S2wGeFM/edit#gid=1524877682
- Sprint 2: https://docs.google.com/spreadsheets/d/1osGKNhEAfVXp01o4ajCFrqaM0s9TgSxjc5P1S2wGeFM/edit#gid=555086435
- Sprint 3: https://docs.google.com/spreadsheets/d/1osGKNhEAfVXp01o4ajCFrqaM0s9TgSxjc5P1S2wGeFM/edit#gid=1110510437
Documentation
- Introduction into Test Frameworks: https://developer.mozilla.org/en-US/docs/Mozilla/QA/Automated_testing
References
- Mochitests: https://developer.mozilla.org/en-US/docs/Mochitest
- Browser Chrome tests: https://developer.mozilla.org/en-US/docs/Browser_chrome_tests
- Mozmill tests: https://developer.mozilla.org/en-US/docs/Mozilla/Projects/Mozmill
- TPS tests: https://developer.mozilla.org/en-US/docs/TPS
