Firefox:1.5.0.10-2.0.0.2:Test Plan
Contents
General Firefox 1.5.0.x Test Plan
This is the basic set of tests we run for every security & maintenance release.
Windows Vista Test Plan
Firefox 2.0.0.2 will be the first release where we support the Windows Vista platform. To that end, Marcia created a Windows Vista Test Plan. You can view the latest iteration of that document here: Windows Vista Test Plan
Assumptions
- 1.5.0.10 and 2.0.0.2 are simultaneous releases of Firefox. It hasn't been decided if we will ship Thunderbird 1.5.0.10 at the same time.
Current Tasks
- Bug Triage (1/23 - completed, working with devs on case by case basis)
- Bug Verifications
Schedule
- Tentative Release Date: Mid February
- Overall Schedule from Community Page
Test Results
Any 1.5.0.10-2.0.0.2 testing results that will help us track progress, identify regressions, and verify fixes should go here.
Smoketests | BFTs | |
---|---|---|
Firefox 2.0.0.2 | PASS | PASS |
Firefox 1.5.0.10 | PASS | PASS |
- Smoketests and BFTs
- l10n related testing
- Updates Testing
- Major Software Updates Testing
- Vista Focused Testing
- Vista Updates Testing
- Distro Test Results
- Security Regression tests Windows - Passed
- JavaScript tests - Passed
- Search Engine Checker Results: (need link)
- Continued new locale testing results:
- Thunderbird 1.5.0.10
The above list is just a sample of what we will be testing and links to blank pages we should us to track our test results. Please add any other test results here. Thanks!
Bug Verifications
When you verify the bug is fixed:
- If you test on Trunk, resolve it as VERIFIED FIXED
- If you test on 1.8.x.x branch, replace the fixed1.8.0.10 / fixed1.8.1.2 keyword with verified1.8.0.10 / verified1.8.1.2
Tips:
- Verify on both 1.8.0.10 and 1.8.1.2 for bugs fixed on both branches
- If you don't see an easy way to verify or need further clarification add a comment to the bug or add "[needs testcase]" (without quotes) to the bug's Status Whiteboard.
Fixed
- All Fixed Bugs (including 1.8.1.2 and 1.8.0.10, with no bugs marked "verified1.8.x.x")
- Refined bug lists for quick reference fo what's fixed where:
- All bug lists above exclude Camino, Thunderbird, Localizations and XForms
Verified
- All Verified Bugs (including 1.8.1.2 and 1.8.0.10, with no bugs marked "fixed1.8.x.x")
- verified 1.5.0.10 bugs
- verified 2.0.0.2 bugs
Priority Verifications
- Critical bugs ("fixed1.8.0.10" or "fixed1.8.1.2" bugs, no "needs testcase" in status whiteboard, and severity is "critical")
- Security bugs ("fixed1.8.0.10" or "fixed1.8.1.2" bugs, no "needs testcase" in status whitebooard, and is marked "security-sensitive")
Note: If you run into a difficult bug, just add the "[needs testcase]" in the status whiteboard and move on.
Need Verification
- bc's js tests
https://bugzilla.mozilla.org/show_bug.cgi?id=357398 https://bugzilla.mozilla.org/show_bug.cgi?id=357392
Cannot/Won't Verify
- Needs testcase or difficult to reproduce:
https://bugzilla.mozilla.org/show_bug.cgi?id=364323 https://bugzilla.mozilla.org/show_bug.cgi?id=360526 https://bugzilla.mozilla.org/show_bug.cgi?id=361781 https://bugzilla.mozilla.org/show_bug.cgi?id=362110 (need to run test in JS Shell) https://bugzilla.mozilla.org/show_bug.cgi?id=362547 (need xpcshell to run test) https://bugzilla.mozilla.org/show_bug.cgi?id=363849 (need JAWS for accessibility testcase)
- Verified by code inspection (should revisit later to confirm):
https://bugzilla.mozilla.org/show_bug.cgi?id=361332
- Non-Firefox bugs (Camino, Sunbird, Thunderbird, etc.):
https://bugzilla.mozilla.org/show_bug.cgi?id=365248
https://bugzilla.mozilla.org/show_bug.cgi?id=362186 (tried to test with TB, but didn't have any luck, asked reporter to retest).
https://bugzilla.mozilla.org/show_bug.cgi?id=363043 (minor change for Sunbird only)