Firefox:1.5.0.4:Test Plan
Contents
General Firefox 1.5.0.x Test Plan
This is the basic set of tests we run for every security & mainenance release.
Current Tasks
I am including all end game tasks including build, security notifications, etc. If anyone doesn't like this, I can create a separate cross-functional tasks page at a higher level.
Monday - May 15th
- Build Tbird L10n Win/Linux/PPC - rhelmer - DONE
- Build TBird L10n UB - rhelmer - delayed
- Test locales that have changes for 1.5.0.4 - juan
- See the signoff page (see link above)
- Verify 10 more FFx bugs - QA-ALL - TBD
- The goal is to verify all security specific, severity=blocker, or Severity=critical
- Approximalte 30 more remain to be verified
- Update the bug verification section of the test plan for bugs that cannot be verified or that are pending verification
Tuesday - May 16th
- Respin TBird for bug 327037 - rhelmer - DONE
- Test locales that have changes for 1.5.0.4 - juan - fr, it, ru - PASSED
- See the signoff page (see link above)
- Verify 10 more FFx bugs - QA-ALL - TBD
- The goal is to verify all security specific, severity=blocker, or Severity=critical
- Approximalte 20(?) more remain to be verified
- Update the bug verification section of the test plan for bugs that cannot be verified or that are pending verification
Wednesday - May 17th and Thursday - May 18th
- Finish L10n testing of changed locals for FFx
- pl - juanb
- nb-BO - timr
- Test the new FFx LT locale - timr
- Verify fix for bug 327037 - tracy - done
- L10n testing of changed locals for TBird - tracy - done
- Run metadiff on locale files - davel
- Spot check P1 locales for FFx and TBird:
- Firefox L10n Spot Check Results - tracy - done - PASS
- Thunderbird L10n Spot Check Results - juan, timr
- Verify 10 more FFx bugs - QA-ALL - TBD
- The goal is to verify all security specific, severity=blocker, or Severity=critical
- Approximalte 10 (?) more remain to be verified
- Update the bug verification section of the test plan for bugs that cannot be verified or that are pending verification
Friday - May 19th
- End of official Release Candidiate testing
Monday - May 22nd
- Start creating updates and signing builds - preed
Wednesday - May 24th
- Start testing updates
- update checker tool - davel?
- Spot check updates - juan, tracy, timr
- Results page: Software Update Testing
- Official Build IDs
- Firefox RC4 = 2006050817 (for all platforms and locales)
- Bob's Magic Build Info Page
Specific Testing for 1.5.0.4
There are a few areas not covered by the general test plan above, and we will track that testing here. A few things to think about and test/verify with 1.5.0.4 include:
- MacOS X Universal Binaries (Marcia/DaveL)
- both BFTs and software update need to be thoroughly tested to ensure all existing users of 1.5.0.2 are properly updated to 1.5.0.3 (both PPC and UB users).
- more investigation into profile migration problems with users moving a PPC profile to a UB build (see Bug 331511)
- Greasemonkey testing (Jesse/Jay)
- a few bugs fixed for 1.5.0.4 change the way Greasemonkey scripts work, so we need to make sure things don't break (e.g. Bug 321101 and all dependencies)
- Dveditz said we should focus on scripts that use array extras and those that try to look into different frames.
- Form Controls Bugs
- see [https://bugzilla.mozilla.org/show_bug.cgi?id=334977 Bug 334977 and all dependencies
Please add any other bugs/areas that need special attention for this release. Thanks!
Test Results
Any 1.5.0.4 testing results that will help us track progress, identify regressions, and verify fixes should go here.
The above list is just a sample of what we will be testing and links to blank pages we should us to track our test results. Please add any other test results here. Thanks!
Bug Verifications
fixed1.8.0.4 Bugs (need verification)
Verified
- "no verification necessary":
- bug 327712
- bug 330900 (would be nice to have testcase)
- bug 326931
- bug 328897
- bug 330169
- bug 331678
- bug 331719
- bug 331786
- bug 331787
- bug 331793
- bug 331820
- bug 334464 fix for HP-UX and SPARC platforms only
- bug 323526 OS/2 only, verified by code inspection
- bug 316845 build bug for cairo on linux, verified by code inspection
Pending
- added [need testcase]:
- need help with testcase:
- bug 330897
- bug 324918 (need to make build and check assertion)
- bug 321101 (need help with setting up and testing PAC scripts)
- bug 330169
- bug 331678
- bug 331820
- bug 335535
- bug 327708
- bug 328897