Releases/Firefox 10/Test Plan
« Firefox 9 | Firefox 10 | Firefox 11 »
Contents
Firefox 10 Test Plan
Summary
Milestone | Firefox 10 |
Status | Currently in Beta -- merging to Released on January 31, 2011 |
Lead | Juan Becerra (irc: juanb) |
2nd | Anthony Hughes (irc: ashughes) |
Latest Build: [ ftp], [ http], [ web]
The following is the test plan for Firefox 10 from Nightly through to Release. Use this document as a reference for what is being tested to validate the quality of Firefox 10. After the release this document will be used as an archive of what was done to validate this release.
If you have some free time, please pick a task below and get in touch with one of the leads.
Details
The following is a description of the tasks which need to be completed throughout this release.
- Daily Tasks
- [ON TRACK] [softvision] Automation: Check dashboards for new failures
- [ON TRACK] [softvision] Bug Triage: Check Bugzilla for regressions
- [ON TRACK] [softvision] Features: Test features and triage feature bugs targeted for this releases
- [ON TRACK] [softvision] Input: Triage Input.MO for prevalent issues and feature requests
- One-time-only Tasks
- [ON TRACK] [ashughes] Nightly Merge: Sign-off initial merge to Nightly
- [ON TRACK] [ashughes] Aurora Merge: Sign-off merge from Nightly to Aurora
- [ON TRACK] [iBeta] Full Functional Tests: Run the full suite of full functional tests on Aurora
- [ON TRACK] [uTest] Website Compatibility: Run suite of Aurora website compatibility tests
- [ON TRACK] [ashughes] Beta Merge: Sign-off merge from Aurora to Beta
- [ON TRACK] [uTest] Website Compatibility: Run suite of Beta website compatibility tests
- [ON TRACK] [ashughes] Release: Sign-off final release
Automation
BFTs
Task | Triage the Mozmill dashboard for test failures and regressions |
Lead | Vlad Maniac (Softvision) |
Peer | Alex Lakatos (Softvision) |
Status | NEW (12), ASSIGNED (9), FIXED (3), REGRESSIONS (0) |
Instructions | |
| |
Bugs Found | |
|
Endurance
Task | Triage the Mozmill Endurance dashboard for test failures and performance regressions |
Lead | Mihaela Velimiroviciu (Softvision) |
Peer | |
Status | Spreadsheet (Nightly) |
Instructions | |
| |
Bugs Found | |
|
Bug Triage
Summary | Check UNCONFIRMED, NEW, FIXED, REOPEN, and tracking/status bugs |
Lead | Vlad Ghetiu (Softvision) |
Peers | Virgil Dicu, Ioana Budnar, Mihaela Velimiroviciu, Simona Badau, Paul Silaghi (Softvision) |
Bugs | QA+, FIXED, UNCONFIRMED |
Results | VERIFIED, REOPENED, NEW |
- Issues Found
- Tips
- If you don't know how to verify a bug, just skip it, move onto the next bug
- Ignore code-level bugs, bugs in tests, build issues
Features
Track features which have landed in Firefox 10 and are ready to be tested (owners)
The following is a statement of feature readiness for release.
Feature | Owner | Status |
Silent Update: Add-ons Default to Compatible | Virgil Dicu | Signed-off for Beta6-2012.01.25 |
Add-on hotfixes | Vlad Ghetiu | Signed-off on Beta 5-2012.01.20 |
Code Editor | Alex Lakatos | |
Console Object Completion | Vlad Maniac | Signed-off for Beta1-2011.12.23 |
Page Inspector / Highlighter | Teodosia Pop | Signed-off for Beta1-2011.12.23 |
CSS Rules View | no owner | |
Style Inspector | Florin Strugariu | |
DOM Bindings: Node List and Array Bindings | no owner | Verified test cases attached to implementation bug 648801 on Firefox 10.0 beta 3 (Mihaela Velimiroviciu) |
Test Suite Fixes for WebGL | no owner | Waiting for confirmation if the feature is in scope for QA.- 2011-12-19 |
Anti-Aliasing for WebGL | no owner | Waiting for confirmation if the feature is in scope for QA.- 2011-12-19 |
Full Screen APIs | Paul Silaghi | Signed off on Beta 5 - 2012-01-20 |
CSS3 3D Transforms | Ioana Budnar | Signed off on Beta 6 - 2012-01-25 |
Links | ||
Scoped Features, Unscoped Features |
Input
The following are the details of daily triage conducted on http://input.mozilla.org.
- Lead: Vlad Maniac (Softvision)
- Peer: Alex Lakatos (Softvision)
- Tasks:
- Go to http://input.mozilla.org
- Filter the results by Firefox version
- Put your results here: spreadsheet
- Any feedback which is spiking should listed below and escalated to the QA release driver
- Popular Feedback
- Results: spreadsheet
Full Functional Tests
The following tracks testing done by iBeta for full functional test coverage. This task is performed once during Aurora only.
- Lead: Anthony Hughes
- [ link to test suite]
- [ link to results of testing]
- [ link to bugs filed by iBeta]
Website Compatibility
The following tracks testing done by uTest for website compatibility. This task is performed after every merge.
- Lead: Anthony Hughes
- Link to test suite
- Link to report for Nightly Web Compatibility
- Link to report for Aurora Web Compatibility
- Link to report for Beta Web Compatibility
- Link to bugs filed
Nightly Merge
Verify that the builds generated from the merge to Nightly have updated properly.
- Nightly
- [ON TRACK] [ashughes] Windows XP:
- [ON TRACK] [ashughes] Windows 7:
- [ON TRACK] [ashughes] Mac OS X 10.6:
- [ON TRACK] [ashughes] Ubuntu 11.04:
- Issues Found
Aurora Merge
Verify the first builds generated from the bits merged to Aurora.
Automated Tests
The following are the detailed results of the automated BFT test runs.
Platform | Assignee | Result |
Windows 2000 | ashughes | PASS - 2011-11-10 |
Windows XP | ashughes | PASS - 2011-11-10 |
Windows Vista | ashughes | PASS - 2011-11-10 |
Windows 7 32-bit | ashughes | PASS - 2011-11-10 |
Windows 7 64-bit | ashughes | PASS - 2011-11-10 |
Mac OS X 10.6 | ashughes | PASS - 2011-11-10 |
Mac OS X 10.7 | ashughes | PASS - 2011-11-10 |
Ubuntu 11.10 32-bit | ashughes | PASS - 2011-11-10 |
Ubuntu 11.10 64-bit | ashughes | PASS - 2011-11-10 |
Reports | ||
Mozmill |
Update Tests
The following are details of update verifications
Platform | Assignee | Result: Auroratest | Result: Aurora |
Windows 2000 | ashughes | PASS - 2011-11-10 | |
Windows XP | ashughes | PASS - 2011-11-10 | |
Windows Vista | ashughes | PASS - 2011-11-10 | |
Windows 7 32-bit | ashughes | PASS - 2011-11-10 | |
Windos 7 64-bit | ashughes | PASS - 2011-11-10 | |
Mac OS X10.6 | ashughes | PASS - 2011-11-10 | |
Mac OS 10.7 | ashughes | PASS - 2011-11-10 | |
Ubuntu1.10 32-bit | ashughes | PASS - 2011-11-10 | |
Ubuntu1.10 64-bit | ashughes | PASS - 2011-11-10 | |
Reports | |||
Auroratest, [ Aurora] |
Manual Spot Checks and Feature Sign-Off
Are all features implemented at this point working?
- CSS3 3D Transforms: signed-off
- Full Screen APIs: signed-off
- Style Inspector: signed-off
- Silent Update: Add-ons Default To Compatible: signed-off
- Highlighter: signed-off
Manual spot Checks spreadsheet
- Platforms: Windows XP, Windows 7 x64, Ubuntu 11.10, Mac 10.6
- Found known issues: bug 699435, bug 642493, bug 587140
- New issues: bug 701742, bug 701739
- Status: PASS with known issues
Beta 1
The following tasks need to be completed to sign-off the Beta merge
Task | Assignee | Status |
Automated Tests | ashughes | SIGN-OFF? - DATE |
Manual Tests | Softvision | SIGN-OFF? - DATE |
Update Tests | ashughes | SIGN-OFF? - DATE (releasetest) |
Bug Fix Verifications | ashughes, Softvision | SIGN-OFF? - DATE |
Feature Sign-offs | ashughes | SIGN-OFF? - DATE |
Issues Found | ashughes, Softvision | SIGN-OFF? - DATE |
Known Issues | ashughes, Softvision | SIGN-OFF? - DATE |
Links | ||
Builds, Litmus Testrun, Mozmill Dashboard |
Automated Tests
The following are the detailed results of the automated BFT test runs.
Platform | Assignee | Result: report |
Windows 2000 | ashughes | PASS - 2011-12-21 |
Windows XP | ashughes | PASS - 2011-12-21 |
Windows Vista | ashughes | PASS - 2011-12-21 |
Windows 7 32-bit | ashughes | PASS - 2011-12-21 |
Windows 7 64-bit | ashughes | PASS - 2011-12-21 |
Mac OS X 10.6 | ashughes | PASS - 2011-12-21 |
Mac OS X 10.7 | ashughes | PASS - 2011-12-21 |
Ubuntu 11.10 32-bit | ashughes | PASS - 2011-12-21 |
Ubuntu 11.10 64-bit | ashughes | PASS - 2011-12-21 |
Manual Tests
Smoketests
The following are the detailed results of the manual smoketests.
Platform | Assignee | Result |
Windows 2000 | Simona | PASS- 2011-12-22 |
Windows XP | Ioana | PASS- 2011-12-22 |
Windows Vista | Simona | PASS- 2011-12-22 |
Windows 7 32-bit | Mihaela | PASS- 2011-12-22 |
Windows 7 64-bit | Paul | PASS- 2011-12-22 |
Mac OS X 10.6.8 | VladG | PASS- 2011-12-22 |
Mac OS X 10.7.2 | VladG | PASS- 2011-12-22 |
Ubuntu 11.10 32-bit | Virgil | PASS- 2011-12-22 |
Ubuntu 11.10 64-bit | Virgil | PASS- 2011-12-22 |
Reports | ||
Litmus |
Focused Tests
The following are the detailed results of the focused feature testing. Provide much detail about your testing: test cases, steps, bugs filed, URLs, add-on/plugin versions, platforms tested, etc
- Regressions
1. bug 713014: Yahoo Messenger within Yahoo Mail does not work in Firefox version 9
- We need to find a regression range and prove that this bug does not affect Firefox 10+
- RESULTS:
- (tester) details
2. Web App Compatibility
- Go to various top-sites and verify functionality is not broken
- RESULTS:
- (tester) details
3. Audio/Video
- Go to various audio and video streaming sites and verify functionality is not broken
- RESULTS:
- (tester) details
4. Plugins
- Test for crashes, performance, and functional regressions with Flash, Silverlight, Quicktime, Java, etc
- RESULTS:
- (tester) details
5. Add-ons
- Test add-ons from various sources: AMO, installed through other apps, downloaded from other sites
- RESULTS:
- (tester) details
6. Rich Profile Updates
- Test updating from a previous Beta with a rich profile of history, bookmarks, and session data
- RESULTS:
- (tester) details
Update Tests
The following are details of update verifications
Platform | Assignee | Result: Releasetest | Result: Beta |
Windows 2000 | ashughes | PASS - 2011-12-22 | RESULT - DATE |
Windows XP | ashughes | PASS - 2011-12-22 | RESULT - DATE |
Windows Vista | ashughes | PASS - 2011-12-22 | RESULT - DATE |
Windows 7 32-bit | ashughes | PASS - 2011-12-22 | RESULT - DATE |
Windos 7 64-bit | ashughes | PASS - 2011-12-22 | RESULT - DATE |
Mac OS X10.6 | ashughes | PASS - 2011-12-22 | RESULT - DATE |
Mac OS 10.7 | ashughes | PASS - 2011-12-22 | RESULT - DATE |
Ubuntu 11.10 32-bit | ashughes | PASS - 2011-12-22 | RESULT - DATE |
Ubuntu 11.10 64-bit | ashughes | PASS - 2011-12-22 | RESULT - DATE |
Reports | |||
Releasetest, Beta |
Bug Fix Verifications
The following are the detailed results of verifications of bug fixes landed in Beta.
Query | Assignees | Status |
QA+ | SoftVision | 11/26 (2011-12-28) |
FIXED | ||
Reports | ||
Fixed bugs verification spreadsheet |
Issues Found
Bug ID | Summary | Reporter | Status |
bug 712882 | Video does not pause when clicked if "Hide controls" is selected | Mihaela | Resolved INVALID |
bug 711742 | HTML5 video's "Save Video As" saves an empty .webm file if you have not actually played the video | Simona | NEW |
bug 712950 | No puzzle pieces shown for missing plugins | Paul | NEW, Investigating if it is a recent regression. |
bug 689121 | Plugin container crash for flash stress test (corner case) - opening same content in 10 tabs | VladM | NEW |
Known Issues
Bug ID | Summary | Status | Blocker? |
bug 708557 | Html5 youtube context menu not persistent when right clicking | New | No |
bug 639480 | Frequent crash of Adobe Shockwave for Director plugin on Mac OS X [@ IMLLib@0x3fd52] | New | No |
bug 573699 | No notification bar displayed in Add-ons manager > Plugins when installed plugins are outdated | New | No |
bug 638770 | clicking on a quicktime video pauses it | New | No |
bug 585822 | Session Restore does not resume download | New | No |
Beta 2
Builds: FTP, HTTP
Litmus: testrun, report
- Checklist
- [DONE] Functional automated tests, synced to Litmus
- [DONE] Manual smoketests
- [DONE] Manual focused tests
- [DONE] Bug fix verifications
- [DONE] Check with Support for top issues from previous Beta/Release
- [DONE] Check with Marcia for top-crashers spiking
- [DONE] Update tests
- [DONE] Get final sign-off from Bob Moss
Automated Tests
The following are the detailed results of the automated BFT test runs.
Platform | Assignee | Result: report |
Windows 2000 | ashughes | PASS - 2011-12-28 |
Windows XP | ashughes | PASS - 2011-12-28 |
Windows Vista | ashughes | PASS - 2011-12-28 |
Windows 7 32-bit | ashughes | PASS - 2011-12-28 |
Windows 7 64-bit | ashughes | PASS - 2011-12-28 |
Mac OS X 10.6 | ashughes | PASS - 2011-12-28 |
Mac OS X 10.7 | ashughes | PASS - 2011-12-28 |
Ubuntu 11.10 32-bit | ashughes | PASS - 2011-12-28 |
Ubuntu 11.10 64-bit | ashughes | PASS - 2011-12-28 |
Manual Tests
Smoketests
The following are the detailed results of the manual smoketests.
Platform | Assignee | Result |
Windows 2000 | VladG | PASS - 2011-12-29 |
Windows XP | VladG | PASS - 2011-12-29 |
Windows Vista | VladG | PASS - 2011-12-29 |
Windows 7 32-bit | Paul | PASS - 2011-12-29 |
Windows 7 64-bit | Paul | PASS - 2011-12-29 |
Mac OS X 10.6.8 | VladG | PASS - 2011-12-29 |
Mac OS X 10.7.2 | geo | FAIL (see below) - 2011-12-28 |
Ubuntu 11.10 32-bit | Virgil | PASS with issues - 2011-12-29 |
Ubuntu 11.10 64-bit | Virgil | PASS with issues - 2011-12-29 |
Reports | ||
Litmus |
Focused Tests
The following are the detailed results of the focused feature testing. Provide much detail about your testing: test cases, steps, bugs filed, URLs, add-on/plugin versions, platforms tested, etc
- Regressions
1. bug 713014: Yahoo Messenger within Yahoo Mail does not work in Firefox version 9
- We need to find a regression range and prove that this bug does not affect Firefox 10+
- RESULTS:
- (Softvision) Results can be found in Comment21
2. Web App Compatibility
- Go to various top-sites and verify functionality is not broken
- RESULTS: PASS
- (abillings)(Softvision) Visit Yahoo!, Gmail, Facebook, Youtube, Google, Wikipedia, Amazon
3. Audio/Video
- Go to various audio and video streaming sites and verify functionality is not broken
- RESULTS: PASS
- (Softvision) See the details and test results in the Etherpad
4. Plugins
- Test for crashes, performance, and functional regressions with Flash, Silverlight, Quicktime, Java, etc
- RESULTS: PASS with known issues
5. Add-ons
- Test add-ons from various sources: AMO, installed through other apps, downloaded from other sites
- RESULTS: PASS
- (Softvision) We've run the Silent Update-Addons Default to Compatible tests. See the details and test results in the Etherpad
6. Rich Profile Updates
- Test updating from a previous Beta with a rich profile of history, bookmarks, and session data (use the Software Update tests from the Litmus testrun)
- RESULTS: PASS
- (Softvision) See the details and test results in the Etherpad
Update Tests
The following are details of update verifications
Platform | Assignee | Releasetest: report | Beta: report |
Windows 2000 | ashughes | PASS - 2011-12-29 | PASS - 2011-12-30 |
Windows XP | ashughes | PASS - 2011-12-29 | PASS - 2011-12-30 |
Windows Vista | ashughes | PASS - 2011-12-29 | PASS - 2011-12-30 |
Windows 7 32-bit | ashughes | PASS - 2011-12-29 | PASS - 2011-12-30 |
Windos 7 64-bit | ashughes | PASS - 2011-12-29 | PASS - 2011-12-30 |
Mac OS X 10.6 | ashughes | PASS - 2011-12-29 | PASS - 2011-12-30 |
Mac OS 10.7 | ashughes | PASS - 2011-12-29 | PASS - 2011-12-30 |
Ubuntu 11.10 32-bit | ashughes | PASS - 2011-12-29 | PASS - 2011-12-30 |
Ubuntu 11.10 64-bit | ashughes | PASS - 2011-12-29 | PASS - 2011-12-30 |
- Issues
[FIXED] Firefox 10.0b1 not finding updates on releasetest
- Due to bug 711275 Make sure appVersion changes with every Firefox 10 beta
Bug Fix Verifications
The following are the detailed results of verifications of bug fixes landed in Beta.
- Any fix you very should have the status-firefox10 flag set to verified
- If the fix has been verified on all affected versions of Firefox, change [qa+] in the whiteboard to [qa!]
- Queries
- QA+: 62 bugs (24 security fixes, 38 functional fixes)
- RESULTS:
- FIXED: 87 bugs (32 QA+, 27 QA?, 16 QA-)
- RESULTS:
- Spreadsheet: softvision verifications
Issues Found
Bug ID | Summary | Reporter | Status |
bug 713991 | Geolocation fails when used with large number of access points | Geo | Regression |
bug 714037 | Text box displayed incorrectly on youtube html5 in Linux overlap text box | Virgil | Tech Evangelism |
bug 714045 | Site favicon not displayed in Panorama if entering Panorama before site has loaded completely | Virgil | Regression |
bug 714173 | Getting "There was a problem submitting your report" messages when trying to submit Mac crashes | Marcia | NEW |
bug 714203 | Screen Artifacts seen while running Lights demo | Marcia | NEW |
bug 714272 | Desktop icon on Tools/Options panel disappears if choosing to 'Save files to' Desktop | Paul | NEW |
bug 714320 | Firefox Crash [@ nsStyleContext::AddChild(nsStyleContext*) ] | Marcia | NEW |
Known Issues
Bug ID | Summary | Status | Blocker? |
bug 712950 | No puzzle pieces shown for missing plugins | NEW | No |
bug 711742 | HTML5 video's "Save Video As" saves an empty .webm file if you have not actually played the video | NEW | No |
bug 708557 | Html5 youtube context menu not persistent when right clicking | NEW | No |
bug 689121 | Plugin container crash for flash stress test (corner case) - opening same content in 10 tabs | NEW | No |
bug 639480 | Frequent crash of Adobe Shockwave for Director plugin on Mac OS X [@ IMLLib@0x3fd52] | NEW | No |
bug 573699 | No notification bar displayed in Add-ons manager > Plugins when installed plugins are outdated | NEW | No |
bug 638770 | clicking on a quicktime video pauses it | NEW | No |
bug 585822 | Session Restore does not resume download | NEW | No |
Beta 3
Builds: FTP, HTTP
Litmus: testrun, report
- Checklist
- [DONE] Functional automated tests, synced to Litmus
- [DONE] Manual smoketests
- {{ |}} Manual focused tests
- {{ |}} Bug fix verifications
- {{ |}} Check with Support for top issues from previous Beta/Release
- {{ |}} Check with Marcia for top-crashers spiking
- {{ |}} Update tests
- {{ |}} Get final sign-off from Bob Moss
Automated Tests
The following are the detailed results of the automated BFT test runs.
Platform | Assignee | Result: report |
Windows 2000 | ashughes | PASS - 2012-01-04 |
Windows XP | ashughes | PASS - 2012-01-04 |
Windows Vista | ashughes | PASS - 2012-01-04 |
Windows 7 32-bit | ashughes | PASS - 2012-01-04 |
Windows 7 64-bit | ashughes | PASS - 2012-01-04 |
Mac OS X 10.6 | ashughes | PASS - 2012-01-04 |
Mac OS X 10.7 | ashughes | PASS - 2012-01-04 |
Ubuntu 11.10 32-bit | ashughes | PASS - 2012-01-04 |
Ubuntu 11.10 64-bit | ashughes | PASS - 2012-01-04 |
- Test Failures
- bug 715413 /restartTests/testAddons_uninstallTheme | Selected category has been loaded (Mac)
- bug 704140 /testToolbar/testBackForwardButtons.js | Timeout exceeded for waitForElement ID: mission_statement (All)
Manual Tests
Smoketests
The following are the detailed results of the manual smoketests.
Platform | Assignee | Result |
Windows 2000 | Simona | PASS - 2012-01-05 |
Windows XP | Ioana | PASS - 2012-01-05 |
Windows Vista | Simona | PASS - 2012-01-05 |
Windows 7 32-bit | Mihaela | PASS 2012-01-05 |
Windows 7 64-bit | Paul | PASS - 2012-01-05 |
Mac OS X 10.6.8 | VladG | PASS - 2012-01-05 |
Mac OS X 10.7.2 | VladG | PASS - 2012-01-05 |
Ubuntu 11.10 32-bit | Ioana | PASS - 2012-01-05 |
Ubuntu 11.10 64-bit | Virgil | PASS 2012-01-05 |
Reports | ||
Litmus |
Focused Tests
The following are the detailed results of the focused feature testing. Provide much detail about your testing: test cases, steps, bugs filed, URLs, add-on/plugin versions, platforms tested, etc
- Priority Focused Testing
2. Default Compatible Add-ons - need a detailed matrix filled out with compatibility NOT READY
3. Add-on Hot Fix NOT READY
- Regressions
1. GC/CC Pauses - need to track down causes / regressions for Firefox 10 GC/CC pauses
- See bug 711900
2. bug 714320 Firefox Crash [@ nsStyleContext::AddChild(nsStyleContext*) ]
- RESULTS:
- Please track results here: https://etherpad.mozilla.org/Bug-714320
- (Softvision) Firefox did not crash. Detailed description of testing and results are in the etherpad above.
3. bug 713014: Yahoo Messenger within Yahoo Mail does not work in Firefox version 9
- We need to find a regression range and prove that this bug does not affect Firefox 10+
- RESULTS:
- (tester) detailed description of testing and results
4. Web App Compatibility
- Go to various top-sites and verify functionality is not broken
- RESULTS: PASS
- (Softvision) results Etherpad
5. Audio/Video
- Go to various audio and video streaming sites and verify functionality is not broken
- RESULTS: PASS
- (Softvision) See the details and test results in the Etherpad
6. Plugins
- Test for crashes, performance, and functional regressions with Flash, Silverlight, Quicktime, Java, etc
- RESULTS: PASS
- Tests ran on Ubuntu 11.10 x86_64, Windows 7, Windows XP and Mac OS 10.6 Litmus Report
7. Rich Profile Updates
- Test updating from a previous Beta with a rich profile of history, bookmarks, and session data (use the Software Update tests from the Litmus testrun)
- RESULTS: PASS
- (Softvision) Results for Software Update and Silent Update tests can be found here (ran on Ubuntu 11.10, x86_64, Windows XP, Windows 7, Mac OS 10.6):Litmus Report
Update Tests
The following are details of update verifications
Platform | Assignee | Releasetest: report | Beta: report |
Windows 2000 | ashughes | PASS - 2012-01-06 | PASS - 2012-01-06 |
Windows XP | ashughes | PASS - 2012-01-06 | PASS - 2012-01-06 |
Windows Vista | ashughes | PASS - 2012-01-06 | PASS - 2012-01-06 |
Windows 7 32-bit | ashughes | PASS - 2012-01-06 | PASS - 2012-01-06 |
Windos 7 64-bit | ashughes | PASS - 2012-01-06 | PASS - 2012-01-06 |
Mac OS X 10.6 | ashughes | PASS - 2012-01-06 | PASS - 2012-01-06 |
Mac OS 10.7 | ashughes | PASS - 2012-01-06 | PASS - 2012-01-06 |
Ubuntu 11.10 32-bit | ashughes | PASS - 2012-01-06 | PASS - 2012-01-06 |
Ubuntu 11.10 64-bit | ashughes | PASS - 2012-01-06 | PASS - 2012-01-06 |
- Issues
Bug Fix Verifications
The following are the detailed results of verifications of bug fixes landed in Beta.
- Any fix you very should have the status-firefox10 flag set to verified
- If the fix has been verified on all affected versions of Firefox, change [qa+] in the whiteboard to [qa!]
- Queries
- QA+: 53 bugs (24 security fixes, 29 functional fixes)
- RESULTS: 10 bugs VERIFIED
- FIXED: 5 bugs (4 QA+, 1 QA?, 0 QA-)
- Spreadsheet: softvision verifications
Issues Found
Bug ID | Summary | Reporter | Status |
bug 715697 | Youtube video becomes choppy when running six videos simultaneously | Jason Smith | NEW |
bug 715692 | Strange content corruption after restoring session | Mike Conley | NEW |
bug 715675 | Tab dragged to new window has no tab widget | Steve Workman | NEW |
bug 715454 | Current group is switched when using switch-to-tab and opening new tab group | Virgil | NEW |
bug 715457 | HTML5 youtube video on pause starts playing when expand/reduce the player | Paul | UNCONFIRMED |
bug 671894 | addons.xpi: Failed to open database (NS_ERROR_STORAGE_BUSY) | Commented (Virgil) | NEW |
bug 716557 | Unable to select which settings to import from another browser when running Firefox for the first time | Paul | NEW |
Known Issues
Bug ID | Summary | Status | Blocker? |
bug 714320 | Firefox Crash [@ nsStyleContext::AddChild(nsStyleContext*) ] | Regression | ? |
bug 713991 | Geolocation fails when used with large number of access points | RESOLVED | N/A |
bug 714037 | Text box displayed incorrectly on youtube html5 in Linux overlap text box | Tech Evangelism | N/A |
bug 714045 | Site favicon not displayed in Panorama if entering Panorama before site has loaded completely | Regression | NO |
bug 714173 | Getting "There was a problem submitting your report" messages when trying to submit Mac crashes | Network? | NO |
bug 714203 | Screen Artifacts seen while running Lights demo | NEW | NO |
bug 714272 | Desktop icon on Tools/Options panel disappears if choosing to 'Save files to' Desktop | Regression | NO |
bug 712950 | No puzzle pieces shown for missing plugins | NEW | No |
bug 711742 | HTML5 video's "Save Video As" saves an empty .webm file if you have not actually played the video | NEW | No |
bug 708557 | Html5 youtube context menu not persistent when right clicking | NEW | No |
bug 689121 | Plugin container crash for flash stress test (corner case) - opening same content in 10 tabs | NEW | No |
bug 639480 | Frequent crash of Adobe Shockwave for Director plugin on Mac OS X [@ IMLLib@0x3fd52] | NEW | No |
bug 573699 | No notification bar displayed in Add-ons manager > Plugins when installed plugins are outdated | NEW | No |
bug 638770 | clicking on a quicktime video pauses it | NEW | No |
bug 585822 | Session Restore does not resume download | NEW | No |
Feedback
If you want to help test and just send us general feedback, please do so below. Areas we are looking for feedback include but are not limited to hangs, crashes, add-on compatibility, youtube, facebook, twitter, etc.
Builds can be found here: FTP or HTTP
You can post your feedback below or in this etherpad.
Be sure to install the Add-on Compatibility Reporter if you want to report incompatibilities.
Beta 4
Builds: FTP, HTTP
Litmus: testrun, report
- Checklist
- [DONE] Functional automated tests, synced to Litmus
- [DONE] Manual smoketests
- [DONE] Manual focused tests
- [ON TRACK] Bug fix verifications
- {{ |}} Check with Support for top issues from previous Beta/Release
- {{ |}} Check with Marcia for top-crashers spiking
- [DONE] Update tests
- [ON TRACK] Get final sign-off from Bob Moss
Automated Tests
The following are the detailed results of the automated BFT test runs.
Platform | Assignee | Result: |
Windows 2000 | ashughes | PASS - 2012-01-11 |
Windows XP | ashughes | PASS - 2012-01-11 |
Windows Vista | ashughes | PASS - 2012-01-11 |
Windows 7 32-bit | ashughes | PASS - 2012-01-11 |
Windows 7 64-bit | ashughes | PASS - 2012-01-11 |
Mac OS X 10.6 | ashughes | PASS - 2012-01-11 |
Mac OS X 10.7 | ashughes | PASS - 2012-01-11 |
Ubuntu 11.10 32-bit | ashughes | PASS - 2012-01-11 |
Ubuntu 11.10 64-bit | ashughes | PASS - 2012-01-11 |
- Test Failures
- Brasstacks report not available due to system outage
Manual Tests
Smoketests
The following are the detailed results of the manual smoketests.
Platform | Assignee | Result |
Windows 2000 | Simona | PASS - 2012-01-12 |
Windows XP | Ioana | PASS - 2012-01-12 |
Windows Vista | Simona | PASS - 2012-01-12 |
Windows 7 32-bit | Mihaela | PASS - 2012-01-12 |
Windows 7 64-bit | Paul | PASS - 2012-01-12 |
Mac OS X 10.6.8 | VladG | PASS - 2012-01-12 |
Mac OS X 10.7.2 | VladG | PASS - 2012-01-12 |
Ubuntu 11.10 32-bit | Ioana | PASS - 2012-01-12 |
Ubuntu 11.10 64-bit | Virgil | PASS - 2012-01-12 |
Reports | ||
Litmus |
Focused Tests
The following are the detailed results of the focused feature testing. Provide much detail about your testing: test cases, steps, bugs filed, URLs, add-on/plugin versions, platforms tested, etc
- Priority Focused Testing
- [DONE] Default Compatible Add-ons - Etherpad - PASS-2012-01-13
- [DONE] Add-on Hot Fix - Etherpad - PASS-2012-01-13
- [DONE] GC/CC Pause Regression Hunting Etherpad
- [DONE] Web App Compatibility Etherpad - PASS-2012-01-13
- [DONE] Plug-in hangs/crashes Etherpad - PASS-2012-01-13
- [DONE] Rich Profile Updates Etherpad - PASS-2012-01-13
Update Tests
The following are details of update verifications
Platform | Assignee | Releasetest: |
Beta: |
Windows 2000 | ashughes | PASS - 2012-01-12 | PASS - 2012-01-13 |
Windows XP | ashughes | PASS - 2012-01-12 | PASS - 2012-01-13 |
Windows Vista | ashughes | PASS - 2012-01-12 | PASS - 2012-01-13 |
Windows 7 32-bit | ashughes | PASS - 2012-01-12 | PASS - 2012-01-13 |
Windos 7 64-bit | ashughes | PASS - 2012-01-12 | PASS - 2012-01-13 |
Mac OS X 10.6 | ashughes | PASS - 2012-01-12 | PASS - 2012-01-13 |
Mac OS 10.7 | ashughes | PASS - 2012-01-12 | PASS - 2012-01-13 |
Ubuntu 11.10 32-bit | ashughes | PASS - 2012-01-12 | PASS - 2012-01-13 |
Ubuntu 11.10 64-bit | ashughes | PASS - 2012-01-12 | PASS - 2012-01-13 |
- Issues
Bug Fix Verifications
The following are the detailed results of verifications of bug fixes landed in Beta.
- Any fix you very should have the status-firefox10 flag set to verified
- If the fix has been verified on all affected versions of Firefox, change [qa+] in the whiteboard to [qa!]
- Queries
- QA+: 53 bugs (24 security fixes, 29 functional fixes)
- RESULTS: 10 bugs VERIFIED
- FIXED: 5 bugs (4 QA+, 1 QA?, 0 QA-)
- Spreadsheet: softvision verifications
Issues Found
Bug ID | Summary | Reporter | Status |
bug 715697 | Youtube video becomes choppy when running six videos simultaneously | Jason Smith | NEW |
bug 715692 | Strange content corruption after restoring session | Mike Conley | NEW |
bug 715675 | Tab dragged to new window has no tab widget | Steve Workman | NEW |
bug 715454 | Current group is switched when using switch-to-tab and opening new tab group | Virgil | NEW |
bug 715457 | HTML5 youtube video on pause starts playing when expand/reduce the player | Paul | UNCONFIRMED |
bug 671894 | addons.xpi: Failed to open database (NS_ERROR_STORAGE_BUSY) | Commented (Virgil) | NEW |
bug 716557 | Unable to select which settings to import from another browser when running Firefox for the first time | Paul | NEW |
bug 717616 | Empty jsloader and jsloader\resource directories added to the Firefox 10.0b4 installer and thereby to the installation which do not get removed on uninstall | Paul | NEW |
Known Issues
Bug ID | Summary | Status | Blocker? |
bug 714320 | Firefox Crash [@ nsStyleContext::AddChild(nsStyleContext*) ] | Regression | ? |
bug 713991 | Geolocation fails when used with large number of access points | RESOLVED | N/A |
bug 714037 | Text box displayed incorrectly on youtube html5 in Linux overlap text box | Tech Evangelism | N/A |
bug 714045 | Site favicon not displayed in Panorama if entering Panorama before site has loaded completely | Regression | NO |
bug 714173 | Getting "There was a problem submitting your report" messages when trying to submit Mac crashes | Network? | NO |
bug 714203 | Screen Artifacts seen while running Lights demo | NEW | NO |
bug 714272 | Desktop icon on Tools/Options panel disappears if choosing to 'Save files to' Desktop | Regression | NO |
bug 712950 | No puzzle pieces shown for missing plugins | NEW | No |
bug 711742 | HTML5 video's "Save Video As" saves an empty .webm file if you have not actually played the video | NEW | No |
bug 708557 | Html5 youtube context menu not persistent when right clicking | NEW | No |
bug 689121 | Plugin container crash for flash stress test (corner case) - opening same content in 10 tabs | NEW | No |
bug 639480 | Frequent crash of Adobe Shockwave for Director plugin on Mac OS X [@ IMLLib@0x3fd52] | NEW | No |
bug 573699 | No notification bar displayed in Add-ons manager > Plugins when installed plugins are outdated | NEW | No |
bug 638770 | clicking on a quicktime video pauses it | NEW | No |
bug 585822 | Session Restore does not resume download | NEW | No |
bug 590994 | Allow themes to set 'chromemargin' | NEW | No |
Feedback 10b4
If you want to help test and just send us general feedback, please do so below. Areas we are looking for feedback include but are not limited to hangs, crashes, add-on compatibility, youtube, facebook, twitter, etc.
Builds can be found here: FTP or HTTP
You can post your feedback below or in this etherpad.
Be sure to install the Add-on Compatibility Reporter if you want to report incompatibilities.
Beta 5
Builds: FTP, HTTP
Litmus: testrun, report
- Checklist
- [DONE] Functional automated tests, synced to Litmus
- [DONE] Manual smoketests
- [DONE] Manual focused tests
- [ON TRACK] Bug fix verifications
- [ON TRACK] Check with Support for top issues from previous Beta/Release
- [ON TRACK] Check with Marcia for top-crashers spiking
- [DONE] Update tests
- [DONE] Get final sign-off from Bob Moss
Automated Tests
The following are the detailed results of the automated BFT test runs.
Platform | Assignee | Result: report |
Windows 2000 | ashughes | PASS - 2012-01-18 |
Windows XP | ashughes | PASS - 2012-01-18 |
Windows Vista | ashughes | PASS - 2012-01-18 |
Windows 7 32-bit | ashughes | PASS - 2012-01-18 |
Windows 7 64-bit | ashughes | PASS - 2012-01-18 |
Mac OS X 10.6 | ashughes | PASS - 2012-01-18 |
Mac OS X 10.7 | ashughes | PASS - 2012-01-18 |
Ubuntu 11.10 32-bit | ashughes | PASS - 2012-01-18 |
Ubuntu 11.10 64-bit | ashughes | PASS - 2012-01-18 |
- Test Failures
- Brasstacks report not available due to system outage
Manual Tests
Smoketests
The following are the detailed results of the manual smoketests.
Platform | Assignee | Result |
Windows 2000 | Simona | PASS - 2012-01-19 |
Windows XP | Ioana | PASS - 2012-01-19 |
Windows Vista | Simona | PASS - 2012-01-19 |
Windows 7 32-bit | Virgil | PASS - 2012-01-19 |
Windows 7 64-bit | Paul | PASS - 2012-01-19 |
Mac OS X 10.6.8 | VladG | PASS - 2012-01-19 |
Mac OS X 10.7.2 | VladG | PASS - 2012-01-19 |
Ubuntu 11.10 32-bit | Ioana | PASS - 2012-01-19 |
Ubuntu 11.10 64-bit | Virgil | PASS - 2012-01-19 |
Reports | ||
Litmus |
Focused Tests
The following are the detailed results of the focused feature testing. Provide much detail about your testing: test cases, steps, bugs filed, URLs, add-on/plugin versions, platforms tested, etc
- Priority Focused Testing
- [ON TRACK] Default Compatible Add-ons - Spreadsheet
- [DONE] Add-on Hot Fix - Etherpad
- [ON TRACK] GC/CC Pause Regression Hunting Etherpad
- [DONE] Web App Compatibility Etherpad
- [DONE] Plug-in hangs/crashes Etherpad
- [DONE] Rich Profile Updates Etherpad
Update Tests
The following are details of update verifications
- DELAYED DUE TO bug 719708
Platform | Assignee | Releasetest: report | Beta: report |
Windows 2000 | ashughes | PASS - 2012-01-20 | PASS - 2012-01-20 |
Windows XP | ashughes | PASS - 2012-01-20 | PASS - 2012-01-20 |
Windows Vista | ashughes | PASS - 2012-01-20 | PASS - 2012-01-20 |
Windows 7 32-bit | ashughes | PASS - 2012-01-20 | PASS - 2012-01-20 |
Windos 7 64-bit | ashughes | PASS - 2012-01-20 | PASS - 2012-01-20 |
Mac OS X 10.6 | ashughes | PASS - 2012-01-20 | PASS - 2012-01-20 |
Mac OS 10.7 | ashughes | PASS - 2012-01-20 | PASS - 2012-01-20 |
Ubuntu 11.10 32-bit | ashughes | PASS - 2012-01-20 | PASS - 2012-01-20 |
Ubuntu 11.10 64-bit | ashughes | PASS - 2012-01-20 | PASS - 2012-01-20 |
- Issues
Bug Fix Verifications
The following are the detailed results of verifications of bug fixes landed in Beta.
- Any fix you very should have the status-firefox10 flag set to verified
- If the fix has been verified on all affected versions of Firefox, change [qa+] in the whiteboard to [qa!]
- Queries
- QA+: 53 bugs (24 security fixes, 29 functional fixes)
- RESULTS: 10 bugs VERIFIED
- FIXED: 5 bugs (4 QA+, 1 QA?, 0 QA-)
- Spreadsheet: softvision verifications
Issues Found
Bug ID | Summary | Reporter | Status |
bug 719380 | Html5 video flickers in full screen mode | VladG | NEW |
bug 382906 | Java applet causes location bar to be unresponsive | Anthony | NEW |
bug 719760 | Shockwave for Director plugin keeps on crashing | VladG | NEW |
Known Issues
Bug ID | Summary | Status | Blocker? |
bug 714320 | Firefox Crash [@ nsStyleContext::AddChild(nsStyleContext*) ] | Regression | ? |
bug 713991 | Geolocation fails when used with large number of access points | RESOLVED | N/A |
bug 714037 | Text box displayed incorrectly on youtube html5 in Linux overlap text box | Tech Evangelism | N/A |
bug 714045 | Site favicon not displayed in Panorama if entering Panorama before site has loaded completely | Regression | NO |
bug 714173 | Getting "There was a problem submitting your report" messages when trying to submit Mac crashes | Network? | NO |
bug 714203 | Screen Artifacts seen while running Lights demo | NEW | NO |
bug 714272 | Desktop icon on Tools/Options panel disappears if choosing to 'Save files to' Desktop | Regression | NO |
bug 712950 | No puzzle pieces shown for missing plugins | NEW | No |
bug 711742 | HTML5 video's "Save Video As" saves an empty .webm file if you have not actually played the video | NEW | No |
bug 708557 | Html5 youtube context menu not persistent when right clicking | NEW | No |
bug 689121 | Plugin container crash for flash stress test (corner case) - opening same content in 10 tabs | NEW | No |
bug 639480 | Frequent crash of Adobe Shockwave for Director plugin on Mac OS X [@ IMLLib@0x3fd52] | NEW | No |
bug 573699 | No notification bar displayed in Add-ons manager > Plugins when installed plugins are outdated | NEW | No |
bug 638770 | clicking on a quicktime video pauses it | NEW | No |
bug 585822 | Session Restore does not resume download | NEW | No |
bug 590994 | Allow themes to set 'chromemargin' | NEW | No |
bug 709029 | The RealPlayer plugin crashes when trying to play a RealPlayer video | NEW | No |
Feedback 10 Beta 5
If you want to help test and just send us general feedback, please do so below. Areas we are looking for feedback include but are not limited to hangs, crashes, add-on compatibility, youtube, facebook, twitter, etc.
Builds can be found here: http or HTTP
You can post your feedback below or in this etherpad.
Be sure to install the Add-on Compatibility Reporter if you want to report incompatibilities.
Beta 6
Builds: FTP, HTTP
Litmus: testrun, report
- Checklist
- {{ |}} Functional automated tests, synced to Litmus
- [DONE] Manual smoketests
- [DONE] Manual focused tests
- [ON TRACK] Bug fix verifications
- [ON TRACK] Check with Support for top issues from previous Beta/Release
- [ON TRACK] Check with Marcia for top-crashers spiking
- {{ |}} Update tests
- {{ |}} Get final sign-off from Bob Moss
Automated Tests
The following are the detailed results of the automated BFT test runs.
Platform | Assignee | Result: report |
Windows 2000 | ashughes | PASS - 2012-01-24 |
Windows XP | ashughes | PASS - 2012-01-24 |
Windows Vista | ashughes | PASS - 2012-01-24 |
Windows 7 32-bit | ashughes | PASS - 2012-01-24 |
Windows 7 64-bit | ashughes | PASS - 2012-01-24 |
Mac OS X 10.6 | ashughes | PASS - 2012-01-24 |
Mac OS X 10.7 | ashughes | PASS - 2012-01-24 |
Ubuntu 11.10 32-bit | ashughes | PASS - 2012-01-24 |
Ubuntu 11.10 64-bit | ashughes | PASS - 2012-01-24 |
- Test Failures
- Brasstacks report not available due to system outage
Manual Tests
Smoketests
The following are the detailed results of the manual smoketests.
Platform | Assignee | Result |
Windows 2000 | Simona | PASS - 2012-01-25 |
Windows XP | Ioana | PASS - 2012-01-25 |
Windows Vista | Simona | PASS - 2012-01-25 |
Windows 7 32-bit | Mihaela | PASS - 2012-01-25 |
Windows 7 64-bit | Mihaela | PASS - 2012-01-25 |
Mac OS X 10.6.8 | VladG | PASS - 2012-01-25 |
Mac OS X 10.7.2 | VladG | PASS - 2012-01-25 |
Ubuntu 11.10 32-bit | Ioana | PASS - 2012-01-25 |
Ubuntu 11.10 64-bit | Virgil | PASS - 2012-01-25 |
Reports | ||
Litmus |
Focused Tests
The following are the detailed results of the focused feature testing. Provide much detail about your testing: test cases, steps, bugs filed, URLs, add-on/plugin versions, platforms tested, etc
- Priority Focused Testing
- [DONE] Default Compatible Add-ons - Spreadsheet Etherpad
- [DONE] Add-on Hot Fix - Etherpad
- [ON TRACK] GC/CC Pause Regression Hunting Etherpad
- [DONE] Web App Compatibility Etherpad
- [DONE] Plug-in hangs/crashes Etherpad
- [DONE] Rich Profile Updates Etherpad
Update Tests
The following are details of update verifications
Platform | Assignee | Releasetest: report | Beta: report |
Windows 2000 | ashughes | PASS - 2012-01-25 | PASS - 2012-01-26 |
Windows XP | ashughes | PASS - 2012-01-25 | PASS - 2012-01-26 |
Windows Vista | ashughes | PASS - 2012-01-25 | PASS - 2012-01-26 |
Windows 7 32-bit | ashughes | PASS - 2012-01-25 | PASS - 2012-01-26 |
Windos 7 64-bit | ashughes | PASS - 2012-01-25 | PASS - 2012-01-26 |
Mac OS X 10.6 | ashughes | PASS - 2012-01-25 | PASS - 2012-01-26 |
Mac OS 10.7 | juanb | PASS - 2012-01-25 | PASS - 2012-01-26 |
Ubuntu 11.10 32-bit | ashughes | PASS - 2012-01-25 | PASS - 2012-01-26 |
Ubuntu 11.10 64-bit | ashughes | PASS - 2012-01-25 | PASS - 2012-01-26 |
- Issues
Bug Fix Verifications
The following are the detailed results of verifications of bug fixes landed in Beta.
- Any fix you very should have the status-firefox10 flag set to verified
- If the fix has been verified on all affected versions of Firefox, change [qa+] in the whiteboard to [qa!]
- Queries
- QA+: 53 bugs (24 security fixes, 29 functional fixes)
- RESULTS: 10 bugs VERIFIED
- FIXED: 5 bugs (4 QA+, 1 QA?, 0 QA-)
- Spreadsheet: softvision verifications
Issues Found
Bug ID | Summary | Reporter | Status |
bug 719380 | Html5 video flickers in full screen mode | VladG | NEW |
bug 382906 | Java applet causes location bar to be unresponsive | Anthony | NEW |
bug 719760 | Shockwave for Director plugin keeps on crashing | VladG | NEW |
Known Issues
Bug ID | Summary | Status | Blocker? |
bug 714320 | Firefox Crash [@ nsStyleContext::AddChild(nsStyleContext*) ] | Regression | ? |
bug 713991 | Geolocation fails when used with large number of access points | RESOLVED | N/A |
bug 714037 | Text box displayed incorrectly on youtube html5 in Linux overlap text box | Tech Evangelism | N/A |
bug 714045 | Site favicon not displayed in Panorama if entering Panorama before site has loaded completely | Regression | NO |
bug 714173 | Getting "There was a problem submitting your report" messages when trying to submit Mac crashes | Network? | NO |
bug 714203 | Screen Artifacts seen while running Lights demo | NEW | NO |
bug 714272 | Desktop icon on Tools/Options panel disappears if choosing to 'Save files to' Desktop | Regression | NO |
bug 712950 | No puzzle pieces shown for missing plugins | NEW | No |
bug 711742 | HTML5 video's "Save Video As" saves an empty .webm file if you have not actually played the video | NEW | No |
bug 708557 | Html5 youtube context menu not persistent when right clicking | NEW | No |
bug 689121 | Plugin container crash for flash stress test (corner case) - opening same content in 10 tabs | NEW | No |
bug 639480 | Frequent crash of Adobe Shockwave for Director plugin on Mac OS X [@ IMLLib@0x3fd52] | NEW | No |
bug 573699 | No notification bar displayed in Add-ons manager > Plugins when installed plugins are outdated | NEW | No |
bug 638770 | clicking on a quicktime video pauses it | NEW | No |
bug 585822 | Session Restore does not resume download | NEW | No |
bug 590994 | Allow themes to set 'chromemargin' | NEW | No |
bug 709029 | The RealPlayer plugin crashes when trying to play a RealPlayer video | NEW | No |
Feedback 10 Beta 6
If you want to help test and just send us general feedback, please do so below. Areas we are looking for feedback include but are not limited to hangs, crashes, add-on compatibility, youtube, facebook, twitter, etc.
Builds can be found here: http or HTTP
You can post your feedback below or in this etherpad.
Be sure to install the Add-on Compatibility Reporter if you want to report incompatibilities.
RC
Builds: FTP, HTTP
Litmus: testrun, report
- Checklist
- [DONE] Functional automated tests, synced to Litmus
- [DONE] Manual smoketests
- [DONE] Manual focused tests
- [ON TRACK] Bug fix verifications
- [ON TRACK] Check with Support for top issues from previous Beta/Release
- [DONE] Check with Marcia for top-crashers spiking
- [ON TRACK] Update tests
- [ON TRACK] Get final sign-off from Bob Moss
Automated Tests
The following are the detailed results of the automated BFT test runs.
Platform | Assignee | Result: report |
Windows 2000 | ashughes | PASS - 2012-01-29 |
Windows XP | ashughes | PASS - 2012-01-29 |
Windows Vista | ashughes | PASS - 2012-01-29 |
Windows 7 32-bit | ashughes | PASS - 2012-01-29 |
Windows 7 64-bit | ashughes | PASS - 2012-01-29 |
Mac OS X 10.6 | ashughes | PASS - 2012-01-29 |
Mac OS X 10.7 | ashughes | PASS - 2012-01-29 |
Ubuntu 11.10 32-bit | ashughes | PASS - 2012-01-29 |
Ubuntu 11.10 64-bit | ashughes | PASS - 2012-01-29 |
- Test Failures
Manual Tests
Smoketests
The following are the detailed results of the manual smoketests.
Platform | Assignee | Result |
Windows 2000 | Simona | PASS - 2012-01-31 |
Windows XP | juanb | PASS - 2012-01-29 |
Windows Vista | juanb | PASS - 2012-01-29 |
Windows 7 32-bit | juanb | PASS - 2012-01-29 |
Windows 7 64-bit | Mihaela | PASS - 2012-01-31 |
Mac OS X 10.6.8 | VladG | PASS - 2012-01-31 |
Mac OS X 10.7.2 | VladG | PASS - 2012-01-31 |
Ubuntu 11.10 32-bit | Ioana | PASS - 2012-01-31 |
Ubuntu 11.10 64-bit | Virgil | PASS - 2012-01-31 |
Reports | ||
Litmus |
Focused Tests
The following are the detailed results of the focused feature testing. Provide much detail about your testing: test cases, steps, bugs filed, URLs, add-on/plugin versions, platforms tested, etc
- Priority Focused Testing
Update Tests
The following are details of update verifications
Platform | Assignee | Releasetest: report | Beta: report |
Windows 2000 | ashughes | PASS - 2012-01-30 | PASS - 2012-01-31 |
Windows XP | ashughes | PASS - 2012-01-30 | PASS - 2012-01-31 |
Windows Vista | ashughes | PASS - 2012-01-30 | PASS - 2012-01-31 |
Windows 7 32-bit | ashughes | PASS - 2012-01-30 | PASS - 2012-01-31 |
Windos 7 64-bit | ashughes | PASS - 2012-01-30 | PASS - 2012-01-31 |
Mac OS X 10.6 | ashughes | PASS - 2012-01-30 | PASS - 2012-01-31 |
Mac OS 10.7 | ashughes | PASS - 2012-01-30 | PASS - 2012-01-31 |
Ubuntu 11.10 32-bit | ashughes | PASS - 2012-01-30 | PASS - 2012-01-31 |
Ubuntu 11.10 64-bit | ashughes | PASS - 2012-01-30 | PASS - 2012-01-31 |
- Issues
Bug Fix Verifications
The following are the detailed results of verifications of bug fixes landed in Beta.
- Any fix you very should have the status-firefox10 flag set to verified
- If the fix has been verified on all affected versions of Firefox, change [qa+] in the whiteboard to [qa!]
- Queries
- QA+: 53 bugs (24 security fixes, 29 functional fixes)
- RESULTS: 10 bugs VERIFIED
- FIXED: 5 bugs (4 QA+, 1 QA?, 0 QA-)
- Spreadsheet: softvision verifications
Issues Found
Bug ID | Summary | Reporter | Status |
Known Issues
Bug ID | Summary | Status | Blocker? |
bug 714320 | Firefox Crash [@ nsStyleContext::AddChild(nsStyleContext*) ] | Regression | ? |
bug 713991 | Geolocation fails when used with large number of access points | RESOLVED | N/A |
bug 714037 | Text box displayed incorrectly on youtube html5 in Linux overlap text box | Tech Evangelism | N/A |
bug 714045 | Site favicon not displayed in Panorama if entering Panorama before site has loaded completely | Regression | NO |
bug 714173 | Getting "There was a problem submitting your report" messages when trying to submit Mac crashes | Network? | NO |
bug 714203 | Screen Artifacts seen while running Lights demo | NEW | NO |
bug 714272 | Desktop icon on Tools/Options panel disappears if choosing to 'Save files to' Desktop | Regression | NO |
bug 712950 | No puzzle pieces shown for missing plugins | NEW | No |
bug 711742 | HTML5 video's "Save Video As" saves an empty .webm file if you have not actually played the video | NEW | No |
bug 708557 | Html5 youtube context menu not persistent when right clicking | NEW | No |
bug 689121 | Plugin container crash for flash stress test (corner case) - opening same content in 10 tabs | NEW | No |
bug 639480 | Frequent crash of Adobe Shockwave for Director plugin on Mac OS X [@ IMLLib@0x3fd52] | NEW | No |
bug 573699 | No notification bar displayed in Add-ons manager > Plugins when installed plugins are outdated | NEW | No |
bug 638770 | clicking on a quicktime video pauses it | NEW | No |
bug 585822 | Session Restore does not resume download | NEW | No |
bug 590994 | Allow themes to set 'chromemargin' | NEW | No |
bug 709029 | The RealPlayer plugin crashes when trying to play a RealPlayer video | NEW | No |
bug 719380 | Html5 video flickers in full screen mode | VladG | NEW |
bug 382906 | Java applet causes location bar to be unresponsive | Anthony | NEW |
bug 719760 | Shockwave for Director plugin keeps on crashing | VladG | NEW |
Feedback 10 RC
If you want to help test and just send us general feedback, please do so below. Areas we are looking for feedback include but are not limited to hangs, crashes, add-on compatibility, youtube, facebook, twitter, etc.
Builds can be found here: http or HTTP
You can post your feedback below or in this etherpad.
Be sure to install the Add-on Compatibility Reporter if you want to report incompatibilities.
Firefox 10.0.1
Builds: FTP, HTTP
Litmus: testrun, report
- Checklist
- [DONE] Functional automated tests, synced to Litmus
- [DONE] Manual smoketests
- [DONE] Manual focused tests
- {{ |}} Bug fix verifications
- {{ |}} Update tests
- {{ |}} Get final sign-off from Bob Moss
Automated Tests
The following are the detailed results of the automated BFT test runs.
Platform | Assignee | Result: report |
Windows 2000 | ashughes | PASS - 2012-02-08 |
Windows XP | ashughes | PASS - 2012-02-08 |
Windows Vista | ashughes | PASS - 2012-02-08 |
Windows 7 32-bit | ashughes | PASS - 2012-02-08 |
Windows 7 64-bit | ashughes | PASS - 2012-02-08 |
Mac OS X 10.6 | ashughes | PASS - 2012-02-08 |
Mac OS X 10.7 | ashughes | PASS - 2012-02-08 |
Ubuntu 11.10 32-bit | ashughes | PASS - 2012-02-08 |
Ubuntu 11.10 64-bit | ashughes | PASS - 2012-02-08 |
- Test Failures
- testSecurity/testSafeBrowsingWarningPages (known, bug 705182)
- testSecurity/testSubmitUnencryptedInfoWarning (bug 725486)
- report
Manual Tests
Smoketests
The following are the detailed results of the manual smoketests.
Platform | Assignee | Result |
Windows 2000 | Simona | PASS - 2012-02-09 |
Windows XP | Ioana | PASS - 2012-02-09 |
Windows Vista | Simona | PASS - 2012-02-09 |
Windows 7 32-bit | Mihaela | PASS - 2012-02-09 |
Windows 7 64-bit | Paul | PASS - 2012-02-09 |
Mac OS X 10.6.8 | Mihaela | PASS - 2012-02-09 |
Mac OS X 10.7.2 | Virgil | PASS - 2012-02-09 |
Ubuntu 11.10 32-bit | Ioana | PASS - 2012-02-09 |
Ubuntu 11.10 64-bit | Virgil | PASS - 2012-02-09 |
Reports | ||
Litmus |
Focused Tests
The following are the detailed results of the focused feature testing. Provide much detail about your testing: test cases, steps, bugs filed, URLs, add-on/plugin versions, platforms tested, etc
- Priority Focused Testing
Update Tests
The following are details of update verifications
Platform | Assignee | Releasetest: report | Release: report |
Windows 2000 | ashughes | PASS - 2012-02-09 | PASS - 2012-02-10 |
Windows XP | ashughes | PASS - 2012-02-09 | PASS - 2012-02-10 |
Windows Vista | ashughes | PASS - 2012-02-09 | PASS - 2012-02-10 |
Windows 7 32-bit | ashughes | PASS - 2012-02-09 | PASS - 2012-02-10 |
Windos 7 64-bit | ashughes | PASS - 2012-02-09 | PASS - 2012-02-10 |
Mac OS X 10.6 | ashughes | PASS - 2012-02-09 | PASS - 2012-02-10 |
Mac OS 10.7 | ashughes | PASS - 2012-02-09 | PASS - 2012-02-10 |
Ubuntu 11.10 32-bit | ashughes | PASS - 2012-02-09 | PASS - 2012-02-10 |
Ubuntu 11.10 64-bit | ashughes | PASS - 2012-02-09 | PASS - 2012-02-10 |
- Issues
Bug Fix Verifications
The following are the detailed results of verifications of bug fixes landed in Firefox 10.0.1
- Any fix you very should have the status-firefox10 flag set to verified
- If the fix has been verified on all affected versions of Firefox, change [qa+] in the whiteboard to [qa!]
- Queries
- https://bugzilla.mozilla.org/show_bug.cgi?id=724284 (Top crasher)
- https://bugzilla.mozilla.org/show_bug.cgi?id=718939 (Java applets and text boxes in chrome)
Issues Found
Bug ID | Summary | Reporter | Status |
bug 725614 | F11 key fails to toggle full screen mode on pages containig Java/Shockwave apps (for some scenarios) | Mihaela Velimiroviciu | NEW |
bug 725296 | Browser is unresponsive while Silverlight content is loading | Mihaela Velimiroviciu | NEW |
bug 725306 | (Vimeo) Video doesn't enter full screen correctly when using context menu | Mihaela Velimiroviciu | NEW |
Known Issues
Bug ID | Summary | Status | Blocker? |
bug 711742 | HTML5 video's "Save Video As" saves an empty .webm file if you have not actually played the video | NEW | No |
bug 709029 | The RealPlayer plugin crashes when trying to play a RealPlayer video | NEW | No |
bug 78414 | (PluginShortcuts) Application shortcut keys (keyboard commands such as f11, ctrl+t, ctrl+r) fail to operate when plug-in (flash, acrobat, quicktime) has focus | NEW | No |
bug 675645 | Firefox freezes when using Pop out while in Fullscreen mode on Youtube | NEW | No |
bug 638770 | clicking on a quicktime video pauses it | NEW | No |
Feedback 10.0.1
If you want to help test and just send us general feedback, please do so below. Areas we are looking for feedback include but are not limited to hangs, crashes, add-on compatibility, youtube, facebook, twitter, etc.
Builds can be found here: http or HTTP
Firefox 10.0.2
Builds: FTP, HTTP
Litmus: testrun, report
Mozmill: report
- Checklist
- [DONE] Functional automated tests, synced to Litmus
- [DONE] Manual smoketests
- [DONE] Bug fix verifications
- [DONE] Update tests on releasetest
- [DONE] Get final sign-off from Bob Moss
- {{ |}} Update tests on release
Automated Tests
The following are the detailed results of the automated BFT test runs.
Platform | Result: report |
Windows 2000 | PASS - 2012-02-16 |
Windows XP | PASS - 2012-02-16 |
Windows Vista | PASS - 2012-02-16 |
Windows 7 32-bit | PASS - 2012-02-16 |
Windows 7 64-bit | PASS - 2012-02-16 |
Mac OS X 10.6 | PASS - 2012-02-16 |
Mac OS X 10.7 | PASS - 2012-02-16 |
Ubuntu 11.10 32-bit | PASS - 2012-02-16 |
Ubuntu 11.10 64-bit | PASS - 2012-02-16 |
- Test Failures
Manual Tests
Smoketests
The following are the detailed results of the manual smoketests.
Platform | Assignee | Result: report |
Windows 2000 | Simona | PASS - 2012-02-16 |
Windows XP | Ioana | PASS - 2012-02-16 |
Windows Vista | Simona | PASS - 2012-02-16 |
Windows 7 32-bit | Mihaela | PASS - 2012-02-16 |
Windows 7 64-bit | Mihaela | PASS - 2012-02-16 |
Mac OS X 10.6.8 | VladG | PASS - 2012-02-16 |
Mac OS X 10.7.3 | VladG | PASS - 2012-02-16 |
Ubuntu 11.10 32-bit | Ioana | PASS - 2012-02-16 |
Ubuntu 11.10 64-bit | Virgil | PASS - 2012-02-16 |
- Focus Testing
The following are the detailed results of the focused testing. Provide much detail about your testing: test cases, steps, bugs filed, URLs, add-on/plugin versions, platforms tested, etc
- [DONE] PNG handling exploratory testing Etherpad
Update Tests
The following are details of update verifications
Platform | Releasetest: report | Release: report |
Windows 2000 | PASS - 2012-02-16 | PASS - 2012-02-16 |
Windows XP | PASS - 2012-02-16 | PASS - 2012-02-16 |
Windows Vista | PASS - 2012-02-16 | PASS - 2012-02-16 |
Windows 7 32-bit | PASS - 2012-02-16 | PASS - 2012-02-16 |
Windos 7 64-bit | PASS - 2012-02-16 | PASS - 2012-02-16 |
Mac OS X 10.6 | PASS - 2012-02-16 | PASS - 2012-02-16 |
Mac OS 10.7 | PASS - 2012-02-16 | PASS - 2012-02-16 |
Ubuntu 11.10 32-bit | PASS - 2012-02-16 | PASS - 2012-02-16 |
Ubuntu 11.10 64-bit | PASS - 2012-02-16 | PASS - 2012-02-16 |
- Issues
3.6.13 Major Update
Platform | Releasetest: report | Release: report |
Windows 2000 | PASS - 2012-02-28 | PASS - 2012-02-28 |
Windows XP | PASS - 2012-02-28 | PASS - 2012-02-28 |
Windows Vista | PASS - 2012-02-28 | PASS - 2012-02-28 |
Windows 7 32-bit | PASS - 2012-02-28 | PASS - 2012-02-28 |
Windows 7 64-bit | PASS - 2012-02-28 | PASS - 2012-02-28 |
Mac OS X 10.6 | PASS - 2012-02-28 | PASS - 2012-02-28 |
Mac OS 10.7 | PASS - 2012-02-28 | PASS - 2012-02-28 |
Ubuntu 11.10 32-bit | PASS - 2012-02-28 | PASS - 2012-02-28 |
Bug Fix Verifications
[DONE] bug 727401 libpng: integer overflow leading to heap-buffer overflow
Issues Found
Bug | Status |
Known Issues
Bug | Status |
bug 725631 - Visiting youtube before other websites and navigating back to youtube, forward button gets disabled | NEW |
bug 701992 - Element FullScreen API should hide Sidebar | RESOLVED FIXED (in Firefox 11) |