Releases/Firefox 10 ESR/Test Plan

From MozillaWiki
Jump to: navigation, search

Contents

Firefox 10 ESR

The following is a test plan to sign-off Firefox 10 ESR for Release.

Firefox 10.0

Builds: FTP, HTTP

Checklist
  • [DONE] Functional automated tests, synced to Litmus
  • [DONE] Manual smoketests
  • [DONE] Bug fix verifications (N/A for first ESR)
  • [DONE] Update tests (N/A for first ESR)

Automated Tests

The following are the detailed results of the automated BFT test runs.

Platform Assignee Result: report
Windows 2000 ashughes PASS - 2012-01-30
Windows XP ashughes PASS - 2012-01-30
Windows Vista ashughes PASS - 2012-01-30
Windows 7 32-bit ashughes PASS - 2012-01-30
Windows 7 64-bit ashughes PASS - 2012-01-30
Mac OS X 10.6 ashughes PASS - 2012-01-30
Mac OS X 10.7 ashughes PASS - 2012-01-30
Ubuntu 11.10 32-bit ashughes PASS - 2012-01-30
Ubuntu 11.10 64-bit ashughes PASS - 2012-01-30
Test Failures

Manual Tests

The following are the detailed results of the manual tests.

Platform Assignee Smoketests
Windows 2000 Simona PASS - 2012-01-31
Windows XP Ioana PASS - 2012-01-31
Windows Vista Simona PASS - 2012-01-31
Windows 7 32-bit Mihaela PASS - 2012-01-31
Windows 7 64-bit Mihaela PASS - 2012-01-31
Mac OS X 10.6 VladG PASS - 2012-01-31
Mac OS X 10.7 VladG PASS - 2012-01-31
Ubuntu 11.10 32-bit Ioana PASS - 2012-01-31
Ubuntu 11.10 64-bit Virgil PASS - 2012-01-31

Litmus: testrun, results

Exploratory Testing
  • Check top-sites like Facebook, Youtube, Gmail, Amazon, banking websites, audio/video streaming, etc
  • Check a random assortment of top add-ons to ensure compatibility
    • The tests and results are listed in the Etherpad

Known Issues

Bug ID Summary Reporter Status
bug 719380 Html5 video flickers in full screen mode VladG NEW
bug 520600 Switching into full screen video playback mode while video is paused switches into play mode automatically Henrik Skupin NEW
bug 702894 Using esc to exit full screen video from built-in player breaks player in pre-DOM API full-screen implementation Christopher Blizzard ASSIGNED
bug 585816 no thumbnail when dragging tabs Juan Becerra RESOLVED WONTFIX
bug 671535 Videos fail to play on Windows 2000 Simona B RESOLVED WONTFIX
bug 382124 Crash Reporter (= Breakpad) doesn't write minidumps on Windows 2000 (old DbgHelp.dll / MiniDumpWriteDump()) Steve England RESOLVED WONTFIX

Firefox 10.0.1

Builds: FTP, HTTP
Litmus: testrun, report

Checklist
  • [DONE] Functional automated tests, synced to Litmus
  • [DONE] Manual tests
  • [DONE] Bug fix verifications
  • [ON TRACK] Update tests on releasetest
  • [ON TRACK] Update tests on beta

Automated Tests

The following are the detailed results of the automated BFT test runs.

Platform Assignee Result: report
Windows 2000 ashughes PASS - 2012-02-08
Windows XP ashughes PASS - 2012-02-08
Windows Vista ashughes PASS - 2012-02-08
Windows 7 32-bit ashughes PASS - 2012-02-08
Windows 7 64-bit ashughes PASS - 2012-02-08
Mac OS X 10.6 ashughes PASS - 2012-02-08
Mac OS X 10.7 ashughes PASS - 2012-02-08
Ubuntu 11.10 32-bt ashughes PASS - 2012-02-08
Ubuntu 11.10 64-bit ashughes PASS - 2012-02-08
Test Failures
  • testSecurity/testSafeBrowsingWarningPages (known, bug 705182)
  • testSecurity/testSubmitUnencryptedInfoWarning (bug 725486)

Manual Tests

The following are the detailed results of the manual testing.

Smoketests

Run the manual smoketests and report results below.

Platform Assignee Result
Windows 2000 Simona PASS with known issues - 2012-02-09
Windows XP Ioana PASS - 2012-02-09
Windows Vista Simona PASS with known issues - 2012-02-09
Windows 7 32-bit Mihaela PASS with known issues - 2012-02-09
Windows 7 64-bit Paul PASS with known issues - 2012-02-09
Mac OS X 10.6.8 Mihaela PASS - 2012-02-09
Mac OS X 10.7.2 Virgil PASS - 2012-02-09
Ubuntu 11.10 32-bit Ioana PASS - 2012-02-09
Ubuntu 11.10 64-bit Virgil PASS - 2012-02-09

Results in Litmus

Update Tests

The following are details of update verifications

Platform Releasetest: report Release: report
Windows 2000 PASS - 2012-02-09 PASS - 2012-02-10
Windows XP PASS - 2012-02-09 PASS - 2012-02-10
Windows Vista PASS - 2012-02-09 PASS - 2012-02-10
Windows 7 32-bit PASS - 2012-02-09 PASS - 2012-02-10
Windos 7 64-bit PASS - 2012-02-09 PASS - 2012-02-10
Mac OS X 10.6 PASS - 2012-02-09 PASS - 2012-02-10
Mac OS 10.7 PASS - 2012-02-09 PASS - 2012-02-10
Ubuntu 11.10 32-bit PASS - 2012-02-09 PASS - 2012-02-10
Ubuntu 11.10 64-bit PASS - 2012-02-09 PASS - 2012-02-10
Issues

Bug Fix Verifications

Bug Status
bug 718939
Java applet causes text entry fields to become semi-unresponsive
TIP: See comment 23 and 25 for steps to reproduce 		VERIFIED FIXED (juanb)
bug 724284
Use after free in nsXBLDocumentInfo::ReadPrototypeBindings 		VERIFIED FIXED (marcia)

Issues Found

Bug Notes
bug 725631
Forward button disabled by visiting Youtube before other websites 		DUPE of bug 682115?
not widely reproducible
bug 725614
Keyboard shortcuts fail on pages containing Java/Shockwave/PDF 		Not a regression, reproducible back to 3.6.26
bug 725306
Vimeo doesn't enter full screen correctly via context menu 		Regressed in Firefox 7.0a1 2011-07-28
bug 725296
Browser is unresponsive while Silverlight content is loading 		Not a regression, affects Chrome
bug 709029
RealPlayer plugin crashes when trying to play a video 		Not a regression, Firefox 4.0 (OOPP?)
bug 638770
Clicking on a quicktime video pauses it 		Trivial UX issue, not worth tracking
bug 78414
Keyboard shortcuts fail when plug-in has focus 		Very old bug, no reason to start blocking
bug 692446
Firefox prompts to install windows media player plugin even though it is already installed 		MSI bug

Firefox 10.0.2 ESR

Builds: FTP, HTTP
Litmus: testrun, report
Mozmill: [ report]

Checklist
  • [DONE] Functional automated tests, synced to Litmus
  • [DONE] Manual smoketests
  • [DONE] Bug fix verifications
  • [DONE] Focused tests
  • [DONE] Update tests on releasetest
  • {{ |}} Get final sign-off from Bob Moss
  • {{ |}} Update tests on release

Automated Tests

The following are the detailed results of the automated BFT test runs.

Platform Result: report
Windows 2000 PASS - 2012-02-16
Windows XP PASS - 2012-02-16
Windows Vista PASS - 2012-02-16
Windows 7 32-bit PASS - 2012-02-16
Windows 7 64-bit PASS - 2012-02-16
Mac OS X 10.6 PASS - 2012-02-16
Mac OS X 10.7 PASS - 2012-02-16
Ubuntu 11.10 32-bit PASS - 2012-02-16
Ubuntu 11.10 64-bit PASS - 2012-02-16
Test Failures

Manual Tests

The following are the detailed results of the manual Smoke and ESR tests.

Platform Assignee Result: report
Windows 2000 Simona PASS - 2012-02-17
Windows XP RemusPop PASS - 2012-02-17
Windows Vista Simona PASS - 2012-02-17
Windows 7 32-bit AlinT PASS - 2012-02-17
Windows 7 64-bit AlinT PASS - 2012-02-17
Mac OS X 10.6.8 AlexLakatos PASS - 2012-02-17
Mac OS X 10.7.2 AlexLakatos PASS - 2012-02-17
Ubuntu 11.10 32-bit RemusPop PASS - 2012-02-17
Ubuntu 11.10 64-bit Vlad Maniac PASS - 2012-02-17

Focus Tests

  1. [DONE] PNG handling exploratory testing Etherpad

Update Tests

The following are details of update verifications

Platform Releasetest: report Esr: report
Windows 2000 PASS - 2012-02-17 PASS - 2012-02-17
Windows XP PASS - 2012-02-17 PASS - 2012-02-17
Windows Vista PASS - 2012-02-17 PASS - 2012-02-17
Windows 7 32-bit PASS - 2012-02-17 PASS - 2012-02-17
Windows 7 64-bit PASS - 2012-02-17 PASS - 2012-02-17
Mac OS X 10.6 PASS - 2012-02-17 PASS - 2012-02-17
Mac OS 10.7 PASS - 2012-02-17 PASS - 2012-02-17
Ubuntu 11.10 32-bit PASS - 2012-02-17 PASS - 2012-02-17
Ubuntu 11.10 64-bit PASS - 2012-02-17 PASS - 2012-02-17
Issues

Bug Fix Verifications

[DONE] bug 727401 libpng: integer overflow leading to heap-buffer overflow

Issues Found

Bug Status
bug 728189
Drag a large png causes firefox to hang 		NEW
bug 728200
Dragging a large png image from browser to desktop temporary hangs 		NEW
bug 728202
Inconsistent behavior when dragging an image to an application 		NEW

Firefox 10.0.3 ESR

Respinning due to bug 733012

Builds: FTP, HTTP
Litmus: testrun, report
Mozmill: [ report]

Checklist
  • [DONE] Functional automated tests, synced to Litmus
  • [DONE] Manual smoketests
  • [DONE] Focus Tests
  • [ON TRACK] Bug fix verifications
  • {{ |}} Update tests on releasetest
  • {{ |}} Get final sign-off from Bob Moss
  • {{ |}} Update tests on esr

Automated Tests

The following are the detailed results of the automated BFT test runs.

Platform Result: report
Windows 2000 PASS - 2012-03-03
Windows XP PASS - 2012-03-03
Windows Vista PASS - 2012-03-03
Windows 7 32-bit PASS - 2012-03-03
Windows 7 64-bit PASS - 2012-03-03
Mac OS X 10.6 PASS - 2012-03-03
Mac OS X 10.7 PASS - 2012-03-03
Ubuntu 11.10 32-bit PASS - 2012-03-03
Ubuntu 11.10 64-bit PASS - 2012-03-03
Test Failures
  • testPreferredLanguage.js::testSetLanguages (bug 731158)
  • testSafeBrowsingWarningPages.js::testWarningPages (bug 705182)

Manual Tests

The following are the detailed results of the manual Smoke and ESR tests.

Platform Assignee Result: report
Windows 2000 Simona PASS - 2012-03-05
Windows XP Paul PASS - 2012-03-05
Windows Vista Simona PASS - 2012-03-05
Windows 7 32-bit Mihaela PASS - 2012-03-05
Windows 7 64-bit Paul PASS - 2012-03-05
Mac OS X 10.6.8 Vlad PASS - 2012-03-05
Mac OS X 10.7.3 Vlad PASS - 2012-03-05
Ubuntu 11.10 32-bit Virgil PASS - 2012-03-05
Ubuntu 11.10 64-bit Virgil PASS - 2012-03-05

Focus Tests

The following are the detailed results of the focused testing and running the regression tests

Platform Assignee Result: report
Windows 7 32-bit Mihaela PASS - 2012-03-05
Windows XP Paul PASS - 2012-03-05
Mac OS X 10.6.8 VladG PASS - 2012-03-05
Ubuntu 11.10 64-bit Virgil PASS - 2012-03-05

Update Tests

The following are details of update verifications

Platform Releasetest: [ report] Esr: [ report]
Windows 2000 result - YYYY-MM-DD result - YYYY-MM-DD
Windows XP result - YYYY-MM-DD result - YYYY-MM-DD
Windows Vista result - YYYY-MM-DD result - YYYY-MM-DD
Windows 7 32-bit result - YYYY-MM-DD result - YYYY-MM-DD
Windows 7 64-bit result - YYYY-MM-DD result - YYYY-MM-DD
Mac OS X 10.6 result - YYYY-MM-DD result - YYYY-MM-DD
Mac OS 10.7 result - YYYY-MM-DD result - YYYY-MM-DD
Ubuntu 11.10 32-bit result - YYYY-MM-DD result - YYYY-MM-DD
Ubuntu 11.10 64-bit result - YYYY-MM-DD result - YYYY-MM-DD
Issues
  • bug 733012 - Firefox 10.0.3esr#1 update channel defaults to nightly-esr10 instead of esr

Bug Fix Verifications

Check that the fixes ported to Firefox 10.0.3 ESR have indeed been fixed. A bug which is reproducible in Firefox 10.0.2 ESR but not in Firefox 10.0.3 ESR is fixed. When verifying a fix, set the status-firefox-esr10 flag to verified.

Fixes landed for Firefox 10.0.3 ESR: bugs (34 / 34 TRIAGED)

Softvision verifications etherpad

Issues Found

Bug Status
bug 725614 - Shortcut keys fail on pages containig Java/Shockwave/PDF after unfocus Previously known, not tracking for 10.0.3ESR
bug 725296 - Browser is unresponsive while Silverlight content is loading Previously known, not tracking for 10.0.3ESR
bug 729872 - No text cursor after HTML5 fullscreen window deactivation Previously known, tracking to fix in Firefox 13
bug 78414 - Shortcut keys fail when plug-in (flash, acrobat, quicktime) has focus Previously known, not tracking for 10.0.3ESR
bug 731981 - Missing steps for missing Shockwave plugin notification Tech Evangelism, not a Firefox bug
bug 709029 - The RealPlayer plugin crashes when trying to play a RealPlayer video Previously known, DUPE of bug 667399
bug 590963 - Google Maps - Earth View Causes Freeze Previously know, not tracking for 10.0.3ESR

Firefox 10.0.3 ESR build 2

Respin due to bug 733012

Builds: FTP, HTTP
Litmus: testrun, report
Mozmill: [ report]

Checklist
  • [DONE] Functional automated tests, synced to Litmus
  • [DONE] Manual smokestests and ESR tests
  • [DONE] Update tests on releasetest
  • [DONE] Get final sign-off from Bob Moss
  • {{ |}} Update tests on esr

Automated Tests

The following are the detailed results of the automated BFT test runs.

Platform Result: report
Windows 2000 PASS - 2012-03-09
Windows XP PASS - 2012-03-09
Windows Vista PASS - 2012-03-09
Windows 7 32-bit PASS - 2012-03-09
Windows 7 64-bit PASS - 2012-03-09
Mac OS X 10.6 PASS - 2012-03-09
Mac OS X 10.7 PASS - 2012-03-09
Ubuntu 11.10 32-bit PASS - 2012-03-09
Ubuntu 11.10 64-bit PASS - 2012-03-09
Test Failures

Manual Tests

The following are the detailed results of the manual Smoke and ESR tests.

Platform Assignee Result: report
Windows 2000 Simona PASS - 2012-03-12
Windows XP Ioana PASS - 2012-03-12
Windows Vista Simona PASS - 2012-03-12
Windows 7 32-bit Mihaela PASS - 2012-03-12
Windows 7 64-bit Paul PASS - 2012-03-12
Mac OS X 10.6.8 VladG PASS - 2012-03-12
Mac OS X 10.7.3 VladG PASS - 2012-03-12
Ubuntu 11.10 32-bit Ioana PASS - 2012-03-12
Ubuntu 11.10 64-bit Virgil PASS - 2012-03-12

Update Tests

The following are details of update verifications

Platform Releasetest: report Esr: report
Windows 2000 PASS - 2012-03-12 PASS - 2012-03-13
Windows XP PASS - 2012-03-12 PASS - 2012-03-13
Windows Vista PASS - 2012-03-12 PASS - 2012-03-13
Windows 7 32-bit PASS - 2012-03-12 PASS - 2012-03-13
Windows 7 64-bit PASS - 2012-03-12 PASS - 2012-03-13
Mac OS X 10.6 PASS - 2012-03-12 PASS - 2012-03-13
Mac OS 10.7 PASS - 2012-03-12 PASS - 2012-03-13
Ubuntu 11.10 32-bit PASS - 2012-03-12 PASS - 2012-03-13
Ubuntu 11.10 64-bit PASS - 2012-03-12 PASS - 2012-03-13
Issues

Issues Found

Bug Status
bug 711742 - HTML5 "Save Video As" saves empty .webm if not played first QA not tracking -- devs investigating
bug 734837 - Broken history when navigating to and from cnn.com QA investigating -- might be server-side issue
bug 734866 - Timeline is still seen in HTML5 full screen mode INVALID - not a Firefox bug

Firefox 10.0.4 ESR

Builds: FTP, HTTP
Litmus: testrun, report
Mozmill: functional, updates
Build ID: 20120420145309
Changeset: 64dad3d2e86e

Checklist
  • [DONE] Functional automation
  • [DONE] Sync automation to Litmus
  • [DONE] Manual smoketests
  • [DONE] Focus Tests
  • {{ |}} Bug fix verifications
  • [DONE] Update tests on releasetest
  • {{ |}} Get final sign-off from Bob Moss
  • {{ |}} Update tests on esr

Automated Tests

The following are the detailed results of the automated BFT test runs.

Platform Result: report
Windows 2000 PASS - 2012-04-22
Windows XP PASS - 2012-04-22
Windows Vista PASS - 2012-04-22
Windows 7 32-bit PASS - 2012-04-22
Windows 7 64-bit PASS - 2012-04-22
Mac OS X 10.6 PASS - 2012-04-22
Mac OS X 10.7 PASS - 2012-04-22
Ubuntu 11.10 32-bit PASS - 2012-04-22
Ubuntu 11.10 64-bit PASS - 2012-04-22
Test Failures

Manual Tests

The following are the detailed results of the manual Smoke and ESR tests.

Platform Assignee Result: report
Windows 2000 Mihaela PASS - 2012-04-23
Windows XP Ioana PASS - 2012-04-23
Windows Vista Simona PASS - 2012-04-23
Windows 7 32-bit Simona PASS - 2012-04-23
Windows 7 64-bit Teodosia PASS - 2012-04-23
Mac OS X 10.6.8 VladG PASS - 2012-04-23
Mac OS X 10.7.3 Alex PASS - 2012-04-23
Ubuntu 11.10 32-bit Simona PASS - 2012-04-23
Ubuntu 11.10 64-bit Virgil PASS - 2012-04-23

Focus Tests

The following are the detailed results of the focused testing and running the regression tests

Platform Assignee Result: report
Windows 7 32-bit Alin PASSED WITH KNOWN ISSUES - 2012-04-23
Windows XP Mihaela PASS - 2012-04-23
Mac OS X 10.6.8 Florin PASS - 2012-04-23
Ubuntu 11.10 32-bit Remus PASS - 2012-04-23

Update Tests

The following are details of update verifications

Platform Releasetest: report Esr: report
Windows 2000 PASS - 2012-04-22 PASS - 2012-04-24
Windows XP PASS - 2012-04-22 PASS - 2012-04-24
Windows Vista PASS - 2012-04-22 PASS - 2012-04-24
Windows 7 32-bit PASS - 2012-04-22 PASS - 2012-04-24
Windows 7 64-bit PASS - 2012-04-22 PASS - 2012-04-24
Mac OS X 10.6 PASS - 2012-04-22 PASS - 2012-04-24
Mac OS 10.7 PASS - 2012-04-22 PASS - 2012-04-24
Ubuntu 11.10 32-bit PASS - 2012-04-22 PASS - 2012-04-24
Ubuntu 11.10 64-bit PASS - 2012-04-22 PASS - 2012-04-24
Manual Spotchecks
  • What's New page does not display after update - PASS (2012-04-24)
Issues

Bug Fix Verifications

Check that the fixes ported to Firefox 10.0.4 ESR have indeed been fixed. A bug which is reproducible in Firefox 10.0.3 ESR but not in Firefox 10.0.4 ESR is fixed. When verifying a fix, set the status-firefox-esr10 flag to verified.

Fixes landed for Firefox 10.0.4 ESR: bugs (6 / 24 triaged)

Softvision verifications etherpad

Issues Found

Full Query
ID Summary Priority Status
678482 Scrolling in web pages with java and shockwave scrambles the content -- RESOLVED
709029 The RealPlayer plugin crashes when trying to play a RealPlayer video -- RESOLVED
747858 A horizontal line is displayed on the Play button from HTML5 videos -- RESOLVED
747909 Youtube.com In Full Screen mode - copy actions are not allowed on HTML5 videos -- RESOLVED
747946 [linux] Slow rendering in Firefox with crazybugs.ivank.net web gl game -- RESOLVED

5 Total; 0 Open (0%); 5 Resolved (100%); 0 Verified (0%);


Firefox 10.0.5 ESR

Builds FTP, HTTP
ID 20120531185831
Changeset 5713c92407dd
Checklist
  • [DONE] Functional automated tests, synced to Litmus
  • [DONE] Manual tests
  • [DONE] Bug fix verifications (target 100%)
  • [DONE] Security fix verifications (target 100%)
  • [DONE] Update tests on releasetest
  • [DONE] Get stability sign-off (marcia)
  • [DONE] Get final sign-off (bmoss)
  • [DONE] Update tests on esr

Automated Tests

Results of the Mozmill automation testruns.

Functional Tests

Platform Result: report Failures: known bugs
Windows 2000 PASS - 2012-05-31 0 - no fails
Windows XP PASS - 2012-05-31 1 - testBlueLarry.js (bug 760374)
Windows Vista PASS - 2012-05-31 0 - no fails
Windows 7 32-bit PASS - 2012-05-31 1 - testBlueLarry.js (bug 760374)
Windows 7 64-bit PASS - 2012-05-31 0 - no fails
Mac OS X 10.6 PASS - 2012-05-31 0 - no fails
Mac OS X 10.7 PASS - 2012-05-31 1 - testGetMoreSearchEngines.js (bug 760376)
Ubuntu 11.10 32-bit PASS - 2012-05-31 0 - no fails
Ubuntu 11.10 64-bit PASS - 2012-05-31 0 - no fails

Update Tests

Platform Releasetest: report Esr: report
Windows 2000 PASS - 2012-06-02 PASS - 2012-06-05
Windows XP PASS - 2012-06-02 PASS - 2012-06-05
Windows Vista PASS - 2012-06-02 PASS - 2012-06-05
Windows 7 32-bit PASS - 2012-06-02 PASS - 2012-06-05
Windows 7 64-bit PASS - 2012-06-02 PASS - 2012-06-05
Mac OS X 10.6 PASS - 2012-06-02 PASS - 2012-06-05
Mac OS X 10.7 PASS - 2012-06-02 PASS - 2012-06-05
Ubuntu 11.10 32-bit PASS - 2012-06-02 PASS - 2012-06-05
Ubuntu 11.10 -bit PASS - 2012-06-02 PASS - 2012-06-05

Smoketests

Run the Firefox 10 ESR Smoketests in Litmus and report results below.

Platform Assignee Result: report
Windows 2000 Simona PASS - 2012-06-01
Windows XP Mihaela PASS - 2012-06-03
Windows Vista Simona PASS - 2012-06-01
Windows 7 32-bit Mihaela PASS - 2012-06-01
Windows 7 64-bit Otilia PASS - 2012-06-03
Mac OS X 10.6.8 Vlad G PASS - 2012-06-03
Mac OS X 10.7.4 Vlad G PASS - 2012-06-03
Ubuntu 11.10 32-bit Ioana PASS - 2012-06-03
Ubuntu 11.10 64-bit Ioana PASS - 2012-06-03

Focus Testing

Plug-ins

  • Tests:
    • Flash (11.2, 11.3)
    • Java
    • Silverlight
    • QuickTime
    • Try videos, games, chat, document viewing, or other rich interfaces
  • Results:
    • Windows 7: PASS (Mihaela)
    • Ubuntu 11.10: PASS (Ioana)
    • Mac OSX 10.6: PASS (VladG)
  • Details & Bugs:
    • bug 759689 Flash content is not loaded using Flash 11.3 Beta

Top Site Compatibility

  • Tests:
    • YouTube: video playback, 3D, uploading large files (>100MB), commenting
    • Facebook: chat, status, pictures, video, games, timeline, groups
    • Banking website authentication and transactions
    • E-Store authentication, shopping cart, and checkout
    • keep an eye out for crashes
  • Results:
    • Windows 7: PASS (Mihaela)
    • Ubuntu 11.10: PASS (Ioana)
    • Mac OSX 10.6: PASS (VladG)
  • Details & Bugs:

Bug Fix Verifications

The following are the detailed results of verifications of bug fixes landed in Beta.

  • Any fix you very should have the status-firefox13 flag set to verified
  • If the fix has been verified on all affected versions of Firefox, change [qa+] in the whiteboard to [qa!]
Query Triaged Remaining  % Complete
QA+: for testers to verify functional fixes 8 0 100%
QA+ SG: for the Security team to verify security fixes 15 0 100%
status-firefox-esr10:fixed: for QA lead to triage for potential QA+ bugs 18 0 100%

Softvision verifications etherpad

QAWANTED

QAWANTED Bugs: 0

Issues Found

Bugzilla query error

error, http-bad-status, Array


Known Issues

Full Query
ID Summary Priority Status
520160 No context menu when watching a video in full screen mode -- RESOLVED
520600 Switching into full screen video playback mode while video is paused switches into play mode automatically -- RESOLVED
702894 Remove pre-DOM API full-screen video implementation (using esc to exit full screen video from built-in player breaks player) -- RESOLVED
747909 Youtube.com In Full Screen mode - copy actions are not allowed on HTML5 videos -- RESOLVED
759689 [adbe 3210913] Flash content is not loaded using Flash 11.3 Beta -- RESOLVED
760417 When selecting "Pop out" for HTML5 videos, the window is opened in full screen mode and the "Full screen" button is still available on its right bottom side -- RESOLVED

6 Total; 0 Open (0%); 6 Resolved (100%); 0 Verified (0%);


Firefox 10.0.6 ESR

Builds FTP, HTTP
ID 20120713125334
Changeset 6c432561c1fd
Checklist
  • [DONE] Functional automated tests, synced to Litmus
  • [DONE] Manual tests
  • [DONE] Bug fix verifications (target 100%)
  • [DONE] Security fix verifications (target 100%)
  • [DONE] Update tests on releasetest
  • [DONE] Get peer sign off
  • [DONE] Update tests on esr

Automated Tests

Results of the Mozmill automation testruns.

Functional Tests

Platform Result: report Failures: known bugs
Windows 2000 PASS - 2012-07-14 0 - no fails
Windows XP PASS - 2012-07-14 0 - no fails
Windows Vista PASS - 2012-07-14 0 - no fails
Windows 7 32-bit PASS - 2012-07-14 0 - no fails
Windows 7 64-bit PASS - 2012-07-14 0 - no fails
Mac OS X 10.6 PASS - 2012-07-14 0 - no fails
Mac OS X 10.7 PASS - 2012-07-14 0 - no fails
Ubuntu 11.10 32-bit PASS - 2012-07-14 0 - no fails
Ubuntu 11.10 64-bit PASS - 2012-07-14 0 - no fails

Update Tests

Platform Releasetest: report Esr: report
Windows 2000 PASS - 2012-07-16 PASS - 2012-07-17
Windows XP PASS - 2012-07-16 PASS - 2012-07-17
Windows Vista PASS - 2012-07-16 PASS - 2012-07-17
Windows 7 32-bit PASS - 2012-07-16 PASS - 2012-07-17
Windows 7 64-bit PASS - 2012-07-16 PASS - 2012-07-17
Mac OS X 10.6 PASS - 2012-07-16 PASS - 2012-07-17
Mac OS X 10.7 PASS - 2012-07-16 PASS - 2012-07-17
Ubuntu 11.10 32-bit PASS - 2012-07-16 PASS - 2012-07-17
Ubuntu 11.10 64-bit PASS - 2012-07-16 PASS - 2012-07-17

Smoketests

Run the Firefox 10 ESR Smoketests(smoketests and ESR tests) in Litmus and report results below.

Platform Assignee Result: report
Windows 2000 Simona PASS - 2012-07-17
Windows XP Simona PASS - 2012-07-16
Windows 7 64-bit Paul PASS - 2012-07-16
Mac OS X 10.7 Mihaela PASS - 2012-07-17
Ubuntu 12.04 Virgil PASS - 2012-07-16

Compatibility Testing

Test the most popular websites for compatibility and stability issues. Just play around with the functionality of the website and look for rendering issues, hangs, and crashes. Use the Top-10 Global and 5 random sites by category.

Bug Triage

Query 06.18 - 06.22 06.25 - 06.29 07.02 - 07.06 07.09 - 07.13 Total
UNCONFIRMED 5 triaged 0 triaged 8 triage 5 triaged 18 triaged
QAWANTED 9 triaged 0 triaged 1 triaged 0 triaged 10 resolved, 1 remain
FIXED 11 verified 0 verified 0 verified 26 verified 38 verified, 3 remain

Issues Found

Full Query
ID Summary Priority Status
774244 When HTML5 videos end - the suggestions are no longer displayed -- RESOLVED
774324 Black square is displayed on amazon when hovering the mouse over the items -- RESOLVED

2 Total; 0 Open (0%); 2 Resolved (100%); 0 Verified (0%);


Known Issues

Full Query
ID Summary Priority Status
520160 No context menu when watching a video in full screen mode -- RESOLVED
520600 Switching into full screen video playback mode while video is paused switches into play mode automatically -- RESOLVED
747909 Youtube.com In Full Screen mode - copy actions are not allowed on HTML5 videos -- RESOLVED

3 Total; 0 Open (0%); 3 Resolved (100%); 0 Verified (0%);


Firefox 10.0.7 ESR

Builds FTP, HTTP
ID 20120824135927
Changeset changeset (pushlog)
Checklist
  • [DONE] Functional automation
  • [DONE] Manual tests
  • [DONE] Bug fix verifications (target 100%)
  • [DONE] Update automation
  • [DONE] Peer sign-off
  • [DONE] Final sign-off
  • [DONE] Updates pushed/tested on ESR channel

Automated Tests

The following are the detailed results of the automated Mozmill test runs.

Platform Results: report
Windows 2000 PASS - 2012-08-25
Windows XP PASS - 2012-08-25
Windows Vista PASS - 2012-08-25
Windows 7 32-bit PASS - 2012-08-25
Windows 7 64-bit PASS - 2012-08-25
Mac OS X 10.6 PASS - 2012-08-25
Mac OS X 10.7 PASS - 2012-08-25
Ubuntu 12.04 32-bit PASS - 2012-08-25
Ubuntu 12.04 64-bit PASS - 2012-08-25
Test Failures (known bugs)
  • /testSecurity/testGreenLarry.js
  • /testSecurity/testGreyLarry.js

Manual Smoketests

Run the Firefox ESR 10.0.7 Smoketests in MozTrap and report the results below.

Platform Assignee Result: report
Windows 2000 Simona PASS - 2012-08-27
Windows XP Paul PASS - 2012-08-27
Windows 7 64-bit Paul PASS - 2012-08-27
Mac OS X 10.7 VladG PASS - 2012-08-27
Ubuntu 12.04 32-bit Virgil PASS - 2012-08-27

Regression Testing

Operating System Tester Plug-in Compatibility Add-on Compatibility Web Compatibility
Windows XP Simona PASS - 2012-08-28 PASS - 2012-08-28 PASS - 2012-08-28
Windows 7 Mihaela PASS - 2012-08-27 PASS - 2012-08-27 PASS - 2012-08-27
Mac OS X 10.7.4 VladG PASS - 2012-08-28 PASS - 2012-08-28 PASS - 2012-08-28
Ubuntu 12.04 Virgil PASS - 2012-08-27 PASS - 2012-08-27 PASS - 2012-08-27
Operating System Tester Web Mail Breakpad Security UI
Windows XP Paul, Virgil PASS - 2012-08-28 PASS - 2012-08-28 PASS - 2012-08-28
Windows 7 Mihaela PASS - 2012-08-27 PASS - 2012-08-27 PASS - 2012-08-27
Mac OS X 10.7.4 VladG PASS - 2012-08-28 PASS - 2012-08-28 PASS - 2012-08-28
Ubuntu 12.04 Virgil PASS - 2012-08-27 PASS - 2012-08-27 PASS - 2012-08-27

Plug-in Compatibility

Install the following plug-ins and go to websites which use them, looking for rendering issues, functional issues, performance issues, and crashes.

  • Adobe Flash Player
    • On Win2k - Flash 10.1.102.64 is the last supported version
  • Microsoft Silverlight
    • the latest Silverlight versions are unsupported on Windows 2000
  • RealPlayer
    • The latest Real Player version (15.0.164) is unsupported on Windows 2000.
  • QuickTime
    • QuickTime 7.1.6 is the last version that should be supported on Windows 2000 but after installing it the plug-in appears in the Add-on Manager but the browser doesn't see it (the message "get Quick Time/Download QuickTime to view this video is displayed).
  • Windows 2000 specific issues (also reproducible on other browsers)
    • Flash videos (YouTube, IMDB, Hulu, CNN) are running jerky - reproducible also on Opera 12.01 and Internet Explorer 7
    • QuickTime videos are not played, the message "Get Quick Time/Download QuickTime to view this video" is displayed even if the plug-in is already installed - reproducible also on Opera and Internet Explorer 7.

Add-on Compatibility

Test the following websites for rendering issues, functional issues, performance issues, and crashes. Pay particular attention to any problems seen after updating Firefox with add-ons installed.

  • Top AMO add-ons
  • AVG toolbar (installed via AVG software)
    • AVG Safe Search 12.0.0.1912 is not compatible with Firefox 15 beta.
    • AVG Security Toolbar can't be installed on Win XP - we get a blue screen while installing it.
  • Norton toolbar (installed via Norton software)
    • Not currently available. Investigating if we can get this software.
  • Yahoo toolbar
  • Yandex toolbar
  • Babylon toolbar
    • On Windows 2000, Babylon Toolbar can't be installed - an error is displayed at installation: "The procedure entry point GetSystemWow64DirectoryW could not be located in the dynamic link library KERNEL32.dll"

Web Compatibility

Test the following websites for rendering issues, functional issues, performance issues, and crashes

  1. Overall Top 10
  2. Top by Country (pick a random site from three random countries)
  3. Top by Category (pick a random site from three random categories)
  4. Webmail clients like gmail, hotmail, and yahoo mail (pay particular attention to any built in web messenger software)
  5. Try Google's MapsGL demo
  6. Try YouTube's HTML5 demo

Note:

  • WebGL is not supported on Win 2000

Web Mail

Test the following websites for rendering issues, functional issues, performance issues, and crashes. In particular make sure email, attachments, web messenger, and video chat are working as expected.

  1. Google Mail
  2. Yahoo Mail
  3. Hotmail
  4. Outlook.com

Breakpad End-to-End

Test the end-to-end functionality in the crash reporting feature, across operating systems.

  • Use the Crash Me add-on to trigger a crash
  • Set up a dirty profile with lots of history, bookmarks, add-ons, themes, tabs, app-tabs, plugin content loaded, etc
  • Repeatedly crash Firefox and submit your reports
  • Verify that your session restores properly
  • Verify your crash reports are submitted properly by going through about:crashes and clicking the reports
  • Try adding comments to your crash report and verify the crash-stats.com report shows the comment
  • Note
    • Breakpad doesn't work on Win2k - Bug 382124.

Security UI

Test the Security UI (under the Favicon) to verify it's working properly for various different website security levels

  • Check the UI opens and closes, displaying the accurate information
  • Check that you can get more information
  • Check View Certificates, Cookies, and Passwords
  • Check sites with Extended Validation (EV), Organization Validation (OV), and Domain Validation (DV) certificates

Update Testing

Note that we are doing partial updates for multiple source versions so we'll need to test on betatest first.

  • Partial: 10.0.6esr
  • Complete: 10.0esr - 10.0.5esr
Platform Releasetest: report ESR: report
Windows 2000 PASS - 2012-08-25 PASS - 2012-08-28
Windows XP PASS - 2012-08-25 PASS - 2012-08-28
Windows Vista PASS - 2012-08-25 PASS - 2012-08-28
Windows 7 32-bit PASS - 2012-08-25 PASS - 2012-08-28
Windows 7 64-bit PASS - 2012-08-25 PASS - 2012-08-28
Mac OS X 10.6 PASS - 2012-08-25 PASS - 2012-08-28
Mac OS X 10.7 PASS - 2012-08-25 PASS - 2012-08-28
Ubuntu 12.04 32-bit PASS - 2012-08-25 PASS - 2012-08-28
Ubuntu 12.04 64-bit PASS - 2012-08-25 PASS - 2012-08-28
Issues

Bug Triage

  1. FIXED: triage these bugs and test to ensure the fix is effective
  2. QAWANTED: triage these bugs and test to fulfill the QA request
  3. UNCONFIRMED: triage these bugs for potential new regressions
Results
  • VERIFIED: 9 (29%)
  • QA-: 13 (42%)
  • QA?: 9 (29%)
  • UNTRIAGED: 0 (0%)
  • 31 Total Bugs

Issues Found

Full Query
ID Summary Priority Status
780280 The Babylon Toolbar changes user settings without reverting them -- RESOLVED
785915 [ESR] Compose new mail message text box in outlook.com not accessible -- RESOLVED
786187 Firefox 10.0.7 crash on MacOS X 10.7.4 -- RESOLVED
786241 [ESR] Remove all cookies button disabled if selecting any cookie in the list -- RESOLVED
786288 When the Babylon Toolbar is enabled - Flash content is not properly rendered -- RESOLVED

5 Total; 0 Open (0%); 5 Resolved (100%); 0 Verified (0%);


Known Issues

Full Query
ID Summary Priority Status
520160 No context menu when watching a video in full screen mode -- RESOLVED
520600 Switching into full screen video playback mode while video is paused switches into play mode automatically -- RESOLVED
667399 RealPlayer G2 LiveConnect plugin crash -- RESOLVED
694288 Vimeo.com - embedded video player is not displayed on Windows 2000 -- RESOLVED
717178 Printing stops after 73%, and browser hangs up -- VERIFIED
747909 Youtube.com In Full Screen mode - copy actions are not allowed on HTML5 videos -- RESOLVED
774244 When HTML5 videos end - the suggestions are no longer displayed -- RESOLVED
774324 Black square is displayed on amazon when hovering the mouse over the items -- RESOLVED
779465 Delayed scrolling in PDFs -- RESOLVED

9 Total; 0 Open (0%); 8 Resolved (88.89%); 1 Verified (11.11%);


Firefox 10.0.8 ESR

Builds FTP, HTTP
ID 20121005152052
Changeset 1b43f8ae3529 (pushlog)
Checklist
  • [DONE] Functional automation
  • [DONE] Manual tests
  • [DONE] Bug fix verifications
  • [DONE] Update automation
  • [DONE] Peer sign-off
  • [DONE] Updates pushed/tested on ESR channel

Automated Tests

The following are the detailed results of the automated Mozmill test runs.

Platform Results: report
Windows 2000 PASS - 2012-10-06
Windows XP PASS - 2012-10-06
Windows Vista PASS - 2012-10-06
Windows 7 32-bit PASS - 2012-10-06
Windows 7 64-bit PASS - 2012-10-06
Mac OS X 10.6 PASS - 2012-10-06
Mac OS X 10.7 PASS - 2012-10-06
Ubuntu 12.04 32-bit PASS - 2012-10-06
Ubuntu 12.04 64-bit PASS - 2012-10-06
Test Failures (known bugs)

Manual Smoketests

Run the Firefox ESR 10.0.8 Smoketests in MozTrap and report the results below.

Platform Assignee Result: report
Windows 2000 Simona PASS - 2012-10-08
Windows XP Mihaela PASS - 2012-10-08
Windows 7 64-bit Paul PASS - 2012-10-08
Mac OS X 10.7 VladG PASS - 2012-10-08
Ubuntu 12.04 32-bit Ioana PASS - 2012-10-08

Regression Testing

Operating System Tester Plug-in Compatibility Add-on Compatibility Web Compatibility
Windows XP Mihaela PASS - 2012-10-08 PASS - 2012-10-08 PASS - 2012-10-08
Windows 7 Paul PASS - 2012-10-08 PASS - 2012-10-08 PASS - 2012-10-08
Mac OS X 10.7 VladG/Virgil PASS - 2012-10-08 PASS - 2012-10-08 PASS - 2012-10-08
Ubuntu 12.04 Ioana PASS - 2012-10-08 PASS - 2012-10-08 PASS - 2012-10-08
Operating System Tester Web Mail Breakpad
Windows XP Mihaela PASS - 2012-10-08 PASS - 2012-10-08
Windows 7 Paul PASS - 2012-10-08 FAIL - 2012-10-08 - see bug 791195
Mac OS X 10.7 VladG/Virgil PASS - 2012-10-08 PASS - 2012-10-08
Ubuntu 12.04 Ioana PASS - 2012-10-08 PASS - 2012-10-08

Plug-in Compatibility

Install the following plug-ins and go to websites which use them, looking for rendering issues, functional issues, performance issues, and crashes.

  • Adobe Flash Player
    • On Win2k - Flash 10.1.102.64 is the last supported version
  • Microsoft Silverlight
    • the latest Silverlight versions are unsupported on Windows 2000
  • RealPlayer
    • The latest Real Player version (15.0.164) is unsupported on Windows 2000.
  • QuickTime
    • QuickTime 7.1.6 is the last version that should be supported on Windows 2000 but after installing it the plug-in appears in the Add-on Manager but the browser doesn't see it (the message "get Quick Time/Download QuickTime to view this video is displayed).

Add-on Compatibility

Test the following websites for rendering issues, functional issues, performance issues, and crashes. Pay particular attention to any problems seen after updating Firefox with add-ons installed.

  • Top AMO add-ons
  • AVG toolbar (installed via AVG software)
    • AVG Safe Search 12.0.0.1912 is not compatible with Firefox 15 beta.
    • AVG Security Toolbar can't be installed on Win XP - we get a blue screen while installing it.
  • Norton toolbar (installed via Norton software)
    • Not currently available. Investigating if we can get this software.
  • Yahoo toolbar
  • Yandex toolbar
  • Babylon toolbar

Web Compatibility

Test the following websites for rendering issues, functional issues, performance issues, and crashes

  1. Overall Top 10
  2. Top by Country (pick a random site from three random countries)
  3. Top by Category (pick a random site from three random categories)
  4. Webmail clients like gmail, hotmail, and yahoo mail (pay particular attention to any built in web messenger software)
  5. Try Google's MapsGL demo
  6. Try YouTube's HTML5 demo

Web Mail

Test the following websites for rendering issues, functional issues, performance issues, and crashes. In particular make sure email, attachments, web messenger, and video chat are working as expected.

  1. Google Mail
  2. Yahoo Mail
  3. Hotmail
  4. Outlook.com

Breakpad End-to-End

Test the end-to-end functionality in the crash reporting feature, across operating systems.

  • Use the Crash Me add-on to trigger a crash
  • Set up a dirty profile with lots of history, bookmarks, add-ons, themes, tabs, app-tabs, plugin content loaded, etc
  • Repeatedly crash Firefox and submit your reports
  • Verify that your session restores properly -
  • Verify your crash reports are submitted properly by going through about:crashes and clicking the reports
  • Try adding comments to your crash report and verify the crash-stats.com report shows the comment
Issues
  • bug 791195 Session Restore loses tabs intermittently after repeated crashes
    • Not a regression, affects Firefox 4.0.1 through Nightly

Update Testing

  • Partial: 10.0.7esr
  • Complete: 10.0esr - 10.0.6esr
Platform Releasetest: report ESR: report
Windows 2000 PASS - 2012-10-08 PASS - 2012-10-09
Windows XP PASS - 2012-10-08 PASS - 2012-10-09
Windows Vista PASS - 2012-10-08 PASS - 2012-10-09
Windows 7 32-bit PASS - 2012-10-08 PASS - 2012-10-09
Windows 7 64-bit PASS - 2012-10-08 PASS - 2012-10-09
Mac OS X 10.6 PASS - 2012-10-08 PASS - 2012-10-09
Mac OS X 10.7 PASS - 2012-10-08 PASS - 2012-10-09
Ubuntu 12.04 32-bit PASS - 2012-10-08 PASS - 2012-10-09
Ubuntu 12.04 64-bit PASS - 2012-10-08 PASS - 2012-10-09
Issues

Bug Triage

  1. FIXED: triage these bugs and test to ensure the fix is effective
  2. QAWANTED: triage these bugs and test to fulfill the QA request
  3. UNCONFIRMED: triage these bugs for potential new regressions
Results

Issues Found

Full Query
ID Summary Priority Status
799075 Failure to determine geolocation on ESR builds on every other try -- RESOLVED

1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);


Known Issues

Full Query
ID Summary Priority Status
78414 Application shortcut keys (keyboard commands such as f11, ctrl+t, ctrl+r) fail to operate when plug-in (flash, acrobat, quicktime) has focus P3 RESOLVED
520160 No context menu when watching a video in full screen mode -- RESOLVED
667399 RealPlayer G2 LiveConnect plugin crash -- RESOLVED
692446 Firefox prompts to install windows media player plugin even though it is already installed -- RESOLVED
694288 Vimeo.com - embedded video player is not displayed on Windows 2000 -- RESOLVED
717178 Printing stops after 73%, and browser hangs up -- VERIFIED
747909 Youtube.com In Full Screen mode - copy actions are not allowed on HTML5 videos -- RESOLVED
779492 The youtube.com Flash pop out video player is opened in the background -- RESOLVED
786742 Firefox EXCEPTION_INVALID_HANDLE crash in js::GCHelperThread::doSweep (Correlation to Yandex Bar) -- RESOLVED
791195 Session is not restored after Firefox crash -- RESOLVED
794924 Choppy fading out for Quicktime videos -- RESOLVED

11 Total; 0 Open (0%); 10 Resolved (90.91%); 1 Verified (9.09%);


Firefox 10.0.9 ESR

Builds FTP, HTTP
ID 20121011153109
Changeset 65788d0445a7 (pushlog)
Checklist
  • [DONE] Functional automation
  • [DONE] Manual tests
  • [DONE] Bug fix verifications
  • [DONE] Update automation
  • [DONE] Peer sign-off
  • [DONE] Updates pushed/tested on ESR channel

Automated Tests

The following are the detailed results of the automated Mozmill test runs.

Platform Results: report
Windows 2000 PASS - 2012-10-11
Windows XP PASS - 2012-10-11
Windows Vista PASS - 2012-10-11
Windows 7 32-bit PASS - 2012-10-11
Windows 7 64-bit PASS - 2012-10-11
Mac OS X 10.6 PASS - 2012-10-11
Mac OS X 10.7 PASS - 2012-10-11
Ubuntu 12.04 32-bit PASS - 2012-10-11
Ubuntu 12.04 64-bit PASS - 2012-10-11
Test Failures (known bugs)

Manual Smoketests

Run the Firefox ESR 10.0.9 Smoketests in MozTrap and report the results below.

Platform Assignee Result: report
Windows 7 64-bit Manuela PASS - 2012-10-12
Mac OS X 10.7 Ioana PASS - 2012-10-12
Ubuntu 12.04 32-bit Virgil PASS - 2012-10-12

Update Testing

  • Partial: 10.0.8esr
  • Complete: 10.0esr - 10.0.7esr
Platform Releasetest: report ESR: report
Windows 2000 PASS - 2012-10-11 PASS - 2012-10-12
Windows XP PASS - 2012-10-11 PASS - 2012-10-12
Windows Vista PASS - 2012-10-11 PASS - 2012-10-12
Windows 7 32-bit PASS - 2012-10-11 PASS - 2012-10-12
Windows 7 64-bit PASS - 2012-10-11 PASS - 2012-10-12
Mac OS X 10.6 PASS - 2012-10-11 PASS - 2012-10-12
Mac OS X 10.7 PASS - 2012-10-11 PASS - 2012-10-12
Ubuntu 12.04 32-bit PASS - 2012-10-11 PASS - 2012-10-12
Ubuntu 12.04 64-bit PASS - 2012-10-11 PASS - 2012-10-12
Issues

Bug Fix Verifications

Known Issues

Full Query
ID Summary Priority Status
78414 Application shortcut keys (keyboard commands such as f11, ctrl+t, ctrl+r) fail to operate when plug-in (flash, acrobat, quicktime) has focus P3 RESOLVED
520160 No context menu when watching a video in full screen mode -- RESOLVED
520600 Switching into full screen video playback mode while video is paused switches into play mode automatically -- RESOLVED
667399 RealPlayer G2 LiveConnect plugin crash -- RESOLVED
692446 Firefox prompts to install windows media player plugin even though it is already installed -- RESOLVED
694288 Vimeo.com - embedded video player is not displayed on Windows 2000 -- RESOLVED
708557 Html5 youtube context menu not persistent when right clicking -- RESOLVED
717178 Printing stops after 73%, and browser hangs up -- VERIFIED
747909 Youtube.com In Full Screen mode - copy actions are not allowed on HTML5 videos -- RESOLVED
779492 The youtube.com Flash pop out video player is opened in the background -- RESOLVED
786742 Firefox EXCEPTION_INVALID_HANDLE crash in js::GCHelperThread::doSweep (Correlation to Yandex Bar) -- RESOLVED
791195 Session is not restored after Firefox crash -- RESOLVED
794924 Choppy fading out for Quicktime videos -- RESOLVED
799075 Failure to determine geolocation on ESR builds on every other try -- RESOLVED

14 Total; 0 Open (0%); 13 Resolved (92.86%); 1 Verified (7.14%);


Firefox 10.0.10 ESR

Builds FTP, HTTP
ID 20121024073834
Changeset bd67b391fe22 (pushlog)
Checklist
  • [DONE] Functional automation
  • [DONE] Manual tests
  • [DONE] Bug fix verifications
  • [DONE] Update automation
  • [DONE] Peer sign-off
  • [DONE] Updates pushed/tested on ESR channel

Automated Tests

The following are the detailed results of the automated Mozmill test runs.

Platform Results: report
Windows 2000 PASS - 2012-10-25
Windows XP PASS - 2012-10-25
Windows Vista PASS - 2012-10-25
Windows 7 32-bit PASS - 2012-10-25
Windows 7 64-bit PASS - 2012-10-25
Mac OS X 10.6 PASS - 2012-10-25
Mac OS X 10.7 PASS - 2012-10-25
Ubuntu 12.04 32-bit PASS - 2012-10-25
Ubuntu 12.04 64-bit PASS - 2012-10-25
Test Failures (known bugs)

Manual Smoketests

Run the Firefox ESR 10.0.10 Smoketests in MozTrap and report the results below.

Platform Assignee Result: report
Windows 2000 Manuela PASS - 2012-10-25
Windows 7 64-bit Manuela PASS - 2012-10-25
Mac OS X 10.7 Virgil PASS - 2012-10-25
Ubuntu 12.04 32-bit Ioana PASS - 2012-10-25

Update Testing

  • Partial: 10.0.9esr
  • Complete: 10.0esr - 10.0.8esr
Platform Releasetest: [ report] ESR: [ report]
Windows 2000 result - YYYY-MM-DD result - YYYY-MM-DD
Windows XP result - YYYY-MM-DD result - YYYY-MM-DD
Windows Vista result - YYYY-MM-DD result - YYYY-MM-DD
Windows 7 32-bit result - YYYY-MM-DD result - YYYY-MM-DD
Windows 7 64-bit result - YYYY-MM-DD result - YYYY-MM-DD
Mac OS X 10.6 result - YYYY-MM-DD result - YYYY-MM-DD
Mac OS X 10.7 result - YYYY-MM-DD result - YYYY-MM-DD
Ubuntu 12.04 32-bit result - YYYY-MM-DD result - YYYY-MM-DD
Ubuntu 12.04 64-bit result - YYYY-MM-DD result - YYYY-MM-DD
Issues

Bug Fix Verifications

Known Issues

Full Query
ID Summary Priority Status
78414 Application shortcut keys (keyboard commands such as f11, ctrl+t, ctrl+r) fail to operate when plug-in (flash, acrobat, quicktime) has focus P3 RESOLVED
520160 No context menu when watching a video in full screen mode -- RESOLVED
520600 Switching into full screen video playback mode while video is paused switches into play mode automatically -- RESOLVED
667399 RealPlayer G2 LiveConnect plugin crash -- RESOLVED
692446 Firefox prompts to install windows media player plugin even though it is already installed -- RESOLVED
694288 Vimeo.com - embedded video player is not displayed on Windows 2000 -- RESOLVED
708557 Html5 youtube context menu not persistent when right clicking -- RESOLVED
717178 Printing stops after 73%, and browser hangs up -- VERIFIED
747909 Youtube.com In Full Screen mode - copy actions are not allowed on HTML5 videos -- RESOLVED
779492 The youtube.com Flash pop out video player is opened in the background -- RESOLVED
786742 Firefox EXCEPTION_INVALID_HANDLE crash in js::GCHelperThread::doSweep (Correlation to Yandex Bar) -- RESOLVED
791195 Session is not restored after Firefox crash -- RESOLVED
794924 Choppy fading out for Quicktime videos -- RESOLVED
799075 Failure to determine geolocation on ESR builds on every other try -- RESOLVED

14 Total; 0 Open (0%); 13 Resolved (92.86%); 1 Verified (7.14%);


Firefox 10.0.11 ESR

Builds FTP, HTTP
ID 20121115102332
Changeset b0b7f731ed02 (pushlog)
Checklist
  • [DONE] Functional automation
  • [DONE] Manual tests
  • [DONE] Bug fix verifications
  • [DONE] Update automation on betatest channel
  • {{|}} Update automation on releasetest channel
  • {{|}} Updates automation on esr channel

Automated Tests

The following are the detailed results of the automated Mozmill test runs.

Platform Results: report
Windows 2000 2 fails - 2012-11-15
Windows XP 1 fail - 2012-11-15
Windows Vista 1 fail - 2012-11-15
Windows 7 32-bit 1 fail - 2012-11-15
Windows 7 64-bit 1 fail - 2012-11-15
Mac OS X 10.6 PASS - 2012-11-15
Mac OS X 10.7 PASS - 2012-11-15
Ubuntu 12.04 32-bit PASS - 2012-11-15
Ubuntu 12.04 64-bit PASS - 2012-11-15
Test Failures (known bugs)

Manual Smoketests

Run the Firefox ESR 10.0.11 Smoketests in MozTrap and report the results below.

Platform Assignee Result: report
Windows 2000 Simona PASS - 2012-11-16
Windows 7 64-bit Ioana PASS - 2012-11-16
Mac OS X 10.7 Manuela PASS - 2012-11-16
Ubuntu 12.04 32-bit Virgil PASS - 2012-11-16

Bug Fix Verifications

Update Testing

  • Partial: 10.0.10esr
  • Complete: 10.0esr - 10.0.9esr
Platform betatest (report) esr ([report])
Windows 2000 PASS - 2012-11-16 result - YYYY-MM-DD
Windows XP PASS - 2012-11-16 result - YYYY-MM-DD
Windows Vista PASS - 2012-11-16 result - YYYY-MM-DD
Windows 7 32-bit PASS - 2012-11-16 result - YYYY-MM-DD
Windows 7 64-bit PASS - 2012-11-16 result - YYYY-MM-DD
Mac OS X 10.6 PASS - 2012-11-16 result - YYYY-MM-DD
Mac OS X 10.7 PASS - 2012-11-16 result - YYYY-MM-DD
Ubuntu 12.04 32-bit PASS - 2012-11-16 result - YYYY-MM-DD
Ubuntu 12.04 64-bit PASS - 2012-11-16 result - YYYY-MM-DD
ESR Manual Spotchecks due to Infra issues
  • PASS Windows 2000: 10.0.10 en-US & de, 10.0.9 en-US & es-ES
  • PASS Windows 7: 10.0.10 en-US & fr, 10.0.9 en-US & it
  • PASS Ubuntu 12.04: 10.0.10 en-US & zh-TW, 10.0.9 en-US & ro
  • PASS Mac OSX 10.7: 10.0.10 en-US & ja-JP-mac, 10.0.9 en-US & de
Issues
  • bug 813699 ondemand_update scripts taking a long time to execute for Firefox 17 updates on release channel

New Issues

Report any new issues found during testing below. Any items marked in bold are considered blocking the release.

Core::Video/Audio

  • bug 812454 The context menu's items remain selected after exiting Full Screen

Plugins::QuickTime

  • bug 812479 QuickTime back/forward and mute buttons do not work

Known Issues

Full Query
ID Summary Priority Status
78414 Application shortcut keys (keyboard commands such as f11, ctrl+t, ctrl+r) fail to operate when plug-in (flash, acrobat, quicktime) has focus P3 RESOLVED
520160 No context menu when watching a video in full screen mode -- RESOLVED
520600 Switching into full screen video playback mode while video is paused switches into play mode automatically -- RESOLVED
667399 RealPlayer G2 LiveConnect plugin crash -- RESOLVED
692446 Firefox prompts to install windows media player plugin even though it is already installed -- RESOLVED
694288 Vimeo.com - embedded video player is not displayed on Windows 2000 -- RESOLVED
708557 Html5 youtube context menu not persistent when right clicking -- RESOLVED
717178 Printing stops after 73%, and browser hangs up -- VERIFIED
747073 Adobe Reader (10.1.3) doesn't work with Firefox (OSX) in default (64-bit) mode -- RESOLVED
747909 Youtube.com In Full Screen mode - copy actions are not allowed on HTML5 videos -- RESOLVED
775082 Video controls disappear after dragging the tabs -- RESOLVED
779492 The youtube.com Flash pop out video player is opened in the background -- RESOLVED
786742 Firefox EXCEPTION_INVALID_HANDLE crash in js::GCHelperThread::doSweep (Correlation to Yandex Bar) -- RESOLVED
791195 Session is not restored after Firefox crash -- RESOLVED
794924 Choppy fading out for Quicktime videos -- RESOLVED
799075 Failure to determine geolocation on ESR builds on every other try -- RESOLVED

16 Total; 0 Open (0%); 15 Resolved (93.75%); 1 Verified (6.25%);


Firefox 10.0.12 ESR

Builds FTP, HTTP
ID 20130103094221
Changeset 9e1102e58ac8 (pushlog)
Checklist
  • [DONE] Functional automation
  • [DONE] Manual tests
  • [DONE] Bug fix verifications
  • [DONE] Update automation on esrtest channel
  • [DONE] Update automation on releasetest channel
  • {{|}} Updates automation on esr channel

Automated Tests

The following are the detailed results of the automated Mozmill test runs.

Platform Functional Results Restart Results
Windows 2000 PASS: 0 fails PASS: 0 fails
Windows XP PASS: 0 fails PASS: 0 fails
Windows Vista PASS: 0 fails PASS: 0 fails
Windows 7 32-bit PASS: 0 fails PASS: 0 fails
Windows 7 64-bit PASS: 0 fails PASS: 0 fails
Mac OS X 10.6 PASS: 0 fails PASS: 0 fails
Mac OS X 10.7 PASS: 0 fails PASS: 0 fails
Ubuntu 12.04 32-bit PASS: 0 fails PASS: 0 fails
Ubuntu 12.04 64-bit PASS: 1 known fail PASS: 0 fails
Test Failures (known bugs)
  • /testSecurity/testGreyLarry.js::testLarryGrey -> Controller.assertJSProperty(ID: page-proxy-favicon) (bug 785041)

Manual Smoketests

Run the Firefox ESR 10.0.12 Smoketests in MozTrap and report the results below.

Platform Assignee Result: report
Windows 2000 Simona PASS - 2013-01-04
Windows 7 64-bit Ioana PASS - 2013-01-04
Mac OS X 10.7 Virgil PASS - 2013-01-04
Ubuntu 12.04 32-bit Ioana PASS - 2013-01-04

Bug Fix Verifications

Update Testing

  • Partial: 10.0.11esr
  • Complete: 10.0esr - 10.0.10esr
Platform esrtest (2013-01-03) releasetest (2012-01-07) esr (2012-01-08)
Windows 2000 PASS: 0 fails PASS: 0 fails PASS: 0 fails
Windows XP PASS: 0 fails PASS: 0 fails PASS: 0 fails
Windows Vista PASS: 0 fails PASS: 0 fails PASS: 0 fails
Windows 7 32-bit PASS: 0 fails PASS: 0 fails PASS: 0 fails
Windows 7 64-bit PASS: 0 fails PASS: 0 fails PASS: 0 fails
Mac OS X 10.6 PASS: 0 fails PASS: 0 fails PASS: 0 fails
Mac OS X 10.7 PASS: 0 fails PASS: 0 fails PASS: 0 fails
Ubuntu 12.04 32-bit PASS: 0 fails PASS: 0 fails PASS: 0 fails
Ubuntu 12.04 64-bit PASS: 0 fails PASS: 0 fails PASS: 0 fails

New Issues

Report any new issues found during testing below. Any items marked in bold are considered blocking the release.

Known Issues

Crashers

  • bug 786742 Firefox EXCEPTION_INVALID_HANDLE crash in js::GCHelperThread::doSweep (Yandex)

Geolocation

  • bug 799075 Failure to determine geolocation on ESR builds on every other try

HTML5 Video

  • bug 520600 Video plays automatically if paused when switching to fullscreen mode
  • bug 708557 Html5 youtube context menu not persistent when right clicking
  • FIXED bug 520160 No context menu when watching a video in full screen mode
  • bug 803057 HTML5 videos continues to play after Pop Out

Plugins

  • bug 78414 Keyboard shortcuts fail if plug-in has focus
  • bug 667399 RealPlayer G2 LiveConnect plugin crash
  • bug 747073 Reader 10 doesn't work in 64-bit mode
  • bug 775082 Flash video controls disappear after dragging the tabs
  • bug 794924 Choppy fading out for Quicktime videos
  • bug 812479 QuickTime back/forward and mute buttons do not work
  • WONTFIX bug 692446 Firefox prompts to install WMP plugin even though it's installed

Printing

  • bug 717178 Printing stops after 73%, and browser hangs up

Session Restore

  • bug 791195 Session is not restored after Firefox crash

Tech Evangelism

  • bug 747909 In Full Screen mode - copy actions are not allowed on HTML5 videos
  • WONTFIX bug 694288 Vimeo embedded video player is not displayed on Windows 2000
  • WONTFIX bug 779492 Youtube Flash pop out video player is opened in the background
Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_10_ESR/Test_Plan&oldid=497495"