Releases/Firefox 51/Test Plan/Beta/51.0.1

From MozillaWiki
Jump to: navigation, search

«  Firefox 51 RC2 | Firefox 51.0.1 »

Firefox 51.0.1 build2 Test Plan

QE recommendation regarding the quality of the build

  • Recommendation based on results from manual testing:
Build 2 SHIP IT


Build 3 SHIP IT, CONDITIONALLY

Manual Testing summary - Platform Coverage and Areas Tested

Build 2

Platform Graphics Build architecture Assignee Results: report
Windows 7 x64 ATI Radeon HD 3000 32-bit Ciprian Georgiu [DONE]
Windows 10 x64 Intel HD 4600 64-bit Iulia Cristescu [DONE]
Mac OS X 10.11.6 Intel Iris Pro 1536Mb 64-bit Timea Zsoldos [DONE]
Ubuntu 16.04 x64 Intel HD 2500 64-bit Petruta Rasa [DONE]
Tested Area Testing Type Results
WEB COMPATIBILITY Smoke and Exploratory Testing PASSED

Build 3

Platform Graphics Build architecture Assignee Results: report
Windows 7 x64 AMD Radeon R7 200 32-bit Paul Silaghi [DONE]
Windows 10 x64 Intel HD 530 64-bit Cistian Comorasu [DONE]
Mac OS X 10.11.6 Intel Iris Pro 1536 64-bit Mihai Boldan [DONE]
Ubuntu 14.04 x86 Intel HD 4600 64-bit Iulia Cristescu [DONE]
Tested Area Testing Type Results
WEB COMPATIBILITY Smoke and Exploratory Testing PASSED

Features

See the [1] gdoc for a general overview

Feature Owner Testing Sign off Details Test Plan
WebGL2 Bogdan Maris [DONE] YELLOW Feature set to release with Firefox 51, pre-Release sign off completed. Yellow because of the new bugs encountered during sign off (1330333, 1330334) and the large number of conformance test failures (test runner). Test Plan
Indicator for Streaming or Permissions Cornel Ionce [DONE] GREEN Feature set to release with Firefox 51, pre-Release sign off completed. Test Plan
Support for FLAC Ciprian Georgiu [DONE] GREEN Feature set to release with Firefox 51, pre-Release sign off completed. Test Plan
Zoom Indicator Iulia Cristescu [DONE] YELLOW Feature set to release with Firefox 51, pre-Release sign off completed. Yellow because of 1310758 and 1300376. Test Plan
ICE candidate generation control and user authorization Iulia Cristescu [DONE] GREEN Feature set to release with Firefox 51, pre-Release sign off completed. Test Plan
Support VP9 for WebRTC Iulia Cristescu --- --- Feature set to release with Firefox 51, but won't be tracked by our team. ---

Results

New bugs

  • none

Known Issues - also seen in previous builds

Major issues also seen in previous builds

  • none

Low impact issues also seen in previous builds

  • Build 2:
Full Query
ID Summary Status Resolution
616629 "Remember Password?" dialog shows too early RESOLVED DUPLICATE
1191290 Glitches after opening images in tumblr RESOLVED WORKSFORME
1210769 Glitches after opening images via flickr RESOLVED WORKSFORME
1233359 Glitches after opening images in facebook NEW
1305744 Twitter profile picture glitches when the page is scrolled in maximized window RESOLVED WORKSFORME
1309534 Glitches when zoom in .jpg files from Wikipedia RESOLVED WORKSFORME
1331637 DnD uploads empty folders on onedrive.com RESOLVED DUPLICATE
1332587 Crash in memcpy | NS_CopySegmentToBuffer rising in Firefox 49 VERIFIED FIXED

8 Total; 1 Open (12.5%); 6 Resolved (75%); 1 Verified (12.5%);


  • Build 3:
Full Query
ID Summary Status Resolution
616629 "Remember Password?" dialog shows too early RESOLVED DUPLICATE
1191290 Glitches after opening images in tumblr RESOLVED WORKSFORME
1192204 Scrollbar is overlapping the Quality entries via Youtube high resolution videos RESOLVED WORKSFORME
1210769 Glitches after opening images via flickr RESOLVED WORKSFORME
1233359 Glitches after opening images in facebook NEW
1305744 Twitter profile picture glitches when the page is scrolled in maximized window RESOLVED WORKSFORME
1309534 Glitches when zoom in .jpg files from Wikipedia RESOLVED WORKSFORME
1331637 DnD uploads empty folders on onedrive.com RESOLVED DUPLICATE

8 Total; 1 Open (12.5%); 7 Resolved (87.5%); 0 Verified (0%);


Branch Bug Fix Verifications

Full Query
ID Summary Status Resolution
1294650 follow up - startup crash in nsPrefBranch::GetIntPref (Websense Endpoint) RESOLVED FIXED
1333423 multiProcessCompatible set to false should override E10SAddonsRollout RESOLVED FIXED
1333516 geolocation not working in Firefox 51 release VERIFIED FIXED

3 Total; 0 Open (0%); 2 Resolved (66.67%); 1 Verified (33.33%);

Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed
Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_51/Test_Plan/Beta/51.0.1&oldid=1161074"