Releases/Firefox 40/Test Plan/Beta/1

From MozillaWiki
Jump to: navigation, search

«  Firefox 39.0 RC build 6 | Firefox 40 Beta 1 | Firefox 40 Beta 2  »

Firefox 40 Beta 1 (build 2) Test Plan

QE recommendation regarding the quality of the build

Recommendation based on results from manual testing CONDITIONAL SIGN-OFF

Manual Testing summary - Platform Coverage and Areas Tested

  • Testing is performed around new features that entered Beta 1, and areas most affected by fixes
  • Test Cases executed and results:
Platform Assignee Results: Regression, Exploratory
Windows 7 x64 (AMD Radeon HD6450, Intel HD 2500) Bogdan Maris, Camelia Badau [DONE]
Windows 10 x64 (nVIDIA GeForce 620, AMD Radeon HD 3000) Cornel Ionce, Andrei Vaida [DONE]
Mac OS X 10.9.5 (Intel Iris Pro 1024 MB) Alexandra Lucinet [DONE]
Ubuntu 14.04 x86 (Intel HD 2500) Vasilica Mihasca [DONE]
Tested Area Testing Type Results
HELLO Regression Testing CONDITIONAL PASS
HELLO - CONTEXT Regression Testing CONDITIONAL PASS
AV ADD-ON COMPATIBILITY Exploratory testing PASS

Features

See the Feature Release Tracking gdoc for a general overview


Feature Owner Status Details Test Plan
Async plugin init Catalin Varga [ON TRACK] Feature is in Beta 40, but still disabled by default - potential final QA sign-off at the end of Beta 39 -
First Run for 40 release Catalin Varga [NOT STARTED] New feature targeted for Firefox 40 (not yet implemented) - final QA sign-off at the end of Beta 40 -
Suggested tiles: Sponsored Cornel Ionce [ON TRACK] Feature dropped from Firefox 39 - final QA sign-off at the end of Beta 40 Test Plan
New Add-on Signing Vasilica Mihasca [ON TRACK] Feature dropped from Firefox 39 (not enough add-ons signed) - final QA sign-off at the end of Beta 40 -
Unified telemetry/FHR - [AT RISK] New feature targeted for Firefox 40 (no testing details received yet) - potential final QA sign-off at the end of Beta 40 -
OMTC by default on Linux Alexandra Lucinet [ON TRACK] New feature targeted for Firefox 40 - final QA sign-off at the end of Beta 40 -
Hello - Context Bogdan Maris [ON TRACK] New feature targeted for Firefox 40 - final QA sign-off at the end of Beta 40 -

Results

New bugs

Full Query
ID Summary Status Resolution
1180129 Loop clients aren't receiving push notifications (no joined conversation notifications / no direct calls) RESOLVED FIXED
1180140 The user is unable to join back the conversation after a crash RESOLVED FIXED
1180197 [Ubuntu] The shared image freezes on the second PC during tab/window sharing RESOLVED INCOMPLETE
1180219 [intermittently] Title page changes after editing Context RESOLVED DUPLICATE
1180222 Both Context states (edit/no edit) visible in conversation window after participant leaves call during context editing RESOLVED WORKSFORME

5 Total; 0 Open (0%); 5 Resolved (100%); 0 Verified (0%);


Known Issues - also seen in previous builds

Major issues also seen in previous builds

Full Query
ID Summary Status Resolution
1145106 crash in atidxx32.dll@0x196f7 RESOLVED WORKSFORME

1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);


Low impact issues also seen in previous builds

Full Query
ID Summary Status Resolution
1051834 screensharing allows the sharing indicator to be shared NEW
1113673 Loop icon is not blue during a call between FxA Accounts RESOLVED WONTFIX
1122858 The Firefox Hello window opens to the top left edge of the screen if the Hello icon is placed in the hamburger menu RESOLVED INCOMPLETE
1137598 Reversed controls for videos that have a css transform flipping the video (no attribute/option to flip video output) RESOLVED INACTIVE
1137602 Windows only - Global indicator does not call any pop-ups from Firefox RESOLVED INCOMPLETE
1137611 Winamp is shared with incorrect skin via a Hello call RESOLVED INCOMPLETE
1144722 Hello button cannot be positioned at the top of Menu panel RESOLVED INCOMPLETE
1146882 Starting tab sharing before the call will not show the tab when someone joins conversation RESOLVED WONTFIX
1154271 crash in nvwgf2um.dll@0x7fec13 RESOLVED WORKSFORME
1163999 Screensharing also stops when user selects 'Stop Sharing' from the camera/microphone permissions drop-down RESOLVED WORKSFORME
1170627 Save Context button doesn't exit screen VERIFIED FIXED
1172847 'Let’s Talk About' hard to see in conversation window after someone joins the conversation due to its color VERIFIED FIXED
1174702 Unnecessary scroll while editing context. RESOLVED FIXED
1175090 Cancel button from the calls made via hello does nothing RESOLVED DUPLICATE

14 Total; 1 Open (7.14%); 11 Resolved (78.57%); 2 Verified (14.29%);


Branch Bug Fix Verifications

Full Query
ID Summary Status Resolution
1149891 crash in CSPService::ShouldLoad(unsigned int, nsIURI*, nsIURI*, nsISupports*, nsACString_internal const&, nsISupports*, nsIPrincipal*, short*) from userscript VERIFIED FIXED
1162569 default engine files should be in the omni.ja file VERIFIED FIXED

2 Total; 0 Open (0%); 0 Resolved (0%); 2 Verified (100%);


Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed
Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_40/Test_Plan/Beta/1&oldid=1082986"