Releases/Firefox 54/Test Plan/Beta/12
From MozillaWiki
« Firefox 54 Beta 11 | Firefox 54 Beta 12 | Firefox 54 Beta 13 »
Firefox 54 Beta 12 Test Plan
Build information
- Release week: May 29th, 2017. Plan is to ship this build on Tuesday, May 30th, 2017 — Release Calendar.
- Build: 54.0b12-build1 | 715d88d0bd82 | 20170529025116 | bugs since previous changeset.
- QA contacts: Florin Mezei (:FlorinMezei), Andrei Vaida (:avaida), Cornel Ionce (:cornel_ionce) — online on #qa and #release-drivers, ⌚️UTC+02:00.
Manual QA'S recommendation for this build
Note: Recommendation based on results from manual testing.
BUILD | TESTING STATUS | RECOMMENDATION | REASON(S) |
---|---|---|---|
54.0b12-build1 | COMPLETED 100% | SHIP IT | No new or blocking issues uncovered, just a few already known bugs of low impact. We've already shipped several releases with them. |
Manual testing summary
Note: Test Plan available at https://testrail.stage.mozaws.net/index.php?/plans/view/4397.
PLATFORM | ASSIGNEE | BUILD | GPU | STATUS PER TEST SUITE | |||
---|---|---|---|---|---|---|---|
Scroll and Zoom | Password Manager | ||||||
Windows 7 x86 | Cristian Comorasu | 32-bit | Intel HD 530 | GREEN | GREEN | ||
Windows 8.1 x64 | Timea Zsoldos | 64-bit | ATI Radeon HD 3000 | GREEN | GREEN | ||
Mac OS X 10.10 | Iulia Cristescu | 64-bit | Intel Iris Pro (1536 MB) | GREEN | GREEN | ||
Ubuntu 12.04 x86 | Cornel Ionce | 32-bit | NVIDIA GeForce 620 | GREEN | GREEN |
Features in Firefox 54
Note: Pre-Release feature sign offs are scheduled to be completed by May 26th.
Note: See https://goo.gl/I6hq5C for a general overview.
FEATURE NAME | TRACKING | QA CONTACTS | TESTING STATUS | SIGN OFF STATUS | ADDITIONAL NOTES | ||
---|---|---|---|---|---|---|---|
Bugzilla | Wiki | Trello | |||||
client-side stackwalking: ping sender | 1310703 | Test Plan | Petruta Rasa | [DONE] | [DONE] | Signed off on 2017-05-26 as GREEN, full test report here. | |
Firefox Screenshots system add-on | Test Plan | Card | Iulia Cristescu | [AT RISK] | [AT RISK] | Will ride Firefox 55 instead, per Trello. | |
Download Panel UX Redesign | 1269956 | Test Plan | Card | Cristian Comorasu | [DONE] | [DONE] | Signed off on 2017-05-25 as GREEN, full test report here. |
Net Monitor MVP | 1307743 | Test Plan | Card | Ciprian Georgiu | [DONE] | [DONE] | Conditionally signed off on 2017-05-24 as YELLOW, because of bug 1350969, full test report here. |
ICE TCP | 1176382 | Card | Iulia Cristescu | [DONE] | [DONE] | Signed off on 2017-05-25 as GREEN, full test report here. | |
Flash async drawing | 1229961 | Test Plan | Card | Stefan Georgiev (Engineering QA) | [AT RISK] | [AT RISK] | Will ride Firefox 55 instead for 32-bit users, per Trello. |
Mobile bookmarks | 1295237 | Test Plan | Kanchan Kumari (Engineering QA) | [ON TRACK] | [IN PROGRESS] |
Detailed test results
Note: New and known bugs are listed in https://testrail.stage.mozaws.net/index.php?/plans/defects/4397.
New bugs
Bugzilla query error
error, http-bad-status, Array
Known bugs
High-impact bugs also encountered in previous builds
Bugzilla query error
error, http-bad-status, Array
Low-impact bugs also encountered in previous builds
ID | Summary | Status | Resolution |
---|---|---|---|
616629 | "Remember Password?" dialog shows too early | RESOLVED | DUPLICATE |
1243385 | Bad repainting while scrolling on gaming.youtube.com | RESOLVED | INCOMPLETE |
1277327 | Video on gaming.youtube.com lags behind while scrolling | RESOLVED | INCOMPLETE |
3 Total; 0 Open (0%); 3 Resolved (100%); 0 Verified (0%);
Bug fix verification
Note: All verified Firefox 54 bug fixes are listed in https://goo.gl/vCGKG3.
ID | Summary | Status | Resolution | Keywords |
---|---|---|---|---|
1341992 | On Windows, it's not possible to scroll using the scrollbar with touch gestures | VERIFIED | FIXED | regression |
1358964 | Temp folder is not deleted on exit | RESOLVED | FIXED | regression |
1363671 | No favicon on about:addons | VERIFIED | FIXED | regression |
1364870 | ffmpeg decoder returning errors if no frame decoded. | VERIFIED | FIXED | regression |
4 Total; 0 Open (0%); 1 Resolved (25%); 3 Verified (75%);
Status tags
- [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
- [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
- [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
- [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
- [IN PROGRESS] - {{mprog}} - actively being tested on
- [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed