B2G/QA/Meetings/2014-10-22

Overview

• Meeting Name: B2G QA Roundtable
• Meeting Time: Wednesdays @ 5pm - 5:45pm
• Vidyo Room: QA Vidyo Room
• Video Link: https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh
• Dial in: 1-800-707-25331
• Meeting Notes: https://wiki.mozilla.org/B2G/QA/Meetings
• Testrun Schedule: http://bit.ly/1jQzW79
• Roadmap for releases: https://wiki.mozilla.org/B2G/Roadmap
• B2G dashboard: http://charts.mozilla.org/

Status Highlights

• v188 now
  • Bug 1086880 - Mobile ID is broken with v188 RIL
  • Bug 1087475 - [Flame][Camera]The viewfinder will fail to function when the user opens and closes the camera app multiple times via the home button
  • Bug 1054898 - [Flame][KK]Take picture with flash light will consume 3~5 seconds
  • Blocking - 2.0? and bugzilla: FirefoxOS::Vendcom
• 2.1 CC criteria: https://wiki.mozilla.org/Release_Management/FirefoxOS/Release_Milestones#CODE_COMPLETE_.28CC.29
  • Full summary: https://wiki.mozilla.org/B2G/QA/2.1#Release_Signoff_Status
• Important Dates
  • 10/23 - 2.1 bug bash
  • 11/14 - Vendor CS deadline
  • 11/21 - 2.1 CC deadline
  • 1/2 - 2.1 GA
  • DST ends: 2 Nov 2014

2.1 Release Update

Features (Organized by Functional Team)

Overall Concerns

Remaining Tasks

Communications

• Contacts: Green
  • No blockers
• Dialer: Yellow
  • https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1081854%2C1082139%2C1079810
  • Bug 1079810 is still in investigation
  • Bug 1081854 and 1082139 are under review
• SMS: Green
  • No blockers
• Cost Control: Yellow
  • Blockers: 3 https://bugzilla.mozilla.org/buglist.cgi?f1=cf_blocking_b2g&list_id=11417012&o1=substring&resolution=---&query_format=advanced&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&bug_status=RESOLVED&v1=2.1&component=Gaia%3A%3ACost%20Control&product=Firefox%20OS

Media

• Ringtone: Green
  • No blockers
• Non-Ringtone: Yellow
  • 4 blockers, 2 camera and 2 music
    • https://mozqa.etherpad.mozilla.org/b2g-qa-roundtable
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1078435
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1080912
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1082938
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1083129
  • Bugs are resolved quickly, but so is the incoming rate
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1087475 became vendcom bug, only repros in v188
  • there are qc raised perf bugs- should we block them?
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1082268
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1086963

Multimedia Platform

• No feature landed in v2.1

Productivity

• Health: Green
  • No blockers
  • Bug 1062792 - [Calendar] Week view - Display blank area when scrolling page (RESOLVED)

Systems Front End

• Health: Yellow
  • 6 blockers https://wiki.mozilla.org/FirefoxOS/systemsfe/releasetracking#FxOS-Systems_Frontend_Blocker_2.1_Dashboard

https://bugzil.la/1084321 Pages navigated to by following links from Facebook app on B2G cannot be zoomed https://bugzil.la/1084060 [Window Management] Tapping on the Camera is recording notification, opens up the download system update window https://bugzil.la/1082879 TypeError: settings is null at: app://system.gaiamobile.org/shared/js/dump.js line: 24 https://bugzil.la/1085593 [SHB] The "Enter SIM PIN" page flashes when Software Home Button is enabled https://bugzil.la/1086715 System Update Ready dialog does not fill the full screen https://bugzil.la/1078901 [Window Mgmt] Confirmation screen for deleting installed app overlays over all other elements and notifications.

• • 5 blocker nominations https://wiki.mozilla.org/FirefoxOS/systemsfe/releasetracking#FxOS-Systems_Frontend_Nomination_2.1_Dashboard

https://bugzil.la/1087042 Progress bar displays in the place for the Guardian app https://bugzil.la/1084301 PIN text edit is focused at start but there's no keyboard https://bugzil.la/1087453 [Email] Scrolling is disabled on email settings page https://bugzil.la/1087484 [Window Management] Going to card view right after opening the camera app leads to a non functional shutter button https://bugzil.la/1067329 Log shaking dumps at invalid place on sdcard

Systems Platform

• Health: Green
  • No blockers

Metrics Testing =

• Health: Green
  • No blockers

Telephony/Networking

• NFC: Yellow
  • Blockers:1

https://bugzilla.mozilla.org/show_bug.cgi?id=1079567 (still in investigation)

• RIL: Yellow
  • Blockers:1 Bug 1086880 mobile ID v188 issue (vendor issue)

Devices

• Bluetooth: Yellow
  • Blockers: 3
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1069868 (RESOLVED FIXED)
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1085201 (wait patch review)
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1086175 (still in investigation)
• MTP: Yellow
  • Blockers: 1
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1074590 (wait patch feedback)
• Storage: Yellow
  • Blockers: 1
    • https://bugzilla.mozilla.org/show_bug.cgi?id=10ko73335 (GonkIntegration issue)

Graphics

• Status: Yellow
  • 7 blockers. Aged bugs are getting traction.
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1058429 : it blocks the blocker
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1062134 : it blocks the blocker
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1064918 : this might need some qa check after the fix
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1042291 : canvas size calculation bug - the fix was stalled because of the b2g-incoming branch failure, and no progress yet.
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1080205 : checkerboarding on iframe, affects marketplace
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1070199 : corrupt screen - not reproducible in v188?
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1079383 : it was closed with fix but reopened recently, bad UI bug on dialer app.
  • Calendar app bug is fixed, will test out tomorrow
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1064918: this looks like it might need extra attention on QA side when fixed.
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1070199: haven't found the cause of this yet, no report of reproduction in v188.
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1080205: is related to checkerboardin on Marketplace app while scrolling.

2.1 Smoketests

• Status: Yellow
  • 1st day of all cases passing
  • Blockers: 0

2.2 Smoketests

• Status: Red
  • Blockers: 2
• [Homescreen][Smart Collection] Launching a Smart Collection causes the device restart after viewing a black screen.

https://bugzilla.mozilla.org/show_bug.cgi?id=1083965

• • User must reboot to recover
• [Graphics] Control panel of the built-in media player is gone

https://bugzilla.mozilla.org/show_bug.cgi?id=1085787

Localization

• Status: Yellow
  • 3 New Blockers
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1085496
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1084843
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1086988
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1086674 (2.1?)
  • 3 Still need verification
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1057188
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1074166
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1074166

Performance

• Status: Yellow
  • latest acceptance report of 2.0 vs 2.1 will be put out soon tonite
  • sneak preview: most apps have shaved about 50-100 ms
  • Camera and settings has regressed by 100ms, will be filed
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1081577

Stability

• Status: RED
  • on average 2.x hours before crashing
  • We stuck in following bugs and try to add more debug log and reproduce
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1077292
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1074063
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1076605

Agenda

• [eric] Customization test case fixing, MDN & test cases are outdated.
  • https://wiki.mozilla.org/B2G/QA/Customizations#Note 1/3 cases fixed.
• [eric] We get feedback from RD/PM, I think we could update the smoke test cases to match current new essential features. http://bit.ly/1uDNceU Review?
• [Edward] Do you need to change base image to v188 in bug bash?
• [pragmatic] Update on Bug Bash: https://etherpad.mozilla.org/b2g-qa-bug-bash-2014-10-23

Event is being co-ordinated from 5 Mozilla offices (with Vancouver being a possible 6th)

This Week - Decisions & Action Items

• [Eric] ping Cmills to update the customizations note on MDN. provide the link to where the MDN pages are.
• [Kevin, All] please provide feedback to the new smoketests review
• [pragmatic] update bug bash base image to v188