B2G/QA/Meetings/2014-11-05

• For Nov 05, 2014

Overview

• Meeting Name: B2G QA Roundtable
• Meeting Time: Wednesdays @ 5pm - 5:45pm
• Vidyo Room: QA Vidyo Room
• Video Link: https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh
• Dial in: 1-800-707-25331
• Meeting Notes: https://wiki.mozilla.org/B2G/QA/Meetings
• Testrun Schedule: http://bit.ly/1jQzW79
• Roadmap for releases: https://wiki.mozilla.org/B2G/Roadmap
• B2G dashboard: http://charts.mozilla.org/

Status Highlights

• • Q4 Goals B2G (Draft)

2.1 Release Update

• 11/14 - QC CS
• 11/21 - 2.1 CC
• Are we hitting our CC acceptance criteria? https://wiki.mozilla.org/Release_Management/FirefoxOS/Release_Milestones#Code_Complete_Criteria

Features (Organized by Functional Team)

Overall Concerns

• Graphical stuff - still issues being seen. Flickering, things in browser, white screen issues
• Flame v188 - https://bugzilla.mozilla.org/show_bug.cgi?id=1085759
• v188-1 image (dont use this image if you are testing OTA)

Remaining Tasks

Communications

• Tester: Johan, Eric
• Cost Control
  • Status: Yellow
  • Blockers: 2
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1084010 (low-impact)
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1083107 (Patch in progress)
• SMS: Yellow
  • Blockers: 2.1 - 1 https://bugzilla.mozilla.org/show_bug.cgi?id=1082067 (Prepaid sim, WIP)
• Dialer, Contacts: Green

Media

• Tester: No-jun, Alison
• Ringtone: Green
  • No blockers
• Non-Ringtone: Yellow
  • 2 blockers, Camera and Music
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1080912
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1082938

Multimedia Platform

• Tester: Gerry Chang
• Health: Green
  • no new features, no regressions

Productivity

• Tester: Edward Chen, Teri Wen
• Status: Yellow
  • Bug 1093572 - [Flame][Email] Unable to login to a specific EAS Email account (dup 1091448)
  • This is special case. If we use this specific mail setting, the bug can be reproduced. The reason is that email app cannot get mail folder list. (Email address: email_38@eas.gte.nu / Hostname : seldmsxt80.gte.nu)

Systems Front End

• Tester: Marcia, Parul
• Status: Yellow
  • 2.1 Blockers: 8 -> https://wiki.mozilla.org/FirefoxOS/systemsfe/releasetracking#FxOS-Systems_Frontend_Blocker_2.1_Dashboard

1090613 [Browser][Youtube] Switching to 'Settings' app via card view when watching a video in landscape full screen causes undesired behavior 1092391 [Clock][Lockscreen] Alarm pop-up appears very high on the lock screen after booting if phone is turned off at the time of the alarm. 1088224 [Window Management] When the user taps on the new voicemail notification nothing happens 1091067 When using Software Home button, overflow menu button in browser chrome is difficult to tap in landscape mode 1081365 [Notifications] The notification tray can get stuck partially open when quickly opening after transitioning between apps with edge gesture 1090152 Status bar is empty on lockscreen on full screen apps 1088157 [Window Management] The user cannot return home in card view 1089528 Notification bar icons will not scroll up with the background when clicking settings

• • 2.0 Blockers: 3 -> https://wiki.mozilla.org/FirefoxOS/systemsfe/releasetracking#FxOS-Systems_Frontend_Blocker_2.0_Dashboard

1051083 [OTA update] Automatic OTA update not working 1077595 [Window Management] After downloading pdf files then deleting them, the download icon in the status bar continues 1083775 [System] status-bar label is overlapped with icons if the operator text is long in 2.0

• • 2.1 Nominations: 3 - > https://wiki.mozilla.org/FirefoxOS/systemsfe/releasetracking#FxOS-Systems_Frontend_Nomination_2.1_Dashboard

1093797 [Window Management] Camera viewfinder will appear black if the user goes in card view and back into camera after a fresh flash 1094351 [Status Bar] When sharing a video via bluetooth, the Status Bar becomes blank 1094506 Icons appear when pulling down statusbar in fullscreen apps

Systems Platform

• Tester: Gerry Chang
• Status: Green

Metrics Testing =

• Tester: Shing Lyu
• Status: Green

Telephony/Networking

• Tester: Alison Shiue
• NFC: Green
  • No blockers
• RIL: Green
  • a nomination but needs confirmation from reporter due to not feasible for current design
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1092295

Devices

• Tester: Eric Chang
• Bluetooth: Green
  • No blockers
• MTP: Green
  • Blockers: 1
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1074590 (RESOLVED FIXED)
• Storage: Yellow
  • Blockers: 1
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1073335 (related to full flash, blocked by bug 1085759)

Graphics

• Tester: No-jun park
• Status: Red
  • 6 Blockers, number is down from last week
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1085593
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1042291 (This one needs attention - not being worked on for a while)
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1088452
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1091777
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1082545
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1070199 (Screen corruption issue, suspecting it's a HW bug)
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1090613
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1087490

2.1 Smoketests

• Tester: Peter Bylenga
• Status: Yellow
  • Outside of the Full Flash issues, no blockers for 5+ days
  • We switched from Full to Shallow because of the outcome of:

https://bugzilla.mozilla.org/show_bug.cgi?id=1085759 (2.1+)

2.2 Smoketests

• Tester: Peter Bylenga
• Status: Red
  • 3 blockers,
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1093121
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1092543
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1094393
• After roc's graphics patch lands we need to check to see if that resolves many of the graphics issues we have been seeing
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1092543
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1093932

Localization

• Tester: Delphine
• Status: Yellow
  • 2 blocker bugs (late-l10n and breaking string freeze):
    • WEB RTC: https://bugzilla.mozilla.org/show_bug.cgi?id=1079519 -- waiting for approval. Need to make sure everyone agrees
    • WEB RTC: https://bugzilla.mozilla.org/show_bug.cgi?id=1079543 -- approved

Performance

• Tester: Geo Mealer
• Status: Yellow
  • https://wiki.mozilla.org/B2G/QA/2014-10-31_Performance_Acceptance
• Apps outside acceptance criteria (launches over 1000 ms) are:
  • Calendar — https://bugzilla.mozilla.org/show_bug.cgi?id=1079557
    • UPDATE: Team has signed off on 1150ms requirement for 2.1
  • Camera — https://bugzilla.mozilla.org/show_bug.cgi?id=1079560
    • UPDATE: Team has signed off on 1550 ms requirement for 2.1
  • Cost Control (Usage) — https://bugzilla.mozilla.org/show_bug.cgi?id=1093847
    • UPDATE: recommendation is to do a local run with SIM installed, since FTU skips that step and retest
  • Settings — https://bugzilla.mozilla.org/show_bug.cgi?id=1079576
    • UPDATE: Team has signed off on 2600ms requirement for 2.1
  • SMS — https://bugzilla.mozilla.org/show_bug.cgi?id=1079582
    • UPDATE: Seems like dev is done optimizing, so we are awaiting a response on a baseline number

Stability

• Tester: Walter Chen, Paul Yang
• New run triggered last night.
  • Bug 1094070 - [MTBF][B2G][Camera][Media Server] black camera screen with buttons
  • running hrs was about 40 ~ 50 hrs last week, we are waiting for latest result this week

Agenda

• [Delphine] introduce RTL feature, and plan of approach
  • UX Specs https://drive.google.com/file/d/0B6fkEC1pmwTiaWs0ZDgyYWZ0UG8/view?usp=sharing
  • Meta bug for RTL:
• [Tony] Teams: review your 2.2 features. still cutting, but starting to formulate
  • https://docs.google.com/a/mozilla.com/spreadsheets/d/1_BothhkqSQLzUvzSZY8P8RFYgphLb_l0JYH32apoJmQ/edit#gid=147855939
• Portland Work Week Schedule
  • tchung will chat next week and have a schedule coming up

This Week - Decisions & Action Items