B2G/QA/Meetings/2015-01-28

Overview

• Meeting Name: B2G QA Roundtable
• Meeting Time: Wednesdays @ 5pm - 5:45pm PDT
• Vidyo Room: QA Vidyo Room
• Video Link: https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh
• Dial in: 1-800-707-2533, #92, #9245
• Meeting Notes: https://wiki.mozilla.org/B2G/QA/Meetings
• Testrun Schedule: http://bit.ly/1jQzW79
• Roadmap for releases: https://wiki.mozilla.org/B2G/Roadmap
• B2G dashboard: http://charts.mozilla.org/
• QA Roundtable Template: https://etherpad.mozilla.org/b2g-qa-roundtable-template (Clone this)

Previous Actions

• Per https://wiki.mozilla.org/B2G/QA/Meetings/2015-01-21 we do not have 3.0 Owners across:
  • Multimedia Platform
    • Eric to check this out with Howie
  • Bluetooth
    • Eric to help with this
  • Metrics
• Performing backouts :
  • RyavnVM is documenting a wiki for gecko/gaia around this and will share soon
  • Work in getting commit access in the interim if you dont have it
    • https://www.mozilla.org/en-US/about/governance/policies/commit/
    • No-jun is dry-running this now ;)

Status Highlights

• • Q4 Goals B2G (Draft)

2.2 Release Update

2.2 Feature work

• Privacy (Gerry)
  • Health: Red
  • Test case coverage:
  • Details: 5 blockers
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1093688
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1111992
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1118155
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1120733
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1121232
      • [AI] Bhavana to help with this
• Cut, Copy, and Paste (Gerry, Edward, Teri, Eric)
  • Health: Green
  • Test case coverage: 80%
  • Details: WIP
• RTL
  • Health: Amber
  • Test case coverage: 57% (15/26)
    • Details: WIP https://wiki.mozilla.org/RTL#Test_cases_status_of_RTL
    • RTL feature-b2g 2.2+: http://mzl.la/1JTN3vC
• NFC (Alison)
  • Health: Green
  • Test case coverage: 100%
  • Details:
    • 2.2 features WIP
    • 3 blockers (regression bugs):
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1120849
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1125019
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1125026
• Rocketbar refactor (Hermes)
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1099157 has been removed from v2.2? wait confirmation from Candice.
• Search suggestion based on provider (Hermes)
  • Health: Green
  • Test case coverage: 80%
  • Details: WIP
• App-grouping (Hermes)
  • Health: Green
  • Test case coverage: 90%
  • Details: WIP
• Task Manager (Hermes)
  • Health: Green
  • Test case coverage: 100%
  • Details: would be finished after disable landscape mode (https://bugzilla.mozilla.org/show_bug.cgi?id=1118390)
• L-porting (Hermes)
  • Health: Yellow
  • Details:
    • a new bug resulted in build failed (https://bugzilla.mozilla.org/show_bug.cgi?id=1126499)
    • 1 Camera recording blocker: (https://bugzilla.mozilla.org/show_bug.cgi?id=1120780)
    • Other components are almost done.
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1111890#c11
• CAF bugs (Eric)
  • Health: Green
  • Test case coverage: 66%
  • Details: working on test case creation Bug 1043558
• TCL bugs (Alison, Eric)
  • Health: Green
  • Test case coverage: 100%
  • Details:
    • Feature "bug 1091544" has one blocker: https://bugzilla.mozilla.org/show_bug.cgi?id=1123567
• Bluetooth (Eric, Teri)
  • Health: Green
  • Test case coverage: 100%
  • Details: Full flash needed for bluetooth to work, waiting for nexus-l
• Metrics (Shing)
  • Health: Green
  • Test case coverage: 100%
  • Details: 1 backed out. No new feature.
    • Bhavana to follow-up and Shing will get testcases ready in the meantime
• 256M RAM memory optimization for WFVGA, 5MP. (Teri)
  • Health: Green
  • Test case coverage: cancelled
  • Details: code backed out due to bug 1081871.
• Multicore performance (Edward)
  • Health:
  • Test case coverage:
  • Better performance on Multicore (App startup time for core apps is comparable to Android

2.1 Smoketests

• Tester:
• Health Status:
• Details:

2.2 Smoketests

• Tester: Eric
• Health Status: Yellow
  • bug 1124760 just got uplifted to v2.2, will verify today

3.0 Smoketests

• Tester: Peter Bylenga
• Health Status: Red
• Details: 2 Blockers + 1 severe issue, all resolved fix, will verify on tomorrow's nightly build
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1126404
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1121871
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1122119

Localization

• Tester: delphine/localizers
• Health Status: 2.2 (because l10n work starts closer to string freeze - nothing to report on master)
• Details:
• https://bugzilla.mozilla.org/show_bug.cgi?id=1105304

Performance

• Tester:
• Health Status:
• Details:

Stability

• Tester: Alison
• Health Status: None
• Details: Not yet started

3.0 Exploratory

• Tester: Peter Bylenga
• Health Status: Red
• Details: 28 bugs found, 8 noms/blockers
  • http://mzl.la/1z4GxRv
• New/Reopened (29 bugs)
  • previous query had it including blocking-b2g status instead of omit
  • http://mzl.la/1z4OBlc

Agenda

[eric] We are going to have a trial run of test case review process - prepare doc, link; attach to a bug, mark r? for qa, rd, epm ... etc. The goal is to let RD/QA/EPM know about our test cases, provide suggestions, and make the case coverage much more complete. [delphine] Arabic RTL is now a committed feature of b2g v2.2 https://wiki.mozilla.org/RTL [bajaj] John Dorlus [:Sline30] joined the automation team on Mon Jan 26. Remote (based out of Orlando, FL). Martijn Wargers [:mwargers] and Johan Lorenzo [:jlorenzo] will be in the Mountain View office next week, along with John Dorlus. [eric] Copy paste bug bash: 01/29 5pm - 6pm PST, 1/30 9am-10am Taipei https://etherpad.mozilla.org/copy-paste-bug-bash [pragmatic] Bug Bash yesterday Jan 27, 2015 https://etherpad.mozilla.org/b2g-qa-bug-bash-2015-01-27. Some statistics: Attendance: 26

• Contributors: 4
• Paris: 3
• Mountain View: 4
• San Francisco: 5
• Portland: 1
• Kirkland: 9

Bugs Filed: 43 http://mzl.la/15uMfjA One and Done tasks completed: 7 More statistics coming soon in a QMO blog post. Thanks to everyone who attended! :-) [pragmatic] About 70 community members will receive Flame devices this week. High school children in Virginia and a contributor in Pennsylvania got their devices today. [PBylenga] Developer Status: QA-ready keyword? flag? Also how to determine if an app/area is not ready to test, by omission? - Spreadsheet