B2G/QA/Meetings/2014-10-29
Contents
Overview
- Meeting Name: B2G QA Roundtable
- Meeting Time: Wednesdays @ 5pm - 5:45pm
- Vidyo Room: QA Vidyo Room
- Video Link: https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh
- Dial in: 1-800-707-25331
- Meeting Notes: https://wiki.mozilla.org/B2G/QA/Meetings
- Testrun Schedule: http://bit.ly/1jQzW79
- Roadmap for releases: https://wiki.mozilla.org/B2G/Roadmap
- B2G dashboard: http://charts.mozilla.org/
Status Highlights
- PDT ends at 2:00 AM on Sunday, November 2, 2014
- 2.2 new dates listed. Google calendar updated
- Feature list (draft) [Do Not Share]
- https://docs.google.com/a/mozilla.com/spreadsheets/d/1_BothhkqSQLzUvzSZY8P8RFYgphLb_l0JYH32apoJmQ/edit#gid=623215577
- QA Owners: Please look through the list at your feature areas, and discuss with your functional teams. The list will continue to get scrubbed down, but team planning begins for feature estimations this week.
- Dev Start (2.2 sprint 1): 2014-11-24 (Gecko 37 will be on m-c and gaia master)
- Total 6 sprints: Last sprint is reserved for stability testing on master
- Feature Landing Readiness: 2015-02-09
- Feature Landing : 2015-02-23 (Gecko 38, base for FxOS 2.2 will be on mozilla-aurora and gaia v2.2 branch created)
- Feature Complete : 2015-04-06 (Gecko 38 moves to mozilla-beta and mozilla-b2g38_v2_2 is created)
- Code Complete : 2015-05-18
- Q4 Goals B2G (Draft)
- Complete 2.1 QA criteria: https://wiki.mozilla.org/Release_Management/FirefoxOS/Release_Milestones#Code_Complete_Criteria
- Identify 3-5 active contributors that has completed One and Done tasks
- Identify 2.2 features and have testplans drafted by end of sprint 2
- Automate 20 gaia UI tests from backlog. have them running on device, and reporting against Tree Herder
- [geo] Running on device (for MarionetteJS) and reporting to Treeherder are both harness features and belong to FxOS Auto, delivery of those is out of scope for QA. We should stick to "automate 20 gaia UI tests," implication being against whatever harness is currently supported and reasonably stable. I'd suggest leaving out "from backlog"--that's an implementation detail.
- Clean up 2.1 invalidated testcases and prepare for 2.2 testsuite
- Feature list (draft) [Do Not Share]
- Tony in Taipei (nov 11-14)
- FX OS Flashing Highlights from Mozilla Festival: https://twitter.com/supersole/status/526429358903525378/photo/1
2.1 Release Update
Features (Organized by Functional Team)
Overall Concerns
Remaining Tasks
Communications
- Cost Control: Yellow
- Dialer: Yellow
- Blocker: 1
- https://bugzilla.mozilla.org/show_bug.cgi?id=1088668 (new blocker, a patch is on its way)
- SMS, Contacts: Green, no blockers
Media
- Ringtone: Green
- No blockers
- No Ringtone: Yellow
- 5 blockers, one is pending review for the fix. 2 music, 1 gallery, 1 video, 1 reopened camcorder that is unable to repro in Flame device.
https://bugzilla.mozilla.org/show_bug.cgi?id=1082938 https://bugzilla.mozilla.org/show_bug.cgi?id=1083129 https://bugzilla.mozilla.org/show_bug.cgi?id=1088051 https://bugzilla.mozilla.org/show_bug.cgi?id=1088456 https://bugzilla.mozilla.org/show_bug.cgi?id=1068559
Multimedia Platform
- No feature land in v2.1
Productivity
- Green
- No blockers
Systems Front End
- Yellow
- 1 Nomination, 4 Blockers -> https://wiki.mozilla.org/FirefoxOS/systemsfe/releasetracking#FxOS-Systems_Frontend_Nomination_2.1_Dashboard
- Blockers:
https://bugzil.la/1089010 Can open utility tray and settings app while SIM PIN dialog is open https://bugzil.la/1088224 [Window Management] When the user taps on the new voicemail notification nothing happens https://bugzil.la/1089621 Edge-swipe gestures are very janky while dragging (are smooth once drag is released) https://bugzil.la/1082879 TypeError: settings is null at: app://system.gaiamobile.org/shared/js/dump.js line: 24
- Nominations
https://bugzil.la/1090562 [Rocketbar] Transitions are missing (The bug was already reported during the bug bash https://bugzil.la/1088429 but got duped because the developer submitted a patch in the new bug.)
Systems Platform
- Green
- No blockers
Metrics Testing =
- Green
- No blockers
Telephony/Networking
- NFC, RIL: Green
- No blockers
Devices
- Bluetooth: Green
- No blockers
- MTP: Yellow
- Blockers: 1
- https://bugzilla.mozilla.org/show_bug.cgi?id=1074590 (wait patch review)
- Blockers: 1
- Storage: Yellow
- Blockers: 1
- https://bugzilla.mozilla.org/show_bug.cgi?id=1073335 (wait bug 1085759 fixed)
- Blockers: 1
Graphics
- Health: Red
- 9 blockers, 2 are reopened
https://bugzilla.mozilla.org/show_bug.cgi?id=1085593 (Fix submitted for review) https://bugzilla.mozilla.org/show_bug.cgi?id=1089040 (review+ ed and in b2g inbound) https://bugzilla.mozilla.org/show_bug.cgi?id=1042291 (patch was pulled, but there is no change for more than a week without progress) https://bugzilla.mozilla.org/show_bug.cgi?id=1088452 (fix was backed out, so only repros in 2.1) https://bugzilla.mozilla.org/show_bug.cgi?id=1089620 (Pending testing when a related bug gets uplifted) https://bugzilla.mozilla.org/show_bug.cgi?id=1080205 (Fix submitted for review) https://bugzilla.mozilla.org/show_bug.cgi?id=1070199 (Reopened- the screen corruption issue is reproducible in v188 as well) https://bugzilla.mozilla.org/show_bug.cgi?id=1079383 (Reopened, but looks like the dupe bug is recently resolved so it' will close soon)
2.1 Smoketests
- Health: Green
- 0 blockers, 6th of consecutive passing
2.2 Smoketests
- Health: Yellow
- 0 blockers
Localization
Performance
- https://wiki.mozilla.org/B2G/QA/2014-10-20_Performance_Acceptance went out last week. We're going to do these on a weekly cadence until signoff.
Stability
- [Paul] https://etherpad.mozilla.org/mtbf
- 1077292 [MTBF][B2G] Phone shutdown due to high power consumption and chopped charging.
- investigating by twqa and t2m
- talking with T2M / will cc bhavana later
- power consumption: Jon Hylands
- 1074063 [MTBF][B2G] Missing rendering for launched apps
- Patch landed in 2.1 this week, will trigger a new run
Agenda
- [eric] We are trying to create some RAT test suite for quick verification http://mzl.la/1szjyWk, by function group and with good path test cases. (Release Acceptance Test here, not regression), the goal is to create suites, so testing time can be estimated, shorten for quick verification.
- [eric] New QA Teri Wen on board https://phonebook.mozilla.org/#search/teri%20wen
- [Tony] READ only - we will have an QA agenda planned for the workweek session in december. I will work with Brian in november on that. stay tuned for agenda.
- [pragmatic] Oct 23 Bug Bash statistics:
- Total Bugs reported: 117 (57 Taipei,
- Blocker bugs: 8 [CKreinbring (2), mwargers, armenzg, piwei, mhenretty, njpark, slyu]
- Nominated Blocker bugs: 3 (allstars.chh, djabber, mlien)
- Participants: 82 [Paris (3), Toronto (5), Remoties (9), Kirkland (22), Mountain View (6), San Francisco (5), Taipei (32)]
- One and Done tasks completed: 33 (created 10 repeatable tasks)
- Badges: General QA Participation Badge (82 nominations), b2g Badge (7 nominations so far)
(To get your badge, sign into https://badges.mozilla.org/ using the same email address as listed in https://etherpad.mozilla.org/b2g-qa-bug-bash-2014-10-23 (lines 220 - 304). Please also upload a fun, creative photo in your profile - no serious photos!) All awardees who have claimed their badges show up here: https://badges.mozilla.org/en-US/badges/badge/General-QA-Participation-Badge https://badges.mozilla.org/en-US/badges/badge/Firefox-OS-Badge
- [marcia] 1000 Flames devices were handed out at Mozilla Festival in London Oct 24 - 26. QA and community flashed the devices (with v180 base image though) https://twitter.com/supersole/status/526429358903525378/photo/1