B2G/QA/Meetings/2014-10-08
From MozillaWiki
Contents
Overview
- Meeting Name: B2G QA Roundtable
- Meeting Time: Wednesdays @ 5pm - 5:45pm
- Vidyo Room: QA Vidyo Room
- Video Link: https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh
- Dial in: 1-800-707-25331
- Meeting Notes: https://wiki.mozilla.org/B2G/QA/Meetings
- Testrun Schedule: http://bit.ly/1jQzW79
- Roadmap for releases: https://wiki.mozilla.org/B2G/Roadmap
- B2G dashboard: http://charts.mozilla.org/
Status Highlights
2.1 Release Update
- 2.1 FC - Oct 10th, (also a national holiday in Taiwan)
- Oct 13th - Canadian thanksgiving
- Geo on PTO Oct 10th-14th
- marcia on PTO 10/10
Features (Organized by Functional Team)
Overall Concerns
- How is user performance and stability?
- How is graphics and rendering?
- Graphic artifacts still appearing. long black lines in the UI
- https://bugzilla.mozilla.org/show_bug.cgi?id=1075719 tracking that issue
- Instance where Rocketbar doesnt accept feedback
- Dialer on idle, leaves a white screen effect
- with a lot of apps open, it seems like performance lags on response. Reproducible on 512mb
- apps aren't being killed on 2.1 when too many apps are being opened
- dialer has call log issues, wont paint correctly
- when trying to launch a link into browser, it just launches a blank page
- sharing a bookmark via SMS, is very slow to load (~2-3 seconds)
- when device is sleeping, waking up will have a blank page with rocketbar at top. need to pull battery. SHB is both on and off
- Bug 1080632 - [Dialer] Blue screen shown when dialing a number from the Contacts app
- Graphic artifacts still appearing. long black lines in the UI
- 2.1 FC criteria: https://wiki.mozilla.org/Release_Management/FirefoxOS/Release_Milestones#FEATURE_COMPLETE_.28FC.29
- All feature landing exceptions must be resolved : YELLOW. know of at least the scrollbar bugs landing
- Bugs with keyword late-l10n should be zero : GREEN
- Chipset vendor requirements or bugs needed to meet their FC date must be resolved : YELLOW
- QA sign-off
- Completed one functional test run : GREEN
- QA defines 2 areas of "functional areas" for exploratory testing and lead will send a "signoff" note when he feels its qualitatively ready : YELLOW: Browser/Rocketbar
- Smoketest Greenness - Latest length of time that we haven't had smoketest regressions needs to be greater than five days : YELLOW
- MTBF Test Run lasts for 30+ hours : RED. with JB base, battery was fine, but KK base is not charging battery. 10-15 hours before battery is dead
- bug 1074063 [MTBF][B2G] white & black screen
- bug 1077292 [MTBF][B2G] Phone shutdown without reason
- bug 1076605 [MTBF][App Launch] Apps can't be launch
- Performance team sign-off to ensure we have met the FC ready criteria (1000ms per app): YELLOW. there are some apps that are still > 1000ms, but discussion will need to happen within each group.
- Bugs with keyword late-l10n should be zero : GREEN
Remaining Tasks
- Complete FC run 3
- Complete l10n run 2
- All Smoketests on 2.1 branch until end of at least 2.1 CC (Nov 21st)
Communications
- Contacts
Health: GREEN
- No blockers
- Cost Control:
Health: YELLOW
- 1 blocker https://bugzilla.mozilla.org/show_bug.cgi?id=1064491
- 1 performance issue https://bugzilla.mozilla.org/show_bug.cgi?id=1079194
- Dialer
Health: YELLOW
- 3 blockers: https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1078663%2C1075699%2C1074379
- 1 nearly fixed (1074379), 1 bad regression (1078663)
- 3 blockers: https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1078663%2C1075699%2C1074379
- SMS
Health: GREEN
- 0 Blockers, but 3 performance issue
- https://bugzilla.mozilla.org/show_bug.cgi?id=1074783
- https://bugzilla.mozilla.org/show_bug.cgi?id=1075410
- https://bugzilla.mozilla.org/show_bug.cgi?id=1079582 Backlog
Media
[Ringtones]
- Health: Green
- No blockers
- Non-Media
- Health: GREEN
- 1 Blocker, (performance issue) might take time to identify the root cause: https://bugzilla.mozilla.org/show_bug.cgi?id=1072500
- 5 noms. 3 of them are from Geo's performance testing results
Multimedia Platform
- Health: GREEN
- No feature landed.
Productivity
- Health: YELLOW
- Blocker (7) https://wiki.mozilla.org/FirefoxOS/productivity/releasetracking#Productivity_Blocker_2.1_Dashboard
- Bug 1018833 - Calendar sync duplicates events - PR Open
- Bug 1071919 - [Calendar] Settings drawer can become stuck open requiring app to be force closed - PR Open
- Bug 1065520 - [Calendar][Week View] Events still display in Week view after they are deleted from another View - PR Merged
- Bug 1070429 - [email/IMAP] getBody returning null, looks like possible fetch corruption [Problem handling message type: gotBody TypeError: body is null] - PR Open
- [Highlight] - Bug 1067270 - [Calendar] Add Google calendar via OAUTH always show something wrong. Not solved.
- Blocker (7) https://wiki.mozilla.org/FirefoxOS/productivity/releasetracking#Productivity_Blocker_2.1_Dashboard
Systems Front End
- Overall: RED
- Soft home button: RED
- Blockers: 7
- https://bugzilla.mozilla.org/show_bug.cgi?id=1074123 waiting for review
- https://bugzilla.mozilla.org/show_bug.cgi?id=1068470 waiting for commit
- https://bugzilla.mozilla.org/show_bug.cgi?id=1078904 waiting for solution
- https://bugzilla.mozilla.org/show_bug.cgi?id=1068470 waiting for commit
- https://bugzilla.mozilla.org/show_bug.cgi?id=1072728 Need RD to check again
- https://bugzilla.mozilla.org/show_bug.cgi?id=1079525 waiting for approval
- https://bugzilla.mozilla.org/show_bug.cgi?id=1078911 waiting for solution (2.0?)
- SFE General: YELLOW
- 12 Blockers -> https://wiki.mozilla.org/FirefoxOS/systemsfe/releasetracking#FxOS-Systems_Frontend_Blocker_2.1_Dashboard
- 3 Nominations -> https://wiki.mozilla.org/FirefoxOS/systemsfe/releasetracking#FxOS-Systems_Frontend_Nomination_2.1_Dashboard
- Standups are being held daily
- Verifications
- This verification is blocked by not having the right type of app->https://bugzilla.mozilla.org/show_bug.cgi?id=846200#c55
Systems Platform
- Health: Green
Metrics Testing =
- Health: Yellow
- Blockers:
- https://bugzilla.mozilla.org/show_bug.cgi?id=1071451 - new
Telephony/Networking
- RIL: Green
- 0 Blockers
- [NFC]
- Health: Green
- blockers: 1
- https://bugzilla.mozilla.org/show_bug.cgi?id=1074083 (RESOLVED FIXED)
- Vender issues:
Devices
- [Bluetooth]
- Health: Yellow
- Blockers: 3
- https://bugzilla.mozilla.org/show_bug.cgi?id=1052304 (patch review+)
- https://bugzilla.mozilla.org/show_bug.cgi?id=1072802 (RESOLVED FIXED)
- https://bugzilla.mozilla.org/show_bug.cgi?id=1079093 (ASSIGNED)
- [MTP]
- Health: Green
- Blockers: 2
- https://bugzilla.mozilla.org/show_bug.cgi?id=1074600 (dup of bug 1074604)
- https://bugzilla.mozilla.org/show_bug.cgi?id=1074604 (waiting for 2.1 approval)
- Vendor issues:
Graphics
- Health: RED
- Blockers: 9 (Likely that they won't be all resolved before Oct. 10th)
- There are 5 blockers that are in the NEW status for past 3 weeks
- https://bugzilla.mozilla.org/show_bug.cgi?id=1042291
- https://bugzilla.mozilla.org/show_bug.cgi?id=1064918 (This one was last modified a week ago and no progress)
- https://bugzilla.mozilla.org/show_bug.cgi?id=1070199
- https://bugzilla.mozilla.org/show_bug.cgi?id=1029552
- https://bugzilla.mozilla.org/show_bug.cgi?id=1062792
- Remaining blockers:
- https://bugzilla.mozilla.org/show_bug.cgi?id=1073252
- https://bugzilla.mozilla.org/show_bug.cgi?id=1073290
- https://bugzilla.mozilla.org/show_bug.cgi?id=1075719
- https://bugzilla.mozilla.org/show_bug.cgi?id=1075077
- 6 noms, 2 of them are from the assessment of slipped feature bug 995519
2.1 Smoketests
- https://bugzilla.mozilla.org/show_bug.cgi?id=1063658 is affecting ST on 2.1
- Having a number of issues with Bluetooth
2.2 Smoketests
- Biggest regression this week was calendar app not launching at all -> https://bugzilla.mozilla.org/show_bug.cgi?id=1078244
- One remaining Bluetooth bug seems to be stalled
https://bugzilla.mozilla.org/show_bug.cgi?id=1077165
Performance
- Health: YELLOW
- https://wiki.mozilla.org/B2G/QA/2014-10-02_Performance_Acceptance
- https://groups.google.com/d/msg/mozilla.dev.gaia/XbY-muL53LE/Vj2ZaZ0l9RoJ
- https://bugzilla.mozilla.org/show_bug.cgi?id=1079585
- Bug 1079585 - [Meta] Meta bug for 2.1 release acceptance performance issues
- Discuss your dependency bugs that are blocking 2.1+ with your teams
- All apps except Video, Settings, and SMS regressed to some degree from 2.0.
- Bugs will be filed on regressing apps, even if not over the 1000 ms acceptance threshold, but it's unclear if they will block.
- Due to regression, it's worth discussing these with your teams as well.
Stability
Agenda
- [Tony] Doing a smoketest sweep with every team. Complete by next week wed
- [PBylenga] add Camera testing (Face Recognition and touch to focus)
- [PBylenga] added https://moztrap.mozilla.org/manage/cases/?filter-id=14789
- [PBylenga] add Camera testing (Face Recognition and touch to focus)
- [Tony] Portland workweek Dec 1-5 (will have 2 days QA breakout sessions)
- Are individual teams triaging the bugs found during the exploratory run?