QA/StaffMeetings/QA-Staff-01-29-2014
From MozillaWiki
< QA | StaffMeetings
Contents
QA Staff Meeting January 29, 2014
# Every Weds @ 1:30p Pacific Time - Mozilla HQ, Warp Core # # Vidyo: https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh # Phone: +1 650 903 0800 or 650-215-1282 x92 Conf# 9245 (US/INTL) # +1 800 707 2533 (pin 369) Conf# 9245 (US Toll Free) # +1 416 848 3114 x92 Conf# 9245 (Canada) # IRC: irc://irc.mozilla.org:6697/#qa
QA Org Items
QA Show and Tell
https://wiki.mozilla.org/QA/Show-and-Tell#Schedule
- This week:
- edwong: Preview of Fx Accounts on Desktop
- Next week:
New Hires & Interviews
- B2G QA team has a few phone screens, and 1 successful onsite yesterday
Upcoming Events/Conferences
- MWC 2014 (2/24 - 2/28). Devices to arrive this week, then testing in progress
- FOSDEM (this weekend, 2/1-2/2) - KaiRo and Henrik will be there.
Notices
Travel / PTO
- [nhirata] temporarily working from Mi currently still, flying back to SFO : feb 8th
- [ctalbert] paternity leave
- [delphine] Fosdem + working from Paris office, Jan 27- Feb 12
- [mwobensmith] PTO 1/30-1/31
- [mbrandt] Birthday PTO 1/31
- [juanb] Birthday PTO 1/31
- [marcia] PTO 1/31
- [jsmith] System frontend Workweek Paris [feb 2 ~ 8]
- [tony] MWC 2/24-2/28, PTO hawaii 3/5-3/20
Roundtable/Discussion Items
- Update re: etherpad->wiki format [geo]
- TL;DL: thanks tons, works a lot better! Please do stick to */= format, and make sure only public info goes into pad.
- Reminder about MozTrap cleanup (email sent earlier this week) [marcia]
QA Team Updates
Desktop (Juan)
- Firefox
- Fx27 on schedule for release.
- Fx for Windows 8 Touch (formerly Metro) will ride Fx28 train. It will be on beta after merge.
- ESR (mwobensmith)
- Prepping for 24.3 release
- Stability (KaiRo)
- PushClipstoDT was a large part of the increased crashes in beta 27
- https://crash-analysis.mozilla.com/bsmedberg/26-to-27-browser.csv
- Graphics card reset in windows makes Firefox crash. Have not tracked down exact range in nightly to find out what triggers this crash more often, but it even regresses more from 27 to 28 from all we know and is at >7% of all crashes on Aurora. We will change to new version of D2D somewhere down the road (Firefox 30?) but we want a stopgap fix for 28 - have contacted Milan and release managers to get this prioritized.
- PushClipstoDT was a large part of the increased crashes in beta 27
- Automation (ashughes)
- Security (mwobensmith)
- TLS 1.1/1.2 compatibility testing for Fx27 complete
- Community
Mobile (Tony)
- SIM Card/SD Card holders for all! ping tchung if interested.
- Firefox for Android (Kevin/Aaron)
- Roadmap update for quarter. see https://wiki.mozilla.org/Mobile/Roadmap
- Synthesized APK Web App support landing; currently looking for issues with the development APK Factory server
- Fx27 b10 shipped
- Firefox account builds still on services-central, when is merge to nightly?
- Nick/Richard does them manually, no schedule ^
- Home Panel customization landed
- Stability (kbrosnan)
- B2G (Geo/jhammink)
- working on 1.4 roadmap. switching to a 12-week cycle
- testcases for 1.3
- collections (jammink/jsmith)
- new features for 1.4 needing testcases (jammink/nhirata/jsmith):
- Exploratory testing - error pages & SIM customizations (jsmith)
- WebRTC P2P Exploratory testing (jsmith)
- Stability (nhirata)
- https://wiki.mozilla.org/CrashKill/2014-01-27#B2G
- new crash bug 964537, bug 964328
- escalated issues for 1.1 stated in https://etherpad.mozilla.org/b2g-meeting-notes
- platform has been concentrated on articulating compatibility program strategy, getting ready for higher-level review
- qablocker keyword (priority status for bugs causing automation/test coverage regressions) shopped around all stakeholders, message going out to drivers this week.
- Geo, Marcia, and Naoki starting working group for initial FxOS One and Done tasks. Talk to one of us if you want to participate.
- Install emulator (Naoki's VM) and set up build for automation work
- Install b2g desktop for blackbox work
- blackbox regression test run (on b2g desktop, probably)
- ad hoc exercises (on b2g desktop, probably)
- ???
- profit
- Geo and Marcia working on "health report," i.e. product quality reporting, using media team as pilot. Includes determination of metrics + baselines on a functional team level. Will expand out to product level after, including metrics/baselines for Q1 goal.
- Initial notes from kickoff/scoping meeting between Geo, Marcia, and John Hammink. Straw man will follow: https://etherpad.mozilla.org/fxos-qa-health-report
- Community Members Onboarding
Services (Edwin)
- Identity/Persona
- Train rolled back due to marketplace bug
- service outages due to disk space issues and broken alarms
- FxA + Sync
- Targeting turn on in Nightly 2/3
- Desktop Builds - testing blitz
- https://wiki.mozilla.org/index.php?title=User_Services/Sync/SetupSyncNext
- functional and load testing on Sync1.5 cluster
- CampaignManager
- annoucements are being sent out to android Fx nightly this week
- Test planning FxOS: WiMF and FxAccounts
Web (Stephen)
- Bob Silverberg has built upon Vaidik's original Dashboard work, and extended and combined it with Marketplace-specific test-results/visibility:
- Affiliates
- Show notes from the last meeting - Afflilaties 2.0 redesign wireframes were discussed - https://affiliates.etherpad.mozilla.org/status-2014-01-24
- B2G/Gaia testing:
- Working with the A-team to continue to make our test/reports more useful, including, esp. on failure:
- https://bugzilla.mozilla.org/show_bug.cgi?id=959520 - Make socket.timeout error messages more useful
- more in the works to help with crashes (auto-submit, auto-collate, etc.)
- https://bugzilla.mozilla.org/show_bug.cgi?id=962700 - [meta] Tracking bug for [auto?] submitting, and potentially being able to list, crashes, while running Gaia UI Tests
- https://bugzilla.mozilla.org/show_bug.cgi?id=959520 - Make socket.timeout error messages more useful
- https://bugzilla.mozilla.org/show_bug.cgi?id=964918 - unittest which is finding potential memory-pressure issues (gfx?)
- now using 2 daily builds -- 1 for Taipei, 1 for Web QA's testing (same tests)
- https://bugzilla.mozilla.org/show_bug.cgi?id=962363
- moar coverage, less work, less redundancy == #win
- also, will not affect Zac/Web QA's report, which will continue to be sent and used by the smoketest team
- https://bugzilla.mozilla.org/show_bug.cgi?id=962363
- now using newly-released Marionette_client 0.7.3:
- http://pastebin.mozilla.org/4131857 (lots of new capabilities/refinements)
- Tarako work is finding some good bugs (memory/perf-related?):
- https://bugzilla.mozilla.org/show_bug.cgi?id=964566 - [perf][Tarako] JavaScriptException: TypeError widgetFrame is undefined app://system.gaiamobile.org/js/cost_control.js, line 116
- https://bugzilla.mozilla.org/show_bug.cgi?id=964587 - [perf] [Tarako] JavascriptException: TypeError: app is undefined app://system.gaiamobile.org/js/window_manager.js, line 884
- Dave Hunt has a patch which will soon land, that should shave ~30 minutes off our device runs:
- https://bugzilla.mozilla.org/show_bug.cgi?id=959217 - Switch tests to the new Marionette wait class
- Working with the A-team to continue to make our test/reports more useful, including, esp. on failure:
- Bouncer
- No updates
- Engagement Projects
- no updates
- Firefox Health Report
- no updates
- Firefox Marketplace
- Krupa's in a work week in Portland, for Payments
- Mozilla.com
- big release/push on Monday, couple of releases since
- Mozillians
- Seeking feedback from the community on the https://mozillians.etherpad.mozilla.org/signup-change-proposal
- Hosted a targeted testing event for the new Curate Groups feature - 15 people attended - https://mozillians.etherpad.mozilla.org/curated-groups-ux-qa
- MDN
- continuous deployment; no updates this week
- Socorro
- Milestone 72 releaed yesterday - https://bugzilla.mozilla.org/show_bug.cgi?id=960656
- Major refactoring of production configs shipped, getting us further down the road to getting the majority of configs open sourced.
- [stage]Bug 965244 - release 72 has broken the cron submitter - https://bugzilla.mozilla.org/show_bug.cgi?id=965244
- Moving to a daily release window of 10am - we will ship daily if we have something worthy
- Milestone 72 releaed yesterday - https://bugzilla.mozilla.org/show_bug.cgi?id=960656
- SUMO
- continuous deployment; no updates this week
- Community Members Onboarding
- Automation Badges post thanking Ivana Catovic for her work: https://quality.mozilla.org/2014/01/webqa-different-ways-to-contribute/
- gnerkus joined the channel & earned the Running QA Automation badge
Community (Marcia)
- Projects
- Firefox OS Tablet Distribution Program
- http://asadotzler.com/2014/01/21/firefox-os-tablet-contribution-program-participation/
- Please think about good candidates from a QA perspective who should get these tablets
- One and Done
- Show and Tell at the start of last week's QA meeting https://vreplay.mozilla.com/replay/showRecordingExternal.html?key=x6QWbQ21oFPXsMi
- Waiting for security review before going live with Version 1 Milestone 1 https://bugzilla.mozilla.org/show_bug.cgi?id=956719 Yvan Boily is assigned.
- Accessibility Testing requested by stephend from Marco Zehe, David Bolter, Trevor Saunders, Alexander Surkov and Eitan Isaacson.
- kthiessen will be asking for small test cases from B2G (Geo/Marcia), Fennec (Kevin), and Desktop (Juan). Send him mail if this will be difficult.
- geo and marcia working on FX OS tasks
- Tentative release date of Milestone 1 is Feb 5, 2014
- Open Badges
- pragmatic working to get licensing changed for winning entry for General QA Participating badge. Once that happens we can create a new badge and start awarding it.
- Community Working Groups
- Systems and Data working group meeting on Friday: https://cbt.etherpad.mozilla.org/systemsdata-2014-01-31
- Pathways Working Group meeting Thursday, Jan 30: https://cbt.etherpad.mozilla.org/pathways-2014-meeting-notes
- Firefox OS Tablet Distribution Program
- QA Community Champions - https://wiki.mozilla.org/QA/Community_Champions
- Group is meeting every other Tuesday
- WIP Goals: https://etherpad.mozilla.org/2014-QA-Champion-Goals
- Please provide ideas and feedback to help us onboard new contributors!
- Upcoming Events
- FOSDEM - Brussels - February 1-2, 2014
- Mozilla Devroom: https://fosdem.org/2014/schedule/track/mozilla/
- FOSDEM - Brussels - February 1-2, 2014
- Testdays (ashughes)
- Video Work
- No update this week
- QMO.next (Raymond)
- No update this week
- Community Members Onboarding
- Mountain View/SF Meetups - http://www.meetup.com/The-Mountain-View-Mozilla-Meetup-Group/
- Please email marcia if you have a topic for February
- They can be presentations or interactive testing sessions
- Please email marcia if you have a topic for February
Firefox Automation (Henrik)
- General
- Automation Development report – week 51/52 2013: http://www.hskupin.info/2014/01/24/automation-development-report-week-5152-2013/
- Team goals for Q1 have been set: https://wiki.mozilla.org/QA/Automation#Goals
- As a note we want to revamp our automation testdays to make automation more attractive to contributors and increase their skills
- Projects
- Mozmill
- Mozmill 2.0.4 will be released today or tomorrow. Only a single blocker is remaining. With it on mozmill-ci production on Monday, we should have a green testrun for the upcoming 28.0 beta tests
- One of our most annoying Firefox crashes (cycle collector) has finally been fixed on Nightly and Aurora, so we are fine for beta releases.
- Mozmill Tests
- Metro library is under final review. It might land soon.
- Mozmill
- MozTrap (Cameron)
- Community Members Onboarding
- samgtr for mozmill and mozdownload
Notes, Takeaways and Action Items
Today
- Notes
- Action Items
- B2G team owes workweek rollup to rest of team/dev-quality [carryover]
- Karl + others: get items for One and Done [carryover]
- Volunteers for Show and Tell [carryover]
- Stephen to ping Simon (if not Yvan) re: security review 1and Done
- Team: contribute to meetup groups w/ Marcia, email ideas, availability, etc.
Last Meeting
- Action Items
- Karl + others: get items for One and Done
- Volunteers for Show and Tell
- B2G team owes workweek rollup to rest of team/dev-quality
Template available at: https://etherpad.mozilla.org/qa-staff-template