QA/StaffMeetings/QA-Staff-02-05-2014

From MozillaWiki
Jump to: navigation, search

Mozilla QA Meeting February 5, 2014 (Video Replay)

# Every Weds @ 1:30p Pacific Time - Mozilla HQ, Warp Core 
#
# Vidyo:  https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh
# Phone:  +1 650 903 0800 or 650-215-1282 x92 Conf# 9245 (US/INTL)
#         +1 800 707 2533 (pin 369) Conf# 9245 (US Toll Free)
#         +1 416 848 3114 x92 Conf# 9245 (Canada)
# IRC:    irc://irc.mozilla.org:6697/#qa

QA Org Items

QA Show and Tell

https://wiki.mozilla.org/QA/Show-and-Tell#Schedule

  • This week:
    • Mochitest On-Device [dclarke]
  • Next week:

New Hires & Interviews

Upcoming Events/Conferences

Notices

Travel / PTO

  • [nhirata] temporarily working from Mi currently still, flying back to SFO : feb 8th
  • [delphine] Working from Paris office, Jan 27- Feb 12
  • [jsmith] System front end Work week Paris [feb 2 ~ 8]
  • [tony] MWC 2/24-2/28, PTO hawaii 3/5-3/20
  • [ashughes] afk this afternoon, back online this evening
  • [mbrandt] 2/25 - 3/1 Posse Roundup Uncon - focus on CD and quality
  • [mwobensmith] 2/6-2/7 PTO
  • [marcia] Mozilla Reps Leadership Meetup 2/15-2/16
  • [geo] 2/28, 3/3 PTO

Roundtable/Discussion Items

  • Regression ranges, per Clint's email
    • Geo: we're trying to determine how to give guidance on criteria for doing these within FxOS. Understanding how to communicate the threshold for "high priority" and "when needed" would help greatly.
      • Mozregression, when do we need regression ranges versus when do we not? Does every blocker need them? Not, but we need to set those expectations
      • Query the backlog of these - check the whine
  • Anthony's graphs from https://ashughes.com/?p=139 (Kevin)

QA Team Updates

Desktop (Juan)

  • Firefox
  • ESR (mwobensmith)
    • Successful launch of 24.3.0
  • Stability (KaiRo)
  • Automation (ashughes)
    • I never have anything to talk about here, can we just roll this into Henrik's section?
  • Security (mwobensmith)
    • Test planning for X-CSP deprecation and safe download feature
  • Community

Mobile (Tony)

  • Firefox for Android (Kevin/Aaron)
    • (not unless this changed in the last hour) Respinning Firefox 28.0b1 for https://bugzilla.mozilla.org/show_bug.cgi?id=968171
    • Sync fully testable with desktop
    • Stability (kbrosnan)
      • Crash rate for 27 release looks similar to 26.0 around 2.0 crashes per 100/adu
  • B2G (Geo/jhammink)
    • Test Runs, etc for 1.3.
      • WAP Push host and VM Config being tested by Qanalysts/Enpei
      • L10n run starting this week
      • possible targetted testrun next week
      • MWC Testing going on including edge gestures (jammink + QAnalysts) and WebRTC (Nils O. + QAnalysts)
        • Reference device has a *LOT* of bustage, needs new base image
        • 1.1 partner device, alot more stable; some minor issues
        • 1.3 device (testing still in progress)
    • Analysing new features for 1.4
      • Committed, Targeted and backlogged features
    • Stability (nhirata)
    • qablocker keyword communicated to drivers and will be used in triage. Please use on bugs that break automation execution or prevent reasonably efficient execution of manual test runs. Add info re: what's impacted and when the next run would be (or if an important cycle is being interrupted).
    • Marcia and Geo continuing work on Health Report/product metrics: https://etherpad.mozilla.org/fxos-qa-health-report -- will be building a "weekly report" against Media team this week to get an idea of whether effort is reasonable and info useful.
    • Performance
      • Eideticker parts all in Mountain View, building out harness this week. First tasks are improving the calibration demos to understand how sensitive Eideticker is re: distinguishing frames, etc.
    • Platform
      • dclarke has over 200k mochitests running on-device against inari! Next step is to triage down to a device-agnostic compatibility set by running against other devices and excluding failures.
      • Packaging WebAPI compatibility test work for handoff to CRB/compatibility programs
      • Will be contacting module owners soon regarding transitioning ownership of B2G mochitest enabling to dev
    • Community Members Onboarding

Services (Edwin)

  • Persona
    • Train pushed - couple hot patches
  • FxA + Sync
    • Landed in Nightly 2/1.
    • Cross team testing effort: Desktop/Android/Servers
    • Updating TPS, automated sync test to use FxA
    • Load testing against all servers this week
    • Internal community test day soon
    • Planning/Organizing performance monitoring
  • CampaignManager
    • Annoucements going out to some versions/channels now.

Web (Stephen)

Community (Marcia)

Firefox Automation (Henrik)

  • General
  • Projects
    • Mozmill
      • Mozmill 2.0.4 has been released but we detected that the issue Andrei was facing last week (multiple Firefox instances open) finally hit us again!
      • The underlying fix is deep process handling code in mozprocess and mozrunner
      • Final fix from Henrik has been reviewed and all pieces have to get landed. We will release mozmill 2.0.5 at latest tomorrow
      • Because of the network outage from yesterday we missed to test all builds for today because the pulse listeners were not working
  • MozTrap (Cameron)
  • Community Members Onboarding

Notes, Takeaways and Action Items

Today

  • Notes
  • Action Items
    • [Geo] move "Last Meeting" action items to top of template
    • [Geo] followup with Clint re: regression range criteria
    • Karl + others: get items for One and Done [carryover]
    • B2G team owes workweek rollup to rest of team/dev-quality [carryover]
    • Volunteers for Show and Tell [carryover]
    • Team: contribute to meetup groups w/ Marcia, email ideas, availability, etc. [carryover]

Last Meeting

  • Action Items from last meeting (2014-01-29)
    • B2G team owes workweek rollup to rest of team/dev-quality [carryover]
    • Karl + others: get items for One and Done [carryover]
    • Volunteers for Show and Tell [carryover]
    • Team: contribute to meetup groups w/ Marcia, email ideas, availability, etc.

Template available at: https://etherpad.mozilla.org/qa-staff-template

Retrieved from "https://wiki.mozilla.org/index.php?title=QA/StaffMeetings/QA-Staff-02-05-2014&oldid=920372"