QA/StaffMeetings/QA-Staff-05-29-2013

5 May 29, 2013

# Every Weds @ 1:30p Pacific Time - Mozilla HQ, Warp Core 
#
# Vidyo:  https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh
# Phone:  +1 650 903 0800 or 650-215-1282 x92 Conf# 9245 (US/INTL)
#         +1 800 707 2533 (pin 369) Conf# 9245 (US Toll Free)
#         +1 416 848 3114 x92 Conf# 9245 (Canada)
# IRC:    irc://irc.mozilla.org:6697/#qa

QA Org Items

   New Hires & Interns

   June 3rd - Swaroopa (intern) for b2g starting : mentor-jhammink

   June 3rd - Vaidik for Web QA (Marketplace): mentor-Krupa

   June 3rd - Samvedena for Desktop: mentor-Anthony

   Upcoming Events/Conferences 

   B2G 1.1 mini workweek in SD (naoki)

   Selenium Conference, June 10-12th

   Notices

   Anthony Hughes will be late to this meeting due to meeting conflict

Travel / PTO

   [jsmith] WebRTC Work Week in Mountain View - June 10th - June 14th

   [jsmith] PTO on 5/30/2013

   [jsmith] Remote in NY on 5/28, 5/29, and 6/1

   [kbrosnan] PTO 5/30, 6/3-6/7

   [henrik] Jun 2nd - Jun 8th in MV for mini Metro automation work week

   [marcia] PTO May 29-31

   [geo] PTO Tuesday+Wednesday 5/28+29 (come to http://www.baycon.org/ !)

   [karl] PTO Thur - Tues -- see above re: BayCon ^^

   [nhirata] Travel : Wed 5/29 evening ~ Sat 6/2 evening San Diego Leo Work Week

   [ashughes] June 3-7 in MV

QA Team Updates

Desktop (Juan)

   Firefox 

   Firefox 22.0 Beta 3 to ship Thursday

   Had a meeting with Asa about Firefox roadmap. It will be communicated by him soon.

   Metro Firefox iteration #7 completed this week

   ESR (mwobensmith) 

   Stability (marcia) 

   https://bugzilla.mozilla.org/show_bug.cgi?id=876143 was filed to backfill the data missing on 5-25. There is also data missing on 5-21.

   Aurora

   https://bugzilla.mozilla.org/show_bug.cgi?id=860641 - Top Aurora crash but latest comment indicates Relevant Knowledge is investigating

   https://bugzilla.mozilla.org/show_bug.cgi?id=869027 is the #3 top crash and has had no movement since last week

   Beta

   https://bugzilla.mozilla.org/show_bug.cgi?id=829954 showed up on the explosive report as a 3 day spike

   Release

   Nothing to report for release - crash rates look very good

   Trunk

   https://bugzilla.mozilla.org/show_bug.cgi?id=875757 was backed out but was pretty explosive on the trunk causing almost 66K crashes on the trunk in the last few days

   Automation (ashughes)

   WebRTC (jsmith)

   Media flow checking mochitests updated and ready for review

   Exploratory testing on incoming blockers

   Next focus - more exploratory testing + media track peer connection automation

   Security (mwobensmith)

   More mixed content testing

   Community 

Mobile (Tony)

   Firefox for Android (Kevin/Aaron) 

   looking for any dynamic toolbar blockers

   Nightly & aurora users

   Performance stats gathered for Product

   https://wiki.mozilla.org/User:Dria/Benchmarks_May_2013

   https://docs.google.com/a/mozilla.com/spreadsheet/ccc?key=0Au1s5D7T3IY-dENzcGFQM3IzSzdJMUZscklMbjVJeWc#gid=0 requires a mozilla.com google docs account

   Stability (nhirata) 

   No Crashkill meeting due to Memorial Day:

   Nightly spiked over the weekend : 

   https://bugzilla.mozilla.org/show_bug.cgi?id=875757

   https://bugzilla.mozilla.org/show_bug.cgi?id=876270

   Database crashes and Flash crashes remain the top types of crash

   B2G (Geo/jhammink) 

   1.0.1

   1.0.1 now in IOT #3 (chile,spain) and IOT #2 (poland)

   IOT Chile  - OEM is planning to pick a build for IOT #3 in the next few days; doesn't fix all the bugs though.

   1.0.1 B2G Release checkist : https://etherpad.mozilla.org/b2g-release-checklist

   Outstanding issues with Youtube app, Google calendar API certs

   1.1

   1.1.0 Testrun - 90% Complete (seeing if QAnalysts can cover more cases and what's blocking)

   Query on "inarirun2' whiteboard for associated failures: http://mzl.la/12Prb03

   1.1 triage is now driven by Leo team (with Mozilla's help)

   MMS excluded from testrun but testcases about to be imported

   TEF also not involved with testrun

   1.2 

   specs are forming now in mozilla box account

   sprint planning discussions and feature work

   Swaroopa starts next week 

   Qanalysts - Steven Thompson resigned, Eliot Sands stepping in

   Stability (nhirata)

    https://bugzilla.mozilla.org/show_bug.cgi?id=875132

   unagi on MC issue

   Leo device still needs some help w/ RIL.  

   Going to Leo Work week to try to sort that out.

   Apps (jsmith)

   One off partner app customization testing as needed

   Still battling trying to get YouTube functional for 1.01

   Community Members Onboarding

Services (Edwin)

   Identity

   AWS is live!

   gmail-bigtent build to QA tomorrow - deploy end of Q2

   B2G tests PR submitted, but pending as it's old code

   Mozilla idp - testing - karl

   jenkins/sauce - automation stability - karl

   Services

   simplePush

   edwin: just ran unit tests. working on b2g flow

   jbonacci:

   Working with zaach on ideas for PiCL IdP and Server

   Working with JR on server-side stuff

   sync - (jbonacci) issues, so many issues

   Working with OPs and Dev and some possible short and long-term fixes

   These ideas will be carried forward to PiCL Server

   heka - used by push and picl - jbo/karl

   jbonacci: working with RaFromBRC on heka stand-alone testing and on usage for PiCL IdP and Server

   picl (jbonacci)

   Full steam ahead on architecture for client (desktop/android), IdP, and Server

   Server stack to include some Services team services: Loads, Marteau, Vaurien, Heka, etc.

   Testable client: TBD

   Testable server: TBD

   FFos support - PiCL v2

   location services- starting up

Web (Stephen)

   B2G/Gaia testing: 

   Added another Inari running v1.0.1 to the mix, so now have 6 running tests (and 3 Unagis, still, running v1-train)

   Reviewing test results this week has been distracted by changes to Marionette's tap logic which has necessitated a change to almost every test but it is a necessary step to be using native taps rather than synthesized taps

   bugs are marked as blocking https://bugzilla.mozilla.org/show_bug.cgi?id=801898 - Get GaiaTest UI smoke tests running reliably in Jenkins CI, and we're working with the A-team on them

   All Marketplace testing blocked by dev change to app packaging https://bugzilla.mozilla.org/show_bug.cgi?id=875261

   New contributor 'sleepr' running b2g desktop ui tests

   Engagement Projects 

    Minor updates pushed to Firefox Flicks

   Firefox Health Report

   Test harness coming soon - https://bugzilla.mozilla.org/show_bug.cgi?id=872094

   Updates - https://etherpad.mozilla.org/FHRMeeting

   Firefox Marketplace 

    http://bit.ly/112RBsC ships on 05/30

   Mozilla.com 

    weekly release shipped 05/29

   Mozillians 

    Targeting a small release for tomorrow 

   https://github.com/mozilla/mozillians/compare/df40c9b567c6bc1797e3da878ad52755995e640d...master

   MDN 

    continuous deployment, no QA updates for now

   Socorro 

    Milestone 48 slated to be released tomorrow

   https://wiki.mozilla.org/Socorro:Releases

   Community Members Onboarding

    sleepr is running Desktop B2G tests (Gaia UI Tests)

Community (Marcia)

   Projects  

   Open Badges - https://mozqa.etherpad.mozilla.org/QA-Badge-Brainstorm

   Parul working on formulating specifics of what the design challenge similar to the one that Web Dev ran. Need to define some of the parameters of how the badges need to look before the design challenge can be posted

   Upcoming Events  

      Mozilla Summit - October

   Invitations have gone out to community and registration will commence

   Email went out from Mardi about next steps

   https://blog.mozilla.org/community/2013/05/24/the-difficult-task-of-deciding/

      Mozilla Summit Assembly - June 14-16 in Paris.

      http://sf.adacamp.org/ - Mozilla is a Gold Sponsor.

      Mozilla Reps events: https://reps.mozilla.oarg/events/#/period/future/

   Testdays (ashughes)

   Anthony to begin mentoring Gabriela to have our first contributor organized testday (date TBD)

   No testdays on the immediate horizon, please contact Anthony Hughes ASAP if you have a testday you want organized (particularly WebQA, Services, Automation)

   mwobensmith would like to plan a Mixed Content Blocking test day in the very near future

   Metro Firefox test day to be scheduled soon.

   Video Work

    No update this week

   QMO.next (Raymond)

    no update

   Community Members Onboarding

Automation Development (Henrik, Dave)

   General

   Projects

   B2G performance

   We are now measuring inaris. See https://datazilla.moz3illa.org/b2g/ and select inari under device.

   Mozmill (Henrik)

   There are a couple of issues left before Mozmill 2.0 rc4 can be released

   We are pretty close to have a green testrun for our Firefox desktop tests (except restart tests)

   Mozmill CI (Henrik)

   Everything is now alive in the new cluster in MPT. The old CI cluster has been shutdown finally!

   Testing Ubuntu 13.04 on staging - new VMs will be requested if everything runs stable enough soon

   Working on getting the l10n tests moved to the production CI

   Web QA

   New version of pytest mozwebqa preparing for release this week

   Followed (hopefully) by pytest browsermob and zap proxy plugins

   Finished prototype of Firefox download link tests using browser

   MozTrap (Cameron)

    Rebecca Billings taking over as the front-line for QA requests.

   Community Members Onboarding 

Roundtable/Discussion Items

   [jsmith] FYI - Commit level access is going to be applied to Mozilla github repositories

   [mschifer] Test Days - participation and planning.

   [camd/rbillings] - Rebecca taking the lead on QA admin requests for MozTrap

   [tchung] - discuss the FFOS train proposal?

Notes, Takeaways and Action Items

   Today 

   Notes

   Action Items    

   Last Meeting 

   Action Items