QA/StaffMeetings/QA-Staff-11-28-2012

lNovember 28, 2012

Every Weds @ 1:30p Pacific Time - Mozilla HQ, Warp Core 
# Vidyo:  https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh

     Phone:  +1 650 903 0800 or 650-215-1282 x92 Conf# 9245 (US/INTL)

#         +1 800 707 2533 (pin 369) Conf# 9245 (US Toll Free)
#         +1 416 848 3114 x92 Conf# 9245 (Canada)
# IRC:    irc://irc.mozilla.org:6697/#qa

QA Org Items

   New Hires & Interviews 

   Please join Web QA in welcoming Bob Silverberg to our team!

   http://www.silverwareconsulting.com/

   Web QA is still looking for its intern

   Upcoming Events/Conferences 

   January 31st - Mobile + Web Devcon - John Hammink on Panel Discussion...

   Dec 5 : SF Office: Mobile Monday Holiday Mixer with Mozilla – Opening Up the Web on Mobile - http://www.mobilemonday.us/events/84733542/?eventId=84733542&action=detail

   Notices

Travel / PTO

   marcia PTO 11/30 and 12/5-12/7

   Matt W PTO 12/7

   Softvision is off on Friday, November 30

QA Team Updates Desktop (Juan)

   Firefox 

   Fx17.0.1 (and ESR) on-going chemspill testing. All hands on deck. Please help.

   I think we are all good -- special thanks to juanb, retornam, bsilverberg, mwobensmith, tracy, stephend, marcia, krupa for the help

   Primary drivers for chemspill (in aggregate):

   https://bugzilla.mozilla.org/show_bug.cgi?id=806192

   https://bugzilla.mozilla.org/show_bug.cgi?id=815042

   https://bugzilla.mozilla.org/show_bug.cgi?id=815743

   https://bugzilla.mozilla.org/show_bug.cgi?id=814101

   https://bugzilla.mozilla.org/show_bug.cgi?id=813264

   https://bugzilla.mozilla.org/show_bug.cgi?id=814554

   https://bugzilla.mozilla.org/show_bug.cgi?id=816197

   Fx18b2 expected to be out by end of the week. 

   ESR (ashughes) 

   17.0.1esr coming (see above)

   Stability (marcia) 

   Platform Stability Notes: https://wiki.mozilla.org/Platform/2012-11-27#Stability_Report_.5BWeekly.5D

   Feedback from Engineering that they would like the weekly stability report to change a bit. This will be discussed at the CrashKill meeting next Monday at 10 AM Pacific.

   Automation (ashughes)

   I am working with dev to identify Social API automation test candidates

   Mihaela (SV) is working with dev to identify PDF.js automation test candidates

   Sync Client (Tracy) 

   no client trains recently

   Community 

Mobile (Tony)

   Issues 

   Fennec: 

   fx17 launched, but are we chemspilling 17.0.1? (kevin lead) desktop only

   investigating initial wave of ARMv6 feedback

   If product drops Armv6 spec, request top phones in market, and %

   Fx18 planning work (aaron lead)

   B2G:  

   contracters onboarded, executing testruns (11 now, 15 next week, 20 next 2 weeks)

   testcase clean up part 1 happening.  http://bit.ly/V5a1GF

   If you would like to help, see jhammink

   cutting down on regressions - any bugs being found now that has "regressed", use the "regression" keyword.   I'm pushing for a 24-hr turn around time.

   If you need an unagi device, see Tony

   Fennec (Kevin/Aaron) 

    Stability (nhirata) 

   Things calmed down after the merge and fixes that occurred afterwards.  For graph see platform notes

   Product Announcements (tracy)

   Dev admin page is avalable but staging servers won't be ready 'til tomorrow (Thursday). rnewman provided a testing extension to change a few hard coded prefs to make testing possible.

   Once servers are ready, I'll begin testing this feature end to end as I have access to the CAP (campaign admin page) to send messages at will.

   B2G (Geo/jhammink) 

   Stability (nhirata)

   still need some things fixed for Stability: ADU etc. see bug 761905 for remaining work to be done

   Doc on how to connect Unagi using B2G created

   https://wiki.mozilla.org/B2G/QA/Bugzilla has been revised

   UXBranch ( https://wiki.mozilla.org/Gaia/UX_Branch ) is now underway, QAing happening separately by bug fixes and being pushed in.  

   https://bugzilla.mozilla.org/buglist.cgi?type0-1-0=notsubstring;field0-1-0=status_whiteboard;field0-0-0=status_whiteboard;query_format=advanced;value0-1-0=qa-verified;type0-0-0=substring;value0-0-0=landed%20in%20uxbranch;product=Boot2Gecko;list_id=5070502

   Performance bugs : https://docs.google.com/spreadsheet/ccc?key=0AohBFXQ042pYdEY4MjQ2ZWJyN093Ny14NHlZaXFSRXc#gid=0

   Working with SUMO on feedback bugs: https://docs.google.com/spreadsheet/ccc?key=0Al_zNwSJwvZfdDh4Qkdua2JfR2NTbUFjeExFUTZXWVE#gid=0

   New Usecases report - https://www.dropbox.com/s/9s155c3qm6rk0l7/b2g_untested_usecases_report.pdf

   NH: This report is great.  Having said that, the reason why some of these are blank is because there were some unanswered comments, and looking at the status they are still unanswered.  These use case doesn't satisfy what's in the spec nor what is implemented.  Trying to get buy in from the PMs about this, however I am not having any luck.

   Triaging existing mochitests for inclusion on TBPL. Have found a number of layout tests we can include, a few tests from other areas.

   Working on a semi-automated way to do this test triage, as manual triage is very slow.

   Permissions testing coming together, nearing completion on all three suites as defined at https://wiki.mozilla.org/B2G/QA/API_Permissions_Test_Plan

   Working with A-Team and B2G dev to get permissions handling for functional tests centralized in the framework so we don't get overly derailed by dependency breakage.

   Moztrap Testcases - currently QAnalyst are running testruns against the device and logging review data.   We'll have a pass at fixing these testcases - per review - during this and next week.

   Apps (Jason) 

   Preloaded apps ramp-up and coordination with Karen

   More exploratory testing of the apps flows on device

   Helping with reviews for apps gaia ui test automation

   Pancake (nhirata) 

   Pancake on hiatus

   Community Members Onboarding

Services (jrgm)

   Sync Server (jrgm) - https://wiki.mozilla.org/QA/Sync/

   BrowserID (jrgm) - https://wiki.mozilla.org/QA/BrowserID

   deploying train-2012.11.09 today

   need to get synced up with jsmith on b2g work

Web (Stephen)

   Q1 2013 "Team Event" has been approved (San Francisco, January 14th-18th); straw-man schedule up here: http://lanyrd.com/2013/mozilla-web-qa-q1-work-week/

   Affiliates 

   No updates

   B2G/Gaia testing: 

   Lots of work on stability/reliability in the last week, testing team can start looking at results and having confidence in them

   23 passing tests (including unit tests -- 14 without)

   ...out of 35

   Spreading into tests that send SMS and make calls - useful stuff for the team to have and getting closer to using the device in a 'real' scenario. (it's fun too!)

   Adding in about 1/2 dozen more tests every week but that will increase now we have good infrastructure and more contributors coming on board. 

   tracking remaining Marionette or infra issues here: https://bugzilla.mozilla.org/show_bug.cgi?id=801898

   Bouncer 

   Successful release on 2012-11-28

   Sentry/Bouncer location availability improvements and reporting - https://bugzilla.mozilla.org/show_bug.cgi?id=804347

   Firefox Marketplace 

   http://cl.ly/3H0B0k1w0x2E is going live 11/29

   Mozilla.com 

   http://scrumbu.gs/p/mozilla_org/

   Mozillians 

   No updates

   MDN 

   http://scrumbu.gs/t/mdn/2012-12-04/

   Socorro 

   Milestone 28 slated to be released today

   https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced;target_milestone=28;product=Socorro;list_id=5071991

   Community Members Onboarding

   none this week

Community (Marcia)

   Goals 

   We have completed both goals that we targeted for q4: https://intranet.mozilla.org/QA/Q42012_QAgoals

   Need to start thinking about overall goals for next quarter and next year

   As of yet there is no information about when and where MozCamps will happen in 2013

   Projects

   Ioana was working a blog post regarding the status of One and Done. When pragmatic gets back into town we will be meeting again to figure out next steps.

   Notes from Community Building Meetup:

   https://wiki.mozilla.org/Contribute/Meetup/Singapore_Nov_2012

   There is talk of perhaps having a dedicated Community meetup, but some people in the mailing list feel this would exclude non FTE

   Upcoming Events 

   David Boswell is hosting a Community Building Workshop this Thursday at 10 AM Pacific:

   Video: David Boswell’s vidyo room (Non-LDAP access: https://v.mozilla.com/flex.html?roomdirect.html&key=LagZYeSPnhIA)

   Audio: 1-800-707-2533, pin: 369, conf: 9634#

   Room: Get to do Choppa in Mountain View 3rd floor and SFO 7E in SF

   Back channel: irc.mozilla.org#mozillians

   Agenda: https://wiki.mozilla.org/Grow#Meetings

   Testdays (ashughes)

   There are no upcoming events at this time.

   [juanb] Possibly a per-window private browsing test day next week, depending on stability of feature in develoment branch.

   Video Work

   No active work on videos going on at this time. There is still footage from MozCamp LATAM that needs to be edited.

   QMO.next (Raymond)

   Community Members Onboarding

Automation Development (Henrik, Dave)

   Gaia UI (Dave)

   To improve test stability, any open apps are now killed prior to each test

   Setting/getting settings has been overhauled to be much more robust

   WebAPI (Rob)

   Emulator crash (bug 790463) caused by Telephony tests i now fixed

   More tests for SMS, telephony, and the proximity sensor

   WebRTC (Henrik)

   Identified and reported all found memory leaks with crashtests and mochitests

   Discussion about how to enable faked devices for automated tests ({{bug|815002}))

   Working on first peer connection mochitests

   Mozmill

   New ESX cluster coming along (network configured - VMs need to be deployed soon)

   MozTrap (Cameron)

   1.2.7 run activation perf improvements

   handling 7500 case runs just fine now

   pushed to staging

   scheduled to push to production

   a few other fixes went in as well

   1.3:

   typing filter text perf fix

   links on runs to enter new bugs

   links to lists with filters

   Community Members Onboarding 

Basecamp Roundtable/Discussion Items

   [item here]

Other Roundtable/Discussion Items

   [jsmith] Automation culture across the QA Organization

   Q4 Goals are still missing from some teams: https://intranet.mozilla.org/QA/Q42012_QAgoals. If you are housing your goals on another page, please link to it.

   [marcia] Have we hired any QA interns? [juanb] Do we have any allotment?

   If not, what are we doing to source individuals for these roles?

   [marcia] Does HR have any new strategies for sourcing individuals for other roles within QA? We haven't had many new hires in 2012

Notes, Takeaways and Action Items

   Today 

   Notes

   Action Items

   Last Meeting 

   Action Items 

Template for this document is here: https://etherpad.mozilla.org/qa-staff-template