Firefox QA Standup - July 15th, 2015

Dial-in Information

• Wednesdays, 8:30am Pacific Time
• Telephone:
• 650-903-0800 or 650-215-1282 x92 Conf# 99779 (US/INTL)
• 1-800-707-2533 (pin 369) Conf# 99779 (US)
• Vidyo Room: QA-Desktop
• Vidyo Guest URL
• Agenda and notes: etherpad
• Archives: wiki.mozilla.org
• Previous Meeting: https://wiki.mozilla.org/QA/Firefox/TeamMeetings/Firefox-QA-Staff-07-08-2015

Attendees: Florin, Catalin V., Camelia, Bogdan, lmandel, Otilia, Teodora, Ioana,maja_zf

Discussion Items

• [Florin] Desktop General status - https://etherpad.mozilla.org/DesktopManualQAWeeklyStatus
  • 40.0 Beta 3 & 4 builds - signed off
  • Exploratory testing - Full screen functionality - requested by Lawrence (https://bugzilla.mozilla.org/show_bug.cgi?id=1176233)
  • Windows 10 testing
  • Regression testing - e10s
  • Main focus:
    • 40.0 Beta builds validation - Beta 5 & 6
    • Windows 10 testing - high priority at the moment
    • Regression testing - e10s

• [Florin] Major New Desktop Features status:

• • [Cornel] Windows 10
    • Several fixes are still waiting for uplift to Beta 40.
    • The issues related to Continuum / Tablet Mode are currently severely affecting eligible devices.
    • Currently working on verifying the new fixes landed/uplifted on Beta 40 and triage for the new bugs affecting Windows 10.
    • Feature status for the previous week: https://wiki.mozilla.org/QA/Desktop_Firefox/Features/Windows_10/July06-July10-QA-Status

• • [Cornel] Suggested tiles: Sponsored
    • Feature successfully uplifted to Fx 40 beta.
    • No major updates.

• • [Bogdan] Hello - Context
    • Feature looks good in Firefox Nightly (there are a few new issues but nothing major)
    • More uplifts to Firefox 40 beta are needed in order to catch 40 release

• • [Ica] Add-ons Signing
    • Firefox 40 - Firefox warns about signatures and allows the installation of unverified add-ons
    • Firefox 41 (beta and release versions) - The unsigned add-ons will not be installed. There will be a preference that will allow signature enforcement to be disabled.
    • Firefox 42 (beta and release versions) - Firefox will not allow unsigned extensions to be installed, with no override
    • No major or critical bugs.

• [Ioana] Mobile updates:
  • Firefox for Android 40 Beta 4 - almost done - mail coming soon
    • no new major issue found, took longer as for b4 we always run BFTs
    • as soon as Appthwack is done will send the results
  • Features - we will try to present updates here starting next week
    • atm we do not have major feature - 42 will bring Tracking Protection
    • a bit harder as we do not use a public place like trello

Project Updates

• E10S (Tracy)

• Graphics (ashughes)

• Metrics / Dashboards (KaiRo)
  • Reasons for increasing/decreasing scores in Top Crash Scores are color-code now, e.g. https://crash-analysis.mozilla.com/rkaiser/crash-report-tools/score/?version=40.0b3&limit=30

• Stability (KaiRo)
  • Flash crashes spiked, probably an issue that Adobe got reported by Google as well and which they fixed in the newest updates along with the security issues.
  • We have some issues with Flash symbols, working on sorting them out.

• EME automation + YouTube MSE automation [sydpolk] [read-only]
  • Q3 focus for media work will be:
    • network bandwidth limiting tests (MSE) (sydpolk)
    • moving short video tests into buildbot to run per commit (but still report as "Tier-2" to Treeherder -- i.e. no backouts by sheriffs in case of test failure) (maja_zf)

• Mobile

Notes and Actions

Heads-Up

• Upcoming PTOs:
  • Andrei Vaida - July 13th to July 24th
  • Alexandra Lucinet - July 17th & 20th
  • Syd Polk - TRIBE training July 15 and 16; PTO July 21
  • maja_zf - July 20, 21
  • kbrosnan - July 24 to Aug 3
  • Teodora Vermesan - July 30 - August 12
  • Flaviu Cos - July 20th to August 07th
  • Otilia Anica - Aug 10-24
  • Ioana - July 17th - 24th
  • Mihai Pop - Paternity leave - July 14th - 27th
  • KaiRo - August 1-9, in Mountain View office Aug 10-15

• Events
  • [Florin] Firefox 40 Beta 3 Testday last Friday (July 10th) - https://etherpad.mozilla.org/testday-20150710
    • only the Bangladesh community participated with 14 people (possibly a new record)
    • exploratory testing + lots of bug fixes verified
    • some audio issues were reported with Hello by two people - working with them to file a bug
    • Marcia received some complaints that testday events are not visible on the main QMO page - agreed to also add posts for the testdays (weekly bugdays remain events only)

Community

Channel Status

Release (Fx 39)(Desktop - KaiRo Mobile - Ioana/Kevin)

• We had a pretty large malware-related crash spike last week, but it looks like the malware shipped an update to fix the crashes.
• Overall, we so far do not know of a trigger for a point release, though the issue with editing (bug 1181130) is at least a ride-along if we find a trigger, and there might be one or two smaller ride-alongs. Still, looks like quality of the 39 release is pretty good! Thanks to everyone who helped get it there!

Beta (Fx40) (Desktop - KaiRo Mobile - Ioana/Kevin)

• Stability is pretty impressive and better than in the last cycles.
• Discussions ongoing if we might delay shipping of Hello Conversation Context feature.

Aurora (Fx 41) (Desktop - KaiRo Mobile - Ioana/Kevin)

• e10s, esp. combined with a11y, still the largest issue on Dev Edition

Nightly (Fx 42) (Desktop - KaiRo Mobile - Ioana/Kevin)

• Nightly crashes have been spiking this week, there are signs that the offending patch might now have been uplifted to Dev Edition :(

ESR (Fx 31.8.0)

• [Catalin] We verified the code signing on Mac Os X 10.9 and Mac Os X 10.10 and Fx 31.8.0 is correctly whitelisted. No further follow-up is necessary.

ESR (Fx 38.1.0)

Security

Automation (whimboo)

• General
  • send issues to Dave Hunt. Whimboo is on parental leave.

• Mozmill / Marionette (whimboo)