Firefox/Channels/Meetings/2019-11-12

Channel Meeting Details

• Tuesdays 10am and Thursdays at 8am Pacific Time
• irc.mozilla.org #planning for backchannel

Video/Teleconference Details

• Zoom Meeting ID: 266 532 573
• https://mozilla.zoom.us/j/266532573
• +17207072699,,266532573# US
• Find your local number: https://zoom.us/u/agItTmqIu

REMEMBER

These notes are read by people who weren't able to attend the meeting. Please make sure to include links and context so they can be understood.

Attendees

• RyanVM, lizzard, Aryx, philipp, jcristau, overholt, pascal,tania, Thomas, dveditz

Schedule Update

Current releases dashboard: https://mozilla.github.io/delivery-dashboard

• 71.0b9 build Monday - desktop+fennec
  • l10n test failures but should be testable
  • released this morning
• 68.3b4 shipped

• 70.0.2 on standby. (ie, the driver for this no longer exists)

• Fennec 68.2.1 gtb coming soon
  • 68.2.2 is still possible, but not certain

Release metrics

Report on release criteria metrics from DRIs https://docs.google.com/spreadsheets/d/1SCFDvnKGHSd7BvAvIAXA135IQnp0W4Mik9Y-jgImaJ8/edit#gid=30214901

• Stability
• Performance
• Security
• Functionality

Off-train releases

Current Shield studies: https://strategy-and-insights.mozilla.com/shield-studies/index.html

Stability

Nightly

Crash Rate overall 2.01 Crash Incidence overall 5.81%, Mission Control v1 rate 5.97 Thursday Crash Rate overall 1.64 Crash Incidence overall 5.57%, Mission Control v1 rate 6.26

• https://bugzilla.mozilla.org/show_bug.cgi?id=1595093 is #4 overall. May be the same cause as the bug referenced in the last comment
• #5 overall has a fix https://bugzilla.mozilla.org/show_bug.cgi?id=1594850
• #6 overall core networking crash is now assigned https://bugzilla.mozilla.org/show_bug.cgi?id=1593545
• #11 overall Fission crash https://bugzilla.mozilla.org/show_bug.cgi?id=1581138 had a one day spike with 94 crashes/1 install, but the per day crash count is small

Beta

Crash Rate overall 1.86 Crash Incidence overall 1.17%, Mission Control v1 rate 3.29 Thursday Crash Rate overall 1.76 Crash Incidence overall 1.14, Mission Control v1 rate 3.31 [71.0b8]

• mc2 scores have become a bit worse since last week, no obvious crash spikes visible in socorro though
• a couple of low volume regressions in 71 from bug 1550108: https://bugzilla.mozilla.org/buglist.cgi?list_id=14984849&o1=equals&o2=substring&v1=1550108&v2=crash&f1=regressed_by&f2=keywords

Release

Crash Rate overall 1.43 Crash Incidence overall 1.02%, Mission Control v1 rate 2.35 Thursday Crash Rate overall 1.41 Crash Incidence overall 0.77%, Mission Control v1 rate 2.51

• Still waiting for an answer to https://bugzilla.mozilla.org/show_bug.cgi?id=1538541
  • AI for marcia to ping victor on slack
• Crash in [@ mozilla::ipc::PrincipalInfoToPrincipal] increasing up to a few hundred daily reports again: https://bugzilla.mozilla.org/show_bug.cgi?id=1582647
  • looks like it's triggered by a third-party website change
• Some ongoing discussion in https://bugzilla.mozilla.org/show_bug.cgi?id=1581121 about crashes with third-party distro built versions (30% of linux browser crashes)

Mobile

• Crash rate is calculated based on usage hours (the time Firefox is actively used).
• Usage hours will be significantly lower on Fennec than on desktop Firefox, so we can't compare mobile rates to desktop rates.

Nightly

fennec nightly summary score: 69.50, Thursday 70.21

• Nothing specific to highlight for Fennec nightly

Beta

fennec beta summary score: 49.89, Thursday 50.19

• * Nothing specific to highlight for Fennec beta

Release

fennec release summary score: 17.48, Thursday 17.59

• Filed https://bugzilla.mozilla.org/show_bug.cgi?id=1595821 to account for newish crash which affects Motorola and API 27
• Top crash https://bugzilla.mozilla.org/show_bug.cgi?id=1587166 continues to affect Huwaei devices
  • AI for marcia to follow up on email thread

Fenix/Firefox Preview

• Spike reported last week in https://bugzilla.mozilla.org/show_bug.cgi?id=1594734 turned out to be all reports are going to Socorro now
• Filed https://bugzilla.mozilla.org/show_bug.cgi?id=1595804 to account for the #2 crash on nightly branch

QA

Nightly

• Fx72 features awaiting documentation/more information:
  • (PI-335) DNS Suffix List and TRR split horizon - there’s some initial documentation that we can use to start drafting a test plan, but we need more details
  • (PI-342) Mixed Content Blocker - there’s strong initial documentation that we can use to start drafting a test plan, but we need more details
  • (PI-316) DNS over HTTPS mode 3 - there’s no information in the ticket
  • (PI-284, PI-345) ServiceWorkers e10s redesign - A bunch of open questions (refer to PI-345, following up with @jstutte)

Beta

• Features that might get Yellow/Red sign-offs:
  • New Certificate Viewer (about:certificate) - No Beta testing was requested although the feature is pref'd on and planning to ride the train. Simple feature but QA still suggests to get smoke testing performed prior to pre-release feature QA sign-off.
  • Feature Promotion Doorhanger for STP, Cryptominer, Fingerprinter - https://bugzilla.mozilla.org/show_bug.cgi?id=1588706 is still reproducible
  • Celebration toast (ETP protection reminders) - we have an open Blocker 1593258

• PI-377- DevTools What's New Panel - Exception Approval process has been initiated. Waiting for leadership team's approval