Mobile/Testing/10 28 15

From MozillaWiki
Jump to: navigation, search

Previous Action Items

  • snorp to file a bug for gecko-on-ios testing

Status reports

Dev team

Rel Eng

  • decommissioned more pandas and foopies bug 1193002. When can we switch to running Android 4.3 on m-a, m-b and m-c? What are the proposed dates for talos on autophone? (Just wondering because we would like to decomm some more pandas)
  • working on a presentation for a releng conference at LISA next month on how we scale Android testing

A Team

  • android-2-3-armv7-api9 Total failure rate: [3.62%]
    • last week 1.46%
    • total failure excluding retries 2.72%
  • android-4-3-armv7-api11 Total failure rate: [2.63%]
    • last week 2.53%
    • total failure excluding retries 1.54%

Data fetched for: 2015-10-20 16:11 — 2015-10-26 21:33

Autophone

  • bc was out most of last week on pto.
  • backlog is pretty high. Does not appear related to infrastructure but is due more to load. May need to institute automatic cancelling of jobs when the backlog is too high. Will still be able to backfill jobs if needed.
  • Bug 1219287 - Autophone - investigate apparent Nexus S regression in S1S2 Throbber start and stop around 2015-10-22
  • Bug 1214812 - Autophone - re-enable mochitest-dom-media tests
    • Working on Nexus S try but not the other devices. Still investigating.
  • Bug 1205836 - Autophone - investigate orange for remote nytimes s1s2
    • Power on tweaks before tests did not help.
  • Bug 1216636] rck3 doesn't summarize iterations well, tp4m/tsvgx have code to support iterations, but we only do 1
    • jmaher is close to finishing up the patch.
    • We will still need to figure out failure to push talos test manifest on the OSX host once this lands.
  • Ted is close to finishing Bug 1069556 - Get rid of local patches, sync back up with Breakpad upstream. Need to update local minidump_stackwalk on the host.
  • deployments
    • Bug 1214531 - Autophone - submitting Talos jobs to Treeherder causes 500 Server errors.
    • Bug 1214831 - Autophone - 2015-10-15 pm deployment
      • Bug 1214530 - Autophone - do not repeat wait-for-device in adb commands
      • Bug 1214588 - Autophone - limit try to specific low volume devices
      • Bug 1214727 - Autophone - adb_android.py ADBDevice.power_on() requires root
      • Bug 1214739 - Autophone - disable Talos except on try
    • Bug 1216089 - Autophone - unprotected reboot in PhoneWorker.ping can kill worker if it fails
    • Bug 1216690 - Autophone - audit and pass root to adb when function contains a root argument.

Perfherder

  • Android APK size and other build metrics should be in perfherder soon, pending review bug 1149164

Round Table

Action Items