Mobile/Testing/11 25 15

From MozillaWiki
Jump to: navigation, search

Previous Action Items

Status reports

Dev team

Rel Eng

  • Alin working on enabling Mochitest push for Android 4.3 bug 1214362

A Team

  • android-2-3-armv7-api9 Total failure rate: [1.28%]
    • last week 1.18%
    • total failure excluding retries 1.06%
  • android-4-3-armv7-api11 Total failure rate: [2.25%]
    • last week 1.7%
    • total failure excluding retries 1.56%

Data fetched for: 2015-11-17 01:21 — 2015-11-23 13:09

Autophone

  • bug 1214812 - Autophone - re-enable mochitest-dom-media tests
  • bug 1129534 - Autophone - Replace autophone.qa.mtv2.mozilla.com
    • Waiting on response from Van about USB-C connectors on Nexus 6P and the HP DL 120 servers. The phones are still USB2 even though they have USB-C connectors.
    • Nexus 6P availability is good. Once I order, it shouldn't take long for them to ship. Planning on ordering 8 Nexus 6P. Will receive the devices, flash AOSP builds and test then ship to Mountain View for deployment with the new linux servers.
    • Marcia shipped spare Autophone devices to me. ETA 2015-11-30. I will flash AOSP builds on the Nexus devices and verify they work well with Autophone then ship back to Mountain View.
    • Hoping for mid-December deployment but early January is more probable.
  • Load
    • We have been experiencing large backlogs on some devices, particularly the Nexus S devices.
    • The Nexus S devices also had a network outage yesterday that was not seen on the Nexus 4, 5 or 7 devices. They may have more issues with the Wifi network in the lab. I may disable the remote tests on Nexus S.
    • I have identified a delay during the throbber measurements that may be preventable.
    • We will only increase the load when the mochitest-dom-media tests are enabled.
    • After I fix the unnecessary delay in throbber measurements, I will update the manifests to reduce the number of tests in order to keep up with the load.
  • Flash
    • I would like to uninstall Flash from the devices by default and have the autophone robocop flash test automatically install and uninstall Flash for the test. I believe this may alleviate some of the nytimes only oranges/crashes we have been seeing in the S1S2 tests. We would still be able to detect if Flash still works using the autophone robocop test. We can revisit this if it does not move the orange needle on nytimes.

Perfherder

Round Table

Action Items

Retrieved from "https://wiki.mozilla.org/index.php?title=Mobile/Testing/11_25_15&oldid=1107227"