Mobile/Testing/05 06 15

Status reports

Dev team

• Are we working on being able to use our production emulators to run tests locally?

Rel Eng

• tested running Android 4.3 debug mochitests on c3.xlarge bug 1160183

A Team

• android-2-3-armv7-api9 Total failure rate: [2.21%]
  • last week 1.35%
  • total failure excluding retries 2.07%
• android-4-3-armv7-api11 Total failure rate: [3.59%]
  • last week 3.57%
  • total failure excluding retries 3.3%

Data fetched for: 2015-04-29 10:12 — 2015-05-05 21:51

• [gbrown] More test chunks needed, but out of builders. bug 1156425

Autophone

• Product Bugs
  • Tracking bug autophone-throbber, bug autophone-unittest
  • bug 1160288, bug 1160294, bug 1160338
• Deployments
  • bug 1161784 Autophone - unplanned downtime 2015-05-05
    • Caused by update to Python 2.7.9. Partially resolved by installing Python 2.7.6 macport; updated to Python 2.7.8.
  • bug 1160155 - Autophone next deployment
    • bug 1150111 Autophone - Add nytimes to page load tests will be fixed.
    • bug 1151882 Autophone - re-enable remote tests will be fixed.
    • bug 1119654 - Autophone - remove sensitive information from autophone.ini under review
      • Will finally check in production configurations. Will distribute mozilla-inbound across two devices where available and distribute others branches across remaining devices. Load on all devices will increase and we may have to adjust for stability and throughput.
    • bug 1162022 Autophone - --close-when-done --autorun no longer supported in testing/mochitest/runtests.py patch under review

Eideticker

• Seems to be working a bit more reliably with a timeout set on jobs
• Potential startup regression -- waiting for more data to verify that it's sustained -- http://eideticker.mozilla.org/#/android/samsung-gn/mozilla-central/startup-abouthome-dirty/timetostableframe/7

Round Table

• [gbrown] bug 1159875 Revive the areweslimyet harness
• [gbrown] bug 1054648 seems stalled and frequently affects 4.3 Debug mochitests

Action Items

• kmoir will start running Android 4.3 debug mochitests on try on c3.xlarge
• gbrown to write up wiki article on mochitest on emulator
• snorp to look into GeckoView "kitchen sink"