Mobile/Testing/02 26 14

From MozillaWiki
Jump to: navigation, search

Previous Action Items

  • Callek to followup on ant install - bug 971841
  • wlach will send email about Datazilla, notifications, etc (for improvements to find gradual, long-term regressions)
  • Talos tests for GeckoView?

Status reports

Dev team

Rel Eng

IT

A Team

  • tegra failure rate: [2.01%]
    • last week 2.08
  • panda failure rate: [15.86%]
    • last week 15.03
    • excluding retries 0.86%

Slow Reftests bug 967913

  • Not successful with SPS
    • Difficulties connecting / retrieving profile on emulators on ec2
      • just too slow to deal with remote debugging connection
    • Able to get profile from local instance of emulator
      • Fennec would crash after 15 - 20 seconds with profiler connected
      • Profile I retrieved did not seem useful
  • When running locally, emulator can complete 32% of chunk 1 vs. 4% on ec2
  • I've created a c3.large instance to see if aws instance type has substantial impact on running time

Android 2.3 emulator

Autophone

  • 2014-02-24 PM - Landed bug 968920 - use standard error percentage as a discriminator.
    • Currently 'rejects' tests which have standard error as percentage of mean over 10%. If a measurement is 'rejected', it is retried once. You can toggle the display of 'rejected' measurements via a checkbox. This is intended to reduce noise from transient phone conditions. Currently, 20_64_32_4f_e9_4f_samsung-gs2 is not producing reliable remote test results and is falling behind.
  • Working on bug 969518 - attempt to use reverse tethering so we can use ethernet over usb instead of wifi.
    • Possible approaches are using ppp over adb and RNDIS over usb. First investigating ppp over adb.

Eideticker

Round Table

Action Items