Mobile/Testing/02 05 14
From MozillaWiki
Contents
Previous Action Items
-
snorp will verify that flash apk installed on pandas via try - snorp will talk to jmaher about talos improvements to find gradual, long-term regressions
Status reports
Dev team
Rel Eng
IT
aws vpn/releng scl3 fw - releng looking at offloading traffic from the aws ip-sec tunnels (HG is particularly heavy). This should lighten the load on the fw.
A Team
- tegra failure rate: [6.46%]
- last week 2.54
- panda failure rate: [16.42%]
- last week 27.08
- excluding retries 1%
Android 2.3 emulator
- mozharness updated
- all tests running (and failing) on Ash
Android x86 emulator
Autophone
- bug 967052 Autophone - improve UI to handle large numbers of phones and repositories.
- Tested using /data/local/tmp/profile for profile locations. This appears to help reduce the variability of the measurements. See bug 852264 - [s1s2] don't hardcode URLs for local test files. Waiting for review. Since this will change the measurement values, I am taking the opportunity to clean up the Twitter test page to remove unused Javascript elasticsearch code.
- Investigated using usb networking.
- usb reverse tethering is a possibility though support across versions is problematic. Reached out to Szymon at Google. He provided some suggestions and the following:
- snorp mentioned adb port forwarding, but I haven't been able to get this to work.
- Have the two Nexus 5 phones. Will get them online after bug 852264 lands.
- Will set up two instances of Autophone:
- s1s2 testing with traffic shaping using mac mini host
- mochitest canvas skia testing without traffic shaping using linux vm.
Eideticker
Round Table
- Android startup crashes: bug 959254, bug 957433, etc
- If we end up needing Android 2.3 on pandas for performance testing, will we need more panda infrastructure? Is the current panda infrastructure being fully utilized (efficiently)?
- SUTAgent isn't connecting to test server
- wget issue?
Action Items
- snorp will talk to jmaher about talos improvements to find gradual, long-term regressions
- gbrown will investigate slow Android 2.3 reftests
- gbrown will follow-up on startup crashes with :glandium
- jake will ask around about bug 967452