Mobile/Testing/11 12 14
From MozillaWiki
Contents
Previous Action Items
- wlach will experiment with running (fewer) eideticker tests against mozilla-inbound, maybe with 1 more device
- mcote will look into getting a resource to look after emulator issues
- mcote will check in with dminor about possible irregularities in weekly failure rates
- dminor was indeed getting the stats at various points; agreed to peg them to 12:00 am Wednesday to ensure that they match week by week.
Status reports
Dev team
Rel Eng
- jlund: split APK builds are available on cedar bug 1073772. Next step after he returns from a conference this week is to enable nightlies bug 1073772
- kmoir: changes for single locale builds on m-b and m-r for android have landed, working to fix to some issues where bouncer and balrog is not updated correctly bug 1019724
Relops
A Team
- android2.3 Total failure rate: [2.85%]
- last week 2.2%
- total failure excluding retries 1.29%
- android4.0 Total failure rate: [20.51%]
- last week 18.18%
- total failure excluding retries 0.86%
Data fetched for: 2014-11-05 03:53 — 2014-11-11 23:32
Autophone
- Downtime last week was due to a failed usb hub.
- The bad hub has been replaced and an additional hub has been added to power the cooling pads.
- System has been stable since hub additions.
- nexus-5-kot49h-1's battery died and it can no longer boot.
- A replacement battery has been ordered and hopefully the non user replaceable battery can be replaced. Backup Nexus 5 devices are in SF. Missing mozilla-inbound testing on Nexus 5.
- Deferred bug 1078645 - Autophone - support/document use of emulators instead of physical devices.
- Continued to find edge case failures handling orphaned emulators on OS X during testing. Sorry I spent so much time on this, but it always seemed like it was very close to completion and I was reluctant to give up.
- Working on bug 1079923 - Autophone - update unittests to fix bitrot.
- Have logcat submission to S3 and linking of logcat from Treeherder for all tests working.
- Have Unittests running, will be ready to test submitting logs to S3/Treeherder today.
- Outstanding issue is how closely I need to mimick the production logs to get benefit of Treeherder parsing.
- bug 1068759 - Add video tests
- Waiting on bug 1079923
- Will need to enable and configure wifi on devices in QA Lab.
Eideticker
- Inbound builds up for a subset of tests (still running rest on m-c, since we can't have two devices working on the same branch in parallel): http://eideticker.mozilla.org/#/android/samsung-gn/mozilla-inbound/startup-abouthome-dirty/timetostableframe/7
Round Table
Action Items
- mcote will look into getting a resource to look after emulator issues
- mcote will check in with dminor about possible irregularities in weekly failure rates
- dminor was indeed getting the stats at various points; agreed to peg them to 12:00 am Wednesday to ensure that they match week by week.