Mobile/Testing/02 03 16
From MozillaWiki
Contents
Previous Action Items
Status reports
Dev team
Rel Eng
- jlund landed changes to drop api-11-14 bug 1219094 for api 15
- kmoir fixed issues with SETA data, added support for api15 (temp using api11 data to reduce load) in bug 1243877
A Team
- android-2-3-armv7-api9 Total failure rate: [2.27%]
- last week 1.14%
- total failure excluding retries 2.15%
- android-4-3-armv7-api11 Total failure rate: [2.59%]
- last week 1.99%
- total failure excluding retries 1.95%
- android-4-3-armv7-api15 Total failure rate: [2.98%]
- last week 0%
- total failure excluding retries 1.75%
Data fetched for: 2016-01-29 01:47 — 2016-02-01 14:39
- test_offline_page bug 1241478 was the worst offender; now skipped.
- test_awsy_lite results from aurora and beta are available now. beta results are slightly better than central: https://treeherder.mozilla.org/perf.html#/graphs?series=[mozilla-central,f21c544b924f1483a93f689c077ef8c784fb0d14,1]&series=[mozilla-central,08426054ad8117351206558fc3d181a38637744d,1]&series=[mozilla-central,cbb2913b112d415ba79e639ff3f22a1e1a382d65,1]&series=[mozilla-beta,59908c3d619c02498493e97926f4c94468dd0fca,1]&series=[mozilla-beta,3ea9dec624c2255ea1fc13297c0515fa2ad17b74,1]&series=[mozilla-beta,7328297dec0adfb1fb1be9905308e5d3d89c3d32,1]
Autophone
[readonly]
- Helping to test bug 1237755 adb shell am start ... no longer actually opens links if
Fennec is already running
- As part of bug 1243408 - Autophone - update test manifests to better utilize new devices and improve test coverage, Investigating a means using sys.boot_completed, dev.bootcomplete, init.svc.bootanim to improve device readiness detection in the attempt to reduce time spent rebooting during tests in order to increase throughput.
- Investigated using /data/local as test root for Nexus 6P. Need to investigate related Unit Tests to fail.
- Next week will finalize plans for Nexus 6P deployment and other maintenance when kbrosnan is in SF/MV later this month.
- talos on 6p is looking good.
- shall we turn off pandas?
Perfherder
Round Table
- Should we run tests like http://mxr.mozilla.org/mozilla-central/source/layout/generic/crashtests/730559.html?force=1 on Android?
- Notice the extreme dimensions!
- It passes, but requires 3+ minutes to run (load) on Android 4.3 opt; 8+ minutes on Android 4.3 debug.