Mobile/Testing/07 17 13
From MozillaWiki
Contents
Previous Action Items
Status reports
Dev team
- working on a new canvas perf talos test
Rel Eng
- Remaining mozharness/mozpool regressions from Bug 829211
- landed Bug 894512 Split mozpool managed pandas away from talos (non mozpool) pandas
- Landed Bug 891889 (robocop thinks it uses 3 chunks, but only is aware of 2, fixes missing tests)
- TODO:
- Set shutdown.stamp prior to requesting a device from mozpool (no bug yet)
- Make verify.py pass prior-to-mozpool requesting if mozpool state is "ready" Bug 889967 (requires Bug 894512)
IT
- Tegra move - The plan is to move these into the Evelyn office.
- We fixed a majority of the bad pandas that were failing by swapping out the SD Card
- 893998 also previously unknown bad pandas are now alerting now that we removed the 'locked_out' state on all the pandas in mozpool
- Jake is looking into why the sdcards failed in such a hard way that the bootloader wasn't able to be read
A Team
Failure Rates
- tegra failure rate: [1.18%]
- panda failure rate: [31.51%]
- as with last week, mostly due to a large number of retrys
Mobile Bugs in Orange Factor Top 10
- bug 835588 - Intermittent "BaseException: Failed to connect to SUT Agent and retrieve the device root."
- according to bugzilla, pmoore had planned to look at this
Work in progress
- Clint filed project paper work and has requested 16 Ubuntu ix machines
- Working on bug 892569 to be able to run cppunittests from mozharness, including remote versions.
- Added some functionality in bug 893085 to remotecppunittests.py to be able to work from apk
- Can run the tests with a few unexpected results
x86 automation
- See bug 891959 [Tracking] Stand up x86 Automated Testing System using Emulators
- Run-times for most tests determined
- Can likely run 4 concurrent emulators
- Concentrating on test failures now
Autophone
- Relocated router to be near phones 2013-07-17.
- Mochitest canvas tests with SkiaGL enabled started running 2013-07-17.
- Results available at http://brasstacks.mozilla.com/autolog/?tree=mozilla-central&source=autolog
- Initially excluding content/canvas/test/webgl/test_webgl_conformance_test_suite.html due to crash on Motorola Atrix.
- Initial Results
- Motorola Atrix known to complete green during initial development
- Samsung Galaxy S3 completed green
- LG Revolution crashed.
- Issues
- Initial runs failed due to a configuration error
- Initially missing minidump_stackwalk but will fix asap.
Will blog announcement later today when things settle down.
Eideticker
- Working to re-enable profiling, using jchen's patches: bug 803616
Round Table
- [dminor] current status of turning reftests on for pandaboards
- [dividehex] solidify the process of identifying and fixing 'bad pandas'
- [blassey (on behalf of jmaher)] ETA on bug 893949 and bug 893081
Action Items
- [callek] follow up on current state of bug 882324
- [callek] send email outlining new "bad panda" process
- [callek] follow up on bug 893949 and bug 893081