This is a new meeting on mobile automation. Its purpose is to keep abreast of shared code, shared solutions, so we don't end up repeating the same mistakes or re-inventing the wheel. Like the "library" app that mcote is working on which can be re-used for autophone, mozharness, and b2g etc. The other purpose of this meeting is to ensure that priorities are straightened out in terms of projects that impact other projects.

Jmaher's Projects

• Mobile automatoin for android fennec builds
  • Mochitest, reftest, talos on tegra
  • working on bringing up panda boards

mcote projects

• Autophone - converting to use sut agent
  • pulling out the device pool so that we can reuse it as a "library" to check in/check out phones.
  • Runs daily tests - not on change
  • Runs on real physical phones (not android dev boards)
• Might also be working on new desktop C agent

Jgriffin

• B2G automation - continuous integration system using jenkins and runs tests using emulators.
• Need to get tests running on panda boards (mochi, ref, xpcshell, and performance with eieticker)
• Dependencies on releng producing b2g builds for panda boards (need to figure out if that is on their plate --> TODO ping Joduinn
• Flash B2G OS in a production environment - TODO ping Jake
• Mihnea is working on a SUTAgent that works in b2g so we can get away from using adb.

mdas

• B2G automation
  • Getting eideticker working with b2g with pandaboard

ahal

• B2G automation
  • Focused on reftest with emulator.
  • Next will be working on panda boards and marionette as needed and/or mozharness.

Mihnea

• Working on making the c version of hte agent work. Runs on emulator and next needs to make it pass the actual tests.
• Got xpcshell tests working on device (but not on pandas yet)

Clint

• coordinating
• mozharness sut_tools to do a smoke test of the device (make sure all frameworks are working)
• rooting a bunch of phones for use in autophone system

wlachance

• Eideticker
• General mobile automation bugs, mozdevice etc.

callek

• Coordinate with (other) releng and get the client_proxy/sut_tools etc.
• Making it play nicely with buildbot
• Working on linux based foopies
• Talos remote mozharness POC up and running.

bc

• working with mark on autophone
• get unitests running on that system - mochitest and robocop
• working on rooting a new motorola phone that can be used for both autophone and eideticker

robwood

• working on writing tests for b2g - has his fist b2g build up and running.

Issues of The Week

Spurious Reboot Issue

• Sometimes jobs on tegras are magically failing in the middle of the tests
• Looks like the tegra gets rebooted by something when it is halfway through the job
• Have not found root cause as yet
• This is doubling our failure rate on the tests which adds to a lot of load because we automatically retrigger jobs, and that causes a downward sprial.
• Jmaher has a patch logging all SUT agent commands to detail who is connecting and what commands they are coming in.
• Networking infrastructure looks fine.
• Debuging everything - but not turning up any smoking guns at the moment.
• We don't have good places to even begin debugging this problem. Almost anything is possible - perhaps one tegra is grabbing someone else's IP address.
• We had to remove the logging in sut_tools - it wasn't helping.
• Patch to mochi & reftest which outputs result of device manager getinfo so that it will otput things like temperature and memory state.

Mozharness

• Uses mozdevice code - this is POC at the moment
• sut_tools are not integrated in mozharness and probably won't be due to the assumptions they make w.r.t. underlying structures
• Going to move forward using mozdevice in mozharness and EOL sut_tools
• This means we roll rxdroid into mozdevice.
• Existing Rxdroid lives here: https://bugzilla.mozilla.org/show_bug.cgi?id=775256

SUTAgent Tests

• http://hg.mozilla.org/automation/remote-testing/file/6b8020ffa955/tests

The C Agent

• Tomorrow at 10AM PDT (at the end of the b2g automation meeting) we will discuss its architecture.

Panda Boards

• So far working for eideticker on b2g.
• So far can talk over adb
• mdas will publish her build and flash instructions for panda boards
• ted and dividehex working on pxe boot to flash on the fly - seems like there is good progress there, probably not completed yet.
• Concerned that the reftest resolution is too low on pandas. We can't get acceptable resolution and keep the panda boards stable. Pandas seem unstable at anything higher than 1024 x 768
• B2G has dedicated linux box for running reftests via an emulator so that it can run reftests at high resolution.

Android XUL

• Jgriffin will follow up with cjones to see if we can turn off the Android XUL tests once we have emulator reftests for b2g running.

Priorities

• Reboot Issue
• Panda w/ B2G on Eideticker
• C Agent
• "Vidyo rental shoppe" for checking in and checkout out devices - to enable foopy-less support (ideally)
• Panda B2G tests (needs releng support for panda builds, needs C agent, needs flashing)
• Smoketest for pandas and tegras/autophone on dailly builds for testing and performance on real hardware

ACTIONS

• wlach to file bug to figure out what command specifically are needed to be implemented in the C agent in order to get mochitest, reftest, and eideticker running
• Jgriffin (and clint) to follow up with joduinn w.r.t. build support for pandas
• Bc to look into busybox installs on phones to see if it could be useful to run the same set of shell commands on the device.