Mobile/Testing/06 26 13
From MozillaWiki
Contents
Previous Action Items
- Joduinn going to follow up with bmoss about his ideas on the tegra move decision
-
Jmaher and team going to keep digging into the failure rate spike, potentially rolling back the recent sutagent change- Rolling back sutagent change seemed to fix things
-
Bc will have an update on autophone reftest testing next week- Mochitests seem more promising
- callek has on his plate this week to write up a concise plan to update the watcher across the board.
-
gbrown - will start on making a new image for the pandas to address the retry bug, and then we can use mozpool to distribute it.
Status reports
Dev team
- liuche is landing bug 872329 - Settings UI - today: affects lots of robocop tests
Rel Eng
- kmoir - panda android with mozharness/mozpool for non-talos tests now in production bug 829211
IT
- Higher density chassis is racked in the data center.
- Tegra move - mrz is working on a proposal to present to the team for review
- Draft https://mana.mozilla.org/wiki/display/~mzeier@mozilla.com/Tegra+-+Migration+out+of+650+Castro
- There has been email back and forth on this, nothing is finalized yet.
A Team
- tegra failure rate: [2.19%]
- m3, m8 are the most problematic
- panda failure rate: [16.82%]
- rc2 is our largest offender
top orange factor bugs:
- bug 807230 - Intermittent DMError: Automation Error: Timeout in command {ls,ps,isdir,mkdr}
- bug 711725 - Tegras and Pandas disconnect with "remoteFailed: [Failure instance: Traceback (failure with no frames):
- bug 845162 - Intermittent Android timeout in test_replay_metadata.html,test_playback_rate.html,test_bug495145.htm...
- bug 689856 - Android tests intermittently just stop
- bug 881404 - Intermittent dom/workers/test/test_closeOnGC.html | Test timed out
other features and bugs:
- bug 877266 Flag and manifest changes for reftests on pandas landed on inbound.
- bug 881897 Reduce amount of polling and data transfer to hopefully reduce frequency of bug 807230
- I have a try run in place which seems promising, but more testing required.
x86 automation
Autophone
- bc in Toronto this week. Some phones down and not recoverable until Friday night. Jobs are queued and will be processed once the phones are recovered.
- Transitioned to new mac mini autophone server.
- Worked on running autophone mochitests with skia enabled. Have some patches in development but delayed due to work week travel.
Eideticker
- Figured out problem with imgur test (bug 884907), just an errant link.
Round Table
- Can help to avoid SUTAgent deployment problems by asking RelEng to test in staging prior to deployment
Action Items
- ctalbert, dminor, gbrown to sort out x86 ownership for Q3
- kmoir to update patch for bug 882324 to run panda reftests