Mobile/Testing/11 20 13

Previous Action Items

• bc to file bugs for skia gl
  • Tracking bug 940992
• bc to complete sutagent 1.20 changes and hand off apk
  • Waiting for testing on staging. Delayed due to Releng work week.
• bc to check with dougt or jduell on importance of network conditioning
  • Consensus appears to keep the conditioning and improve framework to eliminate network bottlenecks for non-test activities.
• gbrown to ensure debug test bugs filed with a meta bug
  • bug 940068 filed
• snorp to try again to repro canvasmark failures
  • see http://puppetagain.pub.build.mozilla.org/data/bmm/artifacts/panda-android-4.0.4_v3.1/ and https://bugzilla.mozilla.org/show_bug.cgi?id=914472#c3
• callek to file bug to turn off canvasmark on pandas for now
  • actually doing said disable is carry over
  • bug 916258

Status reports

Rel Eng

• Jordan (:jlund) updated mobile talos webservers
• Callek, various discussions with IT around tegra/mtv move.

A Team

• tegra failure rate: [1.66%]
• panda failure rate: [10.78%]
  • excluding retries: 1.79

• Working on bug 931926 for cpp unittests on try
  • If that sticks, I'll start work on bug 937637
• Will also start looking at bug 929447 for reftests on trunk trees
• Activity on bug 931882 which will hopefully fix the jit-test that causes retries on Cedar
  • If that fixes things, I'll try to get these scheduled on Try and then on trunk trees

x86 automation

• All tests running hidden on Cedar, with some failures
  • S1 being split into 2 sets because tests generate too much output: bug 939823
  • Random webgl reftest failures/crashes keeping S2 orange
  • S3 green
• Complete:
  • kvm enabled and deployed: bug 929048
  • chunks coalesced, sets coalesced: bug 935214
  • patched emulator deployed: bug 933918
• Working on:
  • deploying new AVD definitions: bug 919812
  • cleaning up remaining failures: bug 936226

Autophone

• Have been testing Mochitest Canvas Skia GL locally. Will begin posting results to Autolog when the set of devices to be used is finalized. Need snorp or someone to review dependencies of bug 940992 to see if the issues are actionable or if those devices should not be used.
• Have generated results around previously reported regressions. Need to triage.
• Temporarily suspended s1s2 throbber testing while evaluating phones for Mochitest Canvas Skia GL testing. Will bring back up shortly and catch up on the backlog.

Round Table

• Shall we observe Meeting Free Week, next week? https://groups.google.com/forum/#!topic/mozilla.dev.planning/rn-wEJWTGgY
• talos tsvgx and tpn need to display on the screen:
  • https://bugzilla.mozilla.org/show_bug.cgi?id=908810

Action Items

• snorp to try again to repro canvasmark failures on panda
  • see http://puppetagain.pub.build.mozilla.org/data/bmm/artifacts/panda-android-4.0.4_v3.1/ and https://bugzilla.mozilla.org/show_bug.cgi?id=914472#c3
• rel-eng to test sut 1.20 in staging
• callek to disable canvasmark on pandas -- bug 916258
• jmaher to follow-up with blassey on talos -- bug 941155
• this meeting cancelled next week