Mobile/Testing/10 24 12
From MozillaWiki
Contents
Previous Action Items
- blassey to look into 17 beta 2 build bustage
- blassey to get karen to email damon and joduinn about x86 builds
- wlach to get ARMv6 builds running on the existing ARMv7 eideticker hardware
Status reports
Dev team
- Re-landed reftest fix for bug 797942 -- looking much better
- Working on Talos-robocop failures bug 790102
Rel Eng
Tegra
- Deployed bug 804739 - Upgrade SUTAgent to 1.14 on tegras in production
- No issues noticed.
Panda
- Landed bug 802768 Cleanup code, begin to add official panda support to sut_tools
- Still needs to be deployed.
- Does affect tegras, but other than slight messaging changes should be no-op there.
- Foopies 33,34 and 35 configured with pandas from chassis 2, 4 and 5
- bug 803685 - failures when running mochitests on new pandas
- jmaher, wlach, kmoir and wlach are on it
- 13 of 36 pandas running tests on staging, a record
Other
- x86 onhold for now bug 750366
IT
- Pandas - Android
- Developing a remote re-imaging process for pandas bug 764534 - Ready for integration with a-team & RelEng
- Integrating Buildbot/Foopies with BMM/MozPool/Lifeguard bug 805016 - New
- 48 Production ready Pandas bug 800038 - all imaging done, RelEng working on these boards, their tracker bug 799698
- Developing a remote re-imaging process for pandas bug 764534 - Ready for integration with a-team & RelEng
- Pandas - b2g
- Image 12 Pandas by hand for b2g (Chassis 3) bug 797629 - DC Ops working with Clint on issues
- Other Updates
- Tracker bug - 800 production ready panda boards bug 799922
- Order parts for 73 Panda Chassis bug 799808 - In progress, all parts going to chassis assembly vendor
- Working on a higher density chassis bug 777393 - On hold due to recent influx of Panda activity
Jake is out for PTO/Wedding from 10/18-11/2.
A Team (unittests/etc...)
- 21.84% total failure rate
- 15.65% failure rate without rck/rck2/rck3.
- [wlach] just landed bug 801652 to hopefully help better diagnose certain types of failures (esp. mochitest robocop failures)
Autophone
- MozPool code separated from Autophone; in testing.
- Talked to dustin about relationship between Lifeguard and BMM.
- We'll be working together, since the two are tightly related.
- Working on some design documents to better understand the relationship between the two.
Eideticker
- Fixed problems getting proper profile symbols
- Add ability to import backdated information into dashboard
- Used to help track DLBI regressions (bug 770144)
- Added a test for timecube (bug 744724)
- Testing armv6 builds on Galaxy Nexus, as a comparative data point: https://groups.google.com/forum/?fromgroups=#!topic/mozilla.dev.platforms.mobile/-vjMOiCmzS8
- How useful are these? BenWa is looking into the differences on taskjs, but all the other tests look very similar
- Going to look into making better/harder tests with BenWa this week
Round Table
-
(Callek) Many suites hidden (bug 803408) - How can we restore sheriff confidence in android, we need to get these actual problems identified and prioritized. - ASSERTION - Mass Hiding of suites is not the answer.-
(quote-from bug) "All Android reftests on Armv6 and Armv7, and those four robo* talos suites are now hidden on mozilla-inbound, mozilla-central, try, fx-team, services-central and profiling."-
These seem to have been unhidden, across the board, since I added this all here.
-
- (callek) Possibly too broad a scope for this meeting and should be taken to mail/elsewhere?
- (callek) will send mail about this instead, since as of typing this we have 7 min left in mtg, maybe we can discuss next week
-
- The ARMv6 checklist - https://wiki.mozilla.org/Projects/ARMv6_Boards
Action Items
- blassey to attend the meeting next week
- blassey and joduinn to take offline x86 priority
- (kmoir) to get info about why some pandas are failing some things intermittently
- (callek) to followup on the android test orange rate stuff I deferred away from mtg