QA/Automation/Meetings/111005
From MozillaWiki
< QA | Automation | Meetings
previous meeting | Meetings | next meeting »
Contents
Dial in
# 650-903-0800 or 650-215-1282 x92 Conf# 315 (US/INTL) # 1-800-707-2533 (pin 369) Conf# 315 (US) # irc.mozilla.org #mozmill for backchannel
Attendees
- DavidB, DavidC, Dave, Matt, John, Al, Henrik, Anthony
Last Weeks Action Items
- [DROPPED] Henrik: Exploratory task, to further understand what Automation Services needs to provide, and the priority
- What was this task about? It's unclear for all of us
- [DONE] DavidC: Understanding of how webapps market place tests / amo tests will coexist
- If split happens for AMO and apps we would have to split the tests
- [DONE] Henrik: Moving Project Pages
- [DONE] David B / Henrik: Responsible for reformatting Project Pages
Roundtable
- Do we want to continue with a separate meeting for Endurance Tests?
- Review Q3 Goals
- Q4 - https://mozqa.sync.in/mozauto-goals11Q4
- Next meeting:
- Chair: David
- Notes: Henrik
Goals Overview 11/Q3
Please mark topics which need to be discussed in the meeting as bold
Issues / Blockers
- TBD.
Automated Testing for WebApps
- Mohamed and Henrik finished up proof on concept for testing the OWA extension; will be included in the daily test-run so we see results on our dashboard
- Henrik is working on a blog post for Q3 retrospective
- Follow up with OWA devs necessary to plan goals for Q4
- David built / configured a jenkins instance
- Setup CI on openwebapps for javascript tests
- Setup CI on for unit tests of the OWA Extension
Team Presence (Documentation)
- Project pages have been moved to our new Automation Services team page; Old Test Automation page can be abandoned soon.
Infrastructure
- TBD.
Selenium Grid 2
- TBD.
Endurance Tests
- TBD.
Project Updates
Please mark topics which need to be discussed in the meeting as bold
Infrastructure
- Shadow test server
- No changes in last two weeks
- On Demand Server (ESX)
- Updates for last two weeks:
- DClarke's Jenkins VM is up and running.
- GMealer's WebDev VM is up and running
- Updates for last two weeks:
- Mozmill Servers
- Al will be doing a test update to VMware Fusion 4.0.2 on QA-Mozmill today.
- If this works, other Mozmill boxes will be upgraded during next week as opportunity presents itself (in concert with ASHughes and HSkupin approval).
- New Mac Minis (8) and new HP rackable servers (8) should arrive during next week.
- Al will be doing a test update to VMware Fusion 4.0.2 on QA-Mozmill today.
- Cloud Automation
Case Conductor (TCM)
- TBD.
Mozmill
- Tests
- Q3:
- 5 Add-ons Manager, 5 Discovery Pane, and 1 App-tab test landed (+1 from our goal)
- 1 Endurance test landed (-7 from our goal)
- Q4:
- Functional: Want to focus more on tests which will ease manual testing during release burden
- Endurance: Want to focus much more time (~50%), perhaps aligned to the MemShrink project
- Community: Want set a "mentorship" goal, maybe use the "mozmill-test-skipped" query as a gateway
- Q3:
- Broken Tests
- Current Top: Nightly (8), Aurora (8), Beta (4), Release (1), 1.9.2 (17)
- Q4: 0 failures on Release/Beta/Aurora, Disable tests on 1.9.2
- Shared Modules
- Redesign Shared Modules
- A couple of tests have been ported by Geo, Dave, and Henrik
- API's got a good push forward and seem to be nearly ready for the browser window
- Automation Scripts
- Dashboard
- Mozmill Crowd
- New version of environments with fixed versions of tools included will be released soon
- On-demand Test Execution
Selenium
- Grid
- Mobile
Other
- E.g. JMeter
Personal Status
For the personal status please check the weekly status updates:
Meeting Notes
Action items
- [NEW] DavidB/Henrik: Add section for goals review to scrum pads
- [NEW] DavidB/Henrik: Start brainstorming for overall goals until end of 2012
- [NEW] Dave: Cancel future endurance test meetings and incorporate updates into meeting template
- [NEW] Matt: Send out email for final goal definition deadline
- [NEW] DavidB: Send out email for proposals for Q4 goals