QA/Test Automation/2011-03-09
From MozillaWiki
< QA | Test Automation
previous meeting | Meetings | next meeting »
Contents
- 1 Dial in
- 2 Attendees
- 3 Last weeks action Items
- 4 Goals Overview
- 5 Risky Goals
- 6 Project Status
- 7 Personal Status
- 8 Roundtable
- 9 Meeting Notes
Dial in
# 650-903-0800 or 650-215-1282 x92 Conf# 315 (US/INTL) # 1-800-707-2533 (pin 369) Conf# 315 (US) # irc.mozilla.org #mozmill for backchannel
Attendees
- ashughes - away at dentist
Last weeks action Items
- Geo
- [DONE] Document failed test process from henrik's email at appropriate place
- Added instructions to disable/re-enable Litmus to Fixing Broken Tests
- Henrik
- [DONE] Send mail to qa-auto for proposal of mozmill-tests refactor (bug 637306)
- [DONE] Send mail for possible qa automation work week
- Matt
- [DONE] Talk with IT to get the shadow server setup
Goals Overview
Risky Goals
Project Status
On-demand update tests (Geo/Henrik)
- Plan for deployment on qa-set done
- Will deploy in parallel copies of the script directories to isolate from current scripts
- Delaying deployment onto Linux due to already-existing VM problems
- notes
- Still working on it
- need to discover
- linux vms are broken on qahorus
- poised to get on qaset
Endurance Tests (Dave/Anthony)
- Add-ons patches landed last week (run with add-ons, download add-ons, report add-ons)
- Memory leak discovered during testday when Greasemonkey is installed. bug 639515
- Notes
- good feadback and tons of results from testday, 1000's of tests
- have checked these results?
- sometime this week for reviewing the results
- good feadback and tons of results from testday, 1000's of tests
Panorama Tests (Anthony/Al)
- 12 tests blocked by bug 629165 due to drag & drop dependencies
- 8 tests currently being developed
- 1 test remaining to be picked up by someone
- 1 test checked-in
- Targeting completion of all unblocked tests by next automation meeting
- Notes
- all but 1 tests is assigned
- get the rest checked in within the next few weeks
- Finishing up Milestone 1
- Currently in Refactor Round, speeding through many small fixes to get code polished and aligned with current standards.
- Discussions continue with A-Team re: upstreaming shared modules. They've agreed to adopt the assertion model and some form of the basic Element class (still working out final structure). Plans are to upstream all Widget classes, though schedule is still being determined.
- Notes
- sprint 1 complete
- negotiating with A-team regarding structure and format. Concerned that they may slow us down.
Shadow web server (Al/Henrik)
- Virtual machine was provisioned at Rackspace this morning.
- Still needs to be configured for net access by Phong.
- Naked server (despite request) so Al gets to go re-learn how to get Apache up and running securely!
- Hope to have everything up and running within next few days and cron job for cloning data from hg configured.
- Notes
- yeah, we have the machine
- Matt owns the domain and needs to transfer to new machine
- naked machine, Al needs to install everything
- not sure what OS distro it is
- certs on sub-domains
- Al will come up with a provision plan
- hg clone of files from litmus
- 15min clone process
- could use hudson
- lets just use cron for now
Others
Mozmill Crowd
- Fixed a problem with the test environment on all platforms which didn't let us specify more than 9 options for the run script
- Investigating a way how to distribute Mercurial pre-installed in test environments without requiring the user to install Xtools on OS X (bug 545432)
- Notes
- should have things resolved next week
Dashboard
- Fix for the l10n view to distinct between fatal and non-fatal assertions
- Notes
- version 2 now
On Demand Provisioning (Cloud Automation) (Al/Henrik)
- Waiting for physical server to arrive and be deployed at PHX colo.
- Last update on March 1 from Phong: "I am going to order a new blade for this and put this in PHX."
- Notes
- waiting for machine to be installed in PHX colo
- General (Henrik)
- Check-ins in the last two weeks
- A couple of failures have been fixed by copying the Ubuntu 10.10 machine from qa-set to qa-horus (Linux VM's still sluggish, probably kernel incompatibilities with vmware tools)
Automation Scripts / Infrastructure (Henrik)
- Rewrite of the automation scripts will start in this week; has to be ready for testday on March 25th
- Notes
Personal Status
For the personal status please check the weekly status updates:
Roundtable
- General
- bug 637306: Final decision for refactoring the mozmill-tests repository
- Refactor Milestone 1 Review
- Notes
- need agreement on directory structure
- Dave proposal looks great
- should files directory become data
- review of milestone 1
- see etherpad above for a comprehensive description