Web Testing/Automation/automation-13-05-2011

<< Last meeting | WebQA Automation | Next meeting >>

Discussion topics

• Waverly working with WebQA now. Currently plowing through code reviews
• Selenium Grid 2.0 progress
• Renaming Selenium environments - proposal is here: https://github.com/davehunt/moz-grid-config/blob/new-environment-names/grid_configuration.yml
• Py.Test doesn't give us a testrun duration in the results XML so we're missing out on some reporting. See http://qa-selenium.mv.mozilla.com:8080/job/input.stage/478/testReport/history/?
• Conftest.py -- everyone know it?
• Unless you have a specific need, we shouldn't be using Firefox4b;en-us;MacOSX6 in tests
  • Related -- Raymond and I talked yesterday about auto-updating an Aurora build on Mac in our env.
    • wget the build, rm -rf the old build/dir, mv the new build to the Applications folder?
• Would like dev/trunk, next/stage, prod test runs
• Where are we with marking tests for specific environments, etc?
• Wishlist from Stephen: BFT/smoketest-style suite for new Engagement projects
  • Think: David's security suite (Garmr) + server status, basic tests, etc.
    • Really lightweight, but useful -- goal is to increase awareness of staging-server/project suck
      • I offer https://webifyme-dev.allizom.org/ as an example

Status Update

AMO | CI

• David has taken over Ayan's tests for AMO Builder Tasks
• Test Day organised for 24-05-11 Blog Post
• Can we fix http://viewvc.svn.mozilla.org/vc?view=revision&sortby=date&revision=88309?
  • Commit that broke it: https://github.com/jbalogh/zamboni/commit/5dc1cfe79ff99fe7c93d01041eb61757137d737b#diff-11

SUMO CI

• SUMO tests migrated to GitHub
• 'Ask A Question' test is up [1]
• 'KB articles' test is coming up

Input CI

• Dave H. is currently fixing the broken build. Have brought in command-line stuff to simplify things.
  • This impacts all open pull requests
  • Removed vars.py completely - we should apply this to other test repos using conftest.py

Socorro CI

• 8 failures are a combo of missing data/tests which need updating

MDN CI

Mozilla.com CI

Action Items

• Make sure each team member has merge ability
• Change to the new Grid naming for Browser-Environments
• Py.Test test run times
  • Have a look at Py.Test and AMO.Rewrite
• Project owners to update their vars.py to Dave's new conftest.py changes
• Speak to Py.Test about decorators for tests and perhaps fix the bug