Auto-tools/Automation Development/Meetings/130930
From MozillaWiki
< Auto-tools | Automation Development | Meetings
previous meeting | Meetings | next meeting »
Contents
Dial in
# When: Every Monday at 8:45am PDT/PST # Vidyo: https://v.mozilla.com/flex.html?roomdirect.html&key=PGtLpx3XQGJz # Phone: 650-903-0800 or 650-215-1282 x92 Conf# 9654 (US/INTL) # 1-800-707-2533 (pin 369) Conf# 9654 (US) # IRC: irc://irc.mozilla.org:6697/#automation # IRC logs: http://irclog.gr/#browse/irc.mozilla.org/automation
General
- Attendees: Mario, Andreea, Cosmin, Henrik, Dave, Otilia, Adrian, Mihai, Andrei
- TBD
- Chair: Dave Hunt
- Notes: Mario
Last Weeks Action Items
- [NEW] Henrik: Update the wiki for quarter goals
- Not done yet - will happen once we got all CI issues fixed
- [DONE] Henrik: Release Mozmill 2.0
Highlights
- [henrik] Automation Development report – week 38 2013
- [henrik] Due to constant crashes, we disabled Windows 8.1 tests until we get the final version of 8.1
- [henrik] Mozmill 2.0 has been released
- [dave] Released b2gperf 0.8
- [dave] Released gaiatest 0.14 & 0.15
- [dave] New blog post - Building a harness for Eideticker... with LEGO
- [henrik] Disabling Windows Defender on all Windows nodes stopped the critical performance issues (see bug 918676)
- [henrik] Windows Error Reporting has been disabled for all of our Windows nodes to stop hanging processes (see bug 920964)
- New blockers, any updates?
-
bug 915697 - Flashing Unagi or Inari devices with latest master build fails and we end up with a black screen - bug 919618 - Create VMs for Windows 8.1 final (x86, x86-64) in qa.scl3.mozilla.com
-
bug 920944 - Two instances of the Homescreen app can be launched - bug 921194 - TypeError: stack is undefined from trusted_ui.js, line 303
-
- You can find all blockers here: http://bit.ly/Tph0NY
Roundtable
- [Andreea] Bug Priorities - it appears that the new way we organized priorities is making us have way too many P1 bugs
- We think it would be best to use all 5 priority flags from Bugzilla to cover all cases:
- P1 - critical, constant failures
- P2 - new tests - the ones with [qa-needed] whiteboard entry are handled first
- P3 - intermittent Failures, enhancements
- P4 - Rare failures (once a month)
- P5 - refactoring, small enhancements
- We think it would be best to use all 5 priority flags from Bugzilla to cover all cases:
- [SV] Metro proposal
- We need to have the structure discussed on the work week inside the repository, so maybe would be good to have a first test: bug 879382
- mozmill-tests
- > firefox > libs, tests
- > metro > libs, tests
- UI lib will be ready in a couple of days
- Firefox Nightly should be set as the default browser on Win 8 machines in order to open it in metro mode
- We need to add the metro testrun to mozmill-automation
- Have Jenkins configured for metro runs
- Have the dashboard updated with a metro tab for results
- We need to have the structure discussed on the work week inside the repository, so maybe would be good to have a first test: bug 879382
Goals Overview
Project Updates
Mozmill (Henrik)
- Mozmill 2.0 and 1.5.23 have been released
- Working on a proposal for the future development
Gaia UI (Dave)
- Goals progress:
- Working like crazy to get the perf tests running again, including a bunch of new scrolling tests and a new FPS metric.
- Also trying to get Eideticker into a presentable state for the Summit.
- [rwood] Some updates for endurance tests for 1.3/master; pull request submitted (bug 920180)
- [rwood] Will be demonstrating the endurance tests at the Summit innovation fair in Brussels, if a table becomes available (currently on the waiting list)
Games Benchmarking (Rob, Joel, BC)
- Deploying a Google Nexus 4 with Firefox OS onto the speedtest framework (Toronto) this week
AWSY (Rob)
- Continuing development on AWSY test driver
- Next steps: Jenkins job and node setup when VMs become available; make output available for AWSY dashboard
Softvision Updates
Desktop Automation
- Goals progress:
- Mozilla Softvision Team Pic: http://tinypic.com/r/2q2hisp/5
- We have added a Top Bugs section to our weekly etherpad in Softvision team to keep track of the most important P1 bugs
- Resolved Fixed:
- bug 888924 - Test failure "Memory cache has no entries after PB mode - 'undefined' should equal '0'" in /testPrivateBrowsing/testAboutCache.js
- bug 911101 - Test failure 'No item selected for element ID: historyMode' in testDisableCookies.js testEnableCookies.js testRemoveAllCookies.js testRemoveCookie.js
- bug 912941 - Fix scrollIntoView calls for earlier Firefox versions where it hasn't been implemented yet
- bug 920416 - Update code to use controller.select() in testPreferences/testPreferredLanguage.js
- bug 919932 - Clean up multiple instances of teardownModule found in the same test
- bug 835383 - Add test that installs an addon without EULA directly from addons.mozilla.org
- Working on:
- Andreea
- bug 795398 - Mozmill test to check that MD5 hash signatures are no longer accepted
- bug 916380 - Modal XPI installation dialog is shown during the restart of Firefox and blocks its shutdown
- bug 758187 - [landed on nightly, need backport] Write a new mozmill test for checking location sharing
- bug 853005 - Update automation script should exit with a non-zero exit code if unable to get update channel
- Andreea
- Cosmin
- bug 916380 - Modal XPI installation dialog is shown during the restart of Firefox and blocks its shutdown
- bug 890181 - Test failure "Tab has been closed" when trying to close a tab with close button
- bug 904577 - Method exists() from elementslib.Elem returns true even after the node has been removed
- bug 865640 - 3rd party plugin failures: "Shockwave Flash is disabled - 'true' should equal 'false'" and "Java Plug-in 1.7.0_21 has been disabled - got 'false'"
- Cosmin
- Mario
- bug 835296 - Add test that installs an addon with EULA directly from addons.mozilla.org
- bug 920497 - Update closeTab method in tabs.js to prevent wrong index values
- bug 786306 - Add more logic to the restart tests to skip following test files if a test is failing
- bug 874344 - Test failure 'New tab has been opened' in testTabbedBrowsing/testNewTab.js
- Mario
- Andrei
- bug 917771 - Test failure "The next result has been selected - '0' should not equal '0'" in testFindInPage
- Andrei
Bug number | Status | Requestee | Requester | Bug Subject |
bug 489474 | Review | Henrik | Andreea | Write automated tests for user generated video controls |
Pull Request | Review | Henrik/Dave | Andreea | Update automation script should exit with a non-zero exit code if unable to get update channel |
bug 786306 | Review | Henrik | Mario | Restart tests logic |
bug 599290 | Feedback | Henrik | Cosmin | Update SoftwareUpdateAPI to support complete relocation to the about dialog |
Mobile (Robocop)
- Progress on Robocop Automation
- Bugs with work in progress:
- bug 820859 - Robocop: Add test for 'Clear Private Data'
- bug 830834 - Robocop: Add test for 'Show Search Suggestions' feature
- bug 836341 - Robocop: Add test for "Clear download history"
- bug 899187 - [fig] Create new testBookmarksPage test to replace original testBookmarksTab.java.in
- bug 888277 - Robocop: Add test for Private Browsing
- Bugs awaiting integration:
- bug 899182 - [fig] Re-implement robocop testBookmark.java.in
- Bugs recently integrated:
- bug 896574 - [fig] Fix and re-enable testAddSearchEngine
- bug 907734 - Robocop: Split database interactions and strings definitions in separate classes to structure Robocop apis better
- bug 916107 - Tag the BrowserSearch ListView and the TopBookmarksView in order for UI tests to access them
- bug 896566 - [fig] Fix and re-enable testClearPrivateData
- bug 896557 - [fig] Fix and re-enable testWebContentContextMenu
- Issues
- We are waiting for the new-new-about-home work to finalize before completing the bookmark tests and focusing on other tests.
Personal Status
For the personal status please check the weekly status updates:
Meeting Notes
The meeting notes for this meeting can be read in the following etherpad:
Action items
- [NEW] %name%: %task%