QA/StaffMeetings/QA-Staff-08-21-2013
From MozillaWiki
< QA | StaffMeetings
Wednesday, August , 2013
# Every Weds @ 1:30p Pacific Time - Mozilla HQ, Warp Core # # Vidyo: https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh # Phone: +1 650 903 0800 or 650-215-1282 x92 Conf# 9245 (US/INTL) # +1 800 707 2533 (pin 369) Conf# 9245 (US Toll Free) # +1 416 848 3114 x92 Conf# 9245 (Canada) # IRC: irc://irc.mozilla.org:6697/#qa
QA Org Items
QA Show and Tell
This week:
https://wiki.mozilla.org/QA/Show-and-Tell#Schedule
Vaidik!
Next week: (Aaron Train) Appthwhack! - http://appthwack.com/
New Hires & Interviews
Upcoming Events/Conferences
[geo] Performance Meetup, Toronto, Aug 26 - 30
B2G work week, Oslo, Sept 7 - 15
https://wiki.mozilla.org/FxOS/Oslo_2013-09-06
Stability workweek - Aug 19 - 23 in Mt. View
Notices
Next week is Samvedana's last week -- please thank her for contributions to Metro Firefox, SocialAPI, Windows 8.1 compatability, and Mozmill Tests
Travel / PTO
[juanb] PTO Aug 8 - 26
[jammink] TRIBES training, Toronto, Aug 28 - Sept 1
[zac] PTO Aug14-Sept 2nd holiday w/some work
[jsmith] PTO Aug 22nd - 23rd
[jbonacci] floater PTO Aug 23
[rbillings] PTO Sept 2-13
[tony] - work from seattle aug 29, 30, PTO, aug 28
[tony] - PTO sept 5- 10
[mbrandt] - Stability work from MV Aug 19th - 23rd
[tracy] - in MV 19th-22nd (traveling on the 18th and 23rd)
[nhirata] - work from MV Aug 19th ~ 22nd ; work from seattle aug 29, 30
[marcia] PTO August 23
[krupa] - working from India Sep 5-17th
[delphine] PTO from August 26-Sep 3
QA Team Updates
Desktop (Juan)
Firefox
23.0.1 shipped 8/16 to address WebRTC regression with a few unrelated ride-alongs
https://wiki.mozilla.org/Releases/Firefox_23/Test_Plan#Firefox_23.0.1
24.0.b4 shipped 8/20
Tentative plan for beta10 of the fast beta cycles is to make beta10 RC1 instead. This is to potentially get more users in bake time so we can catch random things like the unreliably reproducable Radeon crasher.
also considering ceasing the process of generating double RCs since this has failed to prevent us from shipping point releases
Further post-mortem greatness:
https://wiki.mozilla.org/Releases/Firefox_23/Test_Plan#Post-Mortem
ESR (mwobensmith)
Stability (marcia)
Work week in progress. session notes: https://etherpad.mozilla.org/StabilityWeek2013-Notes
23.0.1 - Radeon crash fixed. Also Relevant knowledge blocklisting change is workiing.
Automation (ashughes)
Security (mwobensmith)
CSP, MCB, other acronyms
Community
Mobile (Tony)
Firefox for Android (Kevin/Aaron)
new about:home landed on m-c; focus of testing now
http://lucasr.org/2013/08/21/revamped-ui-in-firefox-for-android/
Loss of functionality
UI breakage
meeting tomorrow to discuss fate of WebRTC on Fx24 (Beta)
Fx23 deployed also to korean tstore
http://www.tstore.co.kr/userpoc/game/viewProduct.omp?insProdId=0000385058
Stability (kbrosnan)
https://wiki.mozilla.org/CrashKill/2013-08-19#Mobile
B2G (Geo/jhammink)
Swaroopa last day yesterday
highlights: B2G Notifications, automated l10n screenshot work, 1.1HD testing, and tons of other great work!
1.2 testing is starting with Nexus 4, TCL phones
need to work with UI automation for device coverage
Joint presentation on QA/A-team work and goals for quality at the Oslo WW. (Jason, John, Jonathan)
Functional team weekly updates - https://etherpad.mozilla.org/gaia-meeting-notes
Stability (nhirata)
https://wiki.mozilla.org/CrashKill/2013-08-19#B2G
Stability work week happening
[nhirata] Browser:
blockers for testing:
Bug 895480, Bug 821519, Bug 895484 Need receivers for Share (URL) web activities
suggested by jsmith to create webapp
need the time to do this
Bug 905831 - [Browser] Searching for words in the URL bar is not giving a search results
Bug 906231 - Please create an update channel for Hamachi to go to 1.2
Need Nexus 4 / Helix for HD graphics testing; Nexus 4 for device testing
Wasabi for CDMA testing (belayed)
[jsmith] Media Recording API & Web Notifications API test planning, exploratory testing, automation dev
API Compatibility test suite
Positive feedback: FMradio & Geolocation feedback from 3rd party
Device Storage tests in flight
[mwargers]: workaround to get xul/xbl mochitests working
bug 846090 - XBL mochitests timing out/failing on b2g
[mwargers]: mochitest exception list cleanup for b2g
bug 901387 - b2g.json cleanup and reorder
Smoketest [marcia]
1.2 Smoketest has moved from the Unagi Device to the Buri device
https://bugzilla.mozilla.org/show_bug.cgi?id=907444 - Updates issue
1.1 Leo Smoketest continues
1.1 Unagi Sanity check continues (Dogfooding build)
[jammink] Comms - Test Planning, Testcase Reviews, Exploratory Testing
[jammink] Productivity - Starting to look into Productivity areas
[jammink] General - Testcase cleanup and reorg in Moztrap
[jammink] Automation - Starting work with L10 tool
[jammink] Presentation - outlining and templating Quality presentation for Oslo WW
Community Members Onboarding
Services (Edwin)
Edwin will be working from home on Tue and Thu for the next few weeks as he gets back into the swing of things post-baby.
Identity
train-2013.07.31 planned to go to production today. is live in production at 12:04PDT
new train-2013.08.15 will go to stage today
Mozilla IdP testing/deployment still stalled on blocker bugs.
Services
Testing of SimplePush continues.
Campaign Manager in danger of becoming a "real product" with real QA needs.
PiCL is basically dead. It has been replaced by FF Accounts (FxA) and Sync 1.1 for the next several milestones leading up to "new" Sync v1.
Dev an QA continues on FF Accounts (was picl-idp) API, client, and server.
Big meeting tomorrow to figure out an accelerated schedule for Sync 1.1 Stage environment and, possibly, a separate "new" Sync Stage environment
Tracking continues on Loads tool, Heka, etc.
(jbonacci) I sent email to a handfull of QA team members with some quick information and links about "new" Sync. When this gets to regular Nightly releases in/on ELM, we will need help from Desktop and Mobile QA. Will also need some input from Tools and Automation...We should probably meet first week of September to discuss resources.
Web (Stephen)
Our Selenium automation suites caught (and were affected by) a 5-star Persona issue https://github.com/mozilla/browserid/issues/3811, in production
pull has been merged, pending hotfix to prod:
https://github.com/mozilla/browserid/pull/3817
B2G/Gaia testing:
our first TBPL "bug": https://github.com/mozilla/gaia-ui-tests/issues/1262 - it's great to be on + visible, in TBPL
(we needed to updated our calendar test due to an intended functionality change)
back with Wi-Fi coverage again on both branches: https://github.com/mozilla/gaia-ui-tests/pull/1261
Automation is largely stable (between 1 and 3 sporadic failures on both v1-train and master!) and continues to find bugs
http://qa-selenium.mv.mozilla.com:8080/view/B2G%20Unagi/job/b2g.unagi.mozril.gaia.master.ui/86/
We're excited to hopefully soon be able to interact with security/modal dialogs:
https://github.com/mozilla/gaia-ui-tests/pull/1265
MMS test is in place:
https://github.com/mozilla/gaia-ui-tests/blob/master/gaiatest/tests/messages/test_sms_with_attachments.py
Vaidik's looking into augmenting our calling tests with http://plivo.com/
Bouncer
now have a robots.txt on prod, with test coverage. Super-woot fantastic, the dev who wrote the feature supplied the pull request for the testcase
https://github.com/mozilla/bouncer-tests/pull/37
Engagement Projects
Another small release of Firefox Flicks went out
Reps is working on updating foundation templates for CD
Firefox Health Report
Stability workweek this week - rewriting the testplan. Heavier emphasis on automation with a lower emphasis on manual regression testing (for web qa)
workweek outcomes - https://etherpad.mozilla.org/StabilityWeek2013-Actions
Firefox Marketplace
http://mzl.la/159ZWRj went live on 08/20
Mozilla.com
Our automation caught a pretty severe PHP/redirect issue
https://bugzilla.mozilla.org/show_bug.cgi?id=906973 is just one example (there were 7 failing tests)
Small changes lately to marketing banners, and a lot of underlying l10n
Mozillians
Testing playdoh updates on staging - this will likely land on prod tomorrow, 8/21/2013
Strong emphasis on user stories that take into account mobile users, the quarterly goal is to identify and implement features that support the upcoming summits
https://bugzilla.mozilla.org/show_bug.cgi?id=902008
Socorro
Stability workweek this week - a major rewrite of the testplan is occuring this week
SUMO
Have landed automated-test support for Persona integration on SUMO: https://github.com/mozilla/sumo-tests/commit/48c9fefb5fc2da3bf0e8e1bb615abfef2ccc77ef
which found a bad bug:
https://bugzilla.mozilla.org/show_bug.cgi?id=905118 - [stage][browserid] Signing in from other pages always redirects user to home_page
Community Members Onboarding
Sasha Kruglov is a rockstar: https://github.com/sashakruglov?tab=activity
roarange is working with Vaidik on Marketplace tests (Selenium/Python)
Community (Marcia)
Projects
Open Badges
The last day for submissions for General QA Participation Badge designs was Fri Aug 16, 2013. A total of 5 badge designs have been submitted:
https://secure.flickr.com/photos/tags/mozqabadges/
https://secure.flickr.com/photos/99032178@N06/sets/72157634940903895/
https://secure.flickr.com/photos/dinobiscuits/sets/72157634638799645/
https://secure.flickr.com/photos/gilaadnir/sets/72157634610922798/
https://secure.flickr.com/photos/100269221@N02/sets/72157635085039730/
http://www.flickr.com/photos/100375890@N02/tags/mozqabadges/
Upcoming Events
Mozilla Summit 2013 - Brussels/Toronto/Santa Clara
Site Hosts wanted, especially in Brussels and Santa Clara: https://wiki.mozilla.org/Summit2013/Experiences/Site_Hosts. Track Stewards role has now been folded into Site Hosts role
https://wiki.mozilla.org/Summit2013/TrackOwners - Sign up here if you are interested in being a Track Owner
Your travel should be booked and your registration should be complete
Mozilla Festival - London - October 25-27
http://mozillafestival.org/
Testdays (ashughes)
Samvedana is working on a Metro Testday for next Friday, August 30
Firefox for Android Test Day this Friday: https://quality.mozilla.org/2013/08/testday-for-firefox-for-android-24-beta/
Video Work
No update this week
QMO.next (Raymond)
Persona WordPress plugin
Community Members Onboarding
Automation Development (Henrik, Dave)
General
Automation Development report week 33 2013: http://www.hskupin.info/2013/08/20/automation-development-report-week-33-2013/
Johannes (:nebelhom) our new reviewer for mozdownload: https://groups.google.com/forum/#!topic/mozilla.dev.automation/n6c4-iRc6us
Projects
Mozmill 2.0
3 bugs remaining to be fixed: http://mzl.la/1d2COdA
We will create the new hotfix-2.0 branch soon, so that new features can land on master again
Mozmill CI
Workaround for mozmill-tests merge issues and mozmill-ci landed:
https://groups.google.com/forum/#!topic/mozilla.dev.automation/btvuB2ezIZQ
Work is happening to upgrade our Jenkins version to the latest LTS (will hopefully fix the high memory consumption)
Starting with the next beta candidate builds we can test other locales than en-US via Pulse now (bug 805812)
Ubuntu 13.04 VMs to be activated most likely tomorrow
mozdownload
Test harness and the first test has landed. Many thanks to Johannes (nebelhom)!
MozTrap (Cameron)
Working on 1.4.8 to add test case priority field.
https://moztrap-dev.allizom.org
Community Members Onboarding
Roundtable/Discussion Items
[tracy] Please make sure your team landing page on QMO is up to date and helpful in getting people involved in your active projects. The WebQA team page is a good model to follow. (Services QA would be the opposite of WebQA then!) - we will work on it.
QA event to follow the meeting! https://etherpad.mozilla.org/qa-outting-signup
Notes, Takeaways and Action Items
Today
Notes
Action Items
Last Meeting
Action Items
