Releases/Firefox 4b4/Test Plan

Firefox 4 Test Plan

Firefox 4 Beta 4 Testplan

Coordinating QA: juanb in irc.mozilla.org, jbecerra@mozilla.com. If not around, contact: mevans, mevans@mozilla.com; tchung, tchung@mozilla.com. Or ping someone in #qa

Description of Release

This is the fourth beta version of Firefox 4. Some of the more notable changes include:

• Firefox Sync
• Tab Candy (Tab Sets)
  • Tabbed Browsing in General

Specific Plan Beta 4

We will run smoketests and BFTs using Mozmill, as well as manual smoketests. We'll also manually run areas of the BFT that focus on several areas listed in this page, while focusing on the changes for this release.

Schedule

We will run through Litmus smoketests, BFTs, and updates checks. We'll focus on features landed for Beta 4.

• Code Freeze: Aug 16
• Builds Start: Aug 17
• QA: Aug 17 - Aug 24 (estimate)
  • Smoketests and BFTs using Mozmill: (1 person)
  • Manual smoketests, BFT areas, and Other OS Spot Checks: Aug 17-20 (3 people)
  • Testday: Aug 13, Aug 20(?) (3 people monitoring)
  • Accessibility: Aug 24 (1 person)
  • Top Sites Functionality and Page Load Testing: Before Aug 24 (1 people)
  • Updates checks: Before Aug 20 (1 person)
    • Manual spot checks as necessary

Builds

Builds for all beta 4 candidates can be found here:

ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b4-candidates/

Test Results

Build 3 (Current)

• Smoketests and BFTs: COMPLETE
• Feature Area Tests: Nearly Completed
• Updates Checks - ashughes: Completed - betatest
• l10n Spot Checks: Completed
• Accessibility - marco: in progress
• Top Sites Testing: Completed
• Top Add-ons - marcia: in progress
• Testday: Completed
• Bugs Filed: crashers, blocking bugs, others
  • Whiteboard entry [4b4]
• Bugs Filed During Testday: crashers, blocking bugs, others
  • Whiteboard entry on testday: [Aug-13-Testday]

Focus Areas

• Firefox Sync
• Tabbed Browsing (in general)
  • Tab Candy
  • App Tabs
  • Session Store
  • Undo Window/Tab Close
  • Private Browsing Interactions with Tab Candy
  • Interaction with Feedback add-on
  • Tab Previews in Win 7
  • Tab Drag and Drop and Tear Off
  • Switch to Tab
• Places (Bookmarks)
• Toolbar Customization and Theme
  • Title bar
• Add-ons Manager
• Fullscreen
  • Interactions with Tab Candy and Personas
• OOPP
  • Crash reporting on Mac
  • key events: cmnd-shift, esc, ...
• Web Console and Inspect
• Layers
• Open Video (ogg, webm)