Releases/Firefox 4b1/Test Plan
Contents
Firefox 4 Beta 1 Testplan
Coordinating QA: juanb in irc.mozilla.org, jbecerra@mozilla.com. If not around, contact: mevans, mevans@mozilla.com; tchung, tchung@mozilla.com. Or ping someone in #qa
Description of Release
This is the first beta version of Firefox 4. It will have the new theme work on Windows. Localized builds of Beta 1 will not ship this release.
Specific Plan Beta 1
We will run smoketests and BFTs using Mozmill, as well as manual smoketests. We'll also manually run areas of the BFT that focus on several areas listed in this page.
Schedule
We will run through Litmus smoketests, BFTs, and updates checks. We'll focus on features landed for beta 1 as well as some of the more prominent features that landed in alpha 5.
- Code Freeze: June 28
- Builds Start: June 28
- QA: June 28-July 2
- Smoketests and BFTs using Mozmill: (1 person)
- Manual smoketests, BFT areas, and Other OS Spot Checks: June 29-July 1 (4 people)
- Testday: July 2 (3 people monitoring)
- Accessibility: Before July 1 (1 person)
- Top Sites Page Load Testing: Before July 1 (1 people)
- Updates checks: June 29, 30 (1 person)
- Manual spot checks as necessary
Builds
Builds for all beta 1 candidates can be found here:
ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b1-candidates/
Test Results
Build 2 (Current)
- Smoketests and BFTs: Completed
- Feature Area Tests: In progress
- Updates Checks - ashughes: Completed - betatest, releasetest
- Accessibility - marco: result
- Top Sites Testing - Tomcat: In progress
- Top Add-ons - unowned: result
- Testday - marcia: Completed
- Bugs Filed: crashers, blocking bugs, others
- Whiteboard entry [4b1]
- Bugs filed on 7/2 Test Day
- Whiteboard entry: [Fx4beta1testday]
Focus Areas
- Theme work on Windows
- Theme work on Mac
- Toolbar Customization
- Firefox Menu
- Tab Strip
- Tabbed Browsing
- Bookmarks
- Search
- Session Restore
- Undo close window/tab
- Form and password manager
- Profile migration
- Scenarios where users start out with 3.6, try out 4.0b1, and go back to 3.6
- These scenarios with Testpilot and Feedback in mind
- Feedback (aka Test Pilot + Input)
- Add-ons manager
- OOPP
- WebM
- Fullscreen
- d2d
- Personas (Lightweight Themes)
- Notifications (geo)
- Antivirus and firewall interactions
