Releases/Firefox 4b4/Test Plan:Feature Area Testing
From MozillaWiki
< Releases
Contents
- 1 Firefox 4 Beta 4 BFTs
- 2 Some Notes
- 3 Results Notes
- 3.1 Example Focus Area
- 3.2 Mac OOPP
- 3.3 Layers
- 3.4 Firefox Sync
- 3.5 Tab Candy
- 3.6 Toolbar and Theme
- 3.7 Tab Drag and Drop and Tear Off
- 3.8 Tabbed Browser (in general)
- 3.9 Fullscreen (interactions with Tab Candy)
- 3.10 Places (Bookmarks & History)
- 3.11 Tab Previews in Win 7
- 3.12 Open video (ogg & WebM)
- 3.13 Interaction with Feedback add-on (install, upgrade)
- 3.14 Private Browsing (with Tab Candy)
- 3.15 App Tabs
- 3.16 Session Restore
- 3.17 Switch To Tab
Firefox 4 Beta 4 BFTs
In addition to running all the Mozmill BFT automated tests, we'll run BFTs corresponding to areas of high priority using the following BFT test run in Litmus as a guide.
- Download builds: ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b4-candidates/
- Use Litmus testrun: https://litmus.mozilla.org/run_tests.cgi?test_run_id=199
Where there are no related Litmus testcases it is up to the feature owners to test their areas.
Some Notes
A big chunk of the functionality below can be grouped into tabbed browsing. Some of the items below like "Undo Window/Tab Close" are not features, but they are things which I wanted to call out individually, which should be checked in tabbed browser, but as a combination when using Tab Candy (Tab Sets) which was one of the major features that landed.
Focus Area | Tester | Status (detailed results at the bottom) |
---|---|---|
Firefox Sync | Tracy | WinXP: Completed Win7: Completed Mac OS 10.6: Completed Linux: ... |
Tab Candy (Tab Sets) | Tracy | WinXP: Completed Win7: Completed Mac OS 10.6: Completed Linux: ... |
App Tabs | marcia | WinXP: Completed Win7: Completed Mac OS 10.6: Completed Linux: ... |
Session Store (in relation to tabbed browsing)
|
ashughes | WinXP: COMPLETE Win7: COMPLETE Mac OS 10.6: COMPLETE Linux: COMPLETE |
Undo Window/Tab Close | ashughes | WinXP: COMPLETE Win7: COMPLETE Mac OS 10.6: COMPLETE Linux: COMPLETE |
Interaction with Feedback add-on (install, upgrade) | aravindm | WinXP: Completed Win7: Completed Mac OS 10.5: Completed Linux: Completed |
Tab Previews in Win7 | gmontagu | Win7: Completed |
Tab Drag and Drop and Tear Off | aravindm | WinXP: Completed Win7: Completed Mac OS 10.5: Completed Linux: Completed |
Switch to Tab | ashughes | WinXP: COMPLETE Win7: COMPLETE Mac OS 10.6: COMPLETE Linux: COMPLETE |
Tabbed Browser (in general) | ahoza | WinXP: Completed Win7: Completed Mac OS 10.6: Completed Linux: Completed |
Places (Bookmarks and History) | vlad | WinXP: Completed Win7: Completed Mac OS 10.6: Completed Linux: Completed |
Toolbar and Theme | aravindm | WinXP: Completed Win7: Completed Mac OS 10.5: Completed Linux: Completed |
Add-ons Manager | vlad | WinXP: Completed Win7: Completed Mac OS 10.6: Completed Linux: Completed |
Fullscreen (interactions with Tab Candy) | ahoza | WinXP: Completed Win7: Completed Mac OS 10.6: Completed Linux: Completed |
OOPP (crash reporting on Mac, key events) | marcia | Mac OS 10.6: Completed |
Web Console/Inspect | Tomcat | WinXP: Completed Win7: Completed Mac OS 10.6: Completed Linux: Completed |
OOPP | marcia | WinXP: Completed Win7: Completed Linux: ... |
Layers | marcia | Cannot be easily tested. Will review crash results to surface issues. |
Open Video (ogg and WebM) | vlad | WinXP: Completed Win7: Completed Mac OS 10.6: Completed Linux: Completed |
Private Browsing (with Tab Candy) | ahoza | WinXP: Completed Win7: Completed Mac OS 10.6: Completed Linux: Completed |
Results Notes
Example Focus Area
- WinXP: Issues can be noted here, such as bugs filed in the area using this platform. Make notes of issues that you encountered but didn't lead to a bug being filed. If you file a bug please add [4b4] in the Whiteboard field.
- Mac OS 10.6: Issue...
- Linux 10.4: Issue...
Mac OOPP
- Mac 10.6 (OOPP crash reporting now available in this build for 10.1 Versions of Flash and the new Java Plugin only)
- Note that only one crash report will be generated since the hang part isn't hooked up yet.
- Several bugs filed, including: bug 588241 and bug 588445
- Noticed some lagginess when switching tabs, but so far have not been able to consistently reproduce.
- 10.5 plugins run in process so this testing does not apply specifically to that OS
Layers
- Most of the bugs will be surfaced from crash data.
- bug 588591 found by sifting through early crash data
- bug 564991 is the bug about implementation of layers, that's where regression are being tracked.
Firefox Sync
- Win (Win 7, XP): no blocking issues found
- Mac (10.6): no blocking issues found
- Linux (version): Issues...
Tab Candy
- Win (Win 7, XP): no blocking issues found
- Mac (10.6): no blocking issues found
- Linux (version): Issues...
Toolbar and Theme
- Win XP: Personas does not sort alphabetically after installing 30 themes even by clicking name. Need to close and open the addons manager tab to get sorted alphabetically. Able to see 31 themes in the Themes Tab. Clicking on remove themes does not remove themes. Need to close and open the Addons manager for the themes tab to get refreshed.
- Win 7:Clicking on remove themes does not remove themes. Need to close and open the Addons manager for the themes tab to get refreshed.
- Mac (10.5.2): Clicking on remove themes does not remove themes. Need to close and open the Addons manager for the themes tab to get refreshed.
- Linux (RHEL 5.3): Clicking on remove themes does not remove themes. Need to close and open the Addons manager for the themes tab to get refreshed.
Tab Drag and Drop and Tear Off
- Win XP: No issues seen.
- Win 7: No issues seen.
- Mac (10.5.2): No issues seen.
- Linux (RHEL 5.3): No issues seen.
Tabbed Browser (in general)
- Win XP: No new problems found
- Win 7: No issues found
- Mac 10.6: No new problems found
- Linux (Ubuntu 10.04): No new problems found
Fullscreen (interactions with Tab Candy)
- Win XP: No new problems found
- Win 7: No new problems found
- Mac 10.6: added an issue in .xls file
- Linux (Ubuntu 10.04): No new problems found
Places (Bookmarks & History)
- Win XP: No new problems found
- Win 7(32): No new problems found
- Mac 10.6: No new problems found
- Linux (Ubuntu 10.04): No new problems found
Tab Previews in Win 7
- Win 7(32): Zoom on a page doesn't reflect on the thumbnail.
- No Recent section on Jump Lists. Maybe this is due to my Spanish Windows 7 version because my Spanish version IE8 shows just the same. Frequent section shows "Frequent" in English but Tasks is in Spanish: "Tareas". This may be due to the same.
Open video (ogg & WebM)
- Win XP: No new problems found
- Win 7(32): No new problems found
- Mac 10.6: No new problems found
- Linux (Ubuntu 10.04): No new problems found
Interaction with Feedback add-on (install, upgrade)
- Win XP:
- Win 7:
- Mac 10.5: ...
- Linux (RHEL 5.3): ...
Private Browsing (with Tab Candy)
- bug 588727 One tab group should be present while in private browsing
App Tabs
- Win XP:
- Win 7: Drag and Drop: the App Tab turns into a normal one. The bug has already been filed.
- Create a combination of App Tabs and regular tabs and alternate their position, if possible, then cycle through them using the keyboard: Alternate position is not possible because the App Tabs turns into normal ones. The bug has already been filed.
- Mac: ...
- Linux: ...
Session Restore
- Windows XP: No issues found
- Windows 7: No issues found
- Mac OSX 10.6: No issues found
- Ubuntu 9.10: No issues found
- Mac 64-bit: No issues found
- Linux 64-bit: No issues found
- Interactions:
- Tab Candy: No major issues found. Need developer feedback for specifics.
- App Tabs: No major issues found. Need developer feedback for specifics.
- Bugs Filed:
- bug 589324 - Switch-to-Tab after Session Restore does not respect Tab Candy grouping
Switch To Tab
- Windows XP: No issues found
- Windows 7: No issues found
- Mac OSX 10.6: No issues found
- Ubuntu 9.10: No issues found
- Mac 64-bit: No issues found
- Linux 64-bit: No issues found
- Interactions:
- Tab Candy: No major issues found. Need developer feedback for specifics.
- App Tabs: No major issues found. Need developer feedback for specifics.