Releases/Firefox 4b5/Test Plan:Feature Area Testing
From MozillaWiki
< Releases
Contents
- 1 Firefox 4 Beta 5 BFTs
- 2 Results Notes
- 2.1 Example Focus Area
- 2.2 D2D
- 2.3 Panorama (usability and keyboard shortcuts, interactions with private browsing, fullscreen, ...)
- 2.4 Theme / Toolbar
- 2.5 Tabbed Browsing
- 2.6 Panorama
- 2.7 OOPP
- 2.8 Bookmarks/Library/History
- 2.9 Ogg/WebM (video indexing/buffer)
- 2.10 App Tabs
- 2.11 Session Restore
- 2.12 Fullscreen
- 2.13 Feedback
- 2.14 Pop-ups
- 2.15 Add-ons Manager
- 2.16 Panorama (usability and keyboard shortcuts)
- 3 Web Console
Firefox 4 Beta 5 BFTs
In addition to running all the Mozmill BFT automated tests, we'll run BFTs corresponding to areas of high priority using the following BFT test run in Litmus as a guide.
- Download builds: ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b5-candidates/
- Use Litmus testrun: https://litmus.mozilla.org/run_tests.cgi?test_run_id=205
Where there are no related Litmus testcases it is up to the feature owners to test their areas.
Focus Area | Tester | Status (detailed results at the bottom) |
---|---|---|
D2D (on by default) | marcia, Tomcat | WinXP: in progress/complete or Not Run Win7: Completed Mac OS 10.6: Completed Linux: ... |
Theme/Toolbar | aravindm | WinXP: Completed Win7: Completed Mac OS 10.5:Completed Linux: Completed |
Panorama (usability and keyboard shortcuts, interactions with private browsing, fullscreen, ...) | Tracy, gmontagu | WinXP: Complete Win7: Complete Mac OS 10.6: Complete Linux: Complete |
OOPP (keyboard input events) | marcia, juanb | WinXP: in progress/complete or Not Run Win7: ... Mac OS 10.6: Completed Linux: ... |
Tabbed Browsing | aravindm, gmontagu, Waverly | WinXP: Completed Win7: Completed Mac OS 10.5: Completed Linux: Completed |
App Tabs | aravindm, gmontagu | WinXP: Completed Win7: Completed Mac OS 10.5: Completed Linux: Completed |
Add-ons Manager | Waverly | WinXP: Complete Win7: Complete Mac OS 10.6: Complete Linux: Complete |
Web Console | Tomcat | WinXP: complete Win7: complete Mac OS 10.6: complete Linux: complete |
Aero Peek (Win7 Only) | Waverly | Win7: Complete |
Menu (keyboard) Shortcuts | marcia | WinXP: in progress/complete or Not Run Win7: ... Mac OS 10.6: ... Linux: ... |
Firefox Sync | Tracy | WinXP: Completed Win7: Completed Mac OS 10.5: Completed Linux: not run |
Ogg/WebM (video indexing/buffer) | Waverly | WinXP: Complete Win7: Complete Mac OS 10.6: Complete Linux: Complete |
Layout | marcia | WinXP: Complete Win7: Complete Mac OS 10.6: Complete Linux: Complete |
Pop-ups | Waverly | WinXP: Complete Win7: Complete Mac OS 10.6: Complete Linux: Complete |
Notifications | ashughes | WinXP: Complete Win7: Complete Mac OS 10.6: Complete Linux: Complete |
Bookmarks/Library/History | Waverly | WinXP: Complete Win7: Complete Mac OS 10.6: Complete Linux: Complete |
Switch to Tab/Awesome Bar | ashughes | WinXP: Complete Win7: Complete Mac OS 10.6: Complete Linux: Complete |
Fullscreen | Cameron, Waverly | WinXP: Complete Win7: Complete Mac OS 10.6: ... Linux: ... |
Feedback (Test Pilot) | aravindm | WinXP: Completed Win7: Completed Mac OS 10.5: Completed Linux: Completed |
Printing | marcia | WinXP: in progress/complete or Not Run Win7: ... Mac OS 10.6: Completed Linux: ... |
Demos/Web Functionality Testing (Audio API) | aravind | WinXP: in progress/complete or Not Run Win7: ... Mac OS 10.6: ... Linux: ... |
Session Restore | Waverly | WinXP: Complete Win7: Complete Mac OS 10.6: Complete Linux: Complete |
Results Notes
Example Focus Area
- WinXP: Issues can be noted here, such as bugs filed in the area using this platform. Make notes of issues that you encountered but didn't lead to a bug being filed. If you file a bug please add [4b5] in the Whiteboard field.
- Mac OS 10.6: Issue...
- Linux 10.4: Issue...
D2D
- Win Vista
- x64 had issues with Grafxbot extension. machine is running one version behind the recommended spec
- Win 7:
- Installed Grafxbot extension and completed a successful run - Machine is running DX9
- Win 7:
- Installed Grafxbot extension and completed a successful run - Machine is running DX10
- Win XP
- Mac 10.6
- Known issue with Mac per https://wiki.mozilla.org/Platform/2010-08-31#GFX. When it is pref'd on the screen gets very pixelated.
- Linux (version): Issues...
Panorama (usability and keyboard shortcuts, interactions with private browsing, fullscreen, ...)
- Win Vista: Issues ...
- Win 7:
- No new issues
- Win XP: Issues...
- Mac 10.6: Issues...
- Linux (version): Issues...
Theme / Toolbar
- bug 592638 - Lightweight Themes are not sorted alphabetically.
- Able to reproduce the above bug in all the platforms.
Tabbed Browsing
- Win 7 : No new issues found
- Win XP : No new issues found
- Mac (10.5): No new issues found
- Linux (RHEL 5.3): No new issues found
Panorama
- Win 7:
- No new issues
- Mac (version): Issues...
- Linux (version): Issues...
OOPP
- Mac (10.6 )
- Windows 7
- Crashes:
- http://crash-stats.mozilla.com/report/index/bp-3c92163a-1ff8-4e79-83f2-676492100901 - newgrounds.com site when machine was idle.
- Crashes:
Bookmarks/Library/History
- Win 7: bug 592650 list of bookmarks is flickering when using forward and back button
- no problems found on other tested platforms
Ogg/WebM (video indexing/buffer)
- bug 584638 .ogv video is choppy and flickering in full screen mode - reproduces all the time on Win XP SP3 and sometimes on Win 7
App Tabs
- Windows XP : Drag and Drop of App Tab within the tab strip/ onto itself / onto the desktop turns into a normal one. Alternating the positing of App Tabs is not possible, as App tabs are creating on the beginning of the tab strip and drag and drop of App tab turns into normal one.
- Windows 7 : Drag and Drop of App Tab within the tab strip/ onto itself / onto the desktop turns into a normal one. Alternating the positing of App Tabs is not possible, as App tabs are creating on the beginning of the tab strip and drag and drop of App tab turns into normal one.
- Mac OS 10.5 : Drag and Drop of App Tab within the tab strip/ onto itself / onto the desktop turns into a normal one. Alternating the positing of App Tabs is not possible, as App tabs are creating on the beginning of the tab strip and drag and drop of App tab turns into normal one.
- Linux :
Session Restore
- No new problems found
- Failed TC's are due to:
- bug 579868 Restoring A Normal Closed Tab that was once a App Tab causes it to turn back into a App tab when restored
- bug 587874 Undo Close Tab should only open tabs from the current group
Fullscreen
- Win 7 : No new problems found. Failed TC's are due to:
- bug 584638 .ogv video is choppy and flickering in full screen mode
- bug 587140 Tab groups can push other groups across screen boundaries, making them invisible or causing groups to overlap
Feedback
- No new problems found
Pop-ups
- No new problems found
Add-ons Manager
- Win 7 : No new problems found. Failed TC's are due to:
- bug 584638 .ogv video is choppy and flickering in full screen mode
- bug 573699 [Add-ons Manager]No notification bar displayed in Add-ons manager > Plugins when installed plugins are outdated
- bug 592213 Java content not displayed properly after resizing the window and scrolling it
- Mac OS 10.6
- bug 547403 Java Embedding Plugin (JEP) won't run in the latest Firefox nightlies (3.7alpha2)
- bug 573699 [Add-ons Manager]No notification bar displayed in Add-ons manager > Plugins when installed plugins are outdated
Panorama (usability and keyboard shortcuts)
- keyboard shortcuts interactions with exclusive flash content sites, embedded flash sites ,Ogg/ Theora Media sites, Fullscreen, Tab )
- Win 7 & Win XP & Linux
- bug 594015 Shortcuts blocked by sites with exclusive flash content
Web Console
- Note bug 583218 - "Web console" in menu isn't checked when it is open