OOPP Focused Testing for 3.6.4(build6)

We'll test around the fixes that went in between build1 and build6, verifying as many OOPP bugs as we can. bug 561871#c10 is specially important because it changes the way we do event handling and hang detection on Windows. Bsmedberg suggested we focus on plugin context menus and full screening.

Plugin versions to focus on:

• Flash 10.0 r45 (current) and 10.1 (rc4).
• Silverlight 3 / 4
• Quicktime 7.6.3

Run the plugins tests in the BFT:

• Plugins BFT

Focus on:

• Exploratory Testing:
  • End to end crashed-plugin UI
    • Flash 10.x and 10.1rc, Silverlight 3/4, Quicktime 7.6
  • Crashed-plugin UI elements and their properties
  • Quicktime 7.6 testing on Windows (any other version)
  • Bing toolbar (uses Silverlight)
  • Any other popular toolbars (Google, Yahoo)
  • Flashblock or a couple of popular extensions
  • One P1 locale (de, fr, pt-br, it... for example)
  • Popular sites compatibility (examples:)
    • http://www.bing.com/videos/browse/movies?q=browse:movies
    • http://www.silverlight.net/learn/videos/silverlight-4-videos/
  • Top sites automated testing (Tomcat)

• Performance Testing:
  • Plugin Testing (Quicktime, Flash and Silerlight) in full screen mode
  • Plugin Testing - HD where appropriate or varying the resolution
  • Visual comparison with other browsers in cases where a performance lag is seen

• User Scenarios Tested
  • Going in and out of full screen using ESC and Alt-Tab
  • Loading a HD video (1080) and going into full screen
  • Right clicking on the flash controls while video is playing
  • Loading a flash video in youtube, pausing and then switching focus to the desktop

• Sites we visit
  • hulu.com
  • vimeo.com
  • blip.tv
  • youtube.com
  • bing videos
  • apple.com/trailers
  • Silverlight Showcase

Windows 7 (marcia)

• Status: Completed
• Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.4) Gecko/20100527 Firefox/3.6.4
• Plugins Tested
  • Shockwave Flash 10.0 r45
  • QuickTime Plug-in 7.6.6
  • Silverlight 4.0.50401.0
• Add-ons:
• New bugs filed during testing:
• Existing bugs seen:
• OOPP Crash Reports:
• Issues Noted:
• Sites visited:

Linux (juanb)

• Status:'
• Build ID:
• Plugins Tested:
• Add-ons: None
• New bugs filed during testing: None
• Existing bugs seen:
• Issues Noted:

Windows XP (juanb/marcia) spot check

• Status: Completed
• Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.4) Gecko/20100527 Firefox/3.6.4 (.NET CLR 3.5.30729)
• Tested with a Win XP VM and hardware
• Plugins Tested:
  • Shockwave Flash 10.0 r45
  • Silverlight 3.0.50106.0
  • QuickTime Plug-in 7.6.6
• Add-ons:
• New bugs filed during testing:
• Existing Bugs seen:
• Issues Noted:
• Top Sites Visited:
• Crashes Noted:
  • See Vista results for a reproducible but that was also seen on Win XP hardware.

Windows Vista (marcia) spot check

• Status: Completed
• Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.4) Gecko/20100527 Firefox/3.6.4 (.NET CLR 3.5.30729)
• Plugins Tested
  • QuickTime Plug-in 7.6.6
  • Shockwave Flash 10.0 r45
  • Silverlight 4.0.50401.0
• Add-ons:
  • Flashblock
• New bugs filed during testing:
  • https://bugzilla.mozilla.org/show_bug.cgi?id=568722
• Existing bugs seen:
• Crashes Noted:
• Issues Noted:

Mac OS X 10.6 (marcia)

• Status: Completed
• Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.4) Gecko/20100527 Firefox/3.6.4
• Plugins Tested
  • Shockwave Flash 10.1 r53
  • QuickTime Plug-in 7.6.6
  • Silverlight 4.0.50401.0
• Add-ons:
• New bugs filed during testing:
• Existing bugs seen:
• Issues Noted:

Mac OS X 10.5 (tester)

• Status:' '
• Build ID:
• Plugins Tested
• Add-ons:
• New bugs filed during testing:
• Existing bugs seen:
• Issues Noted: