OOPP Focused Testing for 3.6.4(build5)

We'll test around the fixes that went in between build1 and build5, verifying as many OOPP bugs as we can. bug 561871#c10 is specially important because it changes the way we do event handling and hang detection on Windows. Bsmedberg suggested we focus on plugin context menus and fullscreening.

Plugin versions to focus on:

• Flash 10.0 r45 (current) and 10.1 (rc4).
• Silverlight 3 / 4
• Quicktime 7.6.3

Run the plugins tests in the BFT:

• Plugins BFT

Focus on:

• Exploratory Testing:
  • End to end crashed-plugin UI
    • Flash 10.x and 10.1rc, Silverlight 3/4, Quicktime 7.6
  • Crashed-plugin UI elements and their properties
  • Quicktime 7.6 testing on Windows (any other version)
  • Bing toolbar (uses Silverlight)
  • Any other popular toolbars (Google, Yahoo)
  • Flashblock or a couple of popular extensions
  • One P1 locale (de, fr, pt-br, it... for example)
  • Popular sites compatibility (examples:)
    • http://www.bing.com/videos/browse/movies?q=browse:movies
    • http://www.silverlight.net/learn/videos/silverlight-4-videos/
  • Top sites automated testing (Tomcat)

• Performance Testing:
  • Plugin Testing (Quicktime, Flash and Silerlight) in full screen mode
  • Plugin Testing - HD where appropriate or varying the resolution
  • Visual comparison with other browsers in cases where a performance lag is seen

Windows 7 (marcia)

• Status: Completed
• Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.4) Gecko/20100523 Firefox/3.6.4 (VM)
• Plugins Tested
  • Silverlight 4.0.50401.0
  • Shockwave Flash 10.0 r45
  • QuickTime Plug-in 7.6.6
• Add-ons:
• New bugs filed during testing:
• Existing bugs seen:
• OOPP Crash Reports:
  • http://crash-stats.mozilla.com/report/index/917d01bf-ebeb-4e54-ad96-b494f2100524
  • http://crash-stats.mozilla.com/report/index/bp-f6c9f1f0-bc4a-498c-9f0b-616c02100524
  • Crashed while loading this URL and going to full screen: URL: http://www.blip.tv/file/3662994?utm_source=featured_ep&utm_medium=featured_ep
• Issues Noted:
  • Build 4 ( Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.4) Gecko/20100513 Firefox/3.6.4) did not crash http://www.blip.tv/file/3662994?utm_source=featured_ep&utm_medium=featured_ep
  • No crash on Windows 7 Lab Machine using the same build and same URL (Build 5)
• Sites visited:
  • Silverlight Showcase
  • Bing Videos

Linux (juanb)

• Status:Completed
• Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.4) Gecko/20100523 Firefox/3.6.4
• Plugins Tested: 10.0, 10.1 rc5
• Add-ons: None
• New bugs filed during testing: None
• Existing bugs seen:
• Issues Noted: Under some instance I was able to do full screen Flash using 10.1 with the Firefox chrome window in the foreground, on VM. Could not see on hardware. Not easy to reproduce.

Windows XP (juanb) spot check

• Status: Completed
• Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.4) Gecko/20100523 Firefox/3.6.4 (.NET CLR 3.5.30729) (20100523185824)
• Plugins Tested: Facebook plugin, Flash 10.0 r45
• Add-ons: Yahoo Toolbar, Skype, FoxClocks, Better Gmail, ReloadEvery, Flagfox
• New bugs filed during testing: bug 568129 - alt-tab when in full screen hulu
• Existing Bugs seen:
• Issues Noted:
• Top Sites Visited: Yahoo, MSN, Youtube, Wired, Hulu,
• Crashes Noted: See bug above. Nominated to block 1.9.2

Windows Vista (marcia) spot check

• Status: Completed
• Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.4) Gecko/20100523 Firefox/3.6.4
• Plugins Tested
  • QuickTime Plug-in 7.6.6
  • Silverlight 4.0.50401.0
  • Shockwave Flash 10.0 r45
• Add-ons:
• New bugs filed during testing: https://bugzilla.mozilla.org/show_bug.cgi?id=567876 OOPP: [@ hang | KiFastSystemCallRet ]
• Existing bugs seen:
• Crashes Noted:
  • http://crash-stats.mozilla.com/report/index/7de83755-3471-4a15-8b0b-a1e892100524
  • http://crash-stats.mozilla.com/report/index/bp-dea19ec6-b3cf-4c44-b177-d346e2100524
• Issues Noted:
  • Got same crash as I did on Window 7 VM. I went to Full screen mode before the blip.tv video finished loading. Filed https://bugzilla.mozilla.org/show_bug.cgi?id=567876

Mac OS X 10.6 (marcia)

• Status: Completed
• Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.4) Gecko/20100523 Firefox/3.6.4
• Plugins Tested
  • Silverlight 4.0.50401.0
  • Shockwave Flash 10.1 r53
  • QuickTime Plug-in 7.6.6
• Add-ons:
• New bugs filed during testing:
• Existing bugs seen:
• Issues Noted:

Mac OS X 10.5 (tester)

• Status:' '
• Build ID:
• Plugins Tested
• Add-ons:
• New bugs filed during testing:
• Existing bugs seen:
• Issues Noted: