Releases/Firefox 3.6.14/Test Plan:Smoketests

From MozillaWiki
Jump to: navigation, search

« Firefox:3.6.14:Test_Plan

Smoketests and BFTs are run partially though Mozmill automation and partially through manual testing (where automation does not currently exist). This means that the Mozmill automation is first run and results logged on this page. Then testers will run the leftover manual tests that the Mozmill testing did not cover. Because of this, please speak with QA (usually Hskupin and Abillings) before beginning manual testing if Mozmill results are not logged to the page below.

Firefox 3.6.14 Smoketest and BFT Results

Smoketests for Build 3

Build IDs

  • Windows: 20110218125750
  • OS X: 20110218124600
  • Linux: 20110218124314

Windows XP (geo)

  • Date: 2011-02-22
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.14) Gecko/20110218 Firefox/3.6.14
  • Mozmill PASS
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Windows 7 (gmontagu)

  • Date: 2011-02-18
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.14) Gecko/20110218 Firefox/3.6.14
  • Mozmill PASS
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Windows Vista (abillings)

  • Date: 2/22/2011
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.14) Gecko/20110218 Firefox/3.6.14
  • Mozmill PASS
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Mac OS X 10.6 (geo)

  • Date: 2011-02-22
  • Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.14) Gecko/20110218 Firefox/3.6.14
  • Mozmill PASS (known issues)
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Linux (abillings)

  • Date: 2/22/2011
  • Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.14) Gecko/20110218 Firefox/3.6.14
  • Mozmill PASS
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Smoketests for Build 2

Build IDs

  • Windows: 20110207134212
  • OS X: 20110207130523
  • Linux: 20110207130507

Windows XP (geo)

  • Date: 2011-02-08
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.14) Gecko/20110207 Firefox/3.6.14 (.NET CLR 3.5.30729)
  • Mozmill PASS
  • Status: RESULTS in Litmus (Mozmill and Manual)
    • Notes:

Windows 7 (tester, gmontagu)

  • Date: February 8
  • Build ID: Build identifier: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.14) Gecko/20110207 Firefox/3.6.14
  • Mozmill PASS
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Windows Vista (abillings)

  • Date: 2/8/2011
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.14) Gecko/20110207 Firefox/3.6.14
  • Mozmill PASS
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Mac OS X 10.6 (geo)

  • Date: 2011/02/08
  • Build ID: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.14) Gecko/20110207 Firefox/3.6.14
  • Mozmill PASS
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Linux (abillings)

  • Date: 2/8/2011
  • Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.14) Gecko/20110207 Firefox/3.6.14
  • Mozmill PASS
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Smoketests for Build 1

Build IDs

  • Windows: 20110121145327
  • OS X: 20110121145415
  • Linux: 20110121145245

Windows XP (ashughes, geo)

  • Date: 2011-01-21
  • Build ID: Firefox 3.6.14 (1.9.2.14, en-US, 20110121145327)
  • Mozmill PASS
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Windows 7 (ashughes, gmontagu)

  • Date: 2011-01-21
  • Build ID: Firefox 3.6.14 (1.9.2.14, en-US, 20110121145327)
  • Mozmill PASS
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Windows Vista (abillings/ashughes)

  • Date: 2011-01-21
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2.14) Gecko/20110121 Firefox/3.6.14
  • Mozmill PASS
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Mac OS X 10.6 (ashughes, geo)

  • Date: 2011-01-21
  • Build ID: Firefox 3.6.14 (1.9.2.14, en-US, 20110121145415)
  • Mozmill PASS
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

Linux (abillings/ashughes)

  • Date: 2011-01-21
  • Build ID: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.14) Gecko/20110121 Firefox/3.6.14
  • Mozmill PASS
  • Status: PASS in Litmus (Mozmill and Manual)
    • Notes:

BFTs

Build 1

Manual Windows XP (Waverley)

  • Date: 24-10-2011
  • Build ID: 20110121145327

The Manual section of the BFT will be divided up in four sections.

  • Sections (from Litmus in order)
    • Installation - Tabbed Browsing (George)
      • Results: PASS in Litmus
    • Search - Addons (George)
      • Results: PASS in Litmus
    • Downloading - Cookies (George)
      • Results: PASS in Litmus with known issues
    • Security - Uninstall (George)
      • Results: PASS in Litmus with known issues
      • Notes: known failures:
    • bug 575236 - acid2: testimage incorrectly rendered
    • bug 134002 - Content of plugins (flash, java applets) doesn't get rendered for printing or print preview
    • bug 573699 - [Add-ons Manager]No notification bar displayed in Add-ons manager > Plugins when installed plugins are outdated
    • bug 435799 - download does not resume where it left off if firefox crashes

Other OS Spot Checks

Windows 2000 (abillings)

Build 1

  • Date: 1/24/2011
  • Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.9.2.14) Gecko/20110121 Firefox/3.6.14
  • Mozmill: PASS (known failure)
  • Status: PASS


Build 2

  • Date:
  • Build ID:
  • Mozmill: PASS (known failure)
  • Status: RESULTS


Build 3

  • Date: 2011-02-18
  • Build ID:
  • Mozmill: PASS
  • Status: RESULTS

Windows 7 64-bit

Build 3

  • Date: 2011-02-18
  • Build ID:
  • Mozmill: PASS
  • Status: RESULTS
Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_3.6.14/Test_Plan:Smoketests&oldid=286368"