QA/Thunderbird3/TestResults/Alpha2

From MozillaWiki
< QA
Jump to: navigation, search

« Back to Thunderbird 3 Alpha 2 Release Page | How you can help in Thunderbird QA

Thunderbird 3 Alpha 2 Test Results

Testing for this release will focus on smoketests, BFTs, and spotchecks of en-US and selected locales.

Related Pages

How you can help in Thunderbird QA

Alpha 2 Release Tracking Page

Links to key test results. More are referenced further below.

Contact Info

QA: Wayne Mery, wsmwk in #maildev channel on irc.mozilla.org or post in newsgroup mozilla.support.thunderbird with subject Shredder Alpha 2

Testers: Can meet each other in #testday channel on irc.mozilla.org

irc instructions

Schedule

Builds hand to QA
08/04
QA signoff
  • Smoketests - 2008-08-11
  • Spotchecks - 2008-08-11
  • BFTs - 2008-08-11

  initial ETA 8/08
  Gave verbal PASS to DavidA ~4pm EST Friday 2008-08-08 (except Mac smoketest yet to complete)

Release Notes

Release notes will be based on:

Build Location and IDs

Build 1

Test Coverage

Overview: smoketest all 3 major platforms. Alpha 1 did a partial BFT. So goal is to BFT all 3 platforms to get BFTs in better shape for beta testing. Divide BFT into pieces to reduce time required per person (IOW soo the full range of tests is accomplished, but not necessarily be a single OS). Check mozilla.feedback.thunderbird.prerelease and mozilla.feedback for additional result comments. [no comments have been found in there nor in m.support.thunderbird]

  • Areas Covered (en-US):
    • Spotchecks
    • Smoketests
    • BFTs
    • L10n, spotcheck selected locales
  • Areas Not Covered:
    • FFTs
    • Updates
    • L10n

QA Summary

  • Smoketests: 2008-08-05 - 2008-08-09
  • Windows XP/Vista BFTs: 2008-08-05 - 2008-08-11
  • Linux BFTs: 2008-08-05 - 2008-08-09
  • Mac BFTs: -
  • Release to World: 2008-08-??

Testing Results Summary

Smoketests

  • Windows XP SP1 (nshopik) - 2008-08-06
  • Windows Vista SP1 (simon.johansson) - 2008-08-06
  • Mac OS X [PPC Mac] 10.4 (who) - 2008-08-??
  • Mac OS X [Intel Mac] 10.5 (nth10sd) - 2008-08-08
  • Linux (multiple) - 2008-08-??

BFTs

  • Windows XP SP2/Vista (wsmwk) - 2008-08-11

Spot checks

  • Windows Vista SP1 - 2008-08-??
  • Mac OS X [PPC Mac] 10.4 - 2008-08-??
  • Mac OS X [Intel Mac] 10.5 - 2008-08-??
  • Linux (multiple) - 2008-08-10

Testday

A Thunderbird 3 Alpha 2 testday may be held and a call for community support to assist with testing.

Detailed Results

Smoketests

Windows XP SP2 (nshopik)

  • Date: 2008-08-06
  • Build ID: version 3.0a2 (? 2008070208)
  • Test Type: Litmus Smoketests
  • Results: PASS
  • Locale: ru
  • Bugs reported: ()

Mac OS X [PPC Mac] 10.4 (who)

  • Date: 2008-08-??
  • Build ID: version 3.0a2 (200807????)
  • Test Type: Litmus Smoketests
  • Results: ????
  • Bugs reported: ()

Mac OS X [Intel Mac] 10.5 (nth10sd)

  • Date: 2008-08-08
  • Build ID: version 3.0a2 (2008072822)
  • Test Type: Litmus Smoketests
  • Results: PASS
  • Bugs reported: bug 450038 Help doesn't redirect to locale, bug 450109 File | Print fails from a standalone message window -- option is blanked out, not selectable, bug 450113 sends via the non-default account until i delete all other smtp accounts except the intended one

Used wrong builds...

Windows XP Vista (simon.johansson)

  • Date: 2008-08-06
  • Build ID: version 3.0a2 (? 2008080600)
  • Test Type: Litmus Smoketests
  • Results: ????
  • Bugs reported: ()

Windows Vista SP2 (neander)

  • Date: 2008-08-06
  • Build ID: version 3.0a2 (? 2008070208)
  • Test Type: Litmus Smoketests
  • Results: ????
  • Bugs reported: ()

BFT

Windows XP SP2/Vista (wsmwk and others)

  • Date: 2008-08-08 2008-08-11
  • Build ID: version 3.0a2 (2008072418)
  • Test Type: Litmus BFT
  • Results: PASS
  • Untested
    • Test 5694 Auto Proxy Connection
    • unimportant or less important to alpha): Extensions, themes, software update
  • Bugs reported: bug [pending] Outlook not offered as import option [testresult 146563], bug 404609 [already on file] installer fails to run without administrator - lacks manifest [testresult 146402], bug 449759 crash @ nsTreeSelection::GetSingle(int*) [testresult 146278], bug [pending+unconfirmed] inline splellchecker fails in html compose [testcase 146005]

Linux (nestler, nigg, ms07, miquelmartin, badgerfiles)

  • Date: 2008-08-05 - 2008-08-09
  • Build ID: version 3.0a2 (2008072418)
  • Test Type: Litmus BFT
  • Results: PASS
  • Bugs reported:
  • Bugs pending: bug??? Breakpad "Enabled=1" is missing testresult 146798, [unconfirmed] Contacts button is missing [testresult 146200], bug ?? "Show the article summary instead..." has no effect. The RSS is all times showed as HTML webpage [testresult 146507], bug??? RSS subscription drops from drag are rejected [testresult 146509], bug???? Unable to add downoad actions via Options -> Attachments -> Download Action testresult 146526, bug??? HTML email does not send as HTML testcase 146528, bug??? phishing detection https://litmus.mozilla.org/single_result.cgi?id=146545 testresult 146545]
  • Bugs existing: bug 449482 Changing draft folder from an Imap folder to a local folder has no effect [testresult 146184]
  • Issues Noted - Bugs filed:
    • _

Spot Check

Visually check accounts manager and addons, login to an account, send a message to ensure there is nothing vividly broken, and tinker around other parts of Thunderbird. To record your test results below: login to the wiki, click edit above at Thunderbird Spot Check, copy one of the blocks below and paste a new one for yourself, and :

  • change PASS/FAILED to PASS or FAILED
  • change who to your name
  • change 200807???? to your buildid from help|about

Spot Check Vista SP1 (who)

  • Build ID: version 3.0a2 (200807????)
  • Status: PASS/FAILED

Spot Check Linux (who)

  • Build ID: version 3.0a2 (200807????)
  • Status: PASS/FAILED

Spot Check Linux (kquiggle)

  • Build ID: version 3.0a2 (200807????)
  • Status: PASS

Spot Check OS X [PPC Mac] 10.4 (who)

  • Build ID: version 3.0a2 (200807????)
  • Status: PASS/FAILED

Spot Check OS X [Intel Mac] 10.5 (who)

  • Build ID: version 3.0a2 (200807????)
  • Status: PASS/FAILED
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Thunderbird3/TestResults/Alpha2&oldid=103567"