Firefox:1.5.0.5:Test Plan:Software Update

From MozillaWiki
Jump to: navigation, search

Software Update Spot Checks (Firefox and Thunderbird)

Thunderbird Results at bottom of this page.

Firefox

en-US Builds

Rotate between partial and full, your choice

Windows en-US [tracy/ispiked]

  • partial betatest 1.5.0.4 -> 1.5.0.5 - PASS
  • partial releasetest 1.5.0.4 -> 1.5.0.5 - PASS
  • complete releasetest 1.5.0.2 -> 1.5.0.5 - PASS
    • Tested successfully downloading and restarting and failing the complete update and restarting to download again. Both passed.

PPC Mac en-US [marcia/ispiked]

  • partial releasetest 1.5.0.4->1.5.0.5 - PASS
  • partial betatest 1.5.0.4->1.5.0.5 - PASS
  • complete betatest 1.5.0.1->1.5.0.5 - PASS
    • Talkback Build ID all cases: 2006072310

Linux (Ubuntu/Fedora) en-US [juanb/ispiked]

  • partial betatest 1.5.0.4 -> 1.5.0.5 - PASS
  • complete releasetest 1.5.0.2 -> 1.5.0.5 - PASS
    • Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.0.5) Gecko/20060719 Firefox/1.5.0.5
    • Talkback BuildID = "2006071912"

P1 Locales

Marcia: Windows ispiked: Linux Juan: Mac

Every other locale, test failing the partial and make sure it falls back to full. If you are making a longer hop from 1.5->1.5.0.5 you can still test failing the update to see that after the failure it goes out and gets the update on the second try. Note that only 1.5.0.4 will use a partial update; 1.5.0.* will all use full updates.

  • da - Windows betatest 1.5 -> 1.5.0.5 [marcia] - PASS
    • Talkback Build ID = 2006071912
  • de - Mac releasetest 1.5.0.1 -> 1.5.0.5 [juanb] - PASS
    • Talkback BuildID = "2006072310"
  • es-ES - Linux betatest 1.5.0.2 ->1.5.0.5 - PASS
  • fi - Windows releasetest 1.5.0.3 -> 1.5.0.5 [marcia] - PASS
    • Talkback Build ID=2006071912
  • fr - Mac betatest 1.5 -> 1.5.0.5 - [juanb] - PASS
    • Talkback BuildID="2006072310"
  • it - Linux releasetest 1.5.0.1 -> 1.5.0.5 - PASS
    • Was failing because of wrong build IDs on AUS, but rhelmer fixed it.
  • it - Linux releasetest 1.5.0.4 -> 1.5.0.5 - PASS
    • Tested both partial updating and restarting, and failing partial and downloading complete. Both passed.
  • ja-JP-mac (mac primarily) - Mac betatest 1.5.0.2 ->1.5.0.5
  • ja - Windows betatest 1.5.0.3 -> 1.5.0.5 [marcia] - PASS
    • Fail on Windows XP Machine, Pass on Windows Machine
    • Talkback Build ID=2006071912
    • rhelmer passed on his machine as well
  • nl - Linux betatest 1.5->1.5.0.5 - PASS
    • Tested failing complete, downloading complete again.
  • pl - Windows releasetest 1.5.0.1 ->1.5.0.5 [marcia] - PASS
    • Talkback Build ID = 2006071912
    • Tested Fail partial, fallback to Full - PASS
  • zh-CN - Mac betatest 1.5.0.4-> 1.5.0.5
    • partial betatest - PASS
      • Mozilla/5.0 (Macintosh; U; Intel Mac OS X; zh-CN; rv:1.8.0.5) Gecko/20060723 Firefox/1.5.0.5
      • Talkback BuildID = "2006072310"
  • zh-TW - Linux releasetest 1.5.0.1 -> 1.5.0.5 - PASS

Thunderbird

en-US Builds

Rotate between partial and full, your choice

Windows en-US [ispiked]

  • partial betatest 1.5.0.4 -> 1.5.0.5 - PASS
    • Tested getting partial update and restarting as well as failing partial and restarting to download complete. Both passed.
  • complete betatest 1.5 -> 1.5.0.5 - PASS

Intel Mac en-US [marcia]

  • partial releasetest (PPC build) 1.5.0.4 -> 1.5.0.5 - PASS
    • confirmed update was correct file size of 7.4 MB
    • On first test, partial failed immediately, fallover to full and then app hung after complete was downloaded. This issue needs to be documented in the post mortem - the thread on IRC was too long to follow.
  • partial releasetest (UB Build) 1.5.0.4 -> 1.5.0.5 - PASS
    • Build ID: version 1.5.0.5 (20060719)
  • complete betatest (PPC build) 1.5.0.2 -> 1.5.0.5 - PASS

PPC Mac en-US [marcia]

  • partial betatest (PPC build) 1.5.0.4 -> 1.5.0.5 - PASS
    • On first test, partial failed immediately, fallover to full and then app hung after complete was downloaded.
  • partial betatest (UB Build) 1.5.0.4 -> 1.5.0.5 - PASS
  • complete releasetest (PPC build) 1.5 -> 1.5.0.5 - PASS
    • Tested failing - PASS

Linux en-US [ispiked]

  • partial betatest 1.5.0.4 -> 1.5.0.5 - PASS
    • Tested failing partial, downloading complete and not failing partial and restarting to update. Both passed.
  • complete releasetest 1.5.0.2 -> 1.5.0.5 - PASS

P1 locales

Every other locale, test failing the partial and make sure it falls back to full. If you are making a longer hop from 1.5->1.5.0.5 you can still test failing the update to see that after the failure it goes out and gets the update on the second try. Note that only 1.5.0.4 will use a partial update; 1.5.0.* will all use full updates.

  • da - Windows betatest 1.5 -> 1.5.0.5 [marcia] - PASS
    • Tested failing the update - PASS
  • de - Mac releasetest partial(= full) 1.5.0.2 ppc -> 1.5.0.5 ub [jay] - PASS
  • de - Mac releasetest partial 1.5.0.4 ppc -> 1.5.0.5 ub [jay] - PASS [6.5 MB - Version 1.5.0.5 (20060719)]
  • es-ES - Linux betatest 1.5.0.2 ->1.5.0.5 [ispiked] - PASS
  • fi - Windows releasetest 1.5.0.2 -> 1.5.0.5 [tracy] - PASS
  • fr - Mac betatest partial(= full) 1.5 ppc -> 1.5.0.5 ub [jay] - PASS [15.8 MB - version 1.5.0.5 (20060719)]
  • fr - Mac releasetest 1.5.0.4 ub -> 1.5.0.5 ub [jay] - PASS [version 1.5.0.5 (20060719)]
  • it - Linux releasetest 1.5.0.2 -> 1.5.0.5 [tracy] - PASS
  • ja-JP-mac (mac primarily) partial 1.5.0.4 ub -> 1.5.0.5 ub [jay] - PASS [1.6 MB - バージョン 1.5.0.5 (20060719)]
  • ja-JP-mac full 1.5.0.5 ppc -> 1.5.0.5 ub [jay] -
  • ja - Windows betatest 1.5.0.4 -> 1.5.0.5 [marcia] - PASS
    • Tested failing the update - PASS
  • nl - Linux betatest 1.5->1.5.0.5 [ispiked] - PASS
    • Tested failing complete update and downloading complete again on restart.
  • nl - Linux betatest 1.5.0.4 -> 1.5.0.5 [ispiked] - PASS
    • This initially failed because the partial updates weren't generated correctly, but rhelmer fixed it.
  • pl - Windows releasetest 1.5 ->1.5.0.5 [marcia] - PASS
  • zh-CN - Mac betatest partial 1.5.0.4-> 1.5.0.5 [tracy] - PASS
  • zh-CN - Mac releasetest full 1.5.0.4 -> 1.5.0.5 [jay] - PASS [17.8 MB - 版本 1.5.0.5 (20060719)]
  • zh-TW - Linux releasetest 1.5.0.4 -> 1.5.0.5 [tracy] - no zh-TW 1.5.0.4 or 1.5.0.5

P2 locales

  • ca - Mac PPC releasetest 1.5.0.2(PPC) -> 1.5.0.5 [rob] - FAIL
    • Downloads full update twice then updater freezes, updates.status = null
  • ca - Mac PPC releasetest 1.5.0.4(PPC) -> 1.5.0.5 [rob] - FAIL
    • Downloads patch, then full update: then updater freezes; updates.status = null
  • ca - Mac PPC releasetest 1.5.0.4(UB) -> 1.5.0.5 [rob] - PASS