Releases/Firefox 3.6.15/BuildNotes

From MozillaWiki
Jump to: navigation, search

Build Engineers

rail, armenzg - bug 638062

Signed-off Revision(s)

a50a49f952c0

Tags

Build # Tag Changeset
1 FIREFOX_3_6_15_BUILD1 c2b88342ea2b

Notifications

  • We have to notify AV vendors once the signed bits are on candidates directory (for email address and template example, see bug 568884#c15 )
  • We have to give mirrors as much notice as possible before pushing to mirrors. This has been 24-72 hours, but has been up to a week in advance. (for email address and template example, see bug 633657 )
  • We have to notify infra-all@ before "go to build" and before we ship. The more advance notice the better.
  • We have to notify metrics once we release

Bugs hit

  • bug 630904 - release_sanity should wait for reconfig to finish successfully before doing sendchange
  • bug 575400#c45 - partner repacks needs to be tagged

Build data

Build # Type Build ID Build machine Time to build
1 Linux 20110303024323 moz2-linux-slave21 59 mins, 40 secs
Mac 20110303024001 bm-xserve16 1 hrs, 40 mins, 50 secs
Windows 20110303024726 win32-slave19 5 hrs, 34 mins, 18 secs

Build 1

  • Clobbered with "Any master/any release/any builder"
  • Pushed buildbot-configs http://hg.mozilla.org/build/buildbot-configs/rev/a0f6e034b7c9 and merged to production branch: http://hg.mozilla.org/build/buildbot-configs/rev/1a8d2f48b74f
  • tagged using FIREFOX_3_6_15_BUILD1 and FIREFOX_3_6_15_RELEASE: buildbotcustom (tip of production-0.8), tools (tip of default), buildbot-configs (tip of production)
  • updated /tools/buildbotcustom/buildbotcustom, /builds/buildbot/configs, and /builds/buildbot/builder_master/tools to latest
  • Left tree open, 0.8.0 automation doesn't require that it closes
  • kicked off automation with: 
PYTHONPATH=/builds/buildbot/builder_master:/builds/buildbot/builder_master/tools/lib/python python \
/builds/buildbot/builder_master/tools/buildbot-helpers/release_sanity.py \
-u rail -V 3.6.15 --branch mozilla-1.9.2 --build-number 1 \
-c release-firefox-mozilla-1.9.2.py --dryrun localhost:9010

Tag

Hit bug 630904, nothing critical. Stopped the build before it started tagging. Resent sendchange.

Update Bouncer

Triggered by automation. No problems.

Source / XULRunner Source

No problems

Build

Remove en-US.xpi

You want to remove the en-US.xpi before autosigning creates the MD5SUMS and the SHA1SUMS.

Please remove this section once bug 628795 is fixed.

Start autosigning

Set up autosinging using instructions

L10n Repack

win32 1/6 repack timed out doing hg clone. Clobbered manually and hit "Rebuild".

Forced release-mozilla-1.9.2-win32_repack_complete to send "Firefox 3.6.15 build1: All unsigned win32 builds now available" email with the following properties set:

  • script_repo_revision: FIREFOX_3_6_15_RELEASE
  • release_config: mozilla/release-firefox-mozilla-1.9.2.py.

Partner Repack

Linux partner repack build failed because partner-repacks repo wasn't tagged by automation. Tagged manually and hit "Rebuild". https://bugzilla.mozilla.org/show_bug.cgi?id=575400#c45

XULRunner Build

xulrunner_macosx_build filed while compiling. Clobbered and retriggered the build to make sure that it's not an infra issue. No problems with second build.

Unittests

Emailed release-drivers.

Oranges: 

* Rev3 Fedora 12 release-mozilla-1.9.2 talos scroll
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox3.6-Release/1299152241.1299153572.14875.gz

release-mozilla-1.9.2-linux_test mochitests on 2011/03/03 03:36:28
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox3.6-Release/1299152188.1299153940.16739.gz

s: moz2-linux-slave26
39512 ERROR TEST-UNEXPECTED-FAIL | /tests/content/html/content/test/test_bug481335.xhtml | Should be visited now - "rgb(0, 0, 238)" should equal "rgb(85, 26, 139)"
39513 ERROR TEST-UNEXPECTED-FAIL | /tests/content/html/content/test/test_bug481335.xhtml | Should still be visited after setting pathname to its existing value - "rgb(0, 0, 238)" should equal "rgb(85, 26, 139)"
39516 ERROR TEST-UNEXPECTED-FAIL | /tests/content/html/content/test/test_bug481335.xhtml | Should be visited now after third load - "rgb(0, 0, 238)" should equal "rgb(85, 26, 139)"

release-mozilla-1.9.2-macosx_test mochitests on 2011/03/03 04:16:51
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox3.6-Release/1299154611.1299156462.620.gz

s: moz2-darwin9-slave61
39506 ERROR TEST-UNEXPECTED-FAIL | /tests/content/html/content/test/test_bug481335.xhtml | Should be visited now after third load - "rgb(0, 0, 238)" should equal "rgb(85, 26, 139)"

release-mozilla-1.9.2-win32_test mochitests on 2011/03/03 08:11:28    
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox3.6-Release/1299168688.1299170105.1864.gz

s: win32-slave16
23693 ERROR TEST-UNEXPECTED-FAIL | /tests/content/base/test/test_bug426646.html | History.go(-1) didn't work? -  should equal "about:blank"
39509 ERROR TEST-UNEXPECTED-FAIL | /tests/content/html/content/test/test_bug481335.xhtml | Should be visited now - "rgb(0, 0, 238)" should equal "rgb(85, 26, 139)"
39510 ERROR TEST-UNEXPECTED-FAIL | /tests/content/html/content/test/test_bug481335.xhtml | Should still be visited after setting pathname to its existing value - "rgb(0, 0, 238)" should equal "rgb(85, 26, 139)"
39513 ERROR TEST-UNEXPECTED-FAIL | /tests/content/html/content/test/test_bug481335.xhtml | Should be visited now after third load - "rgb(0, 0, 238)" should equal "rgb(85, 26, 139)"

Signing

Followed CombinedSigning doc.

Notify AV vendors

L10n Verify

Nothing wrong on the logs.

Updates

3.6* -> 3.6.15

Generation

It failed at first because the job was picked up by a VM.

We re-enabled one of the IX machines that were down and force build it.

Nthomas landed a fix for the special locales that have problems.

This time updates went through properly.

Update Verify

Windows (it seems to work in manual check; another build was triggered to confirm): 

Using  https://aus2.mozilla.org/update/1/Firefox/3.6.4/20100611143157/WINNT_x86-msvc/et/betatest/update.xml?force=1
FAIL: no complete update found for https://aus2.mozilla.org/update/1/Firefox/3.6.4/20100611143157/WINNT_x86-msvc/et/betatest/update.xml?force=1
FAIL: download_mars returned non-zero exit code: 1

No problems in the second build.

OSX (Nothing to worry for 'ml' and 'te' bug 629256: 

Using  https://aus2.mozilla.org/update/1/Firefox/3.6.14/20110218124600/Darwin_Universal-gcc3/ml/betatest/update.xml?force=1
FAIL: no partial update found for https://aus2.mozilla.org/update/1/Firefox/3.6.14/20110218124600/Darwin_Universal-gcc3/ml/betatest/update.xml?force=1
FAIL: download_mars returned non-zero exit code: 1
Using  https://aus2.mozilla.org/update/1/Firefox/3.6.14/20110218124600/Darwin_Universal-gcc3/ml/betatest/update.xml?force=1
FAIL: no complete update found for https://aus2.mozilla.org/update/1/Firefox/3.6.14/20110218124600/Darwin_Universal-gcc3/ml/betatest/update.xml?force=1
FAIL: download_mars returned non-zero exit code: 1
Using  https://aus2.mozilla.org/update/1/Firefox/3.6.14/20110218124600/Darwin_Universal-gcc3/te/betatest/update.xml?force=1
FAIL: no partial update found for https://aus2.mozilla.org/update/1/Firefox/3.6.14/20110218124600/Darwin_Universal-gcc3/te/betatest/update.xml?force=1
FAIL: download_mars returned non-zero exit code: 1
Using  https://aus2.mozilla.org/update/1/Firefox/3.6.14/20110218124600/Darwin_Universal-gcc3/te/betatest/update.xml?force=1
FAIL: no complete update found for https://aus2.mozilla.org/update/1/Firefox/3.6.14/20110218124600/Darwin_Universal-gcc3/te/betatest/update.xml?force=1
FAIL: download_mars returned non-zero exit code: 1
Using  https://aus2.mozilla.org/update/1/Firefox/3.6.13/20101203074432/Darwin_Universal-gcc3/ml/betatest/update.xml?force=1
FAIL: no partial update found for https://aus2.mozilla.org/update/1/Firefox/3.6.13/20101203074432/Darwin_Universal-gcc3/ml/betatest/update.xml?force=1
FAIL: download_mars returned non-zero exit code: 1
Using  https://aus2.mozilla.org/update/1/Firefox/3.6.13/20101203074432/Darwin_Universal-gcc3/ml/betatest/update.xml?force=1
FAIL: no complete update found for https://aus2.mozilla.org/update/1/Firefox/3.6.13/20101203074432/Darwin_Universal-gcc3/ml/betatest/update.xml?force=1
FAIL: download_mars returned non-zero exit code: 1
Using  https://aus2.mozilla.org/update/1/Firefox/3.6.13/20101203074432/Darwin_Universal-gcc3/te/betatest/update.xml?force=1
FAIL: no partial update found for https://aus2.mozilla.org/update/1/Firefox/3.6.13/20101203074432/Darwin_Universal-gcc3/te/betatest/update.xml?force=1
FAIL: download_mars returned non-zero exit code: 1
Using  https://aus2.mozilla.org/update/1/Firefox/3.6.13/20101203074432/Darwin_Universal-gcc3/te/betatest/update.xml?force=1
FAIL: no complete update found for https://aus2.mozilla.org/update/1/Firefox/3.6.13/20101203074432/Darwin_Universal-gcc3/te/betatest/update.xml?force=1
FAIL: download_mars returned non-zero exit code: 1

Linux: no problems, green.

3.5.x -> 3.6.15 Major Updates

MU Generation
  • Requested clobberrer for 1.9.2 major_update
  • Used 'force build' to start the major_update builder.

A couple of first builds failed due to lack of disk space on VM. At some point the builder (automatically retriggerred?) picked up an IX machine. No problems.

MU Verify

All MU update verifies turned red due to missing update of "mn" locale, which was removed from 3.6 (expected).

Socorro product data updates

crash-stat admin: added Firefox 3.6.15 and Firefox 3.6.16pre .

Push to Beta Channel

NOTE we are skipping this as this is a fast release and we are going to go live to the release channel first thing tomorrow (Friday March 4th) morning and later on the beta channel.

The backup has finished successfully.

Review results by reattaching to screen -R armenzg. 

#From a build slave you can reach aus2-staging
#cltbld@aus2-staging.mozilla.org
#This takes now a lot of time because of PHX datacenter
cd /opt/aus2/snippets/staging/
~/bin/backupsnip 20110303-Firefox-3.6.15-beta


Pushed beta snippets upon release-drivers request (3/4/2011 09:53am PDT). 

#From a build slave you can reach aus2-staging
#cltbld@aus2-staging.mozilla.org
#This takes now a lot of time because of PHX datacenter
cd /opt/aus2/snippets/staging/
~/bin/pushsnip 20110303-Firefox-3.6.15-beta

Fix snippets for some locales

This was needed for 3.6.14.

Please remove this section for next release (This text will be modified if I did anything for it on the 3.6.15 release)

Email mirrors about release day date

See Notifications section for more details.

Going live day!

Final checks before push & virus scan

Triggered with scrip_repo_revision: FIREFOX_3_6_15_RELEASE and release_config: mozilla/release-firefox-mozilla-1.9.2.py properties.

Permissions run went well.

Antivirus check run well.

Push to Mirrors

Forced push_to_mirrors builder with the following properties set:

  • release_config: mozilla/release-firefox-mozilla-1.9.2.py
  • script_repo_revision: FIREFOX_3_6_15_RELEASE

Push to community mirrors (3/4/2011 9:45am PDT): 

# cltbld@stage
vim -n /pub/mozilla.org/zz/rsyncd-mozilla-current.exclude
# replace 3.6.14 with 3.6.15

We forgot to do this again. See bug 637805 for automation.

Final Verification

It should trigger automatically when there is enough uptake.

It looks good we only had 'ml' and 'te' failures.

Push release test channel snippets

See bug 643976. We had to re-push this because the 4.0 MU overwrote the snippets. 

#From a build slave you can reach aus2-staging
#cltbld@aus2-staging.mozilla.org
#This takes now a lot of time because of PHX datacenter
cd /opt/aus2/snippets/staging
~/bin/pushsnip Firefox-3.6.16-build1-test

Push release channel snippets

We will need to revert the patch in bug 638227 to re-enable updates from all previous 3.6 builds.

Review results by reattaching to screen -R armenzg. 

#From a build slave you can reach aus2-staging
#cltbld@aus2-staging.mozilla.org
#This takes now a lot of time because of PHX datacenter
cd /opt/aus2/snippets/staging/
~/bin/backupsnip Firefox-3.6.16-build1

The backup of the snippets has finish

Run pushsnip upon rel-drivers request. 

#From a build slave you can reach aus2-staging
#cltbld@aus2-staging.mozilla.org
#This takes now a lot of time because of PHX datacenter
cd /opt/aus2/snippets/staging/
~/bin/pushsnip 20110303-Firefox-3.6.15

We also had to re-enable updates which had been throttled for this release. See bug 638806 for more details.

Update download.mozilla.org for EUBallot

Filed bug 638633#c8 to do the redirection (don't mention browserchoice as it is misleading).

Release

Update symlinks 

#ffxbld@stage
cd /home/ftp/pub/firefox/releases
rm latest-3.6 && ln -s 3.6.15 latest-3.6

Sent the following mail to metrics@mozilla.com: 

Firefox,firefox,firefox,3.6.15,3.6
Firefox,firefox,firefox,3.6.16pre,3.6

XULRunner Signing

Create ~/signXR1.9.2.15.bash file with chmod +x and this content: 

#!/bin/bash
set -x
set -e

PRODUCT=xulrunner
VERSION=1.9.2.15
BUILD=1
TAG=FIREFOX_3_6_15_RELEASE
REPO="releases/mozilla-1.9.2"
EMAIL=armenzg@mozilla.com
KEYDIR=d:/2010-keys

cd ~/hg-tools
hg pull
hg up -r ${TAG}

mkdir -p ~/signing-work/${PRODUCT}-${VERSION}
cd ~/signing-work/${PRODUCT}-${VERSION}
cp ~/hg-tools/release/signing/* .

make setup PRODUCT=${PRODUCT} VERSION=${VERSION} \
  BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} USE_NEW=1
rsync -av -e "ssh -i /home/cltsign/.ssh/xrbld_dsa" \
  --exclude=*.txt --exclude=*-symbols.zip \
  xrbld@stage.mozilla.org:/home/ftp/pub/${PRODUCT}/nightly/${VERSION}-candidates/build${BUILD}/ \
 unsigned-build${BUILD}
rsync -av --exclude=unsigned unsigned-build${BUILD}/ \
 signed-build${BUILD}/
rsync -av unsigned-build${BUILD}/unsigned/ \
 signed-build${BUILD}/

make checksum-files create-sigs stage verify-sigs \
  PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} \
  REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} USE_NEW=1

rmdir signed-build${BUILD}/contrib{,-localized}

rsync -av -e "ssh -i /home/cltsign/.ssh/xrbld_dsa" \
  signed-build${BUILD}/ \
  xrbld@stage.mozilla.org:/home/ftp/pub/${PRODUCT}/nightly/${VERSION}-candidates/build${BUILD}/

Push XULRunner to mirrors

# xrbld@stage
rsync -av --exclude=*.txt --exclude=*unsigned*  --exclude=*-symbols.zip \
  /pub/mozilla.org/xulrunner/nightly/1.9.2.15-candidates/build1/ \
  /pub/mozilla.org/xulrunner/releases/1.9.2.15/

Edited cltbld@stage:/pub/mozilla.org/zz/rsyncd-mozilla-releases.exclude and added 

- xulrunner/releases/1.9.2.14

Update XULRunner entries on wiki

Updated the links in these two wiki pages for the version change:

Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_3.6.15/BuildNotes&oldid=293312"