« back to Bouncer home

Status

Bouncer 2 was staged. See https://bugzilla.mozilla.org/show_bug.cgi?id=304343.

Bouncer 2 is tentatively scheduled to be deployed in the second week of december.

Deployment Notes

Deployment will be a two-phase process.

1. The update system for 1.5.0.9 will be used to test bouncer2 through the build snippets, which will point to a download2.mozilla.org.* URI for complete and partial .mar files.
2. Once we have verified that works, a full migration will take place and for the 2.0.0.1 release we should be relying solely on Bouncer2.

The TODO list below describes what will happen chronologically.

Deployment TODO List

• Stage the code on stage.m.c
• Get Bouncer2 onto main cluster oremj, Dec 6
  • Only PHP bounce script really needs to be on cluster!
• DNS updates oremj, Dec 6
  • Create download1.mozilla.org; point at current bouncer installation
  • Create download2.mozilla.org; point at bouncer2 installation
  • CNAME download.mozilla.org to download1.mozilla.org
• LDAP patch to allow LDAP authentication morgamic, Dec 5
  • Code part is pretty much done
  • Need LDAP info from Aravind (talked to justin about it)
  • Do we need to waterfall auth methods (fallback)?
  • Need to resolve user data in sessions before deploying
• Testing morgamic, lars Dec 6th, 7th
  • Verify v2 links and file sums for all available products
  • Load test URIs using grinder to assure req/s
    • http://download2.mozilla.org/?product=Firefox-2.0&os=mac&lang=en-US
    • http://download2.mozilla.org/?product=Firefox-2.0&os=win&lang=en-GB
    • http://download2.mozilla.org/?product=Firefox-2.0&os=linux&lang=de
  • Load testing to be done on/around Friday the 8th.
• Migration Phase 2, Mid-december
  • Script to migrate mirrors
  • Additional tables to migrate (v1->v2)
    • mirror_locations->files (re-load with loader)
    • mirror_location_mirror_map->downloadables (generated by sentry)
    • mirror_os->oss (manual entry is fine -- only 3)
    • mirror_products->product_versions (re-load with loader)
    • Auto-create per-locale entries for each product -- based on what locales? (will be handled by loader)
    • Migrate patches for update system and partner updates as well. (identifiable by .complete.mar, .partial.mar)
      • loader can put these files in just fine with this command:

./loader.py -L complete.mar -P /firefox/releases/1.5.08/update -S -W complete.mar -X complete.mar -x overwrite <SHA1SUMS

• • • Migrate download product counts from version 1 to version 2 (Lars will write a special script for this)
• When all is ready, switch to CNAME download2.mozilla.org Before 2.0.0.1

Load Testing Notes

see Bouncer:GrinderLoadTesting

• Possible bottlenecks that could have affected tests
  • bandwidth limits
  • connection limits (tcp, for test nodes)
  • definitely NOT cpu limits (test nodes were bored)
• Areas we could tweak
  • keys in downloadables table
  • sql in main bounce script
    • fix joins
    • fix order by clause
  • remove count increments, move all stats to http logs (could end up caching a particular mirror and perform DDOS attacks by mistake on mirror network)

Products to Migrate

Crossed out ones are already migrated to bouncer2. If one of the below are not to be migrated, remove them from the list and put them in "Products to NOT Migrate".

• BonEcho-Alpha1
• BonEcho-Alpha3
• BonEcho-Alpha2
• BonEcho-Alpha3-Complete
• BonEcho-Alpha3-Partial-Alpha2
• Camino-1.0
• Camino-1.0.2
• Camino-1.0.1
• DeerPark-Alpha2
• DeerPark-Alpha1
• Firefox
• Firefox-1.5
• Firefox-1.5.0.3-Partial-1.5.0.2
• Firefox-1.5.0.1
• Firefox-1.5-Partial-1.5rc2
• Firefox-1.5.0.3
• Firefox-1.5.0.3-Yahoo-Complete
• Firefox-1.5.0.2
• Firefox-1.5.0.1-Complete
• Firefox-1.5.0.2-Complete
• Firefox-1.5.0.3-Complete
• Firefox-1.5.0.2-Partial-1.5.0.1
• Firefox-1.5.0.4-Google-Complete
• Firefox-1.5.0.1-Partial-1.5
• Firefox-1.5.0.4-Google-Partial-1.5.0.3
• Firefox-1.5.0.1rc1
• Firefox-1.5.0.4-Yahoo-Complete
• Firefox-1.5.0.1-Yahoo-Complete
• Firefox-1.5.0.1-Yahoo-Partial-1.5
• Firefox-1.5.0.1rc1-Partial-1.5
• Firefox-1.5.0.3-Yahoo-Partial-1.5.0.1
• Firefox-1.5-Complete
• Firefox-1.5.0.4
• Firefox-1.5.0.4-Complete
• Firefox-1.5.0.4-Partial-1.5.0.3
• Firefox-1.5.0.4-Yahoo-Partial-1.5.0.3
• Firefox-1.5.0.1rc1-Complete
• Firefox-1.5rc3
• Firefox-1.0.1
• Firefox-1.0.2
• Firefox-1.0.3
• Firefox-1.0.1-Update
• Firefox-1.0.3-Update
• Firefox-1.0.2-Update
• Firefox-1.0.8
• Firefox-1.5b1
• Firefox-1.0.7-Update
• Firefox-1.0.7
• Firefox-1.5b2
• Firefox-1.5b2-Patch-Complete
• Firefox-1.5b2-Patch-Partial
• Firefox-1.0.4
• Firefox-1.0.5
• Firefox-1.0.4-Update
• Firefox-1.0.6
• Firefox-1.0.5-Update
• Firefox-1.0.6-Update
• Firefox-1.5rc2
• Firefox-1.5rc1
• Firefox-1.5rc3-Complete
• Firefox-1.5rc3-Partial-1.5rc2
• Firefox-1.5rc1-test-complete
• Firefox-1.5rc1-test-partial
• Mitchell-Interview-OSCON2005
• Seamonkey-1.0
• Seamonkey-1.0.2
• Seamonkey-1.0.1
• Suite-1.7.12
• Suite-1.7.13
• Suite-1.7.11
• Suite-1.7.7
• Suite-1.7.8
• Suite-1.7.10
• Thunderbird
• Thunderbird-1.5.0.4-Complete
• Thunderbird-1.5b2
• Thunderbird-1.0.7
• Thunderbird-1.0.2
• Thunderbird-1.1a1
• Thunderbird-1.5.0.4
• Thunderbird-1.5rc1
• Thunderbird-1.5rc1-test-partial
• Thunderbird-1.5.0.4-Partial-1.5.0.2
• Thunderbird-1.0.8
• Thunderbird-1.5.0.2-Partial-1.5
• Thunderbird-1.5
• Thunderbird-1.5.0.2
• Thunderbird-1.5.0.2-Complete
• Thunderbird-1.5b1
• Thunderbird-1.0.5
• Thunderbird-1.5rc2
• Thunderbird-1.1a2
• Thunderbird-1.5rc1-test-complete
• Thunderbird-1.0.6

Products to NOT Migrate

• Carebears