Overview

THIS DOCUMENT IS A DRAFT

Graduation is a process that needs to be considered before an experiment has launched in Test Pilot.

Roles

• Experiment Product Manager: this person is responsible for pushing the experiment forward. Day to day decisions involving the experiment.
• Firefox Product Manager: this person is a part of the core Firefox Product Team and can make decisions on product priority and resourcing.
• Strategy & Insights: this team is a major contributor in our metrics and survey data.

Process

The process starts with getting agreement between experiment owners, and Firefox product managers on the goals and success criteria for the experiment in Test Pilot.

1. Approve the initial Product Hypothesis Document

Please use this template: https://docs.google.com/document/d/1ViXNAWEFTfSI_NW8C7ta2JDG4g5exzQFkcyv5I2UA8Y/edit

This document should be in an approved state before the experiment launches in Test Pilot.

It should answer questions about

   * what is the goal? doing something crazy; what is the realistic priority to ship in Firefox?
   * how much does Test Pilot success effect the agreed upon priority?
   * how likely will this thing be resourced?
   * how long will the experiment be in Test Pilot?

Example: Tracking Protection

Product Hypothesis Document: https://docs.google.com/document/d/1g1aKpaRuhSu13sU09aKDvKCkXgYzdjXwL4yU06xk17M/edit

Example: Page Shot

Product Hypothesis Document: https://docs.google.com/document/d/1UhCdV7Vb82VyEjBPUyU2F4wBX-lcZWfjN42XWCHmaNM/edit

2. Reporting on progress against the PHD, and recommend amendments

Graduation checkins happen every week with product management, and the Test Pilot team.

3. Recommendations on graduation and final decision

Recommendations will be presented to the Test Pilot Mission Control which meets every 2 weeks

https://wiki.mozilla.org/Test_Pilot/Mission_Control

4. Publish learnings

Graduation reports are published on the Test Pilot experiment page

https://testpilot.firefox.com/experiments/universal-search