Overview

Purpose

The purpose of this wiki is to serve as a general test plan for verifying that notifications can be controlled from Settings Menu

Ownership

Developer contact: [Developer contacts: Sebastian Kaspari (:sebastian)

QA: Teodora Vermesan (:TeoVermesan)

Overall Status

[LANDED] Nightly 48: first landed on - 04-04-2016

[LANDED] Aurora 48 : first landed on - 27-04-2016

[LANDED] Beta 48b1: first landed on - 08-06-2016

Testing Summary

Scope of testing

The testing will be focus on verifying that the duration of time the snackbars are shown is increased.

Environments

Testing will be performed on following devices:

• Phones
  • 4.x
  • 5.x
  • 6.0
• Tablet
  • 4.x
  • 5.x
  • 6.0

Specifications

• Give users control to turn on/off Firefox specific notifications, e.g.

+-----------------------------------------+
|                                         |
|  What's new update                 O--  |
|                                         |
|                                         |
|  Unread Bookmarks                  O--  |
|                                         |
|                                         |
|  Website updates                   O--  |
|                                         |
|                                         |
|  Tab queue                         O--  |
|                                         |
+-----------------------------------------+

User stories

• As a user, I want the option to turn on or off Firefox related notifications

Acceptance Criteria

• No notification for the turn off notification
• Notification for turn on notification
• Info for user how to turn on/off notifications (SUMO article)
• Link to notification settings in system notification
• Probe that tracks how many times the notification settings has been viewed and track the state of each notification setting (on/off)

KPI

• No confusion on how to turn on/off notifications
• Based on probes, evaluate usefulness of notification settings.

Testing details

Testing days

Nightly

Date:28-03-2016

• new settings category

• notifications

Date:04-04-2016

• What's new in Nightly

• Website Updates

• Nexus 7 (Android 5.1.1)
• "Website Updates" option was displayed in Settings
• bookmark articles and navigate through Medium, Blogger and Wordpress

Date:14-04-2016

• Create summary description for "Notifications" category
  • New features, website updates

• Got updates from medium.com

Date:18-04-2016

• Notification submenu

• Tapping learn more will open a SUMO article

Date:08-06-2016

Aurora

Date:28-04-2016

Date:23-05-2016

Date:06-06-2016

Beta1

Date:08-06-2016

Bug Work

Tracking bugs

• bugs to track the feature

ex:

Full Query

ID	Summary	Priority	Status
1238087	Create notifications to let users know when websites change	--	RESOLVED
1245642	Remind users of saved bookmarks	--	RESOLVED

2 Total; 0 Open (0%); 2 Resolved (100%); 0 Verified (0%);

New Issues

[NEW] Bug 1245642 - Remind users of saved bookmarks

Bug fixed

[RESOLVED FIXED] Bug 1238087 - Create notifications to let users know when websites change
[RESOLVED FIXED] Bug 1238087 - (content-notifications) Create notifications to let users know when websites change

Signoff

Criteria

• All test cases should be executed
• All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed
• a "Notifications" item is displayed inside Settings > "Advanced"

Results

Nightly testing

• "Notifications" settings category
  • What's new in Nightly

Aurora testing

• "Notifications" settings category
  • What's new in Aurora

Beta testing

• "Notifications" settings category
  • What's new in Beta