QA/Fennec/Safe Browsing v4 on Fennec

From MozillaWiki
< QA‎ | Fennec
Jump to: navigation, search

Overview

Purpose

The purpose of this wiki is to serve as a general test plan for verifying that Firefox will show you a warning message before you visit a site that is suspected of containing malware or phishing.

Ownership

Developer contact: :francois

QA: :ninu

Overall Status

[LANDED] Nightly 58: first landed on - 22-09-2017

[LANDED] Beta 58: first landed on - 13-11-2017

Testing Summary

Scope of testing

The testing will be focus on making sure that the browser blocks different malicious pages like:

  • Pages that contain phishing
  • Pages that contain malware
  • Pages that contain unwanted software

Environments

Testing will be performed on following devices:

  • Phones
    • 5.x
    • 6.x
    • 7.x
    • 8.x
  • Tablet
    • 5.x
    • 6.x
    • 7.x
    • 8.x

Specifications

  • Started in 2008 by Google and used by:
    • Google Chrome
    • Moziila Firefox
    • Apple Safari
    • Opera
  • Impact: billions of users according to Google
  • Goals: prevent user from visiting
    • Phishing sites
    • Malware sites
  • Methodology: blocklist

User stories

  • As a user, I want to be sure that no phishing sites can affect me and I can be warned if i'm about to access that sort of sites
  • As a user, I want to be sure that no malware containing sites can affect me and I can be warned if i'm about to access that sort of sites

Acceptance Criteria

Testing details

Test Cases

Testing days

Date:12-10-2017

  • Exploratory testing
  • Created test cases

Date:13-10-2017

  • created TestPlan
  • Ran Testrail suite Link to testrail
  • Issues logged
    • Failing Updating Safebrowser DB will trigger a frozen browser
    • "This isn't an attack site" button is missing on Android

Date:27-10-2017

Ran Testrail suits:

Verified issues:


Date:14-10-2017

Ran Exploratory and focused on edge case testing on:

  • Sony Xperia Z2 (Android 5.1.1)
  • Samsung Galaxy S6 Edge (Android 7.0)

Date:21-10-2017

Ran Exploratory testing and focused on functional testing. Testing performed on :

  • Samsung Galaxy S6 (Android 6.0.1)
  • Huawei P8 Lite (Android 5.0.1)
  • Nexus 6P (Android 8.0)

Date:22-10-2017

Ran final check on 58.0b12

Sign OFF email

Bug Work

Tracking bugs

  • bugs to track the feature

ex:

Full Query
ID Summary Priority Status
1167038 [meta] Add support for version 4 of the Safe Browsing protocol P2 RESOLVED
1399785 [META] QA bugs of Safe Browsing v4 on Fennec P3 RESOLVED
1399797 Safe Browsing on Fennec: the page will not load after tapping "Ignore this waring" and visiting the page again P3 RESOLVED
1399798 SafeBrowsing on Fennec: no "This isn't an attack site" button for users to report detection problems P3 RESOLVED
1400816 SafeBrowsing v4 for Fennec - Failed to ignore the warning in an iframe -- RESOLVED
1408396 Failing Updating Safebrowser DB will trigger a frozen browser P1 VERIFIED
1408422 "This isn't an attack site" button is missing on Android -- RESOLVED

7 Total; 0 Open (0%); 6 Resolved (85.71%); 1 Verified (14.29%);



Signoff

Criteria

  • All test cases should be executed
  • All blockers, critical issues must be fixed and verified or have an agreed-upon timeline for being fixed

Results

Nightly testing

  • There were no major blockers found while testing this feature.

Beta testing

  • There were no major blockers found while testing this feature.