QA/Fennec/Milestones/2.0/ReleaseTest/Beta2

From MozillaWiki
< QA‎ | Fennec‎ | Milestones‎ | 2.0
Jump to: navigation, search

Fennec 4.0 Beta 2 Test Results

The covered testing for this release will focus on smoketests, verifications and updates. For a list of new features coming in for Fennec 4.0, take a look at the Mobile Planning Page and for test coverage, look at our test plan.

Project contacts

PM: Stuart Parmenter (stuart)
Build: John O'duinn (oduinn)
QA: Aakash Desai (aakashd)

Schedule

Code Freeze
--
Builds hand to QA
--
QA test signoff
--

Build Location and IDs

  1. Go to the candidates folder in our ftp folders
  2. Go to the "4.0b2-candidates" folder
  3. Download the candidate:
    • For the n900, install the application catalog and update to the candidate build via your device App Manager.
    • For Android, download and install the actual build over any other instance

Test Coverage

Smoketests

Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the Fennec 2.0 Test Suite. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.

Please record your detailed results in the "Detailed Test Results" section below.

BFTs for 2.0 Features

BFTs are a more comprehensive set of litmus tests that cover functional testing of features that have landed on Fennec 2.0. Tests are available on litmus under the Fennec 2.0 Test Suite.

Please record your detailed results in the "Detailed Test Results" section below.

Here are the BFT's that need to be run:

  • Feedback
  • RTL Support
  • Panning & Zooming (Screen Navigation)
  • Sync

OS Integration

The Operating System Integration testsuite is a set of tests that target how Fennec works with the platform (i.e. Android, Maemo, etc.) and features of the device itself (i.e. Orientation, hard keyboard, soft keyboard, etc.). Tests are available on litmus under the Fennec 2.0 Test Suite under the "OS Integration Tests" testgroup.

Please record your detailed results in the "Detailed Test Results" section below.

Fixed Bugs Verifications

The following link contains a list of bugs that are fixed for beta 1 and need verifications:

L10n Checks

We don't have coverage of localized builds until the candidate builds are available, so we'll need to run through the tests within the Fennec 2.0 String Guide on the following locales:

  • German
  • Finnish
  • French

Updates

Fennec 2.0 Beta 2 can be downloaded from the Mozilla Beta Catalog.


Updates tests to perform for each build

Test Results

Types of Tests Maemo Android
Smoketests
  • ahoza - FAIL
  • ioana - FAIL
BFTs
  • ahoza - result
  • ashah - result
OS Integration
  • aakashd - result
  • ioana - result
L10n
  • nhirata - result
  • AaronMT - result
Updates
  • ahoza - result
  • aakashd - result
  • ioana - result
  • nhirata - result

Detailed Test Results

Smoketests Results

HTC Desire [ioana]

  • Build: Mozilla /5.0 (Android;Linux armv7l;rv:2.0b7pre) Gecko/20101029 Firefox/4.0b8pre Fennec /4.0b2pre
  • Results: FAIL
  • Notes:
    • Known Issues: bug 606458; bug 608255; bug 603647
    • No Update Notification (tried with the last release build 3)
    • Password are not retained at sync
    • Remember button in the pop up has no effect

n900 [ahoza]

  • Build: Mozilla 5.0 (Maemo; Linuxarmv7l; rv:2.0b7pre) Gecko/20101029 Firefox/4.0b8pre Fennec/4.0b2
  • Results: FAIL
  • Notes:
    • when loading yahoo.com, always get: "Sorry! Something went wrong while displaying a web page" dialog (bug 608255)
    • passwords are not synced
    • "Remember" button in password manager is not working. It does not save the password, nor it closes the dialog.
    • "Beta tester Tools" and Sync section in Preferences tab, Options menu are not localized
    • VKB pops up in Password and Sync Key fields, Options->Preferences->Sync section
    • Unreproducible issues:
      • Browser does not start when using shortcut. It starts when giving "fennec" in X-terminal

BFT Results

Nexus One [ashah]

  • Build:
  • Results: result
  • Notes:

n900 [ahoza]

  • Build:
  • Results: result
  • Notes:

OS Integration Results

HTC Desire [ioana]

  • Build:
  • Results: result
  • Notes:

n900 [aakashd]

  • Build:
  • Results: result
  • Notes:

L10n Results

Droid [AaronMT]

  • Build:
  • Results: result
  • Notes:

n900 [nhirata]

  • Build:
  • Results: result
  • Notes:


Updates Results

HTC Desire [ioana]

  • Build:
  • Results: result
  • Notes:


Droid 2 [nhirata]

  • Build:
  • Results: result
  • Notes:

n900 [ahoza]

  • Build:
  • Results: result
  • Notes:


n900 [aakashd]

  • Build:
  • Results: result
  • Notes:
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Fennec/Milestones/2.0/ReleaseTest/Beta2&oldid=264547"