QA/Fennec/Milestones/2.0/ReleaseTest/Beta1 Build3

From MozillaWiki
< QA‎ | Fennec‎ | Milestones‎ | 2.0
Jump to: navigation, search

Fennec 2.0 Beta 1 Test Results

The covered testing for this release will focus on smoketests, verifications and updates. For a list of new features coming in for Fennec 2.0, take a look at the Mobile Planning Page and for test coverage, look at our test plan.

Project contacts

PM: Stuart Parmenter (stuart)
Build: John O'duinn (oduinn)
QA: Aakash Desai (aakashd)

Schedule

Code Freeze
-- 10/6
Builds hand to QA
-- 10/6
QA test signoff
-- 10/7

Build Location and IDs

  1. Go to the candidates folder in our ftp folders
  2. Go to the "4.0b1-candidates" folder
  3. go to the "build 3" folder
  4. Download the candidate:
    • For the n900, install the application catalog and update to the candidate build via your device App Manager.
    • For Android, download and install the actual build over the Alpha 1 Release of Fennec 2.0

Test Coverage

Smoketests

Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the Fennec 2.0 Test Suite. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.

Please record your detailed results in the "Detailed Test Results" section below.

BFTs for 2.0 Features

BFTs are a more comprehensive set of litmus tests that cover functional testing of features that have landed on Fennec 2.0. Tests are available on litmus under the Fennec 2.0 Test Suite.

Please record your detailed results in the "Detailed Test Results" section below.

Here are the BFT's that need to be run:

  • AwesomeBar (Location Bar & Autocomplete)
  • Feedback
  • RTL Support
  • Form Assistant
  • Panning & Zooming (Screen Navigation)
  • Sharing
  • Sync

OS Integration

The Operating System Integration testsuite is a set of tests that target how Fennec works with the platform (i.e. Android, Maemo, etc.) and features of the device itself (i.e. Orientation, hard keyboard, soft keyboard, etc.). Tests are available on litmus under the Fennec 2.0 Test Suite under the "OS Integration Tests" testgroup.

Please record your detailed results in the "Detailed Test Results" section below.

Fixed Bugs Verifications

The following link contains a list of bugs that are fixed for beta 1 and need verifications:

Updates

Fennec 2.0 Beta 1 can be downloaded from the Mozilla Beta Catalog.


Updates tests to perform for each build

Test Results

Types of Tests Maemo Android
Smoketests
  • mw22 - PASS
  • ahoza - PASS
  • ioana - PASS
  • aakashd - PASS
  • aakashd - PASS
  • AaronMT - PASS
BFTs
  • ahoza - PASS
  • ioana - PASS
  • ashah - PASS
OS Integration
  • ahoza - PASS
  • ioana - PASS
  • aakashd - PASS
Updates
  • nhirata - PASS
  • aakashd - PASS

Detailed Test Results

Smoketests Results

n900 [mw22]

  • Build:
  • Results: PASS
  • Notes: Got one hang, which was probably related to the image upload test. Although the hang occured during the next litmus test. Anyway, after rebooting the N900, the next litmus test worked fine.

HTC Desire [ioana]

  • Build: Mozilla/5.0 (Android; Linux armv7l; rv:2.0b7pre) Gecko/20101006 Firefox/4.0b7pre Fennec/4.0b1
  • Results: PASS
  • Notes:
      • Unreproducible issue : enter address in URL bar and while loading will be displayed a pink background with the upper line black
    • bug 597122 Tab close button appears after a delay
    • bug 594736 Can not upload photo from device
    • bug 536289 Make FTP work for fennec

Motorola Droid 2 [ahoza]

  • Build: Mozilla/5.0 (Android; Linux armv7l; rv:2.0b7pre) Gecko/20101006 Firefox/4.0b7pre Fennec/4.0b1
  • Results: PASS
  • Notes:
    • bug 541439 - persistent checkerboarding when panning up to the top of the page on techcrunch
    • bug 594736 - Can not upload photo from device
    • bug 536289 - Make FTP work for fennec

Samsung Vibrant [aakashd]

  • Build: Mozilla/5.0 (Android; Linux armv7l; rv:2.0b7pre) Gecko/20101006

Firefox/4.0b7pre Fennec/4.0b1

  • Results: PASS
  • Notes:
    • bug 602434 - urlbar disappears when opening the edit bookmarks dialog and the softkb popping up
    • bug 536289 - Make ftp work for fennec
    • bug 599222 - Unresponsive script error in Sync.js during initial sync in Fennec

Nexus One [aakashd]

  • Build: Mozilla/5.0 (Android; Linux armv7l; rv:2.0b7pre) Gecko/20101006

Firefox/4.0b7pre Fennec/4.0b1

  • Results: PASS
  • Notes:
    • bug 602434 - urlbar disappears when opening the edit bookmarks dialog and the softkb popping up
    • bug 536289 - Make ftp work for fennec
    • bug 599222 - Unresponsive script error in Sync.js during initial sync in Fennec

Droid Milestone [AaronMT]

  • Build: Mozilla/5.0 (Android; Linux armv7l; rv:2.0b7pre) Gecko/20101006 Firefox/4.0b7pre Fennec/4.0b1
  • Results: PASS
  • Notes: Crash while clicking the browse button (File Dialog) @ imgur.com - filed bug bug 602503

BFT Results

Motorola Droid 2 [ahoza]

  • Build: Mozilla/5.0 (Android; Linux armv7l; rv:2.0b7pre) Gecko/20101006 Firefox/4.0b7pre Fennec/4.0b1
  • Results: PASS
  • Notes: Known bugs:
  • bug 601581 Form Fill appears only at a second tap in maps.google.com
  • bug 579628 HTML iframe can't be panned
  • bug 602013[regression]first time hitting the space key after typing fast on the will place the cursor(caret) between the first and second character

HTC Desire [ioana]

  • Build: Mozilla/5.0 (Android; Linux armv7l; rv:2.0b7pre) Gecko/20101006 Firefox/4.0b7pre Fennec/4.0b1
  • Results: PASS
  • Notes:
    • AwesomeBar (Location Bar & Autocomplete)
      • bug 599550 If I type too fast characters get inserted in the wrong order
      • Unreproducible issue : opening the second tab (or a system page from second tab) sometimes will bring up a black page, and the place/ line of the first tab is white; see photos [1] or as in the first picture the awesome tap buttons are replace by a pink line
      • Unreproducible issue : when first loading the page, appears a light pinky page and the URL bar is all Black; see photo [2]; in my case mostly in the second tab
      • the unreproducible issues are dismissed only by the back button of the device
    • Feedback
      • bug 597041 [Feedback] Feedback is missing in the control panel on the Android platform
    • RTL Support
      • bug 602457 [RTL] Favicons in about:home are not on the right side
    • Form Assistant
      • bug 591955 [VKB]Soft keyboard pops up after clicking on the url bar
      • bug 601581 Form Fill appears only at a second tap in maps.google.com
      • bug 602472 [VKB]form assistant results do not fit screen size when popping up soft keyboard
    • Panning & Zooming (Screen Navigation)
    • Sharing - no issues
    • Sync - no issues

Nexus One [ashah]

  • Build: Mozilla/5.0 (Android; Linux armv7l; rv:2.0b7pre) Gecko/20101006 Firefox/4.0b7pre Fennec/4.0b1
  • Results: PASS
  • Notes:
    • Issues found in the BFTs:
      • iframes are not scrollable
      • vkb does not come up sometimes while formfill bar is being shown. This is rare though.
      • In RTL, the favicons are not on the RHS on about:home page.
      • 1 test case fails for formfill(search a combo box) and screen navigation(iframe scrolling) each.
      • 2 test cases unclear for location bar.

OS Integration Results

Motorola Droid 2 [ahoza]

  • Build: Mozilla/5.0 (Android; Linux armv7l; rv:2.0b7pre) Gecko/20101006 Firefox/4.0b7pre Fennec/4.0b1
  • Results: result
  • Notes: Known bugs:
    • bug 591955 - [VKB]Soft keyboard pops up after clicking on the url bar
    • bug 601908 - [VKB] Software Keyboard remains popped up in add-ons manager

HTC Desire [ioana]

  • Build: Mozilla/5.0 (Android; Linux armv7l; rv:2.0b7pre) Gecko/20101006 Firefox/4.0b7pre Fennec/4.0b1
  • Results: PASS with the following bugs
  • Notes:
    • Known Bugs:
      • bug 589879 [VKB]Rename "Execute" on the Android Virtual Keyboard for URL input
      • bug 593456 Only support the two-tap URLBar edit mode in Landscape
      • bug 591955 [VKB]Soft keyboard pops up after clicking on the url bar
      • bug 601908 [VKB] Software Keyboard remains popped up in add-ons manager
      • bug 590602 Support input method changing in Fennec --not implemented
    • Unreproducible issues:
      • CRASH - after pressing resume/cancel at a ubuntu download
      • Opening the second tab (or a system page from second tab) sometimes will bring up a black page, and the place/ line of the first tab is white; see photos [3] or as in the first picture the awesome tap buttons are replace by a pink line
      • When first loading the page, appears a light pinky page and the URL bar is all Black; see photo [4]; in my case mostly in the second tab
      • the unreproducible issues are dismissed only by the back button of the device
      • bug 479984 navigation screen (awesomebar) doesn't open when URL field tapped

Nexus One [aakashd]

  • Build: Mozilla/5.0 (Android; Linux armv7l; rv:2.0b7pre) Gecko/20101006 Firefox/4.0b7pre Fennec/4.0b1
  • Results: PASS
  • Notes:
    • bug 589879 - [VKB]Rename "Execute" on the Android Virtual Keyboard for URL input
    • Crash when canceling a download from our ftp directory

Updates Results

Motorola Droid 2 [nhirata]

  • Build: Mozilla/5.0 (Android; Linux armv7l; rv:2.0b7pre) Gecko/20101006 Firefox/4.0b7pre Fennec/4.0b1
  • Results: PASS
  • Notes:

Nexus one [aakashd]

  • Build: Mozilla/5.0 (Android; Linux armv7l; rv:2.0b7pre) Gecko/20101006 Firefox/4.0b7pre Fennec/4.0b1
  • Results: PASS
  • Notes:
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Fennec/Milestones/2.0/ReleaseTest/Beta1_Build3&oldid=259583"