B2G/QA/Meetings/2015-09-30

From MozillaWiki
< B2G‎ | QA‎ | Meetings
Jump to: navigation, search

Overview

Announcements:

Off plan

   Johan: Oct 2

   nhirata: Oct 2

   No-Jun: Oct 1,2

   Gerry - Oct. 7~23, Oct. 30~Nov. 6 (Euro Star)

   Paul - Oct. 14-19

   Al - Oct. 16-21


2.2r

  • Contact Window: Shing Lyu
    • Status: Shing and Al starts to draft SOW for outsource QA

// Following items are for read-only

2.5 Feature

  • Telemetry: Iris/Gerry
    • Test plan draft: https://goo.gl/6ANJuO, modified test plan based on developer's review comments
    • Exploratory test for Add-on metrics/Developer HUD/API
    • Bug list: https://goo.gl/GXRnIH
    • Verified bugs:
      • bug 1171685 - ..., code landed and verified
      • bug ..., code not landed, have played local patches
      • bug
      • bug
  • Pin the Web: Alison
    • Keep exploratory test for new landing feature
    • Bug list: http://mzl.la/1hVD8yw (18 bugs, include 6 blockers)
  • Private Browsing: Alison
    • Only exist one minor feature need to be landed: remove button, other depends bugs on meta bug all were landed.
    • Execute the full run test for this feature
    • Bug list: http://mzl.la/1GvwLrY (4 bugs)
  • Low Device Storage: William (Descope)
    • UX spec 3.0 link update
   - https://mozilla.box.com/s/bfrwwxdaz1o646h8tmmnlq61lv92sy3f
    • VSD spec
   - https://mozilla.box.com/s/zc2he933m7oluvvq5rwu8h97clhi0g2e
    • QA status
   - Test plan creation -> Draft ( https://goo.gl/zVfJpJ ).
    • De-scope this for v2.5 (confirmed by Candice) on Sep. 23rd
  • Add-ons: Mike
   Test cases: https://goo.gl/miw216

   Test cases in Moztrap: https://moztrap.mozilla.org/manage/cases/?filter-suite=925

   Waiting for review: https://bugzilla.mozilla.org/show_bug.cgi?id=1207097

   Test plan: https://goo.gl/GydIV2

   Add-on submission skeleton is ready

   Upload site: https://marketplace-dev.allizom.org/content/addon/submit/

   Upload is successfully

   Manifest doesn't in root folder of archive will cause upload failed:

   https://bugzilla.mozilla.org/show_bug.cgi?id=1210153


  • Performance: Mike
   App/Device startup time

   Serious regression from Sep. 15th: https://bugzilla.mozilla.org/show_bug.cgi?id=1204837

   Under resolving

   Media performance issue is fixed but verification failed

   https://bugzilla.mozilla.org/show_bug.cgi?id=1159343


  • New security model: Mike
   Test Plan: https://goo.gl/FwVQgI

   Test NSec packages will generate from current gaia apps

   Move landing to S9


    • Music NGA has replaced the Music app 2 days ago. Automated acceptance tests are broken. No-Jun has been investigating how much we have to change the page classes to make the tests back working.
    • Contacts. News from 10 days ago: Due to the lack of Navigation in Gecko, they decided to back out the separation of the views. This backout created some other regressions. (Bugs to be listed here)
    • SMS. jlorenzo: Status to come today. I'll discuss with the SMS devs before the go/no go meeting.
      • UPDATE (after TW/EU session), landing done:
      • Split of 2 views (Messages and Conversation). Even though they are landed, they are not used. The SMS app we use in master still display 1 single page. This explains mostly why we didn't get that much regression in SMS.
      • Split between backend and frontend: Some (but not all) of the mozAPI are put in a worker. Starting a worker This has introduced the performance regression started on July https://goo.gl/Zo8TzS . Some memory regression was introduced (±4MB at start up).


Riding the train features:

  • RTL: William
    • Phoxygen has delivered the first 2.5 RTL patch (System)
   - https://bugzilla.mozilla.org/show_bug.cgi?id=1208170
    • Development priority: 
   System -> FTU ->Homescreen -> Dialer -> SMS -> Settings -> EMAIL -> Contacts -> Browser -> Calendar -> the others


  • updates: FOTA : nhirata
    • see https://bugzilla.mozilla.org/show_bug.cgi?id=1204658#c1 2 weeks out.
    • still needs work to be done; At risk though it's not a release item. Chances are this is dropped as an item.
    • aries and flame are two separate FOTA parts
      • working on getting a FOTA fix for aries out first: can make FOTA builds, need to make sure no dogfood blockers
      • then working on getting flame to FOTA gecko/gaia only
  • Vaani : nhirata - still haven't tested yet due to Dogfood issues with Aries
    • dropped for 2.5; work still being done, QA still needed. Will be an ongoing tweak of fuzzy logic
    • please use the MozSpeech app in dogfood-latest build
    • Taskcluster:nhirata use 0.99.22 image


2.5 Spark/Aries-KK Smoketests

  • Tester: QAnalysts (KevinT)
    • Health Status: Aries: Red 2 blockers

New: - https://bugzil.la/1209717 - taskcluster b2g device builds submit to production balrog 

*Fails [2313]

Existing: - https://bugzil.la/1206028 [Aries KK][Hackerplace] Hackerplace app is unuseable. 

 *Fails[16424]
 **This has been resolved as fixed. Not occurring on FOTA build. We will verify this on the next nightly.

Severe Issues: - https://bugzil.la/1183033 [B2G] Keyboard doesn't have click sound - https://bugzil.la/1203603 [Cost Control][Aries] Data Limit and Usage Graph not displaying accurate results 

 ** This issue only occurs after OTA from RC4 and the user has turned on wi-fi and data in the RC4 FTU

- https://bugzil.lad/1204622 crash in strlen | __vfprintf 

 ** Reproduce-able crash after completing FTU when going quickly, doesn't affect testing.

- https://bugzil.la/1204617 [Aries][Bluetooth] does not sends files from Mobile device to Computer. 

 ** This issue only occurs after OTA from RC4.

- https://bugzil.la/1196177 Launch Camera from Gallery, but Camera can not work if you repeatly tap Home key to exit while Camera is launching. - https://bugzil.la/1198968 [Aries][NFC] Files cannot be transferred using NFC - https://bugzil.la/1210234 - Alarms and Timers will show a broken blank screen if they trigger when the device screen is off. 

- https://bugzil.la/1210190 - Alarm time created is displayed as a different time

2.5 Aries Dogfood

  • Health Status: Aries: Red 2 blockers

New: - https://bugzil.la/1210234 - Alarms and Timers will show a broken blank screen if they trigger when the device screen is off. 

*Fails [16520]

- https://bugzil.la/1210190 - Alarm time created is displayed as a different time 

*Fails [16520]

2.5 Exploratory

  • Tester: QAnalysts (KevinT)

=== 2.5 fullrun === (Update: 9/30)

  • The third 2.5 full run will be kick-off on Oct. 8th

=== 2.5 smoketest (Marigold) === (Update: 9/30)

  • Aries-KK Master Smoke Test Results
 ● Existing:
   1. [Aries KK][Hackerplace] Hackerplace app is unuseable.
      - https://bugzil.la/1206028
  • Flame-KK Master Smoke Test Results
 ● Existing:
   1. [OTA] Latest Flame build is a day behind
       - https://bugzil.la/1188992
  • Severe Issue:
  - https://bugzil.la/1183033 [B2G] Keyboard doesn't have click sound
  - https://bugzil.la/1203603 Data Limit and Usage Graph not displaying accurate results
  - https://bugzil.la/1204622 crash in strlen | __vfprintf
  - https://bugzil.la/1204617 Bluetooth cannot send files from Mobile device to Computer.
  - https://bugzil.la/1196177 Launch Camera from Gallery, but Camera can not

work if you repeatly tap Home key to exit while Camera is launched


2.5 MTBF

flame-kk 512MB avg. running hours: 34.26 Blocker: 

- https://bugzilla.mozilla.org/show_bug.cgi?id=1206634
- https://bugzilla.mozilla.org/show_bug.cgi?id=1198950

mtbf bugs in Q3 https://bugzilla.mozilla.org/show_bug.cgi?id=1182954

    • RA exit criteria: 100 hrs
    • CC exit criteria: 200 hrs

Previous action items

(Update: Sep. 30th)

  • [DEFERED] delphine to try to figure out mid cycle l10n run; sept 7th -- [UPDATE] this needs to be later, test case coverage isn't done yet. ETA: the week of Sep. 21st
  • [DEFERRED] nhirata to sync up with delphine about Vaani
  • [DONE - see NGA update] jlorenzo: follow up with SMS about the status of the landings, before the go/no go meeting.
  • [In progress] marcia: follow up with pallavi regarding community budget.
    • Some discussion of this issue will happen at the Work Week
  • [In progress][whsu] William to confirm ETA for RTL test case ready
 [William 9/30] It will be 10/12 or earlier.
  • [DONE - still Go for Private browsing][Candice] To narrowed down scope for Tracking Protection
  • [DONE]Data storage features for v2.5 will be de-scoped for v2.5 (confirmed by Candice) on Sep. 23rd
  • [DONE] Go/No Go meeting will be held next week on Sep. 30th
 https://docs.google.com/spreadsheets/d/1Q21Znmj65blyEEgjaq1LvPcAm58-4xUUfNXsGXzdq2k/edit#gid=554660483
  • [DONE][Gerry/No-jun/Paul] to discuss about effects OGA to NGA with GIP.
 GIP for OGA music still works; follow up for NGA music with GIP in Q4
  • [Jamie_/Marcia] to host a meeting about community engagement
  • [DONE][Al] be the backup for putting meeting notes to Wiki; nhirata to be primary on putting meetings notes to wiki.

== Agenda == (update Sep. 30th)


FYI, the newcomer QA Page: https://quality.mozilla.org/teams/firefox-os-qa/ Daily Bulletin board (Feel free to post news here): https://wiki.mozilla.org/B2G/QA/Daily_Bulletin

  • [Jamie_] could we set up a list of things that is updated of things that need to be done or tested for contributors (b2g daily bulletin is there but that only tells you so much)
    • Jamie suggested having a meeting about working on writing One and Done tasks that can eventually be used for a Test Day.
  • FxOS MozLando - Meetings and Presentations Planning


Community Updates [marcia-read only]

[Jamie_]

  • Revamp of QA pages is being held off till end of Q3
  • Setting up a QA test day for firefox os (working with Noah and Mermi)
  First one to be held mid-late October, would like to know best day to help with 2.5 release
  also a suggestion list of feature or stuff most relevant to test with 2.5 for aim
  add to this document please https://etherpad.mozilla.org/A8ETomIqwt will be covered more next meeting when more details are defined email : jamie@mozillausa.org


This Week - Decisions & Action Items

Testing information

  • View source is in: Dev option and enable view source, hold the power button and the menu will appear there.
  • Vaani voice sampler, "MozSpeech" is in the dogfood; dogfood being blocked.
  • FOTA white listing for IMEI not implemented yet
  • Marketplace go to : Marketplace-dev.allozim.org, search for :debug and use addons
Retrieved from "https://wiki.mozilla.org/index.php?title=B2G/QA/Meetings/2015-09-30&oldid=1100711"