B2G/QA/Meetings/2015-11-11

From MozillaWiki
< B2G‎ | QA‎ | Meetings
Jump to: navigation, search

Overview

Status Highlights

  • v2.5 CC: December 14th
  • v2.2r RedSquare Project is cancelled
  • New Structure on Meeting minutes (this etherpad)

Off Plan

PTO plan

  • Al - Nov. 13th
  • nhirata - Dec 28 ~ Jan 4
  • jlorenzo: Dec 23rd - Jan 4th
  • QAnalysts: Dec 24th - Jan 3rd

Upcoming Holidays

  • U.S.
    • November 26 and 27
    • December 24 and 25
  • France: Nov 11th, December 25th

2.6 Status

2.6 Feature (NEW)

2.6 Spark/Aries-KK Smoketests

  • Tester: QAnalysts (KevinT)
    • Health Status: Green, 0 blockers

No blockers

Severe Issues: - https://bugzil.la/1217928 [New Homescreen] Homescreen App order is not preserved during OTA when moving to the New Home Screen - https://bugzil.la/1208808 Discrepancy between toLocaleFormat and toLocaleString when timezone is unresolved - https://bugzil.la/1211266 Occasional missing icons after flashing homescreen - https://bugzil.la/1213233 [Homescreen] All icons on homescreen can't be shown, after user selected "New Home Screen" or "Default Home Screen" - https://bugzil.la/1220812 After unlocking the device from the lockscreen there is a long pause until reaching the home screen

2.6 Aries Dogfood

  • Health Status: Aries: BLOCKED (Build was a nightly build instead of a dogfood build)

Existing: - https://bugzil.la/1217490 [Aries] After OTA my dogfood-latest channel is sometimes reset to nightly or dogfood - https://bugzil.la/1222527 We can lose the "debug.performance_data.dogfooding" setting after OTA

=== 2.6 Flame === (No build was smoked today. Same Gaia and Gecko as yesterday)

  • Health Status: Yellow, 1 blocker:

New: None

Existing: - https://bugzil.la/1214737 Device should check to make sure that the proper fingerprint for a FOTA is being used before trying to FOTA 

 * Fails [2313]

1223600 Incorrect wording in fingerprint error message when trying to update from a wrong base build. Severe issues: - https://bugzil.la/1221316 [Flame KK] The time is changed after OTA which causes multiple issues - https://bugzil.la/1217928 [New Homescreen] Homescreen App order is not preserved during OTA when moving to the New Home Screen - https://bugzil.la/1208808 Discrepancy between toLocaleFormat and toLocaleString when timezone is unresolved - https://bugzil.la/1211266 Occasional missing icons after flashing homescreen - https://bugzil.la/1213233 [Homescreen] All icons on homescreen can't be shown, after user selected "New Home Screen" or "Default Home Screen" - https://bugzil.la/1220812 After unlocking the device from the lockscreen there is a long pause until reaching the home screen

2.6 Exploratory


2.5 Status

2.5 Feature

  • Telemetry: Iris
    • Creating test cases on Moztrap
    • Bug list: https://goo.gl/GXRnIH, no blocker
      • bug 1218327 - "installs" in payload of app usage metric is not recorded when installing packaged app from Marketplace - have landed and verified on Aries


  • Replaceable Homescreen: Teri
    • Edit mode change - bug 1218805
    • Bug 1218329 - Waiting for approval to uplift to V2.5 branch
  • Late Customization: Teri
    • No blocker 


   *** Not in v2.5


  • NGA: Johan Isabel is taking over
    • 11/11: No code update since the branching out. There will be NGA retrospectives on Thursday and Friday. Isabel and I will attend.


  • RTL: William
   • Development progress: (Implementation order: http://bit.ly/1MsORSC)
       - All of committed apps has been completed
       - Now, bug triage and focus on P1 bugs
          *** RTL bug triage: http://tinyurl.com/rtl-triaging 
   • Test progress:
        - Completed:

   All of committed apps has been tested

   Filter RTL bugs on Bugzilla

               * Bug list:  http://mzl.la/1L7R1ka
  • updates: FOTA : nhirata
    • Aries FOTA
      • Testing blocked by bug 1215667; IMEI whitelist work blocked.
    • Flame FOTA : gecko/gaia only
      • FOTA fixed using pvtbuild/buildbot; need to move to taskcluster (see agenda items)
      • T2M build being sent to T2M is blocked by waiting for information in regards to https://bugzil.la/1218600 / bug 1214222
  • Vaani : nhirata -
    • dropped for 2.5; work still being done, QA still needed. Will be an ongoing tweak of fuzzy logic
    • need vaani automatable: bug 1219450
    • please use the MozSpeech app in dogfood-latest build
    • going to ping Andre tomorrow
  • Others

=== 2.5 fullrun (Marigold) === (William, update: 11/11)

  • We plan to finish a fullrun before 12/14

=== 2.5 smoketest (Marigold) === (William, update: 11/11)

  • Aries
   1. Bug 1218721 - Importing contacts gets stuck when importing a contact without a name.
       * https://bugzil.la/1218721 
       * It was failing TC-[6119]
  • Flame
   1. Bug 1218721 - Importing contacts gets stuck when importing a contactwithout a name.
       * https://bugzil.la/1218721 
       * It was failing TC-[6119]
   2. Bug 1220056 - [Flame KK][FOTA/ OTA] After OTA update is downloaded and install it, device will reboot and enter the recovery mode successfully.
      * https://bugzil.la/1220056 
      * It was failing TC-[2313]
  • Severe Issue: (Aries and Flame)

- https://bugzil.la/1220739 No new Dogfood Aries build available on Taskcluster, or on the 'dogfood-latest' channel. - https://bugzil.la/1208808 Discrepancy between toLocaleFormat and toLocaleString when timezone is unresolved - https://bugzil.la/1213233 [Homescreen] All icons on homescreen can't be shown, after user selected "New Home Screen" or "Default Home Screen" - https://bugzil.la/1220812 After unlocking the device from the lockscreen there is a long pause until reaching the home screen

2.5 MTBF

- [DONE] lab moved to ateam network - [DONE] Moving to longer setup flame-kk 512MB avg. running hours: 48.12 Blocker: -[Resolved] https://bugzil.la/1217289 Leak browser iframe through BrowserContextMenu and PinPageSystemDialog 

- [Resolved] https://bugzil.la/1206634  [MTBF] After 20 hours executing, test cases failed consequently
aries-kk 2GB running hours: 48.09

mtbf bugs in Q4 https://bugzilla.mozilla.org/show_bug.cgi?id=1182954

    • RA exit criteria: 100 hrs
    • CC exit criteria: 200 hrs


This Week - Decisions & Action Items

  • For flame updating, please use v18D_nightly_v4 as base build, update to the latest dogfood and then update to the newest build (nightly-latest). For now, you cannot update from any random build.
  • [atsai] Cancel Nov. 18th(PDT)/19th(CCT) weekly b2g roundtable. Al to remind everyone to update status on Wednesday.
  • [atsai] To create v2.6 product version on Moztrap. To add Aries to device list on Moztrap.
  • [marcia] Update Work Week community document in preparation for Work Week


Previous action items


Agenda

  • [atsai] QA roundtable next week (Nov. 18th(PDT)/19th(CCT)) conflicts with FxOS All hands. Propose to postpone for one day
  • [marcia] Work Week Room Update
  • [Kevin] Need 2.6 product version in Moztrap as well as Aries under devices
  • [nhirata] clean up work w/ builds being done w/ releng + taskcluster team this week. Hopefully we'll get builds in a better situation.


Community Updates [marcia-read only]

Q4 Goals

  • Hackathon Event - Complete
  • Documentation
  • Community Planning Strategy Document has been created and will be circulated soon for review
  • Documentation [Jamie]
  • will be starting on revamp of firefox OS QA pages soon, have to talk to some people about it.


Testing information (Read Only)

https://gaia-l10n.allizom.org/integration/gaia-central/file/88990292cece/shared/firefox_sync/firefox_sync.properties https://gaia-l10n.allizom.org/integration/gaia-central/file/88990292cece/distros/b2gdroid/apps/ftu/ftu-droid.properties https://gaia-l10n.allizom.org/integration/gaia-central/file/88990292cece/distros/b2gdroid/apps/ftu/manifest.properties

- Firefox Sync strings will likely be covered by automation, but needs to be confirmed as it seems not everything is covered

  • For flame updating, please use v18D_nightly_v4 as base build, update to the latest dogfood and then update to the newest build (nightly-latest). For now, you cannot update from any random build.

Reference Links

Retrieved from "https://wiki.mozilla.org/index.php?title=B2G/QA/Meetings/2015-11-11&oldid=1105309"