B2G/QA/Meetings/2015-11-04

From MozillaWiki
< B2G‎ | QA‎ | Meetings
Jump to: navigation, search


NOTE: Please be aware it's a public etherpad and be careful about confidential information

// For 2015/11/04

Overview

   Meeting Name: B2G QA Roundtable

   Meeting Time (Taipei-EU): Wednesdays @ 3:30pm - 5:45pm CST

   Meeting Time (Taipei-MV/SF): Wednesdays @ 5pm - 5:45pm PDT

   Vidyo Room: QA-B2G Vidyo Room

   Video Link: https://v.mozilla.com/flex.html?roomdirect.html&key=A97nLDtY921vuLGRB1jv5S6OKs

   Dial in: 1-800-707-2533, #92, #9245

   Meeting Notes: https://wiki.mozilla.org/B2G/QA/Meetings

   Testrun Schedule: http://bit.ly/1jQzW79

   Roadmap for releases: https://wiki.mozilla.org/B2G/Roadmap

   B2G dashboard: http://charts.mozilla.org/

   QA Roundtable Template:  https://etherpad.mozilla.org/b2g-qa-roundtable-template  (Clone this)

   Performance result: http://raptor.mozilla.org


Announcements:

   List your ideas for Topics for Moz Orlando work week : qa@mozlando

   same idea as what we did for work week for Whistler

   v2.5 CC: December 14th


PTO plan

   Gerry+Mike+Shako+Walter+Shing - Oct. 30~Nov. 6 (Euro Star)

   nhirata - Dec 28 ~ Jan 4

   jlorenzo: Dec 23rd - Jan 4th


Upcoming Holidays

  • U.S.
    • November 26 and 27
    • December 24 and 25

2.2r

   Contact Window: Shing Lyu

   Status: 

   Talked with 2 potential QA outsource candidate, waiting for their formal quote and proposal.

   LG provided us the RedTai source code, build ok but flashing falied.

   Under evaluation: pvt to taskcluster build

2.5 Feature

  • TV - Seamless Experience: Cynthia
    • It's ready for testing



   *** Bug list: http://mzl.la/1GoYtvy

   *** Bug 1217682 landed but addons.allizom.org isn't up yet to do testing against:
   **** ddurst: You can't test yet, but the url will be something like https://blocklist.allizom.org/blocklist/1/%7Bec8030f7-c20a-464f-9b0e-13a3a9e97384%7D/2.0.0.8/
   **** ddurst: that syntax is https://blocklist.addons.mozilla.org/blocklist/3/%APP_ID%/%APP_VERSION%/%PRODUCT%

    *** late landing which nhirata tested, several bugs found : 

   1220197 - Addon is not disabled if on the block list.  

   1219995 - WONTFIX - UX: feedback for a block add on gives "App install error:MANIFEST_URL_ERROR"

   1219962 - FIXED -  Addon doesn't seem to be utilizing the blocklist; blocklisted app can still be installed.                

   **** final testing blocked by not having builds. : 1220743  no builds nor FOTA files are not listed for 2.5 and 2.6
    • Silent Update
   *** Not in v2.5
  • Performance: Mike (backup: Iris)
    • App/Device startup time
   *** One regression from 20th Oct. https://bugzilla.mozilla.org/show_bug.cgi?id=1216403
    • Media performance have landed, and also verified on Flame and Aries
   *** https://bugzilla.mozilla.org/show_bug.cgi?id=1159343
   *** Asked Marigold to run Media regression test
    • Display/Graphic performance
   *** Regression test done and doesn't have new issue.

  *** Test nsec packages: http://people.mozilla.org/~mlien/index.html
    • Two user stories still not landed completely
   *** Process switch: https://bugzilla.mozilla.org/show_bug.cgi?id=1214572
   *** Data jar isolation: https://bugzilla.mozilla.org/show_bug.cgi?id=1178526


_* NGA: Johan

    • Performance back to what they used to be in 2.2. Only 1 remaining blocker in SMS, but not related to NGA.
  • RTL: William
   • Development progress: (Implementation order: http://bit.ly/1MsORSC)
       - Completed:

   Dialer, FTU, System, Homescreen, Browser, Emergency Call, Settings, Contacts, Search, Keyboard, Bookmark, E-mail, and Calendar

        - On-going:

   Callscreen RTL, and RTL bug triaging

        - RTL bug triaging: http://tinyurl.com/rtl-triaging 
   • Test progress:
        - Completed:

   Dialer, FTU, System, Homescreen, Browser, Emergency Call, Settings, Contacts, Search, Keyboard, Bookmark, E-mail, and Calendar

        - Todo:

   Callscreen and bug work

        - Test results: https://goo.gl/EgHFDm  
        - Bug list: https://goo.gl/KGvwvo


  • updates: FOTA : nhirata
    • Aries FOTA
      • Testing blocked by bug 1215667; IMEI whitelist work blocked.
    • Flame FOTA : gecko/gaia only
      • FOTA fixed using pvtbuild/buildbot; need to move to taskcluster (see agenda items)
      • T2M build being sent to T2M is blocked by waiting for information in regards to https://bugzil.la/1218600 / bug 1214222
  • Vaani : nhirata -
    • dropped for 2.5; work still being done, QA still needed. Will be an ongoing tweak of fuzzy logic
    • need vaani automatable: bug 1219450
    • please use the MozSpeech app in dogfood-latest build
    • going to ping Andre tomorrow
  • Others (no change from last week)
    • View Source: No-Jun
      • All major features are verified, there is only one bug that's being checked right now, but it's not a blocker (Bug 1204011)
      • Test suite is in moztrap

2.6 Spark/Aries-KK Smoketests

  • Tester: QAnalysts (KevinT)
    • Health Status: BLOCKED. No Aries build available. Need releng to configure the build jobs. Flame-kk builds are used instead.

New: None

Existing: - https://bugzil.la/1218721 Importing contacts gets stuck when importing a contact without a name. 

* Fails [6119]
**Requires that the user has a contact on the SIM without a name, but will break the entire import process.

Severe Issues: - https://bugzil.la/1220739 No new Dogfood Aries build available on Taskcluster, or on the 'dogfood-latest' channel.

  • This is because the balrog VPN proxy is disabled

- https://bugzil.la/1217928 [New Homescreen] Homescreen App order is not preserved during OTA when moving to the New Home Screen - https://bugzil.la/1217220 Received videos through MMS do not play and a serious error occurs when trying to watch them in video app - https://bugzil.la/1208808 Discrepancy between toLocaleFormat and toLocaleString when timezone is unresolved 

*This issue is resolved fixed but has failed verification. This bug has been reopened.

- https://bugzil.la/1211266 Occasional missing icons after flashing homescreen - https://bugzil.la/1213233 [Homescreen] All icons on homescreen can't be shown, after user selected "New Home Screen" or "Default Home Screen" - https://bugzil.la/1220812 After unlocking the device from the lockscreen there is a long pause until reaching the home screen

  • More severe on Flame but still happens on Aries
- https://bugzil.la/1209654 [Cost Control] Data alert doesn't match reported usage

2.6 Aries Dogfood

  • Health Status: Aries: BLOCKED. No Aries build available. Need releng to configure the build jobs. Flame-kk builds are used instead.

Existing: - https://bugzil.la/1218721 Importing contacts gets stuck when importing a contact without a name. 

* Fails [6119]
**Requires that the user has a contact on the SIM without a name, but will break the entire import process.
- https://bugzil.la/1209654 [Cost Control] Data alert doesn't match reported usage
 * Fails [8938]

2.6 Flame

  • Health Status: Flame: Red. 2 blockers

New: None

Existing: - https://bugzil.la/1218721 Importing contacts gets stuck when importing a contact without a name. 

 * Fails [6119]
 ** Requires that the user has a contact on the SIM without a name, but will break the entire import process.
- https://bugzil.la/1220056 [Flame KK][FOTA/ OTA] After OTA update is downloaded

and install it, device will reboot and enter the recovery mode successfully. 

 * Fails [2313]
 
 Severe issues:

- https://bugzil.la/1221316 [Flame KK] The time is changed after OTA which causes multiple issues - https://bugzil.la/1221264 Marketplace fails after nightly-latest OTA 20151103030244 

 *This issue seems to only occurs when the user has the incorrect time on their device before the OTA.

- https://bugzil.la/1220778 Unable to play 3gp music file - https://bugzil.la/1217928 [New Homescreen] Homescreen App order is not preserved during OTA when moving to the New Home Screen - https://bugzil.la/1217220 Received videos through MMS do not play and a serious error occurs when trying to watch them in video app - https://bugzil.la/1208808 Discrepancy between toLocaleFormat and toLocaleString when timezone is unresolved 

*This issue is resolved fixed but has failed verification. This issue has been reopened.

- https://bugzil.la/1211266 Occasional missing icons after flashing homescreen - https://bugzil.la/1213233 [Homescreen] All icons on homescreen can't be shown, after user selected "New Home Screen" or "Default Home Screen" - https://bugzil.la/1220812 After unlocking the device from the lockscreen there is a long pause until reaching the home screen 

- https://bugzil.la/1209654 [Cost Control] Data alert doesn't match reported usage

2.6 Exploratory

=== 2.5 fullrun (Marigold) === (William, update: 11/04)

=== 2.5 smoketest (Marigold) === (William, update: 11/04)

  • Aries
   1. Bug 1218721 - Importing contacts gets stuck when importing a contact without a name.
       * https://bugzil.la/1218721 
       * It was failing TC-[6119]
  • Flame
   1. Bug 1218721 - Importing contacts gets stuck when importing a contactwithout a name.
       * https://bugzil.la/1218721 
       * It was failing TC-[6119]
   2. Bug 1220056 - [Flame KK][FOTA/ OTA] After OTA update is downloadedand install it, device will reboot and enter the recovery mode successfully.
      * https://bugzil.la/1220056 
      * It was failing TC-[2313]
   3. Bug1209654 - [Cost Control] Data alert doesn't match reported usage
      * https://bugzil.la/1209654 
      * It was failing TC- [8938]


  • Severe Issue: (Aries and Flame)

- https://bugzil.la/1220778 Unable to play 3gp music file - https://bugzil.la/1217928 [New Homescreen] Homescreen App order is not preserved during OTA when moving to the New Home Screen - https://bugzil.la/1217220 Received videos through MMS do not play and a serious error occurs when trying to watch them in video app - https://bugzil.la/1208808 Discrepancy between toLocaleFormat and toLocaleString when timezone is unresolved (*This issue is resolved fixed but it still can be reproduced.) - https://bugzil.la/1211266 Occasional missing icons after flashing homescreen - https://bugzil.la/1213233 [Homescreen] All icons on homescreen can't be shown, after user selected "New Home Screen" or "Default Home Screen" - https://bugzil.la/1220812 After unlocking the device from the lockscreen there is a long pause until reaching the home screen


2.5 MTBF

- lab moved to ateam network - Moving to longer setup flame-kk 512MB avg. running hours: 48.12 Blocker: -[landed] https://bugzil.la/1217289 Leak browser iframe through BrowserContextMenu and PinPageSystemDialog 

- [checkin-needed] https://bugzil.la/1206634  [MTBF] After 20 hours executing, test cases failed consequently
aries-kk 2GB running hours: 48.09

mtbf bugs in Q4 https://bugzilla.mozilla.org/show_bug.cgi?id=1182954

    • RA exit criteria: 100 hrs
    • CC exit criteria: 200 hrs

Previous action items

(Update: Oct. 7th)

  • [team] Finalize sessions/Items for Agenda for Orlando

https://docs.google.com/document/d/1B3zIDd2s3-kqMRqzefNxDNQ8aQGs3jTo9u0XskobNc4/edit

  • [Al/Pallavi] To follow up the QA ww between Moz ww
  • [In progress] marcia: follow up with pallavi regarding community budget.


Agenda

[nhirata] update 11/4:

[marcia] Mozlando


(update November 4th)

https://gaia-l10n.allizom.org/integration/gaia-central/file/88990292cece/shared/firefox_sync/firefox_sync.properties https://gaia-l10n.allizom.org/integration/gaia-central/file/88990292cece/distros/b2gdroid/apps/ftu/ftu-droid.properties https://gaia-l10n.allizom.org/integration/gaia-central/file/88990292cece/distros/b2gdroid/apps/ftu/manifest.properties

- Firefox Sync strings will likely be covered by automation, but needs to be confirmed as it seems not everything is covered

  • Scope of this meeting: Is it supposed to be public or private?
    • If private: Remove this event from the public QA calendar, and remove the notes the public wiki
    • If public: Use a public etherpad for the meeting notes

Community Updates [marcia-read only]


  • Community Planning Strategy Document has been created and will be circulated soon for review
  • Future Events
    • Leadership Summit in Singapore - end of January
      • Not clear what the functional team role will be in this event - awaiting word from George Roter
    • FOSDEM - January 30 and 31, Brussels, BE
      • Planning meeting to be held this Friday with Francisco Picolini of the Participation team and Asa Dotzler

[Jamie_]

  • will be starting on revamp of firefox OS QA pages soon, have to talk to some people about it.

This Week - Decisions & Action Items


Testing information

Retrieved from "https://wiki.mozilla.org/index.php?title=B2G/QA/Meetings/2015-11-04&oldid=1104352"