Compatibility/Mobile Testing Surveys

Mobile Testing Surveys

SoftVision will be testing the top mobile sites—in Firefox for Android—in a list of prioritized locales, and reporting bugs as they find them.

Test Plan

In general, we want to test a site in the most useful ways it can be tested, beyond looking at the home page, i.e., play and pause video, create an account and log in, add and remove an item to/from a cart, open a menu and select items, upvote a post, etc.

It's hard to know a priori what this will end up looking like. The plan is to start exploratory testing with the US locale and make notes of what is and isn't useful (or possible) to test. From that we'll create a test plan of the remaining locales based on the types of sites and their related common interactions.

As part of this testing, we should also document obstacles. For example, do we need to create paid accounts to test some of the sites? Do we need to purchase items, or is it enough to take a transaction all the way until payment is requested?

(Note: if we need to get money for this type of testing, we can request it.)

Wiki Test Plan

Bug Reporting Guidelines

All sites should be tested in Firefox for Android Nightly. If an issue doesn't reproduce in Chrome for Android, AND reproduces in Firefox for Android Nightly, a bug should be filed on webcompat.com with steps to reproduce and a screenshot (except for NSFW content; see below).

Bug identifier

Each bug report should have a lowercase bug identifier to help us link back to all bug reports filed as part of this project, and by country (via a search query). It should look like this:

sv; country: us

That is, the string "sv;" followed by a space, followed by the string "country:" followed by a space, followed by the 2 letter ISO 3166-1 alpha-2 code that corresponds to the top site list.

See here for a reference on country codes: https://en.wikipedia.org/wiki/ISO_3166-1_alpha-2#Officially_assigned_code_elements

NSFW Content

Some sites tested may be adult or pornographic in nature. If bugs are encountered in these types of sites, screenshots should either not be included in the bug reports, or have the Not-Safe-For-Work portions blurred out before uploading.

Locales

We will start with the following locales, more to come after. Each locale should link to a query to bring up reported bugs, a link to the tested URLs, and have a summary once it has been tested.

Getting top sites

Top Sites can be obtained from Alexa: http://www.alexa.com/topsites/countries

The following snippet of code can be run in the browser console on a result page to make it easy to copy and paste into the wiki.

(Note: https://aws.amazon.com/alexa-top-sites/ also exists, but subscribing doesn't seem to be working for me at the moment)

$$('div.tr > div > p > a:nth-child(1)').map(el => {
  return `#  ${el.textContent} \n`;
}).join('')

US

Some of these won't be useful to test (t.co, for example). And others will have additional popular subdomains worth testing. Alexa doesn't provide that info, unfortunately.

1. Google.com
2. Youtube.com
3. Facebook.com
4. Amazon.com
5. Yahoo.com
6. Wikipedia.org
7. Reddit.com
8. Twitter.com
9. Ebay.com
10. Linkedin.com
11. Netflix.com
12. Diply.com
13. Instagram.com
14. Live.com
15. Craigslist.org
16. Ntd.tv
17. Bing.com
18. Imgur.com
19. Cnn.com
20. Office.com
21. Pinterest.com
22. Tumblr.com
23. Microsoftonline.com
24. T.co
25. Chase.com
26. Nytimes.com
27. Blogspot.com
28. Paypal.com
29. Imdb.com
30. Livejasmin.com
31. Pornhub.com
32. Wordpress.com
33. Espn.com
34. Apple.com
35. Walmart.com
36. Msn.com
37. Wikia.com
38. Breitbart.com
39. Salesforce.com
40. Bankofamerica.com
41. Weather.com
42. Wellsfargo.com
43. Washingtonpost.com
44. Microsoft.com
45. Zillow.com
46. Huffingtonpost.com
47. Twitch.tv
48. Instructure.com
49. Dropbox.com
50. Intuit.com
51. Foxnews.com
52. Googleusercontent.com
53. Stackoverflow.com
54. Yelp.com
55. Github.com
56. Pandora.com
57. Adobe.com
58. Conservativetribune.com
59. Soundcloud.com
60. Indeed.com
61. Etsy.com
62. Aol.com
63. Force.com
64. Gfycat.com
65. Amazonaws.com
66. Spotify.com
67. Vice.com
68. Xfinity.com
69. Onclkds.com
70. Buzzfeed.com
71. Godaddy.com
72. Txxx.com
73. Quora.com
74. Weebly.com
75. Patch.com
76. Bestbuy.com
77. Thesaurus.com
78. Capitalone.com
79. Baidu.com
80. Blackboard.com
81. Thepiratebay.org
82. Bbc.com
83. Go.com
84. Tripadvisor.com
85. Roblox.com
86. Dingit.tv
87. Forbes.com
88. Homedepot.com
89. Stackexchange.com
90. Vimeo.com
91. Deviantart.com
92. Target.com
93. Rumble.com
94. Usps.com
95. 123movies.is
96. Irs.gov
97. Cnet.com
98. Citi.com
99. Dailymail.co.uk
100. Businessinsider.com

France

Note: Top 125 included, in case there are duplicates not worth testing. Mike can get more if needed.

1. Google.fr
2. Youtube.com
3. Google.com
4. Facebook.com
5. Wikipedia.org
6. Amazon.fr
7. Leboncoin.fr
8. Yahoo.com
9. Live.com
10. Orange.fr
11. Twitter.com
12. Livejasmin.com
13. Free.fr
14. Linkedin.com
15. Lemonde.fr
16. Instagram.com
17. Reddit.com
18. Lefigaro.fr
19. Ebay.fr
20. Cdiscount.com
21. T.co
22. Zone-telechargement.ws
23. Jeuxvideo.com
24. Labanquepostale.fr
25. Allocine.fr
26. Msn.com
27. Commentcamarche.net
28. Pole-emploi.fr
29. Sfr.fr
30. Pornhub.com
31. Vk.com
32. Lequipe.fr
33. Twitch.tv
34. Xhamster.com
35. Pinterest.com
36. Voirfilms.co
37. Programme-tv.net
38. Credit-agricole.fr
39. 20minutes.fr
40. Github.com
41. Netflix.com
42. Aliexpress.com
43. Caf.fr
44. Wordpress.com
45. Francetvinfo.fr
46. Bongacams.com
47. Torrent9.biz
48. Tumblr.com
49. Stackoverflow.com
50. Linternaute.com
51. Dailymotion.com
52. Microsoft.com
53. T411.ai
54. Bing.com
55. Paypal.com
56. Xvideos.com
57. Onclkds.com
58. Meteofrance.com
59. Bfmtv.com
60. Laposte.fr
61. Txxx.com
62. Voyages-sncf.com
63. Porn555.com
64. Leparisien.fr
65. Amazon.com
66. Dl-protecte.com
67. Reverso.net
68. Pagesjaunes.fr
69. Nouvelobs.com
70. Fnac.com
71. Apple.com
72. Imgur.com
73. Huffingtonpost.fr
74. Lcl.fr
75. Dingit.tv
76. Tf1.fr
77. Impots.gouv.fr
78. Office.com
79. Vente-privee.com
80. Societegenerale.fr
81. Bouyguestelecom.fr
82. Caisse-epargne.fr
83. Creditmutuel.fr
84. Boursorama.com
85. Priceminister.com
86. Wordreference.com
87. Laposte.net
88. Lexpress.fr
89. 01net.com
90. Wikia.com
91. Linguee.fr
92. Ok.ru
93. Banquepopulaire.fr
94. Adobe.com
95. Booking.com
96. Ouest-france.fr
97. Deezer.com
98. Leroymerlin.fr
99. Service-public.fr
100. Dealabs.com
101. Microsoftonline.com
102. 9gag.com
103. Soundcloud.com
104. Uptobox.com
105. Tripadvisor.fr
106. Clubic.com
107. Libertyland.co
108. Over-blog.com
109. 1fichier.com
110. Mabanque.bnpparibas
111. Imdb.com
112. Airbnb.fr
113. Wlp-acs.com
114. Lesechos.fr
115. Google.ru
116. Amazonaws.com
117. Outbrain.com
118. Liberation.fr
119. Vimeo.com
120. Streamcomplet.com
121. Secretsdujeu.com
122. Dropbox.com
123. Zimbra.free.fr
124. Societe.com
125. Buzzfil.net

India

1. Google.co.in
2. Youtube.com
3. Google.com
4. Facebook.com
5. Yahoo.com
6. Amazon.in
7. Wikipedia.org
8. Flipkart.com
9. Onlinesbi.com
10. Irctc.co.in
11. Hotstar.com
12. Linkedin.com
13. Indiatimes.com
14. Onclkds.com
15. Ntd.tv
16. Blogspot.in
17. Stackoverflow.com
18. Cricbuzz.com
19. Xvideos.com
20. Quora.com
21. Hdfcbank.com
22. Twitter.com
23. Paytm.com
24. Torrentz2.eu
25. Ndtv.com
26. Popads.net
27. Instagram.com
28. Uidai.gov.in
29. Billdesk.com
30. Icicibank.com
31. Naukri.com
32. Rediff.com
33. Wittyfeed.com
34. Bet365.com
35. Thewhizmarketing.com
36. Amazon.com
37. Microsoft.com
38. Wordpress.com
39. Whatsapp.com
40. Ebay.in
41. Bookmyshow.com
42. Live.com
43. Pornhub.com
44. Moneycontrol.com
45. Googleusercontent.com
46. Snapdeal.com
47. Imdb.com
48. Intoday.in
49. Jabong.com
50. Msn.com
51. Airtel.in
52. Makemytrip.com
53. Xnxx.com
54. Espncricinfo.com
55. Justdial.com
56. Bhaskar.com
57. Olx.in
58. Freejobalert.com
59. Savefrom.net
60. Bing.com
61. Blogger.com
62. Sarkariresult.com
63. Clicksgear.com
64. W3schools.com
65. Manoramaonline.com
66. Github.com
67. Indianrail.gov.in
68. Andhrajyothy.com
69. Softonic.com
70. India.com
71. Indianexpress.com
72. Porn555.com
73. Tamilrockers.lv
74. Paytm.in
75. Reddit.com
76. Adobe.com
77. Yts.ag
78. Tutorialspoint.com
79. Apple-kungfu.com
80. Pinterest.com
81. Rambler.ru
82. Xhamster.com
83. Mi.com
84. Incometaxindiaefiling.gov.in
85. Shopclues.com
86. Newstrend.news
87. Ask.com
88. Aarth.com
89. Doubleclick.net
90. Godaddy.com
91. 1337x.to
92. Axisbank.co.in
93. Myntra.com
94. Nsdl.com
95. Oneindia.com
96. Iwanttodeliver.com
97. Slideshare.net
98. Quikr.com
99. Hindustantimes.com
100. Office.com
101. Blogspot.com
102. Txxx.com
103. Insistpost.com
104. Amazonaws.com
105. Thehindu.com
106. Filehippo.com
107. Torrentproject.se
108. Microsoftonline.com
109. Indiamart.com
110. Stackexchange.com
111. Sportzwiki.com
112. Voot.com
113. Eenadu.net
114. News18.com
115. Mydala.com
116. Primevideo.com
117. Myway.com
118. Uptodown.com
119. Dailymotion.com
120. T.co
121. Trackmedia101.com
122. Sarvgyan.com
123. Emailaccessonline.com
124. Actcorp.in
125. Ozee.com

Germany

1. Google.de
2. Youtube.com
3. Google.com
4. Facebook.com
5. Amazon.de
6. Ebay.de
7. Wikipedia.org
8. Vk.com
9. Ebay-kleinanzeigen.de
10. Web.de
11. Ok.ru
12. Livejasmin.com
13. Yahoo.com
14. Gmx.net
15. Reddit.com
16. Mail.ru
17. T-online.de
18. Twitter.com
19. Instagram.com
20. Spiegel.de
21. Xhamster.com
22. Paypal.com
23. Bild.de
24. Live.com
25. Chip.de
26. Google.com.tr
27. Yandex.ru
28. Bing.com
29. Pornhub.com
30. Twitch.tv
31. Google.ru
32. Whatsapp.com
33. Gutefrage.net
34. Tellonym.de
35. Txxx.com
36. Netflix.com
37. Focus.de
38. Tumblr.com
39. Welt.de
40. Google.com.ua
41. Linkedin.com
42. Wetter.com
43. Mobile.de
44. Wordpress.com
45. Blogspot.de
46. Postbank.de
47. Immobilienscout24.de
48. Imgur.com
49. Bs.to
50. Microsoft.com
51. Msn.com
52. Dict.cc
53. Bahn.de
54. Amazon.com
55. Otto.de
56. Github.com
57. T.co
58. Heise.de
59. Telekom.com
60. Hclips.com
61. Streamcloud.eu
62. Xing.com
63. Stackoverflow.com
64. Xvideos.com
65. Idealo.de
66. Aliexpress.com
67. Dhl.de
68. Pinterest.de
69. Booking.com
70. 1und1.de
71. Upornia.com
72. Apple.com
73. Deutsche-bank.de
74. Wikia.com
75. Deref-web-02.de
76. Zeit.de
77. Vice.com
78. Wetteronline.de
79. Chaturbate.com
80. Kinox.to
81. Imdb.com
82. Mozilla.org
83. Deref-gmx.net
84. 9gag.com
85. Bongacams.com
86. Adobe.com
87. Wetter.de
88. Dropbox.com
89. Tagesschau.de
90. Youporn.com
91. Onclkds.com
92. Junbi-tracker.com
93. Computerbild.de
94. Commerzbank.de
95. Mydealz.de
96. Sueddeutsche.de
97. Tipico.de
98. Faz.net
99. Leo.org
100. Vodafone.de
101. Zdf.de
102. Mediamarkt.de
103. N-tv.de
104. Soundcloud.com
105. Steamcommunity.com
106. Popads.net
107. Chefkoch.de
108. Rambler.ru
109. Likemag.com
110. Zalando.de
111. Autoscout24.de
112. Ing-diba.de
113. Olx.ua
114. Check24.de
115. Ebay.com
116. Dkb.de
117. Hotmovs.com
118. Stargames.com
119. Ablogica.com
120. Outbrain.com
121. Kicker.de
122. Sunnyplayer.com
123. Duden.de
124. Comdirect.de
125. Amazonaws.com

Taiwan

1. Google.com.tw
2. Pixnet.net
3. Youtube.com
4. Facebook.com
5. Ettoday.net
6. Google.com
7. Yahoo.com
8. Ltn.com.tw
9. Setn.com
10. Momoshop.com.tw
11. Nownews.com
12. Wikipedia.org
13. Gamer.com.tw
14. Tvbs.com.tw
15. Ptt.cc
16. Ck101.com
17. Ebc.net.tw
18. 104.com.tw
19. Appledaily.com.tw
20. Pchome.com.tw
21. Life.tw
22. Ruten.com.tw
23. Eyny.com
24. Udn.com
25. Mobile01.com
26. Ctitv.com.tw
27. Baidu.com
28. Dcard.tw
29. Ipetgroup.com
30. Epochtimes.com
31. Talk.tw
32. Teepr.com
33. Instagram.com
34. Storm.mg
35. Taobao.com
36. Feebee.com.tw
37. Businessweekly.com.tw
38. 1111.com.tw
39. Twitch.tv
40. Sina.com.tw
41. Xuite.net
42. Cmoney.tw
43. Bomb01.com
44. Shopee.tw
45. Everydayhealth.com.tw
46. Twitter.com
47. Line.me
48. Kknews.cc
49. Books.com.tw
50. Cool3c.com
51. Qoolquiz.com
52. Techbang.com
53. Elle.com.tw
54. Plurk.com
55. Coco01.net
56. Live.com
57. Imgur.com
58. 591.com.tw
59. 99kubo.com
60. Icook.tw
61. Juksy.com
62. Read01.com
63. Buy123.com.tw
64. Qq.com
65. Weibo.com
66. Chinatimes.com
67. Disp.cc
68. Commonhealth.com.tw
69. Vogue.com.tw
70. Cnyes.com
71. Ipeen.com.tw
72. Buzzorange.com
73. Niusnews.com
74. Cwb.gov.tw
75. Dongtw.com
76. Tmall.com
77. Pcstore.com.tw
78. Jkforum.net
79. Hinet.net
80. Wetalk.tw
81. Apple.com
82. Github.com
83. Litv.tv
84. Chenderroad.com
85. Cna.com.tw
86. Playsport.cc
87. Healthylives.tw
88. Gomaji.com
89. Microsoft.com
90. Tumblr.com
91. Stackoverflow.com
92. 518.com.tw
93. Parenting.com.tw
94. Thenewslens.com
95. Github.io
96. Biggo.com.tw
97. Liontravel.com
98. Popdaily.com.tw
99. Blogspot.com
100. Gamme.com.tw
101. Yungching.com.tw
102. Amazon.com
103. Top1health.com
104. Xvideos.com
105. Koreastardaily.com
106. Sina.com.cn
107. Eprice.com.tw
108. Mamibuy.com.tw
109. Colatour.com.tw
110. Marieclaire.com.tw
111. Dm5.com
112. Popads.net
113. Maplestage.com
114. 8maple.ru
115. I-gamer.net
116. Wordpress.com
117. Walkerland.com.tw
118. Pornhub.com
119. Gq.com.tw
120. Findprice.com.tw
121. Pinterest.com
122. Reddit.com
123. Dropbox.com
124. Click108.com.tw
125. Fc2.com

Indonesia

1. Google.co.id
2. Google.com
3. Youtube.com
4. Tribunnews.com
5. Detik.com
6. Tokopedia.com
7. Yahoo.com
8. Facebook.com
9. Bukalapak.com
10. Liputan6.com
11. Kompas.com
12. Merdeka.com
13. Kaskus.co.id
14. Kapanlagi.com
15. Wordpress.com
16. Brilio.net
17. Cerpen.co.id
18. Lazada.co.id
19. Indoxxi.net
20. Vidio.com
21. Grid.id
22. Blibli.com
23. Uzone.id
24. Alodokter.com
25. Kompasiana.com
26. Dream.co.id
27. Viva.co.id
28. Instagram.com
29. Kumparan.com
30. Wikipedia.org
31. Okezone.com
32. Sindonews.com
33. Idntimes.com
34. Popads.net
35. Suara.com
36. Tempo.co
37. Blogspot.com
38. Blanja.com
39. Cnnindonesia.com
40. Bintang.com
41. Lk21.co
42. Bola.net
43. Wowkeren.com
44. Bola.com
45. Whatsapp.com
46. Scribd.com
47. Kemdikbud.go.id
48. Vemale.com
49. Savefrom.net
50. Republika.co.id
51. Olx.co.id
52. Subscene.com
53. Uptodown.com
54. Ask.com
55. Twitter.com
56. Tirto.id
57. Deloton.com
58. Academia.edu
59. Blogger.com
60. Klikbca.com
61. Slideshare.net
62. Shopee.co.id
63. Myway.com
64. Hicpm5.com
65. Adexchangeperformance.com
66. Bolasport.com
67. Mozilla.org
68. Zippyshare.com
69. Brainly.co.id
70. Bp.blogspot.com
71. Tiket.com
72. Msn.com
73. Adf.ly
74. Planetlagu.site
75. Jawapos.com
76. Hao123.com
77. Metrotvnews.com
78. Jpnn.com
79. Drakorindo.co
80. Samehadaku.net
81. Bkn.go.id
82. Txxx.com
83. Onclkds.com
84. Popcash.net
85. Jd.id
86. Popbela.com
87. Ns21.me
88. Fromdoctopdf.com
89. Files.wordpress.com
90. Oload.stream
91. Mediafire.com
92. Bisnis.com
93. Indosport.com
94. Bolalob.com
95. Indexmovie.me
96. Doubleclick.net
97. Wifi.id
98. Pipeschannels.com
99. Simpkb.id
100. Bankmandiri.co.id
101. Pulsk.com
102. Planetlagu.online
103. Duniaku.net
104. Googleusercontent.com
105. Olymptrade-promo.com
106. Pinterest.com
107. Microsoft.com
108. Tabloidbintang.com
109. Softonic.com
110. Cloudfront.net
111. Gridoto.com
112. Liveadexchanger.com
113. Traveloka.com
114. Internetspeedtracker.com
115. Kemenag.go.id
116. Linkedin.com
117. Jalantikus.com
118. Pajak.go.id
119. Solidfiles.com
120. Kemenkeu.go.id
121. Bioskopkeren.ws
122. Easypdfcombine.com
123. Offertogo.online
124. Axzsd.pro
125. T.co
126. Jobstreet.co.id
127. Kemenkeu.go.id
128. Launchpage.org
129. Higheurest.com
130. Spotscenered.info
131. Userscloud.com
132. Offertogo.online
133. Line.me
134. Linkshrink.net
135. Wattpad.com
136. Beritasatu.com
137. Adreactor.com
138. Cpmofferconvert.com
139. Putrr18.com
140. Freepik.com
141. Bing.com
142. Ouo.io
143. 4shared.com
144. Iqoption.com
145. Televisionfanatic.com
146. Searchpro.club
147. Dramakoreaindo.com
148. Tumblr.com
149. Coeg.in
150. Jitunews.com