Update:RemoraV32:Test Plan
From MozillaWiki
Written (largely) by Stephen Donner stephend@mozilla.com
Contents
Description of Release
The goal of AMO Version 3.2 is to radically simplify the add-ons experience for end users thru better navigation, recategorization and site design.
Tracking / Implementation Bug
Staging URLs
https://remora-reskin.stage.mozilla.com/en-US/firefox/
http://preview.addons.mozilla.org (public-facing stage)
https://remora.stage.mozilla.com/en-US/firefox/
Design Mocks
http://people.mozilla.com/~madhava/files/amo/2007-11-21/
Test Approach (now with testing-progress indication!)
- Any DB-poking I can help out with, Mike / Wil?
- DB's are to the point where they are horizontally scalable, so no.
- How are we going to load / stress test?
- We can use Grinder to test stage, but unless we're doing ridiculously complex stuff in the view, load should not change much at all. Main concerns would again be search, main page and browse pages. If we add file links to search results that could hurt the db, so we should test this in a way that reflects prod.
- Registration
- Login/logout
- Clear picture of how the logged-in/default experiences differ
- Test migration of categories
- Likewise, we should test that bookmarks to the current site map to the new one
- Test 1.5/2.0.0.x/3.0 extensions
- Top 20 (or so?) extensions
- Top 20 (or so?) themes
- JavaScript-disabled case
- Going well; mostly covered, I think, by bugs
- See all possible links to all possible files
- Flat view - hyperlink to the file
- Do we message the user?
- Other browsers; do we message them, too? (Let's define "graceful degradation," if that's what we're going to use)
- Accessibility - employ Tim Keenan's help, if he has cycles
- XHTML compliance?
- We validate to whatever the document DTD declares
- Run link checker
- Search
- Empty-string searches
- Null searches
- 255-character-limit searches
- Escape
- Unescape
- Results navigation
- Previous / Next arrows
- Numerals
- Ellipses (in the middle)
- Image preview / lightbox
- Bounds-limit (no previous when you're on the first, no next when on last...)
- Views
- "Flat" view - category only
- Within category
- Ratings
- While logged-in, can you change at will?
- Most Popular
- Reviews
- Advanced Details
- Limits of Add-on descriptions; truncate at some paragraph-length boundary? (a la Rock your Firefox)
- And please, please, let's kill (read: escape) attempted HTML, or just make it useful (see the paragraph tags in https://remora.stage.mozilla.com/en-US/firefox/addon/7)
- So, let's fix https://bugzilla.mozilla.org/show_bug.cgi?id=343573 :-P
- Deferred to the 3.3 release; not scoped here
- And please, please, let's kill (read: escape) attempted HTML, or just make it useful (see the paragraph tags in https://remora.stage.mozilla.com/en-US/firefox/addon/7)
- Recommendations
- Its presence begs the question: how do we determine what a "similar add-on" is; key by category?
- Sorting (Name, Date, Popularity, Ranking)
- Make sure to test both:
- "Flat" sort
- Sort-within-search-results
- Make sure to test both:
- Build your own; goes to DevMO, or what?
- "Other Languages" select pulldown; general locale testing?
- Sandbox
- "Show Experimental Add-ons" linked to this
- Tooltips / ALT | TITLE text
- Footer - different privacy policy, or global Mozilla-com one?
Browser Testing Matrix
Windows XP SP2 | Windows Vista | Mac | Linux | |
---|---|---|---|---|
Firefox 2.0.0.13 - FULL SUPPORT | P1 | P1 | P1 | P1 |
Internet Explorer 7 - Non-degraded experience | P1 | P1 | N/A | N/A |
Internet Explorer 6 - Non-degraded experience | P1 | N/A | N/A | N/A |
Opera 9.25 - Non-degraded experience | P2 | P2 | P2 | P2 |
Safari 2.0.4 / 3.1 - Non-degraded experience | P1 | P1 | P1 | N/A |
Flock 1.1 | P2 | P2 | P2 | P2 |
Test Cases
(Will be) Located in the AMO (addons.mozilla.org) component in Litmus
Test Results
Windows XP SP2 | Windows Vista | Mac | Linux | |
---|---|---|---|---|
Firefox 2.0.0.13 | . | . | . | . |
Internet Explorer 7 | . | . | N/A | N/A |
Internet Explorer 6 | . | N/A | N/A | N/A |
Opera 9.25 | . | . | . | . |
Safari 2.0.4 / 3.1 | . | . | . | N/A |
Flock 1.1 | . | . | . | . |
Detailed Test Results
Windows XP SP 2 - .
Vista - .
Mac - .
Linux - .