Pancake/French Toast/Prototyping/2012-08 General User Testing
From MozillaWiki
< Pancake | French Toast | Prototyping
Contents
Script
Preparation
- Animated wireframe for Scenario 1 File:French-toast-ur-search.key.tar.gz. Plan to start with scenario 1. This gives users a chance to understand the layer concepts before exploring paper prototypes.
- Print a copies of wireframes to use as paper prototypes
- Print a copy of the video release form: https://intranet.mozilla.org/images/a/ac/Mozilla_User_Studies_Release_Form_-_1-18-12_update.pdf
- Sharpie marker
Tip: You can use Photo Booth or iMovie to record video/audio from your Mac.
What is the job-to-be-done for this script?
- Make user comfortable
- Capture unbiased reactions
Avoid correcting the user, but keep things moving if they get stuck.
Intro
- My name is _______. I'm a designer at Mozilla. I'm currently doing research and development on a new product, and would love your feedback.
- I'll ask a few background questions. Then, I'll show you a prototype and give you a scenario. Remember, you'll have to use your imagination a bit: this is just a sketch.
- Afterwards, I'll ask you a few follow-up questions. It will take about 30 to 45 minutes.
- If something doesn't make sense, let me know. This is exactly the kind of feedback I'm looking for.
- If it's ok with you, I'll video the exercise. This helps us remember your actual impression of the app. We won't share it outside of Mozilla.
Warm-up
- Survey: Name, Age
- What are some of the ways you save things for later?
- What kinds of things do you save from the web?
- What are some of the ways you organize things you save?
- What do you share?
- How? What services do you use?
- What do you like about those services?
- Is there anything you wish you could do with them that you can't?
Exercise
- Imagine you just installed a new iPad app from Mozilla. It says it's a social app you can use to "collect and share the web". This is is a sketch of what it might look like.
- Please point out the things you see on screen and tell me what you think they are. Point out anything that seems unusual or confusing.
- Ok, let's explore a scenario. While we do it, try to "think aloud" about what is happening.
- Scenario 1:
- You want to learn more about a band you recently discovered.
- When you find what you're interested in, you'll probably want to save it.
- Scenario 2:
- Maybe there are others out there that have similar musical tastes?
- If you find them, you'll want to follow them and be updated.
- What do you expect when I _______?
- How is it different from what you expected?
- What do you expect to be able to do with it?
- Please point out what you see on screen. What do you think it does?
- (After transitions, changes) What do you think just happened?
- How is it different from what you expected?
- Please point out what you see on screen. What do you think it does?
- Show me how you would _______. Go ahead -- try it.
Follow-up
- Is there anything you would like to see on this page that isn't here?
- Is there anything on this page that you would never use?
- Why?
- (Handing user paper prototypes, sharpie) Are there any other customizations you would make?
- Show me (encourage sketching onto paper prototype)
Win
- "I'm not a technical person".
- Loves her android phone. "I hate iOS, it doesn't have widgets".
- "I use Pinterest, but I don't share"
File:2012-08-win-sketches.pdf.tar.gz
Notes:
- Confused about the role of the back button in the viewer (thought it should go back to search)
- Wanted a close button for layers, or some kind of tab system
- Likes "Recent searches" area
- Identified all icons on Lv 1 without a problem, except "Explore"
- Wanted a personal space to save things for later, or some kind of default board
Cristina
- Identified most buttons on Lv 1 without a problem.
Did not participate in sketching on paper prototypes.
Laura
- Wanted updates to appear as default screen
- Liked the idea of using this
- "I don't really use bookmarks anymore. If I have an image, I add it to Pinterest, if it's text, I add it to Delicious..."