userzoom webinar: remote prototype testing

Webinar:

How To: Remote Prototype Testing

November 17th, 2011

Webinar Overview & Goals

1. Brief Introductions

2. What do we mean by Remote Prototype Testing?

3. When is Remote Prototype Testing useful?

4. Case study:

How to set up, design a Remote Prototype Test

What results can you expect?

5. Takeaways, Q&A

Introductions

Alfonso de la Nuez

Founder & CEO

at UserZoom

Kim Oslob

Dtor. Client Services

at UserZoom

4 quick facts about UserZoom

Leading SaaS company specializing in Remote UX Testing

Our obsession is to help businesses create excellent Customer Experiences

Our software solution includes 8 different tools to run Remote UX Research

Around for about 9 years, offices in Sunnyvale (CA), Cheshire (UK) and Barcelona (Spain)

50% of Fortune’s Most Admired Companies!!!

Some accomplishments

Before we begin, let’s take a quick poll to get to know you better…

What do we mean by Remote Prototype Testing?

Typical scenario for UX Pros

Sure we’d love to run testing, but…

UX & Usability research tends to be expensive

Time is not on our side

Target audiences are all around

Budget issues anyone???

• Hundreds of users agree to participate in a study

• In their natural context

• From geographically spread locations

• Users try to complete tasks (or goals) + answer questions

• No human moderation needed

• Our browser bar connects users’ browsers with a server

Remote Unmoderated Testing

What we mean by Remote Prototype Testing

What you can test with Remote Prototype Testing

Of course, low and high fidelity wireframes/prototypes

…but also:

Mock-ups

Images

Multimedia

Advantages and benefits or Remote Prototype Testing

Advantages and benefits

Cost-effective

Advantages and benefits

Quick, agile

You can gather feedback in a matter of hours

Advantages and benefits

Stats!

You can test with large samples

Advantages and benefits

Geographic representation

Your audience may be anywhere!

Advantages and benefits

Unbiased feedback

Advantages and benefits

Detailed feedback, results

However, not to be used when…

Getting highly qualitative data

In-person interviews are important

Note: Not all research

goals can be met

Remote testing and Agile Development

Characteristics: Speed Iterative Requirement

analysis Design User testing

Remote Testing is here to help!

Types of Remote Testing projects

Types of Remote Testing projects

Task-based surveys (Remote Usability)

Types of Remote Testing projects

Click Testing

Types of Remote Testing projects

Timeout Testing

Types of Remote Testing projects

Tree Testing

Types of Remote Testing projects

Multimedia surveys

Let’s take poll #2 now!

Case Study

Examples of Prototyping Tools

Case Study Explanation

• With each tool, Axure and Just In Mind, we ran a 30 user remote usability study

• The Axure study featured a low-fidelity prototype for an e-commerce company

• The Just In Mind study featured a high-fidelity prototype for a banking company

• Both vendors generate hosted, trackable prototypes

30

Axure Study Initial Questionnaire

1. How often do you shop for clothing online?

11/1/2011

31

Axure Study Task - Find Shoes

Add a pair of women's shoes to your shopping cart. When you are done, click "I'm Finished".

Starting page:

11/1/2011

32

Axure Study Clickstream

Note: We can validate success by URL

Page click-throughs on Axure prototypes are trackable with UserZoom

33

Axure Study Click Heatmap

The large red “heat” indicator shows a majority of people clicked there to begin the the task finding the pair of women’s shoes.

34

Axure Study Task - Find Shoes

Task Effectiveness & Efficiency

11/1/2011

35

Axure Study Task - Success Questionnaire

1. Please indicate how easy it was for you to find the shoes:

11/1/2011

36

Axure Study Task - Abandon Questionnaire

1. Please select the reason(s) why you chose to abandon or were not able to complete this task: (check all that apply)

11/1/2011

37

Just In Mind Study

Now let’s look at the Just In Mind Prototype Study

38

Just In Mind Study Initial Questionnaire

1. How often do you manage your banking online?

11/2/2011

39

Just In Mind Study Task - Find Credit Card

Find the annual fee amount on the PremierPass Rewards Credit Card. When you are done, click "I'm Finished".

Starting Page:

11/2/2011

40

Just In Mind Study Clickstream

41

Just In Mind Study Click Heatmaps

42

Just In Mind Study Task - Find Credit Card

Task Effectiveness

11/2/2011

43

Just In Mind Study Task - Validation Questionnaire

1. What is the annual fee for the PremierPass Card?

11/2/2011

44

Just In Mind Study Task - Success Questionnaire

1. Please indicate how easy it was for you to find the annual fee amount:

11/2/2011

Some takeaways…

1. You don’t need a live website to run remote testing

2. Many benefits to remote prototype testing, including reduced costs, speed, etc.

3. Remote Prototype Testing in Agile Dev: A great fit!

4. There are various types of remote testing projects, not just remote usability, when developing prototypes

5. Make sure the tool used generates trackable prototypes

6. The detailed of the data collected is AWESOME and very actionable, plus you can do iterative testing too!

More info? Check out our How-To articles on www.userzoom.com!

Q&A

Please don’t go yet! Let’s take the final poll…

Thanks so much for your time!

Check out our upcoming news and events at www.userzoom.com

Sunnyvale (USA)

440 N. Wolfe Rd. Sunnyvale,CA 94085 Phone: +1 (408) 524 7445 Contact: Alfonso de la Nuez

Barcelona (Spain)

Av. Diagonal 419 3º 2ª 08008 Barcelona Phone: +34 93 414 7554 Fax: +34 93 209 8380 Contact: Xavier Mestres

Cheshire (UK)

Booths Park. Chelford Road, Knutsford, Cheshire WA16 8GSPhone: + 44 (0)1565 759890Cell: + 44 (0)7900 472 920Contact: Arthur Moan