practical usability testing

30
Practical Usability Testing Session in Association with techgig.com / Nimbuzz Ravindran Antonysamy QA Head, Nimbuzz http://www.techgig.com/expe rt-speak/Practical-Usabilit y-Testing-432 1 Before we fall in love with our own designs, lets find out what ‘really’ our users are thinking about it !!

Upload: ravindran-antonysamy

Post on 12-May-2015

1.332 views

Category:

Education


0 download

DESCRIPTION

Usability testing largely misunderstood with User acceptance testing which we do with customers (UAT). Usability testing is NOT UAT. This webinar will give you the basics of Usability testing. This webinar will give you the types of usability testing (Hallway testing, Remote usability testing, Expert review, Automated Expert review and A/B testing). Usability testing measures the usability, or ease of use, of a specific object or set of objects, whereas general human-computer interaction studies attempt to formulate universal principles. Why Usability test your product? How to conduct usability testing? What is a Screener? How to recruit users? What is a test protocol and why you need to make it, who should make it? How to conduct the usability testing with appropriate users? What to focus on, when recruiting users? How to reward them or motivate them? What are all the challenges when conducting usability testing with real users? How to tackle them? What is the hardware and software requirements when conducting usability testing? This webinar addresses all, to help you kick-start your usability testing initiative! Key Discussion Points: Usability testing history Types of Usability testing How to perform usability testing in practical? How to present the data to the Product Management ? How to follow up the usability test results helps or transforms into business?

TRANSCRIPT

Page 1: Practical Usability Testing

Practical Usability Testing Session in Association with

techgig.com / Nimbuzz

Ravindran AntonysamyQA Head, Nimbuzz

http://www.techgig.com/expert-speak/Practical-Usability-Testing-432

1

Before we fall in love with our own designs, lets find out what ‘really’ our users are thinking about it !!

Page 2: Practical Usability Testing

2

Who Am ITarget AudienceWhat is Usability testing ?PET – Persuasion / Emotion / Trust ISO 9241How to hire usability testers ?Screener / Consent form / recording Test protocol Execution / PrototypesPresenting ReportsMobileQAZone.comLinks (tools / videos)Nimbuzz !!

12/04/2023 Go get Nimbuzz from http://get.nimbuzz.com

Page 3: Practical Usability Testing

3

Usability testing largely misunderstood with User acceptance testing which we do with customers (UAT). Usability testing is NOT UAT. This webinar will give you the basics of Usability testing. This webinar will give you the types of usability testing (Hallway testing, Remote usability testing, Expert review, Automated Expert review and A/B testing).

Usability testing measures the usability, or ease of use, of a specific object or set of objects, whereas general human-computer interaction studies attempt to formulate universal principles.Why Usability test your product? How to conduct usability testing? What is a Screener? How to recruit users? What is a test protocol and why you need to make it, who should make it?

12/04/2023 Go get Nimbuzz from http://get.nimbuzz.com

Page 4: Practical Usability Testing

4

How to conduct the usability testing with appropriate users? What to focus on, when recruiting users? How to reward them or motivate them?What are all the challenges when conducting usability testing with real users? How to tackle them?

What is the hardware and software requirements when conducting usability testing?

This webinar addresses all, to help you kick-start your usability testing initiative!

12/04/2023 Go get Nimbuzz from http://get.nimbuzz.com

Page 5: Practical Usability Testing

5

Key Discussion Points:

Types of Usability testingHow to perform usability testing in practical?How to present the data to the Product Management ?How to follow up the usability test results helps or transforms into business?

Who Should Attend?Mobile Application Testers, Mobile Handheld Testers, Mobile Usability testers, Product Managers, Test and Tech Leads

12/04/2023 Go get Nimbuzz from http://get.nimbuzz.com

Page 6: Practical Usability Testing

6

Who Am I & What I love

12/04/2023 Go get Nimbuzz from http://get.nimbuzz.com

Page 7: Practical Usability Testing

7

Who Am I & What I love

12/04/2023 Go get Nimbuzz from http://get.nimbuzz.com

Robotics

Renewable Energy

Open Source

Page 8: Practical Usability Testing

All testing types

8

Hallway testingRemote Usability TestingExpert reviewAutomated expert reviewA/B Testing

Page 9: Practical Usability Testing

Best testing types

9

Few Famous methodologies, and why we should use or why we should not use them:

Hallway testing: set of people invited to test the product. Engaged in the early stages of design / product. We shall invite new nimbuzz employees to perform this test. This is a pilot test before performing the actual usability testing (this will evaluate our test protocol and test methodology)

Other formats such as Expert review, automated expert review, A/B testing shall not be engaged at this point (considering the cost involved for tools and resources)

Moderated Usability testing : We shall hire usability testers / real users via social media channels / friends circles. Evaluate them. Invite them to Nimbuzz. Follow the test protocol reviewed by Kapil, Harsh and approved Jammy + Respective PM. Conduct the test and circulate the results.

Page 10: Practical Usability Testing

Buzz about Sample Size

10

According to the industry, the more number of users we use, great possibility is that they will come across the same kind of usability problems. So we shall use 5 test samples in the beginning. At the max, we shall use 7 or 10 people for this.

More users, Same

problem

Page 11: Practical Usability Testing

Test Execution Method

11

- Participant evaluation sheet shared with the PM and he/she provide inputs for selecting the relevant participants.- On Scheduled test day, participant arrives to the test lab, briefed about the product he/she will be using- Usability test session conducted by Test moderator and an Observer is present to observe the events as It happens.- Moderator follows the test protocol (Reviewed by Functional team and

approved by Product manager) and request the tester to perform those actions. - User / usability tester “think aloud “ and speaks as he/she performs actions on

the specific task.- User / usability testers face & tapping action & think aloud voice recorded as it

goes (prior consent had been obtained in written form from the tester)- The Data then presented to the Product management with a easy to use –

decision making format (PPT presentation + consolidated videos of facial and finger tapping along with voice)

Page 12: Practical Usability Testing

Features for Usability

Testing

12

- Go with Core Features- Go with mostly visible to the user- Go with the feature that you want the user to focus on when entering /

navigating in your product - Go with features that fetches money

Page 13: Practical Usability Testing

Test Protocol

13

Task / Question Expected Reply / User Action (User think aloud when performing this)

Problems faced by the User

Comments by the Moderator

You downloaded Nimbuzz client and you do not have an username. Please create a Nimbuzz account in this phone.

- User opens Application and touches I am a new user

- Feeding the number is mandatory ?

- Can I skip this ?- How much time I have

to wait for an SMS ?- Can I use call me

Option now ?- Do I have to Use

numbers in the password ?

- Allowing Phone book upload is mandatory ?

* Sample test protocol. Usability test moderator will carry a print of this to the usability test lab (or wherever the usability test been executed) and use this as a key to request the user to perform various test actions. We shall have 10 – 15 tests during one usability session with a user – maximum duration 1 hour to 1.5 hours.

Page 14: Practical Usability Testing

Resource / Tools and Costs

14

For Hiring Resources, in Indian context, we shall pay 1K per user. Considering we hire 5 people for Phase 1, we spend 5K.

In International context, upto 100 USD / 100 EURO’s paid. Some times companies issue gift cards / gift vouchers / calling cards

Phase 1 Usability testing – 5 users : 5000 Rs (90 USD)One time purchase of tools (http://www.techsmith.com/morae.html) – Ex for Windows : 15,000 Rs (or 299 USD)

Heatmap tools : http://www.testing-web-sites.co.uk/2013/01/23/20-heatmap-tools-for-testing-your-websites-usability/

Page 15: Practical Usability Testing

Screener

To Inform the consultancy company or Human resources team to get

the right people

15

Page 16: Practical Usability Testing

PersonaPersonas

The purpose of personas is to create reliable and realistic representations of your key audience segments for reference. These representations should be based on qualitative and some quantitative user research and web analytics. Remember, your personas are only as good as the research behind them.

http://www.usability.gov/how-to-and-tools/methods/personas.html

16

Page 17: Practical Usability Testing

Participants

17

1. Engineers2. Non Engineers3. Government Employees4. Kids5. Students (College / School)6. Travelers7. Low / High economical backgrounds8. Plumbers, Doctors, Labors

Page 18: Practical Usability Testing

18

http://www.youtube.com/watch?v=9wQkLthhHKA

Page 19: Practical Usability Testing

19

Should user Cam to record user expressions and voice, separate cam for recording user actions (such as tapping on the product). If required we will procure some simple stands to keep the mobile / cam.

Page 20: Practical Usability Testing

20

Page 21: Practical Usability Testing

21

Page 22: Practical Usability Testing

22

Page 23: Practical Usability Testing

Website Heat map

23

Page 24: Practical Usability Testing

Mobile Heat map

24

Page 25: Practical Usability Testing

Paper Prototype

25

Page 26: Practical Usability Testing

Paper Prototype

26

Page 27: Practical Usability Testing

Presentation / Report Format

27

User (1 to n) Data will be presented with a video (of the user when performing action, video of the Device under test during the test, audio recoding when they “think aloud”.

Humm…Now I am trying to create an

account

Details: User is really comfortable in

downloading the app. But she faced trouble in receiving the pin and feeding

in. Please watch 2:35 min in the video.

-Sample-

Page 28: Practical Usability Testing

Overall Execution Path

28

Initial test plan created &

circulated to Product Leadership and management

Execution Plan and Test Protocol

Approved by Product

Leadership and Management

Resource cost + Tools cost

approved by management

Hiring resources, Scheduling & Lab setup completed

Test Execution & video editing / analysis report

created

Final Presentation to

Product Leadership* and

Management

Page 29: Practical Usability Testing

Links:

Documents / Info : http://www.usability.govEye Tracking : http://www.tobii.com/en/eye-tracking-research/global/research/Usability testing of a Fruit : http://www.youtube.com/watch?v=3Qg80qTfzgU7 Principles : http://www.youtube.com/watch?v=0oS-tvCUbBs10 AB testing tools : http://www.practicalecommerce.com/articles/4133-10-A-B-Testing-Tools-for-Small-Businesses

Remote Usability testing and UX Research Tools : http://remoteresear.ch/tools/PET : http://www.slideshare.net/QuiffBoy/pet-designing-for-persuasion-emotion-and-trust

http://www.nngroup.com/ and http://www.nngroup.com/books/designing-web-usability/ http://www.amazon.in/dp/0321344758/?tag=googinhydr2506-21 (DON’T make me think – steve krug)

29

Page 30: Practical Usability Testing

Thanks, time for QAConnect with me [email protected] if required..

Youtube Link of this Session : http://www.youtube.com/watch?v=XXNXNSrlZcs

Nimbuzz Chat ID : ravindran2454Get Nimbuzz Mobile Application for Android, iPhone, Windows Phone, PC,

Symbian, Java Phones from http://get.nimbuzz.com or www.nimbuzz.com

30