ncsu libraries: rapid user testing with prototypes

NCSU Libraries Rapid user testing with prototypesTRLN Annual Meeting – July 2010

Susan Teague Rector & Angie Ballard

1

What we tested

Do users navigate using the expected menu items?

Do users pre-select tabs in a tabbed search box before entering search terms?

How do users interact with tabbed or non-tabbed search results?

2

Methodology

Users were asked to complete 4 of 15 tasks using a working prototype of navigation menus only.

Each task required the user to open a navigation menu and indicate which menu item they would select to look for the specified information.

Facilitators recorded up to 4 of each user’s menu selections, in order of selection.

Navigation Testing Search Box Testing

3

Each participant completed 2 tasks using one of the 2 search models; many participants volunteered to answer more than 2 questions.

Facilitators documented tab the participant initially

selected search term(s) used path taken to complete the task, whether the participant used the

default ‘All’ tab only, silos only or both.

A facilitator assessment of task difficulty was recorded for both tests

Users were recruited in situ in the library lobby

Test Setup

4

Used candy bars as incentives

2 laptops with browsers open to prototype

Cycled through 15 tasks; 2-4 tasks per user in five minute sessions

D. H. Hill Lobby

Response Rate

Total of 32 participants in 2 hours

24 Undergraduates 3 Graduates 2 Staff 1 Visitor 2 Library Staff Members

Total of 28 participants in 4 hours

22 Undergraduates 3 Graduates 2 Library Staff Members 1 Non-Traditional

Student

Navigation Testing Search Box Testing

5

Take Aways

Rapid testing:

Yields more feedback in less time. Best for testing specific features. Tests should last no more than 5 minutes. Saves resources for recruiting, scheduling,

logistics, testing, and compensation. Does not save research planning & analysis

time.

6

Take Aways

Informal test environment may mean more realistic user interactions with product.

Results are somewhat skewed toward users who use the physical space.

Should be balanced with results from other types of testing.

Helps uncover areas for further testing.

7

Results & full presentation

http://news.lib.ncsu.edu/redesign/2010/04/22/usability-testing/

8

Thank you!

Questions?

susan_teague_rector@ncsu.eduangie_ballard@ncsu.edu

9