usability testing of mobius catalog

Usability Testing of Usability Testing of MOBIUS CatalogMOBIUS Catalog

Caryn Scoville, MLSCaryn Scoville, MLSE. Diane Johnson, MLS, AHIPE. Diane Johnson, MLS, AHIP

Michael SpearsMichael Spears

J. Otto Lottes Health Sciences LibraryJ. Otto Lottes Health Sciences LibraryUniversity of MissouriUniversity of Missouri

Usability testing stepsUsability testing steps1.1. Review the primary goals of the web site or Review the primary goals of the web site or

application. application. 2.2. Design scenarios and tasks that Design scenarios and tasks that

correspond to site goals.correspond to site goals.3.3. Find appropriate users who are willing to Find appropriate users who are willing to

test the site (3-5 people are usually test the site (3-5 people are usually enough).enough).

4.4. Set up sessions and conduct tests Set up sessions and conduct tests 5.5. Rate problems in terms of severity and Rate problems in terms of severity and

frequency.frequency.6.6. Report back to stakeholders and designers Report back to stakeholders and designers

Review the primary goals of Review the primary goals of web site or applicationweb site or application

• Concentrate of book orderingConcentrate of book ordering– Look for a book in the MERLIN catalog.Look for a book in the MERLIN catalog.– Discover that a book is not available Discover that a book is not available

and proceed to MOBIUS.and proceed to MOBIUS.– Order the book.Order the book.

Design scenarios and tasks Design scenarios and tasks

““You want to read a book that you You want to read a book that you heard about. You go to the library heard about. You go to the library catalog to see if you can get it. catalog to see if you can get it.

Find the book Find the book The Rat That Ate The Rat That Ate PoodlesPoodles by Paul Buchanan.” by Paul Buchanan.”

Find usersFind users

• Sent mass email to Health Sciences Sent mass email to Health Sciences usersusers

• Offered $10 gift certificates to bookstoreOffered $10 gift certificates to bookstore

• 12 people responded, 7 users selected 12 people responded, 7 users selected (3 med students, 3 staff, 1 faculty)(3 med students, 3 staff, 1 faculty)

• 6 tests completed (1 staff user did not 6 tests completed (1 staff user did not show)show)

Conduct testsConduct tests

• 15 minutes allotted for MOBIUS testing15 minutes allotted for MOBIUS testing

• Camtasia Studio 3 used for audio and Camtasia Studio 3 used for audio and screen capturescreen capture– Cost: $299 for Camtasia 5, educational Cost: $299 for Camtasia 5, educational

discounts availablediscounts available– Can be used to make online tutorialsCan be used to make online tutorials– Just need a microphoneJust need a microphone– Morae software designed for more Morae software designed for more

sophisticated usability testingsophisticated usability testing

Task Task

““You want to read a book that you You want to read a book that you heard about. You go to the library heard about. You go to the library catalog to see if you can get it. catalog to see if you can get it.

Find the book Find the book The Rat That Ate The Rat That Ate PoodlesPoodles by Paul Buchanan.” by Paul Buchanan.”

About the taskAbout the task

• The Rat that Ate PoodlesThe Rat that Ate Poodles is not is not owned by MU Libraries or other owned by MU Libraries or other MERLIN librariesMERLIN libraries

• Users were started in MERLIN catalogUsers were started in MERLIN catalog

• Successful task completion= users Successful task completion= users search MERLIN and then proceed to search MERLIN and then proceed to MOBIUS when the book is not foundMOBIUS when the book is not found

ResultsResults

• So how did the users do?So how did the users do?– MERLIN search clipMERLIN search clip

•0 out of 6 users proceeded 0 out of 6 users proceeded to MOBIUS after searching to MOBIUS after searching MERLIN. MERLIN.

MOBIUS prompting questionMOBIUS prompting question

• ““Do you see any other way to find the Do you see any other way to find the book?”book?”

– MOBIUS prompt clipMOBIUS prompt clip

•3 out of 6 users proceeded 3 out of 6 users proceeded to MOBIUS after prompting to MOBIUS after prompting questionquestion

Requesting the bookRequesting the book

ClusterCluster

Cluster clipCluster clip

•5 out of 6 users selected 5 out of 6 users selected the correct cluster the correct cluster

IDID

ID clipID clip

•0 out of 6 got their ID right on 0 out of 6 got their ID right on the first trythe first try

•3 of 5 users were eventually 3 of 5 users were eventually successful after multiple successful after multiple attemptsattempts

Results summaryResults summary

• Users in MERLIN don’t know that Users in MERLIN don’t know that MOBIUS ordering is an option for MOBIUS ordering is an option for them.them.

• ““Cluster” is a confusing concept.Cluster” is a confusing concept.

• ID problem is huge. Single sign-on is ID problem is huge. Single sign-on is needed.needed.

Notes on usability testingNotes on usability testing

• You don’t need Camtasia to do a testYou don’t need Camtasia to do a test

• Users don’t read instructionsUsers don’t read instructions

• Seeing how your users use your Seeing how your users use your website is vitalwebsite is vital

““Their perception Their perception is your reality”is your reality”

ContactsContacts

• Caryn Scoville, Caryn Scoville, scovillec@health.missouri.eduscovillec@health.missouri.edu

• E. Diane Johnson, E. Diane Johnson, johnsone@health.missouri.edujohnsone@health.missouri.edu

• Michael Spears, Michael Spears, spearsm@health.missouri.eduspearsm@health.missouri.edu