usability testing of mobius catalog
DESCRIPTION
Presentation for MOBIUS Conference in Lake of the Ozarks, MO on June 4,2008.TRANSCRIPT
Usability Testing of Usability Testing of MOBIUS CatalogMOBIUS Catalog
Caryn Scoville, MLSCaryn Scoville, MLSE. Diane Johnson, MLS, AHIPE. Diane Johnson, MLS, AHIP
Michael SpearsMichael Spears
J. Otto Lottes Health Sciences LibraryJ. Otto Lottes Health Sciences LibraryUniversity of MissouriUniversity of Missouri
Usability testing stepsUsability testing steps1.1. Review the primary goals of the web site or Review the primary goals of the web site or
application. application. 2.2. Design scenarios and tasks that Design scenarios and tasks that
correspond to site goals.correspond to site goals.3.3. Find appropriate users who are willing to Find appropriate users who are willing to
test the site (3-5 people are usually test the site (3-5 people are usually enough).enough).
4.4. Set up sessions and conduct tests Set up sessions and conduct tests 5.5. Rate problems in terms of severity and Rate problems in terms of severity and
frequency.frequency.6.6. Report back to stakeholders and designers Report back to stakeholders and designers
Review the primary goals of Review the primary goals of web site or applicationweb site or application
• Concentrate of book orderingConcentrate of book ordering– Look for a book in the MERLIN catalog.Look for a book in the MERLIN catalog.– Discover that a book is not available Discover that a book is not available
and proceed to MOBIUS.and proceed to MOBIUS.– Order the book.Order the book.
Design scenarios and tasks Design scenarios and tasks
““You want to read a book that you You want to read a book that you heard about. You go to the library heard about. You go to the library catalog to see if you can get it. catalog to see if you can get it.
Find the book Find the book The Rat That Ate The Rat That Ate PoodlesPoodles by Paul Buchanan.” by Paul Buchanan.”
Find usersFind users
• Sent mass email to Health Sciences Sent mass email to Health Sciences usersusers
• Offered $10 gift certificates to bookstoreOffered $10 gift certificates to bookstore
• 12 people responded, 7 users selected 12 people responded, 7 users selected (3 med students, 3 staff, 1 faculty)(3 med students, 3 staff, 1 faculty)
• 6 tests completed (1 staff user did not 6 tests completed (1 staff user did not show)show)
Conduct testsConduct tests
• 15 minutes allotted for MOBIUS testing15 minutes allotted for MOBIUS testing
• Camtasia Studio 3 used for audio and Camtasia Studio 3 used for audio and screen capturescreen capture– Cost: $299 for Camtasia 5, educational Cost: $299 for Camtasia 5, educational
discounts availablediscounts available– Can be used to make online tutorialsCan be used to make online tutorials– Just need a microphoneJust need a microphone– Morae software designed for more Morae software designed for more
sophisticated usability testingsophisticated usability testing
Task Task
““You want to read a book that you You want to read a book that you heard about. You go to the library heard about. You go to the library catalog to see if you can get it. catalog to see if you can get it.
Find the book Find the book The Rat That Ate The Rat That Ate PoodlesPoodles by Paul Buchanan.” by Paul Buchanan.”
About the taskAbout the task
• The Rat that Ate PoodlesThe Rat that Ate Poodles is not is not owned by MU Libraries or other owned by MU Libraries or other MERLIN librariesMERLIN libraries
• Users were started in MERLIN catalogUsers were started in MERLIN catalog
• Successful task completion= users Successful task completion= users search MERLIN and then proceed to search MERLIN and then proceed to MOBIUS when the book is not foundMOBIUS when the book is not found
ResultsResults
• So how did the users do?So how did the users do?– MERLIN search clipMERLIN search clip
•0 out of 6 users proceeded 0 out of 6 users proceeded to MOBIUS after searching to MOBIUS after searching MERLIN. MERLIN.
MOBIUS prompting questionMOBIUS prompting question
• ““Do you see any other way to find the Do you see any other way to find the book?”book?”
– MOBIUS prompt clipMOBIUS prompt clip
•3 out of 6 users proceeded 3 out of 6 users proceeded to MOBIUS after prompting to MOBIUS after prompting questionquestion
Requesting the bookRequesting the book
ClusterCluster
Cluster clipCluster clip
•5 out of 6 users selected 5 out of 6 users selected the correct cluster the correct cluster
IDID
ID clipID clip
•0 out of 6 got their ID right on 0 out of 6 got their ID right on the first trythe first try
•3 of 5 users were eventually 3 of 5 users were eventually successful after multiple successful after multiple attemptsattempts
Results summaryResults summary
• Users in MERLIN don’t know that Users in MERLIN don’t know that MOBIUS ordering is an option for MOBIUS ordering is an option for them.them.
• ““Cluster” is a confusing concept.Cluster” is a confusing concept.
• ID problem is huge. Single sign-on is ID problem is huge. Single sign-on is needed.needed.
Notes on usability testingNotes on usability testing
• You don’t need Camtasia to do a testYou don’t need Camtasia to do a test
• Users don’t read instructionsUsers don’t read instructions
• Seeing how your users use your Seeing how your users use your website is vitalwebsite is vital
““Their perception Their perception is your reality”is your reality”
ContactsContacts
• Caryn Scoville, Caryn Scoville, [email protected]@health.missouri.edu
• E. Diane Johnson, E. Diane Johnson, [email protected]@health.missouri.edu
• Michael Spears, Michael Spears, [email protected]@health.missouri.edu