student's world: photo diary study

134
Student’s World: Photo Diary Study Computers in Libraries - April 16, 2007 Nicole Hennig Web Manager & Usability Specialist 1

Upload: nicole-hennig

Post on 27-Aug-2014

2.137 views

Category:

Education


2 download

DESCRIPTION

2006 ethnographic study of student information-seeking at MIT. http://www.hennigweb.com/presentations/cil2007/index.html

TRANSCRIPT

Page 1: Student's World: Photo Diary Study

Student’s World: Photo Diary Study

Computers in Libraries - April 16, 2007

Nicole HennigWeb Manager & Usability Specialist

1

Page 3: Student's World: Photo Diary Study

Outline

• why we did it

• methodology

• findings

• what we plan to do because of it

• further resources

3

Page 4: Student's World: Photo Diary Study

you hear all these theories:

“students are using google”

“they aren’t coming to libraries”

“they use wikipedia, instead of scholarly resources”

4

Page 5: Student's World: Photo Diary Study

We wanted to find out what our students REALLY do.

5

Page 6: Student's World: Photo Diary Study

So we studied their information-seeking habits in the context of real life.

6

Page 7: Student's World: Photo Diary Study

In the past we’ve done usability tests of our systems, one by one.

7

Page 8: Student's World: Photo Diary Study

8

Page 9: Student's World: Photo Diary Study

But that only tells us how each system works or doesn’t work for them, once they’ve found it and are using it.

9

Page 10: Student's World: Photo Diary Study

usability testing is good for: fixing an existing system

contextual research is good for:deciding what to build

10

Page 11: Student's World: Photo Diary Study

So we turn to...anthropology

11

Page 12: Student's World: Photo Diary Study

Thanks, University of Rochester!

An anthropologist on staff

12

Page 13: Student's World: Photo Diary Study

If you can’t follow the users around all day in their environment, instead you can give them a “cultural probe.”

13

Page 14: Student's World: Photo Diary Study

14

Page 15: Student's World: Photo Diary Study

We called it the “photo/diary study.”

15

Page 16: Student's World: Photo Diary Study

students volunteered to track their information-seeking behavior

for one week

16

Page 17: Student's World: Photo Diary Study

in-depth interviews

17

Page 18: Student's World: Photo Diary Study

16 undergrads + 16 grad students

18

Page 19: Student's World: Photo Diary Study

19

Page 20: Student's World: Photo Diary Study

20

Page 21: Student's World: Photo Diary Study

21

Page 22: Student's World: Photo Diary Study

22

Page 23: Student's World: Photo Diary Study

students from:

1 art & architecture14 engineering 6 science 5 school of humanities & social sciences 3 management 3 undecided

(roughly like the population at MIT)

23

Page 24: Student's World: Photo Diary Study

Their photos, screen shots, and a diary of what they didhelped them tell us the story.

24

Page 25: Student's World: Photo Diary Study

the interviews

25

Page 26: Student's World: Photo Diary Study

a total of 8 librariansteams of 2 people

- one to conduct the interview- one to take notes

26

Page 27: Student's World: Photo Diary Study

warm up questions

1. what department are you in?

2. how long have you been at MIT?

3. about how many times a month do you use the libraries in person?

4. about how many times a month do you use our electronic resources?

5. about how many times a month do you search for information NOT using the MIT libraries?

27

Page 28: Student's World: Photo Diary Study

they tell the story of their week

(about an hour)

use the photos and diary to jog their memories

28

Page 29: Student's World: Photo Diary Study

questions we used to guide the interviews

what were you looking for?where were you doing your research?

when were you doing this?what strategies did you use?

what sources did you use?how did you learn about these sources?

29

Page 30: Student's World: Photo Diary Study

questions we used to guide the interviews

what devices did you use?what worked?

what problems did you have?how often do you usually do this task?

30

Page 31: Student's World: Photo Diary Study

we repeated back what we heard along the way:

“let me get this right, you’re saying that....”

“so in other words you did x?”

31

Page 32: Student's World: Photo Diary Study

Understanding Your Users: A Practical Guide to User Requirements Methods, Tools, and Techniques

Catherine Courage & Kathy Baxter

useful book for interviewing techniques:

32

Page 33: Student's World: Photo Diary Study

results

33

Page 34: Student's World: Photo Diary Study

Everyone was busyand sleep-deprived.

Especially undergrads.

Students rarely asked for help.

34

Page 35: Student's World: Photo Diary Study

goals, tasks, methods

35

Page 36: Student's World: Photo Diary Study

we used cards to write down each method used for each task they were working on

36

Page 37: Student's World: Photo Diary Study

we wanted to understand their goalsso that we could find ways to help them meet those goals

37

Page 38: Student's World: Photo Diary Study

grad student goals

- research & thesis 64%- conference presentations & publishing 14%- current awareness 9%

- helping the lab function- networking- job search

38

Page 39: Student's World: Photo Diary Study

undergrad student goals

- complete their course work 75%- research 7%- current awareness 7%

- participate in MIT clubs & social activities

39

Page 40: Student's World: Photo Diary Study

tasks - most frequent

- search for a known item

- search for information on a topic

- find facts

- search for a partially known item (don’t have complete citation)

- take notes & organize information

40

Page 41: Student's World: Photo Diary Study

tasks - most frequent

- complete class assignment

- check web sites or email or RSS feeds for current awareness

- study for a class

- learn about a software program

- do course readings

41

Page 42: Student's World: Photo Diary Study

methods - most frequent

- search Google- go directly to a known URL- use the library catalog to browse or search- search our licensed citation databases- use course web sites- review class notes- search our finding tool for e-resources (Vera)

42

Page 43: Student's World: Photo Diary Study

methods - most frequent

- read textbooks- consult with other students- consult with faculty or guest lecturers- search Google Scholar- search our licensed full text databases- physically browse a collection in the library- refer to books in their personal library- use Wikipedia

43

Page 44: Student's World: Photo Diary Study

none of that is surprising.

so we asked ourselves...

44

Page 45: Student's World: Photo Diary Study

- were they successful from their own points of view?

- were they efficient and effective from our point of view as librarians?

45

Page 46: Student's World: Photo Diary Study

- were they successful from their own points of view?

grads: yes, for 86% of their tasksundergrads: yes 93%

(we always asked: did you find what you were looking for?)

46

Page 47: Student's World: Photo Diary Study

- were they efficient and effective from our point of view as librarians?

grads: yes for 77% of their tasksundergrads: yes 85%

(we subjectively rated each task)

47

Page 48: Student's World: Photo Diary Study

For all tasks

successful(in their own view)

efficient (in our view)

grads 86% 77%

undergrads 93% 85%

percentage of tasks done during the week of the study

48

Page 49: Student's World: Photo Diary Study

- you might say... well librarians will always think of better ways

but...

49

Page 50: Student's World: Photo Diary Study

- we also broke it down by type of task and that’s where we saw a big difference

50

Page 51: Student's World: Photo Diary Study

Searching for information on a topic

successful(in their own view)

efficient (in our view)

grads 80% 40%

undergrads 82% 64%

percentage of tasks done during the week of the study

51

Page 52: Student's World: Photo Diary Study

Searching for information on a topic

This is an area where we can help.

52

Page 53: Student's World: Photo Diary Study

They had a tendency to start with sources they were familiar with.

53

Page 54: Student's World: Photo Diary Study

54

Page 55: Student's World: Photo Diary Study

and with sources recommended by a trusted network of people.

55

Page 56: Student's World: Photo Diary Study

family

friends

colleagues

advisors

roommates

56

Page 57: Student's World: Photo Diary Study

not librarians

57

Page 58: Student's World: Photo Diary Study

also common:

- figuring it out themselves

58

Page 59: Student's World: Photo Diary Study

that’s the culture at MIT

59

Page 60: Student's World: Photo Diary Study

This is another area where we can help.

Help them make connectionsInclude our expert librarians in those connections.

60

Page 61: Student's World: Photo Diary Study

They used a wide variety of sources.

61

Page 62: Student's World: Photo Diary Study

Google e-books

textbooks

MIT Open Courseware

Amazon

Google Scholar

Google Print

Google maps

62

Page 63: Student's World: Photo Diary Study

Google

library databases

e-books

textbooks

MIT Open Courseware

social science data setsAmazon

Google Scholar

Google Print

Google maps

web sites of other universities

personal libraries

63

Page 64: Student's World: Photo Diary Study

Google

library databases

e-books

textbooks

old course notes

MIT Open Courseware

lab notebooks

social science data setsAmazon

Google Scholar

Google Print

Google maps

personal contacts (people)

web sites of other universities

personal libraries

64

Page 65: Student's World: Photo Diary Study

usually began with Google.

65

Page 66: Student's World: Photo Diary Study

Almost everyone had a few favorite resources.

66

Page 67: Student's World: Photo Diary Study

They tended to reuse their favorites, rather than try new ones.

67

Page 68: Student's World: Photo Diary Study

Many students did their TOPICAL discovery in non-library sources.

68

Page 69: Student's World: Photo Diary Study

then came to the library to look up the items they found.

69

Page 70: Student's World: Photo Diary Study

Looking up known items in our systemsusually worked well.

70

Page 71: Student's World: Photo Diary Study

71

Page 72: Student's World: Photo Diary Study

Undergrads mainly looked for information related to courses they were taking.

72

Page 73: Student's World: Photo Diary Study

Often a few good sources were enough.

73

Page 74: Student's World: Photo Diary Study

In those cases, people get what’s convenient to get.

74

Page 75: Student's World: Photo Diary Study

Graduate studentslooked for information related to their research.

75

Page 76: Student's World: Photo Diary Study

- more difficult and time-consuming.

- highly-specific topics.

- needed more depth and comprehensiveness.

76

Page 77: Student's World: Photo Diary Study

1. trouble with knowing where to look

2. trouble with effectively searching the sources they used

77

Page 78: Student's World: Photo Diary Study

They spent a large amount of time with varying degrees of success.

78

Page 79: Student's World: Photo Diary Study

Sometimes used “brute force” methods.

VERY time consuming

79

Page 80: Student's World: Photo Diary Study

from our point of view as librarians

“if they had only known about X!”

(fill in the blank)

80

Page 81: Student's World: Photo Diary Study

from their point of view:

They often thought that’s how it had to be.

81

Page 82: Student's World: Photo Diary Study

Another area where we can help.

82

Page 83: Student's World: Photo Diary Study

Also:

They used a wide variety of methodsfor “personal info management.”

i.e., organizing what they found

83

Page 84: Student's World: Photo Diary Study

They spend a lot of timedoing this (in creative ways).

84

Page 85: Student's World: Photo Diary Study

Most students are suffering from information overload.

85

Page 86: Student's World: Photo Diary Study

Refworks, Endnote, Zotero,CiteULike, Connotea....

a big interest in this area.

86

Page 87: Student's World: Photo Diary Study

By the way:

We conducted a large library survey this past year with a very high response rate.

87

Page 88: Student's World: Photo Diary Study

users want us to simplify search,felt there were

too many starting points

88

Page 89: Student's World: Photo Diary Study

Too many starting points

89

Page 90: Student's World: Photo Diary Study

Too many starting points

90

Page 91: Student's World: Photo Diary Study

Too many starting points

91

Page 92: Student's World: Photo Diary Study

Too many starting points

92

Page 93: Student's World: Photo Diary Study

Another finding:

They are not aware of many of the services we provide beyond the obvious ones.

93

Page 94: Student's World: Photo Diary Study

A picture of their culture

- sleep deprived- stressed, in a hurry- do it yourself- focused on getting course work done or doing research- current awareness important- relying on trusted network of friends and colleagues

94

Page 95: Student's World: Photo Diary Study

- not asking for help- not knowing about all our services- not knowing about all our research databases- using “brute force” methods- struggling with organizing the info they have already found- need to share the info with colleagues

A picture of their culture

95

Page 96: Student's World: Photo Diary Study

so what are we going to do?

96

Page 97: Student's World: Photo Diary Study

Priorities• Make topical discovery easier and more

effective.

• Incorporate community & trust features in our systems.

• Embed ourselves & our systems where users are.

• Build our expertise into the systems, create systems that you learn from by using.

97

Page 98: Student's World: Photo Diary Study

Faceted browsing improves discovery

98

Page 99: Student's World: Photo Diary Study

We’re looking at different solutions for a new catalog interface using faceted browsing:

- Endeca- Siderean

- Univ. of Rochester XC- build our own using Solr & Lucene

- Worldcat Local

99

Page 100: Student's World: Photo Diary Study

Not just our catalog, but also to include:

- DSpace repository- Image collections

- Future archival collections- Pages from our web site

all with different types of metadata:MARC, Dublin Core, VRA, etc.

100

Page 101: Student's World: Photo Diary Study

federated search of licensed e-content

aggregated search of our local content with faceted

browsing

catalog DSpace repository

image collections

archives

nearly 500 research databases

101

Page 102: Student's World: Photo Diary Study

And we’re building a better way for students to discover our research databases

(almost 500 of them), using federated searching.

(to be released next fall)

102

Page 103: Student's World: Photo Diary Study

community and trust features

103

Page 104: Student's World: Photo Diary Study

So many community features available now:

- Social bookmarking- Tagging- Comments- Reviews- Rating- Popularity rankings (circ stats and e-resource usage stats)

104

Page 105: Student's World: Photo Diary Study

We want more of these features in our systems

105

Page 106: Student's World: Photo Diary Study

We’d like a system where the MIT community can contribute

reviews

106

Page 107: Student's World: Photo Diary Study

We’d like a multi-university tagging sytem.

(PennTags.. across academia).

107

Page 108: Student's World: Photo Diary Study

putting ourselves where users are

108

Page 109: Student's World: Photo Diary Study

Where are the users?

- Google- Google Scholar- Google Print- Wikipedia- Amazon- iTunes- Facebook- Stellar (course management system at MIT)- MIT departmental web sites- faculty web sites at other institutions

109

Page 110: Student's World: Photo Diary Study

We are already embedded in Google Scholar.

110

Page 111: Student's World: Photo Diary Study

111

Page 112: Student's World: Photo Diary Study

112

Page 113: Student's World: Photo Diary Study

Browser extensions

• LibX - Firefox extensionlibraries.mit.edu/libx

113

Page 114: Student's World: Photo Diary Study

114

Page 115: Student's World: Photo Diary Study

LibXadds our search to the browser toolbar

115

Page 116: Student's World: Photo Diary Study

Puts links to the libraries where the users are:

- such as Amazon, Barnes & Noble, Powell’s- New York Times book reviews- Google- and more.

116

Page 117: Student's World: Photo Diary Study

Links from Amazon to our catalog

cue

117

Page 118: Student's World: Photo Diary Study

Links from Amazon to our catalog

118

Page 119: Student's World: Photo Diary Study

LibX

links ISBNs to our catalog

Without LibX, the ISBN is not a link.

119

Page 120: Student's World: Photo Diary Study

LibX

right-click sends selected text on a page

toGoogle Scholar

and more

120

Page 121: Student's World: Photo Diary Study

libx.org

121

Page 122: Student's World: Photo Diary Study

Other ways to put ourselves where they are

- our news blog (Wordpress)

- RSS feeds for the blog and for new titles in our catalog

- podcasts in iTunes

- “insideMIT” portal under development, build library widgets for that

- work on extending library systems inside course management systems

122

Page 123: Student's World: Photo Diary Study

We now have a “betas” page

... similar to Google Labs

123

Page 124: Student's World: Photo Diary Study

libraries.mit.edu/betas

124

Page 125: Student's World: Photo Diary Study

labs.google.com

125

Page 126: Student's World: Photo Diary Study

126

Page 127: Student's World: Photo Diary Study

127

Page 128: Student's World: Photo Diary Study

Successful systems extend the users’ work practice.

- Karen Holzblatt

128

Page 129: Student's World: Photo Diary Study

Design works best when it models user behavior.

-Joshua Porter

129

Page 130: Student's World: Photo Diary Study

We should look for ways to understand andextend the practice of our users.

130

Page 131: Student's World: Photo Diary Study

Understanding your users: a practical guide to user requirements methods, tools, and techniques. Morgan Kaufmann, 2004.Catherine Courage and Kathy Baxter.http://www.amazon.com/Understanding-Your-Users-Requirements-Technologies/dp/1558609350/

Contextual design: a customer-centered approach to systems designs. Morgan Kaufmann, 1997.Hugh Beyer and Karen Holtzblatt.http://www.amazon.com/Contextual-Design-Customer-Centered-Interactive-Technologies/dp/1558604111

Useful resources

131

Page 133: Student's World: Photo Diary Study

questions?

133

Page 134: Student's World: Photo Diary Study

Rethinking how we provide bibliographic services for the University of California. Bibliographic Services Task Force. December 2005.http://libraries.universityofcalifornia.edu/sopag/BSTF/Final.pdf

Perceptions of Libraries and Information Resources. OCLC Reports, 2005.http://www.oclc.org/reports/2005perceptions.htm

The Changing Nature of the Catalog and Its Integration with Other Discovery. Library of Congress, 17 March 2006.http://www.loc.gov/catdir/calhoun-report-final.pdf

Key reports with similar findings & recommendations to ours

134