tidsrdhoxss2012
DESCRIPTION
Presentation to the Digital.Humanities@Oxford Summer School 2012.http://digital.humanities.ox.ac.uk/dhoxss/TRANSCRIPT
![Page 1: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/1.jpg)
Eric T. Meyer & Kathryn EcclesOxford Internet Institute, University of Oxford
Digital Humanities@Oxford Summer School5th July 2012
Impact as a process: considering the reach of resources from the
start
@etmeyer#tidsr#dhoxss
Slides at: http://www.slideshare.net/etmeyer/tidsrdhoxss2012
![Page 2: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/2.jpg)
What is impact and why consider it?
What do we mean by impact?
•Reaching intended audience•Reaching new audiences•Attracting users•Attracting new usage•Enabling new research questions•Enabling new approaches to education
![Page 3: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/3.jpg)
Where to begin?
• Identify your audience and key stakeholders
• Set your goals. What types of impact do you envisage your resource having?
• What steps are you taking to ensure these types of impact?
• Identify connections
• What resources do you see as successful in terms of audience and impact?
• Do you see your resource as part of a network of connected resources?
![Page 4: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/4.jpg)
Digitisation and Impact
![Page 5: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/5.jpg)
Measuring usage and impact
What to measure?
• Users
• Types of use
• Awareness
• Citation practices
• Marketing strategies
• Embedding
![Page 6: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/6.jpg)
• JISC funded project
• July 2008-April 2009
• Looked at five specific JISC-funded resources
• Designed to test the TIDSR methods and review them for the TIDSR toolkit
TIDSR: The first usage and impact study
![Page 7: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/7.jpg)
Methods
Quantitative methods
• Webometrics
• Web Analytics
• Log file analysis
• Scientometrics / bibliometrics
• Content Analysis
Qualitative methods
• Interviews
• Focus groups
• User feedback
• Referrer analysis
• Content Analysis
![Page 8: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/8.jpg)
Project 1 – Online Historical Population Reports (OHPR/Histpop)
![Page 9: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/9.jpg)
Survey: Low Awareness
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
88%
63%
39%
63%69%
7%
27%
35%
28% 22%
3% 7%
18%
7% 7%2% 2%
7%1% 2%
Use it regularly or frequently
Use it on occasion
Have seen it, but don't use it
I haven't heard of it
![Page 10: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/10.jpg)
Survey: High Importance to Users
HistPop BOPCRIS BL News BL SoundsMed Backfiles0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
71%
51% 49%
36%
61%
29%
35% 34%
40%
33%
79%
69%72%
60%
76%
96%
84%
90%86%
82%
Important to my research
Important to my teaching
Important to field
Would recommend
![Page 11: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/11.jpg)
Log Files: Non UK Activity
![Page 12: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/12.jpg)
Log File Analysis
Top Search Phrases: Histpop
![Page 13: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/13.jpg)
Histpop: User Communities
Perception: Specific niche community Well known by target audience Transforming access and usage patterns
User surveys: Embedded in educational resources Enhanced access to primary sources
▪ ‘Histpop made it possible to do a completely different project’
Continuing education, online resources, non-traditional learners
![Page 14: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/14.jpg)
Project 2 – British Library 19th Century Newspapers
![Page 15: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/15.jpg)
Project 2 – British Library 19th Century Newspapers
![Page 16: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/16.jpg)
Citation Habits
HistPop
BOPCRIS
BL News
BL Sounds
Med Back-files
9%
36%
53%
38%
43%
55%
36%
38%
50%
48%
36%
21%
6%
13%
10%
0%
7%
2%
0%
0%
Original version Original + URL Online version Other
0%10%20%30%40%50%
46%
29%
35%
20%
43%
Have you ever published a piece based on your work in this collection?
If so, how did you cite the collection?
![Page 17: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/17.jpg)
Webometric results
• Highest numbers for original British Library resource (analogue)• 19th Century British Library Newspapers registers strong links for a project page• Note: Importance of comparator sites when using webometrics
![Page 18: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/18.jpg)
Blog Evidence
![Page 19: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/19.jpg)
Project 3 – British Library Archival Sound Recordings
![Page 20: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/20.jpg)
Interviews, Group Interviews, Focus Groups
Time intensive, but productive if you are careful about what you ask!
Different stakeholders: Project team: Positive view of the work
only Broader stakeholders: While the digital
project was good, it also introduced tensions in the broader setting of the library
New kinds of serendipity, wide range of users
![Page 21: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/21.jpg)
News
Engagement officer
![Page 22: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/22.jpg)
Project 4 – British Official Publications Collaborative Reader Information Service (BOPCRIS): 18th Century Official Parliamentary Publications Portal 1688-1834
![Page 23: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/23.jpg)
Project 4 – British Official Publications Collaborative Reader Information Service (BOPCRIS): 18th Century Official Parliamentary Publications Portal 1688-1834
![Page 24: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/24.jpg)
Webometrics
• Some resources are available through multiple outlets• Webometrics can capture comparative awareness• These results show how powerful known resources and/or publishers can be
![Page 25: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/25.jpg)
Project 5 – Wellcome Medical Journals: the backfiles project
![Page 26: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/26.jpg)
Project 5 – Wellcome Medical Journals: the backfiles project
![Page 27: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/27.jpg)
Webometrics
Wellcome Medical Journals Backfiles project page records strong links, links to Pub Med for WMJB material impossible to trace
![Page 28: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/28.jpg)
Knowing the Users
Historians? (would be looking at older articles) Not typical PubMed users Search interface issues / limited search
Clinicians? (would be looking at newer articles) Not typically reading 100 year old articles
Other users? Paths of discovery?
![Page 29: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/29.jpg)
New uses?
Majority of downloads targeted more recent material – opening up of new resources to clinicians
More thorough and comprehensive searches Historians reported more comprehensive
search results (quantitative results) Also reported increased browsing,
greater serendipity, due to time saved finding articles
![Page 30: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/30.jpg)
7%
12%
16%
17%
31%
34%
45%
47%
51%
54%
58%
62%
71%
77%
83%
13%
11%
9%
30%
18%
29%
32%
38%
27%
24%
32%
36%
56%
50%
48%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90%
Cornell Animal Sounds
Sciper
Histpop
Chronicling America
Fine Rolls
Wellcome Medical Journal Backfiles
Historical Directories
Internet Lib of Early Journals
BOPCRIS
Archival Sounds
Imperial War Museum
Old Bailey Online
British Periodicals
British Library Newspapers
House of Commons Parliamentary Papers
Non-UK Awareness
UK Awareness
Awareness of Resource by Country
![Page 31: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/31.jpg)
How did you find this resource?
0%5%
10%15%20%25%30%35%40%45%50%
HistPopBOPCRISBL NewsBL SoundsMed Back-files
![Page 32: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/32.jpg)
http://microsites.oii.ox.ac.uk/tidsr/
![Page 33: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/33.jpg)
Coming this autumn….
http://www.kdcs.kcl.ac.uk/innovation/impact.html
Project page: Impact of Digitised Resources
Simon Tanner’s blog post about the project
http://simon-tanner.blogspot.co.uk/2012/03/new-approach-to-measuring-impact-for.html
![Page 34: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/34.jpg)
![Page 35: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/35.jpg)
University of Oxford Podcasts
![Page 36: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/36.jpg)
Proceedings of the Old Bailey Online
![Page 37: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/37.jpg)
British History Online
![Page 38: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/38.jpg)
![Page 39: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/39.jpg)
Siobhan Davies RePlay
![Page 40: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/40.jpg)
http://www.rin.ac.uk/humanities-case-studies
Bulger, M., Meyer, E.T., de la Flor, G., Terras, M., Wyatt, S., Jirotka, M., Eccles, K., Madsen, C.
![Page 41: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/41.jpg)
The Case Studies
![Page 42: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/42.jpg)
Browsing and Searching
Libraries
Journals
Peers
79%66%
Google Scholar
59%
55%
62%
83%
48%
76%
95%
Visit the library
Browse library materials online
Search library materials online
Citation chaining
Browse printed journals
Browse online journals
Consult peers and experts
![Page 43: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/43.jpg)
Reconfiguring Resources
![Page 44: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/44.jpg)
“ Old Bailey Online hasn’t replaced anything for me or displaced anything for me, but it is part of this general transformation of how I do what I do.
![Page 45: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/45.jpg)
“The amount of time I now spend doing the very mechanical, laborious, time-consuming work is much smaller. You can now do things in 5 seconds which it took you 3 months to do a few years ago.
![Page 46: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/46.jpg)
Transformations in Use
![Page 47: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/47.jpg)
It’s a huge change. You can do things much more quickly, read much more widely, find connections…it’s very, very important. “
![Page 48: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/48.jpg)
With something like the Burney Collection, 5 years ago for writing an article I would need to review the newspapers, I would have gone into the British Library and done it on microfilm.
20 years ago, I would have gone into the British Library and done it with the actual paper in front of me. Now I sit at home and I do a keyword search.
“
![Page 49: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/49.jpg)
Asking new questions?“
![Page 50: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/50.jpg)
I’m not sure all of this raises the quality of anybody’s work. I think it would be quite daft to pretend that all of this makes us better scholars, or makes our books or papers of higher quality. I don’t know if that is true by any means, but it certainly makes it easier and I suppose makes the quantity of stuff that you can produce greater.
“
![Page 51: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/51.jpg)
What might take you several months if not years of research, you could do in hours, days, a week. So I think that means that it makes the nature of your research different because it allows you quantitative information much more quickly, which then allows you to maybe think about how you might use that information differently, because you’ve got so much more time.
“
![Page 52: tidsrdhoxss2012](https://reader038.vdocuments.us/reader038/viewer/2022103113/554c50e9b4c905452e8b47a7/html5/thumbnails/52.jpg)
Eric T. [email protected]
http://www.oii.ox.ac.uk/people/?id=120
Kathryn [email protected]
http://www.oii.ox.ac.uk/people/?id=138
Oxford e-Social Science Project
Project work funded by:
Slides at: http://www.slideshare.net/etmeyer/tidsrdhoxss2012