five repositories, one datasetfiles.archivists.org/researchform/2012/pdfs/custer... · 2012. 8....

52
Five Repositories, One Dataset USING EXPLORATORY DATA ANALYSIS TECHNIQUES TO TRACK PATTERNS OF USE

Upload: others

Post on 28-Aug-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature

Five Repositories,

One Dataset USING EXPLORATORY DATA ANALYSIS TECHNIQUES TO TRACK PATTERNS

OF USE

Page 2: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature

Mark Custer

Noah Huffman

Jennie Levine Knies

Kyle Rimkus

Sara Snyder

Page 3: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature

Outline of Today’s talk

1. Introduction: Exploratory and preliminary nature of the study

2. Overview of website / EAD-portal metrics for three years

3. The path to an aggregate data set and difficulties

4. Collection-level metrics: one year, in depth

5. Visits from Mobile devices over the years

6. Wikipedia referrals over the years

7. Conclusion: Next Steps

Page 4: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature

1: Introduction

Page 5: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature
Page 6: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature
Page 7: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature
Page 8: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature
Page 9: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature
Page 10: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature

2: Website Metrics, 2009-2011

Page 11: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature
Page 12: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature
Page 13: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature
Page 14: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature
Page 15: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature

3: The Path and its Difficulties

Page 16: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature
Page 17: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature
Page 18: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature

/collections/findingaids/downgall.htm%20and%20http:/www.aaa.si.edu/collectionsonline/downgall/overview.htm

/collections/oralhistories%20/tranSCRIPTs/levine02.htm

/search?q=cache:zqG_DxtU1AIJ:proust.library.miami.edu/findingaids/?p=collections/controlcard&id=480+orestes+miami&cd=13&hl=en&ct=clnk&gl=us

/translate_c?hl=ar&sl=en&u=http://proust.library.miami.edu/findingaids/%3Fp=collections/controlcard&id=247&prev=/search%3Fq=batista%2Bcollection&hl=ar&client=firefox-a&channel=s&rls=org.mozilla:ar:official&sa=N&rurl=translate.google.com.eg&usg=ALkJrhiuq78PNcimpnEph3V5gEnNNUZuNw

/search?q=cache:wkJ778Y-NEgJ:test.lib.umd.edu/archivesum/actions.DisplayEADDoc.do%3Fsource%3DMdU.ead.histms.0008.xml%26style%3Dead+historical+Davis+family+Texas&cd=6&hl=en&ct=clnk&gl=us

/digitalcollections/rbmscl/inv/results?q=testimonial+advertising&fq=duke.collection%3Ainv&start=0&rows=20&f=keyword&t=testimonial+advertising&btnG.x=0&btnG.y=0

/url_result?ctw_=sT,eCR-EJ,bT,hT,uaHR0cDovL3d3dy5saWIudW1kLmVkdS9hcmNoaXZlc3VtL2h0bWwvTWRVLmVhZC5saXRtcy4wMDA3Lmh0bWw=,qlang=ja|for=0|sp=-5|fs=100%|fb=0|fi=0|fc=FF0000|db=T|eid=CR-EJ,

/archivesum/actions.DisplayEADDoc.do?source=/MdU.ead.scpa.0078.test.xml&style=ead

Page 19: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature

/collections/findingaids/downgall.htm%20and%20http:/www.aaa.si.edu/collectionsonline/downgall/overview.htm

/collections/oralhistories%20/tranSCRIPTs/levine02.htm

/search?q=cache:zqG_DxtU1AIJ:proust.library.miami.edu/findingaids/?p=collections/controlcard&id=480+orestes+miami&cd=13&hl=en&ct=clnk&gl=us

/translate_c?hl=ar&sl=en&u=http://proust.library.miami.edu/findingaids/%3Fp=collections/controlcard&id=247&prev=/search%3Fq=batista%2Bcollection&hl=ar&client=firefox-a&channel=s&rls=org.mozilla:ar:official&sa=N&rurl=translate.google.com.eg&usg=ALkJrhiuq78PNcimpnEph3V5gEnNNUZuNw

/search?q=cache:wkJ778Y-NEgJ:test.lib.umd.edu/archivesum/actions.DisplayEADDoc.do%3Fsource%3DMdU.ead.histms.0008.xml%26style%3Dead+historical+Davis+family+Texas&cd=6&hl=en&ct=clnk&gl=us

/digitalcollections/rbmscl/inv/results?q=testimonial+advertising&fq=duke.collection%3Ainv&start=0&rows=20&f=keyword&t=testimonial+advertising&btnG.x=0&btnG.y=0

/url_result?ctw_=sT,eCR-EJ,bT,hT,uaHR0cDovL3d3dy5saWIudW1kLmVkdS9hcmNoaXZlc3VtL2h0bWwvTWRVLmVhZC5saXRtcy4wMDA3Lmh0bWw=,qlang=ja|for=0|sp=-5|fs=100%|fb=0|fi=0|fc=FF0000|db=T|eid=CR-EJ,

/archivesum/actions.DisplayEADDoc.do?source=/MdU.ead.scpa.0078.test.xml&style=ead

Page 20: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature

43422

15441 12421

3815

7325

1012

12472

71

601

1335

0

5000

10000

15000

20000

25000

30000

35000

40000

45000

50000

AAA Duke ECU Maryland Miami

Total Rows of Data Analyzed, 2009-2010

analyzed rows separated rows

Page 21: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature

4: Collection-level Data

Page 22: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature
Page 23: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature
Page 24: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature
Page 25: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature

0

100000

200000

300000

400000

500000

600000

700000

AAA Duke ECU Maryland Miami

PVs UPVs

Page 26: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature

0

100000

200000

300000

400000

500000

600000

700000

AAA Duke ECU Maryland Miami

PVs UPVs

Page 27: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature

AAA Duke ECU Maryland Miami

1st 87.27% 70.96% 71.57% 70.47% 65.93%

2nd 9.22% 16.71% 16.10% 16.28% 16.22%

3rd 2.51% 7.55% 7.26% 8.08% 10.61%

4th 0.76% 3.56% 3.56% 3.75% 5.24%

5th 0.24% 1.22% 1.51% 1.42% 2.00%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

The uneven distributions, as pictured in 5 sets of quintiles

Page 28: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature

AAA Duke ECU Maryland Miami

1st 87.27% 70.96% 71.57% 70.47% 65.93%

2nd 9.22% 16.71% 16.10% 16.28% 16.22%

3rd 2.51% 7.55% 7.26% 8.08% 10.61%

4th 0.76% 3.56% 3.56% 3.75% 5.24%

5th 0.24% 1.22% 1.51% 1.42% 2.00%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

The uneven distributions, as pictured in 5 sets of quintiles

Page 29: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature

21,945.59

9,494.46

4,103.40 3,702.08

882.39

EPVHS

EPVHs in 2009-2010

AAA Duke ECU Maryland Miami

Page 30: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature

0

5000

10000

15000

20000

25000

30000

35000

40000

0 200 400 600 800 1000 1200

AAA: EPVHs vs UPVs

Page 31: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature

0

1000

2000

3000

4000

5000

6000

0 50 100 150 200 250

Duke: EPVHs vs UPVs

Page 32: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature

0

200

400

600

800

1000

1200

1400

1600

1800

2000

0 20 40 60 80 100 120

ECU: EPVHs vs UPVs

Page 33: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature

0

500

1000

1500

2000

2500

3000

0 50 100 150 200 250

Maryland: EPVHs vs UPVs

Page 34: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature

0

100

200

300

400

500

600

700

800

0 5 10 15 20 25 30 35 40

Miami: EPVHs vs UPVs

Page 35: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature

0

5000

10000

15000

20000

25000

30000

35000

40000

0 200 400 600 800 1000 1200

All: EPHVs vs. UPVs

Page 36: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature

AAA Duke ECU Maryland Miami

1st 87.27% 70.96% 71.57% 70.47% 65.93%

2nd 9.22% 16.71% 16.10% 16.28% 16.22%

3rd 2.51% 7.55% 7.26% 8.08% 10.61%

4th 0.76% 3.56% 3.56% 3.75% 5.24%

5th 0.24% 1.22% 1.51% 1.42% 2.00%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

The uneven distributions, as pictured in 5 sets of quintiles

Page 37: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature

83.33%

10.50%

3.94% 1.66%

0.57% 0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

1ST 2ND 3RD 4TH 5TH

Page 38: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature

5: Mobile

Page 39: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature

Mobile Traffic to Duke Library Resources December 2009-April 2012

Page 40: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature

iPad

[PERCENTA

GE]

iPhone

[PERCENTA

GE]

Android

[PERCENTA

GE]

Other

[PERCENTA

GE]

CHART TITLE

Page 41: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature

Mobile Visit Behavior

Avg. Pages/Visit

• Mobile visits - 1.83

• All visits – 3.04

Avg. Time on Site

• Mobile visits - 1:07

• All visits - 2:31

From Google Analytics Data (July 1, 2011-June 30, 2012) from:

AAA, Duke University, East Carolina University, University of Maryland, and

University of Miami

Page 42: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature

Traffic Sources:

Mobile Visits vs. All Visits

Mobile Visits All Visits

From Google Analytics Data (July 1, 2011-June 30, 2012) from: AAA, Duke University, East Carolina University, University of Maryland, and University of Miami

Search Traffic 72%

Referral Traffic 15%

Direct Traffic 13%

Search Traffic

[PERCENTAGE]

Referral Traffic

[PERCENTAGE]

Direct Traffic [PERCENTAG

E]

Page 43: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature

All Visits – Top Referrers Mobile Visits – Top Referrers

Referring Sites:

Mobile Visits vs. All Visits

From Google Analytics Data (July 1, 2011-June 30, 2012) from: AAA, Duke University, East Carolina University, University of Maryland, and University of Miami

University Website

[PERCENTAGE]

Wikipedia [PERCENTAGE]

Facebook [PERCENTAGE]

Google Services [PERCENTAGE]

All Other [PERCENTAGE]

University Website

[PERCENTAGE]

Wikipedia [PERCENTAGE]

Facebook [PERCENTAGE]

Google Services 2%

All Other [PERCENTAGE]

Page 44: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature

6: Wikipedia

Page 45: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature

13.25%

11.98%

13.35%

11.00%

11.50%

12.00%

12.50%

13.00%

13.50%

2009 2010 2011

Page 46: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature

27.63%

16.27%

5.44%

13.50%

3.41%

23.05%

14.87%

5.51%

9.51%

6.94%

28.28%

14.23%

5.64%

11.22%

7.40%

AAA DUKE ECU MARYLAND MIAMI

Page 47: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature

37,018

38,483

41,031

35,000

36,000

37,000

38,000

39,000

40,000

41,000

42,000

2009 2010 2011

Page 48: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature

31,400

3,974

536 930 178

33,210

3,388

546 887 452

35,426

3,212

548 1,356 489

AAA DUKE ECU MARYLAND MIAMI

Page 49: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature

8: Conclusion Next Steps

How best to define a collection-level page? Should we?

Which metrics are most useful for archivists, researchers, etc.?

Beyond the collection, how can we analyze these data sets by

subject / topic?

How best to share this data?

How else can it be analyzed?

Page 50: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature

8: Conclusion Next Steps

How best to define a collection-level page? Should we?

Which metrics are most useful for archivists, researchers, etc.?

My hunch:

UPVs

EPVHs

Reading Room Hours

Reference Consultations

And?

Beyond the collection, how can we analyze these data sets by subject / topic?

How best to share this data?

How else can it be analyzed?

Page 51: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature
Page 52: Five Repositories, One Datasetfiles.archivists.org/researchform/2012/PDFS/Custer... · 2012. 8. 30. · Outline of Today’s talk 1. Introduction: Exploratory and preliminary nature

8: Conclusion Next Steps

How best to define a collection-level page? Should we?

Which metrics are most useful for archivists, researchers, etc.?

Beyond the collection group, how can we analyze these data sets

by subject / topic?

How best to share this data?

How else can it be analyzed?