assessment forum 2013 - columbia university libraries - 13_0620

23
Science & Engineering Libraries Observationa l Study 0/4 Jeffrey Lancaster, Emerging Technologies Coordinator [email protected] Slides at:

Upload: jeffreylancaster

Post on 15-Jan-2015

6.199 views

Category:

Technology


2 download

DESCRIPTION

This is a series of presentations for the CUL/IS Assessment Forum 2013 detailing work and tips on: an observational study, Lenel entry data analysis, KeyServer data analysis, and a skills assessment and training program.

TRANSCRIPT

Page 1: Assessment Forum 2013 - Columbia University Libraries - 13_0620

Science & Engineering Libraries

Observational Study

0/4

Jeffrey Lancaster, Emerging Technologies Coordinator

[email protected]

Slides at: slideshare.net/jeffreylancaster

Page 2: Assessment Forum 2013 - Columbia University Libraries - 13_0620

Observational Study 1/4

Goals• Better understand how

patrons occupy Science & Engineering Division spaces

• Gather information about patrons who bring their own technology

• How can we prepare for impending space crunches?

Page 3: Assessment Forum 2013 - Columbia University Libraries - 13_0620

Observational Study

Geology Library

Mathematics Library

Engineering Library

2/4

Instrument

Science & Engineering Library

Page 4: Assessment Forum 2013 - Columbia University Libraries - 13_0620

Observational Study 3/4

Execution• Maps of libraries drawn in

Adobe Illustrator• Seats• Soft seating• Printers & photocopiers

• Coding from Nisa + additions:

• LAs, supervisors, subject specialists carried out the observations

A: Reading/working on an academic assignmentAL: Using own productivity device for academic workAC: Using library computer as part of academic workALC: Using both a library computer and own device for academic workA(s): Doing academic work in a group

RC: Using library computer for non-academic activityRL: Using own device for non-academic activityR: Socializing, resting, relaxingR(s): Socializing, resting, relaxing in a groupX: Not engaged (getting ready to leave or settling in)Z: SleepingC: Camping (e.g. books, coat, etc., but nobody in sight)

Page 5: Assessment Forum 2013 - Columbia University Libraries - 13_0620

Observational Study 4/4

Outcome• Still working on it…

• With the closing of the Engineering Library in Summer 2014, we anticipate extended hours in the Science & Engineering Division libraries

• In new spaces, we will better accommodate patrons who bring their own technology

Page 6: Assessment Forum 2013 - Columbia University Libraries - 13_0620

Science & Engineering Libraries

Lenel Entry Data

0/5

Jeffrey Lancaster, Emerging Technologies Coordinator

[email protected]

Slides at: slideshare.net/jeffreylancaster

Page 7: Assessment Forum 2013 - Columbia University Libraries - 13_0620

Lenel Entry Data 1/5

How and Why?• Several libraries use student

‘swipe’ access• Business• Butler• Starr East Asian• Law• Lehman• Science & Engineering• Social Work

• Who are your patrons?

Page 8: Assessment Forum 2013 - Columbia University Libraries - 13_0620

Lenel Entry Data 2/5

This is Lenel DataL: Drive -

/LIO/LIO_For_All_CU_Library_Staff/Library Use Data/

Page 9: Assessment Forum 2013 - Columbia University Libraries - 13_0620

• It’s a PivotTable, so first open it on a PC

• We use DIV_MO worksheet• Information organized by division at

monthly intervals

• Best to group users by school, association• SEAS• CUMC• General Studies• Etc.

Lenel Entry Data 3/5

Tips

Page 10: Assessment Forum 2013 - Columbia University Libraries - 13_0620

Lenel Entry Data 4/5

Data Visualization

Page 11: Assessment Forum 2013 - Columbia University Libraries - 13_0620

Lenel Entry Data 5/5

Outcome• Preparing to close the

Engineering Library• Can develop new space options for

students

• Can justify asking for a percentage of student technology fees

• Can refute claims that certain populations ‘only use certain libraries’

Page 12: Assessment Forum 2013 - Columbia University Libraries - 13_0620

Science & Engineering Libraries

KeyServer Data

0/5

Jeffrey Lancaster, Emerging Technologies Coordinator

[email protected]

Slides at: slideshare.net/jeffreylancaster

Page 13: Assessment Forum 2013 - Columbia University Libraries - 13_0620

KeyServer Data 1/5

What is KeyServer?• Sassafras KeyServer tracks

the licenses for the Libraries’ software

• Information gathered by KeyServer includes:• Total and average number of times a

program is opened• Total and average duration of use• Longest use

• LITO has automated the collection and presentation of KeyServer information

Page 14: Assessment Forum 2013 - Columbia University Libraries - 13_0620

KeyServer Data 2/5

KeyServer Datahttps://www1.columbia.edu/sec/cu/libraries/inside/clio/statistics/digital_centers/digital_centers.html

Page 15: Assessment Forum 2013 - Columbia University Libraries - 13_0620

Unique Users by AffiliationTotal Use(scale is logarithmic) 3/5

Data Visualization

Page 16: Assessment Forum 2013 - Columbia University Libraries - 13_0620

KeyServer Data 4/5

Tips• Be aware of time

conversions• Times reported as hours : minutes :

seconds• Excel can do funny things with times –

will try to convert to date

• Need to deliberately calculate total minutes• = CONCATENATE(cell) will transform

time to days

• Mac and PC software is recorded separately• SUM over times in units of days

• Need to develop a baseline over time

Page 17: Assessment Forum 2013 - Columbia University Libraries - 13_0620

KeyServer Data 5/5

Outcome• Can optimize the number

and types of licenses we purchase

• Can develop training for high- and/or low-use software

• Currently no way to match a user’s identity (affiliation) to their software usage in a center• Too ‘Big Brother’?

Page 18: Assessment Forum 2013 - Columbia University Libraries - 13_0620

Science & Engineering Libraries

Skills Assessment

0/5

Jeffrey Lancaster, Emerging Technologies Coordinator

[email protected]

Slides at: slideshare.net/jeffreylancaster

Page 19: Assessment Forum 2013 - Columbia University Libraries - 13_0620

Skills Assessment 1/5

Goals• What is the base level of

knowledge subject specialists ought to possess about software?

• Develop a training program around software and new technologies

• Include software and new technologies as research tools in a reference interview

Page 20: Assessment Forum 2013 - Columbia University Libraries - 13_0620

Skills Assessment 2/5

InstrumentGoogle Docs survey asking: prior knowledge,

expertise, desire to learn

Page 21: Assessment Forum 2013 - Columbia University Libraries - 13_0620

Skills Assessment 3/5

Data Visualization

Page 22: Assessment Forum 2013 - Columbia University Libraries - 13_0620

Skills Assessment 4/5

Outcome• A staff training program that

included:• Software overview• Homework assignments• Software-specific presentations• Seminar-style tutorials

• We are continuing to develop new ‘modules’• Google apps• 3D printing

Page 23: Assessment Forum 2013 - Columbia University Libraries - 13_0620

Skills Assessment 5/5

Outcome“Overall, they were a great help to me in getting me to overcome my reluctance (and anxiety) about trying new software tools.”“A side effect to this assignment was the knowledge that with not a lot of effort I can familiarize myself pretty quickly with these applications enough so that I can suggest them to patrons who are looking for specific tools, or answer general questions about their use.”

“I realized how far my interests, skills, etc. are away from the ever-changing role of technology in libraries.”

“This effort had a lot to do with how much people trusted and liked you…”

“I learned from it what software to pick while helping patrons.”

“However I’m finding it challenging to keep up with the skills I have gained since I’m not using all of them on a regular basis.”

“We still lack the technical skills.”