“I’m sorry, but we didn’t know we wanted to know that!”
Building Frameworks of Organizational Intelligence
Joe Zucca Director for Planning and Communication University of Pennsylvania Libraries
NISO Usage Data ForumNovember 1-2, 2007Dallas, TX
Home, May 2006
Building Frameworks of Organizational Intelligence
New Library Home Page: The “Hindrance” Effect
Building Frameworks of Organizational Intelligence
Use of Electronic Resources, Spring 2005 and 2006 Comparison [local not vendor counts]
1 2 3 4 5 6 7 8 9 10 11 12 13 15 16 17 25 37 41 58 79 166 Total (row)
Bookmark old home 7 2 7 1 1 181 34 5 36 9 8 5 5 6 2 1 1 1 2 1 1 1172 3 5 4 2 1 1 163 5 2 2 2 1 1 134 4 1 1 1 1 85 2 1 36 1 1 1 37 1 1 28 2 2
16 1 122 1 126 1 1
Total (column) 7 36 15 46 19 10 10 7 11 3 2 4 4 3 1 1 1 1 1 1 1 1 185
12,827 sessions logged (this 24-hour snap shoot, minus ‘bots)
185 (1.4%) sessions opted for old home
20 sessions opting for old home involved Safari
135 old home sessions (1.1% of total) -- bookmarks or first clicks on new home: no tolerance
No. of clicks before visitor left new for old home
Total clicks logged
New Library Home Page: User Intolerance
Building Frameworks of Organizational Intelligence
What are the properties of these structures?
How versatile are they?
Are we able to adapt or repurpose them to facilitate
measurement?
What resources (tools, dollars, staff) are required to harvest, transform, and manage the data that now live all around us?
Data live all around us in structures.
Building Frameworks of Organizational Intelligence
Information Loop
Data Farm Environment
Clean | Anonymize Normalize
Data Streams
Integrate Inform
Report Builder
Dashboard
Data Bureau
Service Environment
Catalog
Funds
Circulation
ERED
DYNIX BorrowDirect
SFX | ERM?
WEBApacheezproxy
People and Network Data
Ref|Instruct
Working with data structures
Building Frameworks of Organizational Intelligence
E-Resource Use Reference ContactCirculation
Acquisitions Funds
Holdings
Copier | Printer Use
Gate Swipes
Resolve Resource
Resolve People
Resolve Places
Web Analytics
Image Collection Use
Data Farm Oracle Space-Overview
18+ gb, in 139 tables, for collecting and disseminating management info
Staff Census
LDAP
Tech Processing Workflow
Digital Library
Voyager-Supported Services
Building Use
Resolution Services
Administration
Reference & Instruction (dynamic)
Building Frameworks of Organizational Intelligence
Consortia ILL/DocDel
70-Member ILL Coop.
Interacting with data: dashboard pages
Building Frameworks of Organizational Intelligence
Building Frameworks of Organizational Intelligence
Interacting with data: report builders
DATA FARM
Submit for asynchronous
processingand delivery
Scheduled reports
Research[rmediated]
[e.g., record consultations,request ID resolution using the library intranet]
Building Frameworks of Organizational Intelligence
Interacting with data: “data bureau”
Auto-survey
Sample Data Structure I - Voyager
Invoice_line_item
invoice_status
purchase_order
line_item
invoice_line_item_funds
fund
invoice
vendor
bib_master
bib_text
Building Frameworks of Organizational Intelligence
Sample Data Structure II - Data Farm Table
Building Frameworks of Organizational Intelligence
Sample Data Structure III – Data Farm Funds Report
Building Frameworks of Organizational Intelligence
“…but we didn’t know we wanted to know that!”
Building Frameworks of Organizational Intelligence
Slide of report by fund and publisher (casalini) deleted
Data Farm: Operational Parameters
Raw Data In | Minimally Processed Data Out
Modules to Normalize, Resolve, Anonymize, and Format Data
Self-Executing—Dashboards, Cron’d Processes
Mediated Services: Report Builders, Resolvers, Research
Synchronous & Asynchronous Processing
Backup and Security
Data Harvest, Retention, and Storage Policies
Building Frameworks of Organizational Intelligence
Data Farm: Example Applications
Reference & instruction measures: • assess “market penetration”,• track changes in the modality and focus of service• account for liaison activities in annual reviews
Web page analytics: navigation, use frequencies, browser functionality, search functionality
Fund tracking and collection metrics, current and historical, for:• annual budget allocation, • stacks management,• storage decisions
E-resource tracking: monitor customer interest, use analysis
ILL consortial traffic: facilitate local collection analysis
Proxy log analysis, current study of interdisciplinary research behavior
Building Frameworks of Organizational Intelligence
A different take on a management information framework
Building Frameworks of Organizational Intelligence
xxx.xx.xxx.xxx|-|zucca|[26/Jul/2007:15:41:01 -0500]| GET https://proxy.library.upenn.edu:443/login?proxySessionID=10335905&url= http://www.csa.com/htbin/dbrng.cgi?username=upenn3&access=upenn34&cat=psycinfo&adv=1 HTTP/1.1| 302|0|http://www.library.upenn.edu/cgi-bin/res/sr.cgi?community=59| Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/418.9.1 (KHTML, like Gecko) Safari/419.3| NGpmb6dT6JXswQH|__utmc=94565761; ezproxy=NGpmb6dT6JXswQH; hp=/; proxySessionID=10335514; __utmc=247612227; __utmz=247612227.1184251774.1.1.utmccn=(direct)| utmcsr=(direct)|utmcmd=(none); UPennLibrary=AAAAAUaWP5oAACa4AwOOAg==; sfx_session_id=s6A37A3E0-3B8E-11DC-80E9-85076F88F67F
Sample Data Structure: EZ-Proxy Log
Building Frameworks of Organizational Intelligence
xxx.xx.xxx.xxx |-|zucca|[26/Jul/2007:15:41:01 -0500]| GET https://proxy.library.upenn.edu:443/login?proxySessionID=10335905&url= http://www.csa.com/htbin/dbrng.cgi?username=upenn3&access=upenn34&cat=psycinfo&adv=1 HTTP/1.1| 302|0|http://www.library.upenn.edu/cgi-bin/res/sr.cgi?community=59| Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/418.9.1 (KHTML, like Gecko) Safari/419.3| NGpmb6dT6JXswQH|__utmc=94565761; ezproxy=NGpmb6dT6JXswQH; hp=/; proxySessionID=10335514; __utmc=247612227; __utmz=247612227.1184251774.1.1.utmccn=(direct)| utmcsr=(direct)|utmcmd=(none); UPennLibrary=AAAAAUaWP5oAACa4AwOOAg==; sfx_session_id=s6A37A3E0-3B8E-11DC-80E9-85076F88F67F
xxx.xx.xxx.xxx = .edu | on-campus | Van Pelt Library | staff office
July 26, 2007: 3:41 p.m.
Device= Mac | OSX Browser= Safari
Sample Data Structure: EZ-Proxy Log
Building Frameworks of Organizational Intelligence
xxx.xx.xxx.xxx |-|zucca|[26/Jul/2007:15:41:01 -0500]| GET https://proxy.library.upenn.edu:443/login?proxySessionID=10335905&url= http://www.csa.com/htbin/dbrng.cgi?username=upenn3&access=upenn34&cat=psycinfo&adv=1 HTTP/1.1| 302|0|http://www.library.upenn.edu/cgi-bin/res/sr.cgi?community=59| Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/418.9.1 (KHTML, like Gecko) Safari/419.3| NGpmb6dT6JXswQH|__utmc=94565761; ezproxy=NGpmb6dT6JXswQH; hp=/; proxySessionID=10335514; __utmc=247612227; __utmz=247612227.1184251774.1.1.utmccn=(direct)| utmcsr=(direct)|utmcmd=(none); UPennLibrary=AAAAAUaWP5oAACa4AwOOAg==; sfx_session_id=s6A37A3E0-3B8E-11DC-80E9-85076F88F67F
Referring URL = library web page listing resources on Psychology (community 59) | Olson, Coordinating Bibliographer
Sample Data Structure: EZ-Proxy Log
Building Frameworks of Organizational Intelligence
xxx.xx.xxx.xxx |-|zucca|[26/Jul/2007:15:41:01 -0500]| GET https://proxy.library.upenn.edu:443/login?proxySessionID=10335905&url= http://www.csa.com/htbin/dbrng.cgi?username=upenn3&access=upenn34&cat=psycinfo&adv=1 HTTP/1.1| 302|0|http://www.library.upenn.edu/cgi-bin/res/sr.cgi?community=59| Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/418.9.1 (KHTML, like Gecko) Safari/419.3| NGpmb6dT6JXswQH|__utmc=94565761; ezproxy=NGpmb6dT6JXswQH; hp=/; proxySessionID=10335514; __utmc=247612227; __utmz=247612227.1184251774.1.1.utmccn=(direct)| utmcsr=(direct)|utmcmd=(none); UPennLibrary=AAAAAUaWP5oAACa4AwOOAg==; sfx_session_id=s6A37A3E0-3B8E-11DC-80E9-85076F88F67F
zucca [Penn authentication key] = Provost cntr | LIBRARY | staff
Sample Data Structure: EZ-Proxy Log
Building Frameworks of Organizational Intelligence
xxx.xx.xxx.xxx |-|zucca|[26/Jul/2007:15:41:01 -0500]| GET https://proxy.library.upenn.edu:443/login?proxySessionID=10335905&url= http://www.csa.com/htbin/dbrng.cgi?username=upenn3&access=upenn34&cat=psycinfo&adv=1 HTTP/1.1| 302|0|http://www.library.upenn.edu/cgi-bin/res/sr.cgi?community=59| Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/418.9.1 (KHTML, like Gecko) Safari/419.3| NGpmb6dT6JXswQH|__utmc=94565761; ezproxy=NGpmb6dT6JXswQH; hp=/; proxySessionID=10335514; __utmc=247612227; __utmz=247612227.1184251774.1.1.utmccn=(direct)| utmcsr=(direct)|utmcmd=(none); UPennLibrary=AAAAAUaWP5oAACa4AwOOAg==; sfx_session_id=s6A37A3E0-3B8E-11DC-80E9-85076F88F67F
SessionID 10335905=PsycInfo (resource identifier 7014)
Sample Data Structure: EZ-Proxy Log
Building Frameworks of Organizational Intelligence
xxx.xx.xxx.xxx |-|zucca|[26/Jul/2007:15:41:01 -0500]| GET https://proxy.library.upenn.edu:443/login?proxySessionID=10335905&url= http://www.csa.com/htbin/dbrng.cgi?username=upenn3&access=upenn34&cat=psycinfo&adv=1 HTTP/1.1| 302|0|http://www.library.upenn.edu/cgi-bin/res/sr.cgi?community=59| Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/418.9.1 (KHTML, like Gecko) Safari/419.3| NGpmb6dT6JXswQH|__utmc=94565761; ezproxy=NGpmb6dT6JXswQH; hp=/; proxySessionID=10335514; __utmc=247612227; __utmz=247612227.1184251774.1.1.utmccn=(direct)| utmcsr=(direct)|utmcmd=(none); UPennLibrary=AAAAAUaWP5oAACa4AwOOAg==; sfx_session_id=s6A37A3E0-3B8E-11DC-80E9-85076F88F67F
sfx_session_id=Journal of Experimental Child Psychology,
“Relations Among Musical Skills, Phonological Processing and Early Reading Ability in Preschool Children.”
Sample Data Structure: EZ-Proxy Log
Building Frameworks of Organizational Intelligence
xxx.xx.xxx.xxx|-|zucca|[26/Jul/2007:15:41:01 -0500]| GET https://proxy.library.upenn.edu:443/login?proxySessionID=10335905&url= http://www.csa.com/htbin/dbrng.cgi?username=upenn3&access=upenn34&cat=psycinfo&adv=1 HTTP/1.1| 302|0|http://www.library.upenn.edu/cgi-bin/res/sr.cgi?community=59| Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/418.9.1 (KHTML, like Gecko) Safari/419.3| NGpmb6dT6JXswQH|__utmc=94565761; ezproxy=NGpmb6dT6JXswQH; hp=/; proxySessionID=10335514; __utmc=247612227; __utmz=247612227.1184251774.1.1.utmccn=(direct)| utmcsr=(direct)|utmcmd=(none); UPennLibrary=AAAAAUaWP5oAACa4AwOOAg==; sfx_session_id=s6A37A3E0-3B8E-11DC-80E9-85076F88F67F
TRANSLATION:
• Made an open-url connection to an article on reading aptitude published in the Journal of Experimental Child Psychology.
• Logged into PsychInfo (CSA)
• Using a staff computer (MAC|OSX|Safari) located in Van Pelt Library
• A library staff (Provost’s center affiliate)
• July 26, 2007 at 3:41 pm
and in the same session,
Sample Data Structure: EZ-Proxy Log
Building Frameworks of Organizational Intelligence
EVENT
Org|ProgramStaff
ServiceGenre
LibraryProgram
CampusLocation
Date|Time
IP-Domain
Environment
URL
Budget
Restricted
Unrestricted
Expnd Amt
Fund Code
Events: a Structure for
Library Decision Metrics
Dept
SchoolClient
Rank
Major
Biblio-graphicContent
School
Reqmnt
Dept
Dept
LevelCourseDescriptor
ClientProgram
Building Frameworks of Organizational Intelligence
Service Environment
Catalog
Funds
Circulation
ERED
DYNIX BorrowDirect
SFX | ERM?
WEBApacheezproxy
Ref|Instruct
Data Farm Silos
funds
Building Frameworks of Organizational Intelligence
DATA STORE
query (xsql)parse, resolve,
anonymize,secure!
store asmetridoc.xml
Data Farm Framework
oracle
logs
oracle
XML
Sources
Repository processes
Analysis
perl
XL
Service Environment
Catalog
Funds
Circulation
ERED
DYNIX BorrowDirect
SFX | ERM?
WEBApacheezproxy
Ref|Instruct
Building Frameworks of Organizational Intelligence
Event Elements Articulated in an XML Schema
EVENT
LibraryProgram
EnvironmentClient
Content
ClientProgram
Budget
<ENVIRONMENTAL><v.domain><p.domain><date><time><session><url>
</ENVIRONMENTAL>
<CLIENT><school><dept><rank>
</CLIENT>
<LIBRARY PRGRM><service genre><staff_name><staff_org><staff_prgm>
</LIBRARY PRGRM>
<CONTENT><title><author><holdings><call_no><isbn><issn><url><res_id><sfx_id>
</CONTENT>
METRIDOC
Building Frameworks of Organizational Intelligence
<ENVIRONMENTAL><v.domain><p.domain><date><time><session><url>
</ENVIRONMENTAL>
<CLIENT><school><dept><rank>
</CLIENT>
<LIBRARY PRGRM><service genre><staff_name><staff_org><staff_prgm>
</LIBRARY PRGRM>
<CONTENT><title><author><holdings><call_no><isbn><issn><url><res_id><sfx_id>
</CONTENT>
Event Elements Articulated in an XML Schema
Building Frameworks of Organizational Intelligence
CampusLocation
Date|Time
IP-Domain
Environment
URL
EVENT
LibraryProgram
EnvironmentClient
Content
ClientProgram
Budget
METRIDOC
Building Frameworks of Organizational Intelligence
Dept
School
Client
Rank
Major
<ENVIRONMENTAL><v.domain><p.domain><date><time><session><url>
</ENVIRONMENTAL>
<CLIENT><school><dept><rank>
</CLIENT>
<LIBRARY PRGRM><service genre><staff_name><staff_org><staff_prgm>
</LIBRARY PRGRM>
<CONTENT><title><author><holdings><call_no><isbn><issn><url><res_id><sfx_id>
</CONTENT>
Event Elements Articulated in an XML Schema
EVENT
LibraryProgram
EnvironmentClient
Content
ClientProgram
Budget
METRIDOC
Building Frameworks of Organizational Intelligence
<ENVIRONMENTAL><v.domain><p.domain><date><time><session><url>
</ENVIRONMENTAL>
<CLIENT><school><dept><rank>
</CLIENT>
<LIBRARY PRGRM><service genre><staff_name><staff_org><staff_prgm>
</LIBRARY PRGRM>
<CONTENT><title><author><holdings><call_no><isbn><issn><url><res_id><sfx_id>
</CONTENT>
Event Elements Articulated in an XML Schema
EVENT
LibraryProgram
EnvironmentClient
Content
ClientProgram
Budget
Org|Program
Staff
Service Genre
LibraryProgram
METRIDOC
Building Frameworks of Organizational Intelligence
<ENVIRONMENTAL><v.domain><p.domain><date><time><session><url>
</ENVIRONMENTAL>
<CLIENT><school><dept><rank>
</CLIENT>
<LIBRARY PRGRM><service genre><staff_name><staff_org><staff_prgm>
</LIBRARY PRGRM>
<CONTENT><title><author><holdings><call_no><isbn><issn><url><res_id><sfx_id>
</CONTENT>
Event Elements Articulated in an XML Schema
EVENT
LibraryProgram
EnvironmentClient
Content
ClientProgram
Budget
Biblio-graphicContent
METRIDOC
Building Frameworks of Organizational Intelligence
Data Source
instructions
Eventschema
metridoc.xml
voyager
Penn Community
Staff db
Java-based
processes
Data Store
<ENVIRONMENTAL><van_pelt><p.location><26-jul-2007><15:41:01><10335905>< http://www.csa… >< http://www.library.upe..><macOSX><safari2.0.4>
</ENVIRONMENTAL>
<CLIENT><LIB><admin><staff>
</CLIENT>
<LIBRARY PRGRM><urs><olson><5035><colldev>
</LIBRARY PRGRM>
<CONTENT><psycinfo><CSA><1017-7041><1901-3425><1452845903>< http://www.csa… ><sfx_id>
</CONTENT>
Schematic Workflow
Building Frameworks of Organizational Intelligence
Summary:
Exploring new frameworks to achieve greater data integration.
Taking advantage of xml extensibility to enrich the descriptive power of library data resources.
Aligning management information technology with the broader direction in digital library design.
Evaluating the potential for shared, open-source solutions thatmight promote collaborative data gathering and assessment.
Building Frameworks of Organizational Intelligence
Joe [email protected] 215-573-4643
University of Pennsylvania Library Office of Planning and Communication
Questions?
Building Frameworks of Organizational Intelligence