EUse Measurement: A Detour Around the Publishers

1
E-Use Measurement A Detour Around the
Publishers ALCTS Summer 2005
Joe Zucca Assessment, Planning and Publications
Librarian University of Pennsylvania Library
2
ALCTS Summer 2005
Student Use of E-Resources Three Profiles by
Residence logins per capita, by hour. Feb
03-May 05 49,857 logins total
Harnwell N757
Avr. Login per Resident
Hour of Day
3
ALCTS Summer 2005
The Top 15 Titles by Use, Comparative Ranks 3
Houses and All Users
4
ALCTS Summer 2005
Key Attributes of Metrics and Measurement
Processes
Metrics Comprehensive Licensed Stuff,
Local, Public
Consistent Uniform Across Resources, Replicable
Context-Sensitive Location, Time,
Demographic, Cost, Resource Type Class, Need
Processes-Data Granular, Normalized,
Integrative, Anonymous
Processes-Architecture Scaleable, Efficient
(high output for low effort), Sustainable,
Distributed
5
ALCTS Summer 2005
Schematic View of the Data Logging Process
6
ALCTS Summer 2005
Data Farm Project Events, Data, Plumbing,
Information
Service Events
7
ALCTS Summer 2005
Data Farm Oracle Space 14 gb, in 75 tables,
tracking events and their properties
Reference Contact
Circulation
Acquisitiions Funds
Web Analytics
Holdings
Image Collection Use
Tech Processing Workflow
Copier Printer Use
Gate Swipes
8
ALCTS Summer 2005
So, what do we do with the data?
Provide a distributed and multi-tiered
environment for interacting with raw data and
generating quantitative information
Lower barriers between management information
and people with management responsibility (or
any other staff) Help to scale and
institutionalize assessment
9
ALCTS Summer 2005
INTERACTIONS with DATA
Dashboards Vital signs at a glance
10
ALCTS Summer 2005
INTERACTIONS with DATA
Report Builders
11
ALCTS Summer 2005
Attempts at ranking for selection based on use
and other factors
12
ALCTS Summer 2005
A Hypothetical Scheme for Journal Selection
Ranking
Qualitative Scores Quantitative
Scores Factor Rank
Librarian rank Impact Penn Artcls.
Use Metric Cost Effc Title 1
1 2.60 1
3 4
-1.54 1 Title 2 1
3.87 6 4
54 -1.72
2 Title 3 3 22.4
9 9
8 -1.89 3 Title n
13
ALCTS Summer 2005
INTERACTIONS with DATA
Ad Hoc Mediated
14
ALCTS Summer 2005
Ad Hoc Interactions with the Database
Items Charged and E-resource Log-ins Fall 2004

15
ALCTS Summer 2005
Relationship Between E-Resource Use and Item
Circulation, Fall 2004 72 observations
16
ALCTS Summer 2005
Practical Applications of Data Farm Resources
Budget defense (slow but steady rates of
increase, curtailing the need to make major
cuts in materials)
Print collection management
E-resource selection (driving trade-offs more
typically than cuts)
Staffing Facilities Planning
Developing and testing web tools
Feeding the data-mavens and spreading best
practices
17
ALCTS Summer 2005
Key Attributes of Metrics and Measurement
Processes REPRISED
Metrics Comprehensive Licensed Stuff,
Local, Public
Consistent Uniform Across Resources, Replicable
Context-Sensitive Location, Time,
Demographic, Cost, Resource Type Class, Need
Processes-Data Granular, Normalized,
Integrative, Anonymous
Processes-Architecture Scaleable, Efficient
(high output for low effort), Sustainable,
Distributed
18
E-Use Measurement A Detour Around the
Publishers
Joe Zucca zucca_at_pobox.upenn.edu University of
Pennsylvania Library
19
ALCTS Summer 2005
ScienceDirect Journals Regression of View Counts
(Elsevier) on Penn Login Counts. Feb-Nov 2003.
1,270 cases
20
ALCTS Summer 2005
OCLC Databases Regression of Vendor Login Counts
on Penn Login Counts, jl2001-je2002. 48 cases
21
ALCTS Summer 2005
Three E-Use Profiles by Residence Top Ten Titles
Used Logins per Capita, Feb 03-May 05
22
ALCTS Summer 2005
Three E-Use Profiles by Residence Top 15 Titles
Used (by login count)