EMetrics: What you need to know to get started

1
E-Metrics What you need to know to get started

• Denise M. Davis
• Director, Statistics Surveys
• National Commission on Libraries and Information
  Science (NCLIS) 202-606-9200 ddavis_at_nclis.gov

2
Expectation modification theory

• It is not enough to ask lets capture database
  use information.
• The measures need to be meaningful in order to
  understanding
• how libraries meet the information needs of their
  users.
• Technology is driving what we can and cannot
  collect.
• User demand is driving what we need to collect.
• Funders are driving what we must collect.

3
Same issues, different formats, more opportunity
for use reporting

• The questions librarys need to answer are the
  same what vendors are able to provide has
  improved dramatically
• Greater literacy of what data are collectable and
  what data are valuable to libraries
• Uniformity in statistics reporting remains a key
  issue
• National library surveys are beginning to adopt
  measures and require reporting
• National and international standards
  organizations are adopting electronic measures
  (ISO and NISO)

4
Metrics in Use or Field Testing

• ICOLC
• NCES State Library Agency Survey, Federal State
  Cooperative Survey (FSCS), Academic Library
  Survey
• ARL
• IMLS granted supported network statistics
  research (Bertot/McClure)
• NISO Z39.72002

5
Network Statistic and Location of Collection

• NISO Z39.7 2002
• Appendix C - Measuring public library networked
  services Preparing your library to collect
  network statistics. Table 2. Network Statistics
  and Collection Issues.
• Public access workstations Branch level
•  
• Public access workstation users Branch level
•  
• Maximum speed of public access Internet
  workstations Branch level
•  
• Full text titles available by subscription
  System level/vendor
•  
• E-book titles available by subscription System
  level/vendor

6
New Network Statistic and Location of Collection

• Commercial services sessions (formerly database
  sessions) System level/vendor
•  
• OPAC sessions System level/vendor
•  
• Menu selections System level
•  
• Rejected sessions (turnaways) System
  level/vendor
•  
• OPAC searches System level/vendor
•  
• Library collection searches (queries) System
  level
• Commercial services searches (queries) System
  level/vendor
• (formerly database queries)

7
New Network Statistic and Location of Collection

• OPAC descriptive records examined System
  level/vendor
• Library collection descriptive records examined
  System level
• Commercial services descriptive records examined
  (formerly items examined using subscription
  services) System level/vendor
• Units/records examined System level/vendor
• Library collection full-content units examined
  System level
• Commercial services full-content units examined
  System level/vendor

8
Additional Network Statistic and Location of
Collection

• Virtual reference transactions Branch or
  system level
•  
• Public service time spent servicing information
  technology Branch level
•  
• Virtual visits to networked library resources
  
• System level
•  
• Formal user information technology instruction
• Branch level
•  
• Point-of-Use information technology instruction
  
• Branch level

9
National Comprehensive Projects

• Developing National Data Collection Models for
  Library Network Statistics and Performance
  Measures. (2000)
• Sponsored by the Institute of Museum and
  Library Services (IMLS).
• http//www.ii.fsu.edu/Projects/IMLS/index.html
• Statistics and Performance Measures for Public
  Library Networked Services (Bertot, McClure,
  Ryan, 2001)
• Developing a National Data Collection Model for
  Public Library Network Statistics and Performance
  Measures
• Broad focus on measuring use, usage, and uses of
  network-based resources
• Database usage a key component, but focus in
  areas of Public Access, Virtual Visits,
  Electronic Services, and Instruction

10
E-Metrics Initiatives 2000 to the Present

• Network Performance Measures Focus Group 4,
  Summary of discussion and handouts from
  participants (2002) http//www.nclis.gov/statsurv/
  FocusGroup4/FocusGroup4.html
• Network Performance Measures Focus Group Group
  Discussion 3, Summary Notes. (2000-2001)http//w
  ww.nclis.gov/statsurv/FINALRPT.NCLIS.vendor.FG.1.1
  1.01.doc
• Guidelines For Statistical Measures of Usage of
  Web-Based Indexed, Abstracted, and Full Text
  Resources. (November 1998). International
  Coalition Of Library Consortia (ICOLC).
  http//www.library.yale.edu/consortia/2001webstat
  s.htm
• ARL New Measures Initiative. (2001) Association
  of Research Libraries (ARL). http//www.arl.org/s
  tats/newmeas/newmeas.html

11
Where to find additional information

• NISO Z39.7 Library Statistics Draft Standard for
  Trial Use http//www.niso.org/emetrics/
• CLIR report on vendor statistics (prepared by
  Judy Luther). The white paper is available from
  http//www.clir.org/pubs/reports/reports.html
• Library Statistics Measures, compiled by Joe
  Ryan http//web.syr.edu/jryan/infopro/stats.html
  
• State Library Agency Survey Steering Committee
  adopts core network performance measures for
  FY2002 national reporting. (2001)http//www.nclis
  .gov/libraries/lsp/StLArevised2001.html
• ISO Standard 2789, Library Statistics
• http//www.iso.org/iso/en/ISOOnline.frontpage

12
Summary