VTs University Libraries

1
VTs University Libraries

• Assessing Technology-based Projects for Faculty
  Evaluations
• Some Survey Results
• and comparisons with ARL Academic Libraries

2
Technology-based Projects include

• Publication of articles in ejournals
• Development of Web-based materials
• e.g., Web pages, tutorials, digitization
• Development of video/audio tapes
• Development of computer software
• e.g., CD-ROMs

3
74 of library faculty responded to the survey

• 28 of 38 library faculty on LIBFAC
• Every category represented administration
  (including heads, directors), CLs, Collection
  Management, DLA, ILL, Instruction, Reference,
  Technical Services
• Tenured (59), non-tenured (33), and not on
  tenure track (7)
• 60 10 years, 40 11 years

4

• Q1.
• 68 of the library faculty have developed
  tech-based projects in the last 3 years that they
  considered appropriate for evaluation purposes.

• Q2.
• 93 of the library faculty felt they had been
  encouraged to develop tech-based projects.

5
Q3. Do librarians feel that they are supported
in their development of tech-based projects?

• Yes Equipment, software, training provided.
• No Support is lacking for time to development.

6
Q4. Why create technology-based projects?
7
Q5. Technology-based projects librarians
developed in last 3 years appropriate for
evaluation
8
Q5. Other types of technology-based projects for
evaluations (comments)

• Team-taught, online course
• Timelines
• Oral history interviews
• Database design input, testing, etc.

9
Q6 and Q7 Within the past 3 years has there been
an increase in the number of tech-based projects

• Q6.
• ...on which you collaborated?

• Q7.
• ...that you initiated?

10
Q6. Within the past 3 years, has there been an
increase in the number of tech-based projects on
which you collaborated?
11
Q8. The merit of a tech-based project may be
assessed through its quality, relevance, or
contribution to the profession. Indicate which
materials you might evaluate.
12
Q8. Other materials to evaluate when deciding on
the merit of a tech-based project

• Benefit to general public
• Usefulness to me or its users
• Meets one of more needs of its target audience
• 41 decreases staff hours required since using
  technology
• VT usefulness ARL awards

13
Q9. Criteria used to determine merit
14
Q9. Other criteria that should be used to
determine merit of tech-based projects

• Enhances distance learning initiatives
• Operations run better more more efficiently
• Usefulness
• Contribution to the University
• Serves the needs of the end-user

15
Q10. Should PCA Guidelines specifically address
tech-based projects?
16
Q10. Should PCA Guidelines specifically address
tech-based projects? Yes.

• Clarification about types of materials and how
  they will be evaluated.
• Reminder that content and quality of the project
  is key, not the format.
• So that it is clearly understood that such
  projects are worthy of recognition.
• To make sure that everyone knows achievement in
  this domain is valued.

17
Q10. Should PCA Guidelines specifically address
tech-based projects? No.

• Acceptable projects should be defined by these
  guidelines
• Treat like other projects does it serve a real
  need?
• Any innovative project should be considered
• Tell when and when not to include Web pages in
  dossier

18
Q11. Do tech-based projects deserve more
credibility?
19
Q11. Do tech-based projects deserve more
credibility?

• If yes, what would give them more credibility?
• Creativity, accuracy, relevance, originality
• Standardize procedures and documentation
• Financial recognition in annual salary
• Motivate people who could do more
• If they deserve less, why?
• Technology is a process not a product
• Technology is a tool. The real determining factor
  is has it met a need and is it helping those in
  its target audience?

20
Q12. Will tech-based projects ever be sufficient
evidence of scholarship?