NRC Assessment of Research Doctoral Programs Faculty Questionnaires

1
NRC Assessment of Research Doctoral
ProgramsFaculty Questionnaires

• Andrew J. Szeri
• Associate Dean, Graduate Division
• University of California, Berkeley
• January 24, 2007

2
Plan of the Briefing

• Overview of the NRC Assessment
• Developed program list, faculty list
• Institutional Questionnaire
• Program Questionnaire
• Faculty Questionnaire
• Student questionnaire (advanced to candidacy)
• Economics, English, Physics, Neuroscience,
  ChemEng
• How rankings will be developed
• Details on the Faculty Questionnaire
• Why its crucial that you respond

3
Rankings

• Quantitative data being gathered. NRC will
  determine weights to multiply by quantitative
  measures to yield a measure of program quality.
  All rankings to be reported in quartile ranges.
• Explicit assignment of weights by faculty
  members via the faculty questionnaire.
• Implicit derivation of weights by faculty
  members via the second questionnaire.
• Subsidiary rankings will highlight specific
  aspects of program quality Research Impact,
  Student Support and Outcomes, Diversity of
  Academic Environment.
• Quantitative data given to researchers to do
  their own rankings.

4
Faculty Questionnaire - Dates

• Faculty should receive email invitation from NRC
  starting Thursday, January 18
• The Chancellor sent an email stressing the
  importance of answering this questionnaire on
  Tuesday, January 16
• Berkeleyan article, January 18
• Paper invitations arriving around January 23
• Due date February 22, 2007
• Late questionnaires accepted until April 1, but
  limited input.

5
Key Highlights of Faculty Questionnaire

• NRC will use ISI for citations to journal
  publications.
• Faculty must input their book titles. ISI
  coverage is almost non-existent on book coverage,
  so it is very important to list your books.
• NRC will gather awards and honors from various
  societies and awarding entities.
• Questionnaire asks for input on explicit weights.
• Faculty will be asked if they want to become
  eligible to be a rater - i.e. help to determine
  weights by the implicit method.
• Now we examine screenshots of important parts of
  the Faculty Questionnaire

6
Overview
7
A1. Emeritus or not has been preloaded.
8
A2. Data Preloaded (co-chair counts omitted by
accident, correction email sent to affected
faculty)
9
A4. Specializations - Update
10
D1. Other Names - Important
11
D2. Zip codes
12
D3. Books Important!
13
D4. Journal Articles - Limit 30
14
D5. Other Scholarly Products
15
D6. Professional Societies
16
E1. Extramural Grants or Contracts?
17
E2. How many grants? E3. How many students
supported?
18
E4. Intellectual Property
19
E4. How many?
20
F1. Doctoral Students Please update if possible
21
G1. Faculty Characteristics
22
G2. Student Characteristics
23
G3. Program Characteristics
24
G4. Decide how to weight quality metrics
25
I. Upload your CV (word, rtf, pdf)
26
J1. Do you want to be a rater?
27
J1. Willing to be a rater? If yes, they will ask
for your contact information.
28
Faculty Survey Index

• Jump to Section A (Program Identification)
  please review
• Jump to Section B (Prior Experience) - Optional
• Jump to Section C (Educational Background) -
  Optional
• Jump to Section D (Scholarly Activity) important
  for book based fields
• Jump to Section E (Research Activity)
  intellectual property, grants
• Jump to Section F (Doctoral Students) optional
  (we have preloaded list of students and first job
  placement for earlier years)
• Jump to Section G (Program Quality) -IMPORTANT
• Jump to Section H (Demographic Information)
  -Optional
• Jump to Section I (Curriculum Vitae) Upload
  your CV
• Jump to Section J (Participate as a Rater)
• Jump to Submit Survey Page (once you submit, you
  wont be able to return to it)
• Quit for now          E-Mail the HelpDesk
           Back          Jump to other Sections
           Rationale for Questions          Review
  All Answers

29
Why its crucial to participate

• Only faculty members who respond to the
  questionnaire by February 22 may participate in
  the nation-wide reputational survey that will
  lead to rankings.
• Only faculty members who respond to the
  questionnaire by February 22 may vote on what
  characteristics of a doctoral program are
  indicators of quality this will lead to
  rankings.
• In book-based fields of scholarship, the only way
  faculty publications will be recorded by the NRC
  is through their listing by the faculty on their
  questionnaire responses (D3).
• In fields where research grants are important,
  the only way research grants to faculty will be
  recorded by the NRC is through their listing by
  the faculty on their questionnaire responses
  (E2).
• In fields where intellectual property is
  important, the only way invention disclosures and
  patents will be recorded by the NRC is through
  their listing by the faculty on their
  questionnaire responses (E4)