CSRQ Quality Review Process

1
CSRQ Quality Review Process

• The following flow chart illustrates how the CSRQ
  Center will review each school reform program
  using the Quality Review Tool (QRT), a set of
  forms, rules, and evaluation criteria that have
  been carefully designed to guide the process.
  Seasoned CSRQ staff will conduct the three-part
  reviews using the QRT. The process is divided
  into three parts
• Part 1
• Gather materials on the CSR program from
  journals, the internet, and from the program
  itself.
• Review the materials to develop an initial
  description of the CSR program.
• Interview the CSR program developer to complete
  and validate the description and to request
  information on studies of the programs
  implementation and effectiveness.
• Interview staff at 5 program schools to verify
  the descriptive information and better understand
  the CSR program implementation process.
• Part 2
• Qualify studies that meet the CSRQ Center
  standards for internal and external validity
  independence of the researchers face and
  psychometric validity of the outcome measures
  size of program effects and other quality
  indicators.
• Rate the rigor of the research design and
  identify those studies of sufficient quality to
  be included in a Part 3 review.
• Part 3
• Review qualified studies to rate the cumulative
  evidence on the programs effects on student
  achievement additional outcomes family and
  community involvement links between research and
  program design and evidence that the program
  providers services and support to schools
  enables successful implementation.
• Generate the CSR program report.

2
CSRQ Quality Review Process
Part 3
Part 1
Part 2
Gather Review Descriptive Materials on CSR
Program
Gather Qualify CSR Studies
Review and Report Evidence of Effectiveness
Identify Studies for Part 3 Review
Conduct School Interviews
Rate Cumulative Evidence of Effectiveness
Review Qualified Studies and Reconcile
Inconsistencies
Complete Initial Descrip- tion of CSR Program
Complete Description of CSR Program
Request Additional Information from Program
Developer
Complete CSR Program Report
Rate Rigor of the Research Design