USE OF TREND DATA

1
USE OF TREND DATA

• California
• CDE California Department of Education
• State Personnel Development Grant (SPDG)

2
Four Uses of Trend Data

• Assessment
• Implementation
• Outcomes
• Program Effectiveness

3
Four Uses of Trend Data

• Assessment
• SAMM Site Academic Measures Metafile
• Implementation
• TIC (Team Implementation Checklist) Charting
  Program
• Outcomes
• CST (CA Standards Test) Charting Program
• Program Effectiveness
• ERIA Effective Reading Intervention Academy

4
SAMM
alan.wood_at_calstat.org
Assessment

• Site-level Academic Measures Metafile

5
SAMM

• CDE publishes many site-level data files annually
• Most files include data at site, LEA and county
  levels
• These files also include data on subgroups within
  each site
• Each site is identified by a unique 14-digit
  string which is identical throughout these files
  (like NCES ID)
• SAMM gathers 8 annual research files across 8
  yrs 47 individual data files in total
• Filemaker Pro integrates these files and
  populates a three page site profile with 243 data
  points.

6
SAMM
7
SAMM

• Sample SAMMSite ProfilePage 1 of 3
• Enrollment data overall and for at-risk subgroups
• CST Percent Proficient or Above in ELA and Math,
  overall and for at-risk subgroups.

8
SAMM

• Sample SAMMSite ProfilePage 2 of 3
• Academic Performance Index (API)
• rankings (by decile)
• scores (from 200 to 1,000)
• CST Percent Proficient or Above in ELA and Math

9
SAMM

• Sample SAMMSite ProfilePage 1 of 3
• Program Improvement Status
• Expulsion, Suspension and Truancy Information

10
SAMM for Assessment

• SAMM is used to monitor program eligibility of
  individual schools and districts
• Leadership Sites are schools who compete for
  recognition and TA based on innovative strategies
  and positive outcomes
• SAIT/DAIT teams have used these profiles to
  identify areas needing improvement at PI sites
• Data collected by SAMM is used in aggregate to
  evaluate program-wide outcomes

11
TIC CHARTING PROGRAM
http//www.calstat.org/effectivereading.htmleval
Implementation

• Team Implementation Checklist

12
TIC and Implementation

• Team Implementation Checklist
• Self-reported monitor of program implementation
• Short (26 criteria) and simple, with respondents
  answering achieved, in progress, or not
  started.
• Implementing ERIA
• ERIA Effective Reading Intervention
  AcademyLiteracy Program
• Site Teams plan, guide and motivate
  implementation
• Site Teams complete TIC and other instruments

13
TIC and Implementation

• TIC Charting Program
• Utilizes MS Excel ubiquitous in California
  schools
• This single Excel workbook includes instrument,
  instructions, and instantaneous charting
  capabilities
• Single file collects responses twice per yr for 4
  yrs
• Checklist guides and informs Site Team
• Checklist summarizes program elements and is a
  reference for Site Team twice yearly
• Charting creates instantaneous, visual feedback

14
TIC and Implementation

• Site teams complete the form directly in the
  Charting Program using drop-down menus.
• This eliminates the need for data entry
  transcription or coding errors.

15
TIC and Implementation

• Responses are aggregated and charted
  automatically by the Charting Program.
• The chart is filled in over 4 years, allowing
  sites to view their own progress through time.

2007-08
2008-09
2009-10
2010-11
16
TIC and Implementation
17
CST CHARTING PROGRAM
http//www.calstat.org/CSTProficiencyCharting.htm
Outcomes

• California Standards Testing

18
CST Charting of Outcomes
19
CST Charting of Outcomes

• These separate tables populate the charts.
• CST Scores are easily accessed at the CDE
  website.
• Scores must be manually added to these tables,
  which requires minimal data entry.

20
CST Charting of Outcomes

• Here, columns which were previously used to
  represent All Students and Students with
  Disabilities are used to display 2007 and 2008
  scores at each of three grade levels.

21
CST Charting of Outcomes

• The chart can also be reconfigured to show up to
  six years of data for a single grade level, such
  as seventh graders.

22
COHORT GROWTH
http//www.calstat.org/effectivereading.htmleval

• Program Effectiveness

• ERIA Effective Reading Intervention Academy

23
Cohort Growth andProgram Effectiveness
24
Four Uses of Trend Data

• Assessment
• SAMM allows annually published research files to
  be accessed, integrated, and displayed
  longitudinally
• Implementation
• TIC Charting guides implementation by
  showingprogress over time and areas needing
  attention
• Outcomes
• CST Charting empowers stakeholders to view,
  share, and interpret changing outcomes over all
  proficiency levels
• Program Effectiveness
• Cohort charting reveals program impacts

25
USE OF TREND DATA

• Chris Drouin, CDEcdrouin_at_cde.ca.gov
• SPDG Evaluators
• Cheryl Li Walter, Ph.D. Alan Woodli_at_sonic.net
  alan.wood_at_calstat.org
• All this and more is available for download
  athttp//www.calstat.org/evaluation.html