System for AYP Analysis and Accountability Report Cards

1
System forAYP Analysis and Accountability Report
Cards

• Kyung-Sung Kim Pete Goldschmidt

UCLA Graduate School of Education Information
StudiesCenter for the Study of
EvaluationNational Center for Research on
Evaluation, Standards, and Student Testing
2
Input of AYP Analysis

• AMO (Annual Measurable Objectives)
• Reading/Language
• Mathematics
• Other Indicators
• Graduation Rates (High Schools)
• Attendance Rates (Until Middle Schools)
• Additional Indicators
• API (Academic Performance Index)

3
The Sources of Input Data

• AMO Percent Proficient Participation Rates
• State DOE Provided
• Student Level Information
• Other Indicators
• District Office Provided
• School Level Information
• Additional Indicators (i.e. API)
• State
• School Level Information

4
Information for AYP Analysis

• State AYP Targets until 2014
• Approved Calculation Rules
• Safe Harbor
• Subgroup Criteria
• Other alternative rules
• Data Aggregation and Disaggregation
• School Level
• District Level

5
Tools for AYP Analysis

• Multilevel Data Input (Student/School/District/Sta
  te)
• Longitudinal Data Input
• Capability of Complex Calculation Rules
• Automated Matching Function
• Automated Data Aggregation Disaggregation

6
Functions of AYP Analysis

• Many Computation Rules
• Different Level of Input Information
• AMO- Student Level
• Graduation Rates- School Level
• Different Data Format for Input Information
• Mainframe DB Oracle/Informix/IBM DB2
• PC DB Excel/DBF/Access
• Some other non-standard Format Data
• Many Exceptions
• Tool for Multi-level Calculation

7
Tools for Accountability Report

• Automated Report Generation
• Generic Reporting Capability
• (Bar/Pie/Floating Bar/History etc.)
• Accountability Report Capability
• Pre-Defined Report Cards
• Customized Report Cards

8
Functions of Accountability Reports

• 1. Texts Input with or w/o DB link
• 2. Line and Box input
• 3. Graphics Input with or w/o DB link
• Dial, Thermometer, Vertical Bar,
• Horizontal Bar, Odometer, Dummy
• Graphics, Line Graphs many other
• Graphic Objects

9
Scenario of AYP Analysis Accountability Reports
Data Input
Analysis
Output
AYP DB
AYP Analysis Tool
Reporting Tool
ODBC


Complex Calculation Matching by ID Data
Aggregation Data Disaggregation
Generic Report Accountability Report
(Pre-defined or Customized) Data Export
(Excel or other DB Format)
AMOs (ELA, Math)
Addl Indicator (i.e. API)

Other Indicators (i.e. Grad Rates)
10
(No Transcript)
11
Generic Reporting Capability(borrowed from QSP
Engine)
12
Example of CustomizedAccountability Report Cards
(I)
13
Example of CustomizedAccountability Report Cards
(II)
14
(No Transcript)
15
(No Transcript)
16
(No Transcript)
17
(No Transcript)
18
(No Transcript)
19
More Functions And Graphics

• Many more Objects from QSP Reports
• Quartile Bar, Floating Bar, Goal Outputs
• Individual Student Report and Progress
• Scatter Plot, Simple Statistics Outputs
• Moving Graphic Outputs (Using XML)
• 3 Dimensional Outputs

20
What CRESST Can Do for You?

• Database Management
• Data Cleaning from Many other Sources
• (DBF, Excel, MDB, Oracle, Informix, DB2)
• Combining several data from several levels
• Summarizing (aggregation, disaggregation)
• AYP Analysis
• Customization of Accountability Report Cards
• Supported by Professional Graphics Designer
• Posting Report Cards
• Web or Paper based Outputs

21
Who You can Contact

• Joan Herman
• Co-Director of CRESST
• herman_at_cse.ucla.edu