Using Disaggregated Data Effectively

1
Using Disaggregated Data Effectively

• NCA-CASI Spring Data Conference
• Indianapolis Hilton Hotel
• March 7th, 2005

2
Why Disaggregate???

• Ensure Equity
• Confirm or Refute Perceptions
• Better Understand of Situational Conditions
• Provides Information Needed to Make Informed
  Decisions

3
Why Disaggregate?
Statement Your car has an average tire pressure
of 27 pounds. Is this adequate?
Disaggregated DataTire 1 - 32 Tire 2 32 Tire 3
- 32 Tire 4 - 12
4
Why Disaggregate???
Statement Only 5 of Indiana residents have
reported symptoms of the new virus.
Disaggregated Data by County All counties
reported 0 except for Lake at 21, LaPorte at
24 and Porter at 36.
5
Why Disaggregate???
Statement 76 of all 3rd Graders Passed the 2004
ISTEP.
6
(No Transcript)
7
Going Deeper Into The Data

• If your population size is large enough,
  drilling down to the next level of data can shed
  even more light on the chosen topic.
• Every topic has multiple variants that can have
  a profound impact on results.
• You probably dont have time to disaggregate
  every possible variant, so choose wisely.

8
(No Transcript)
9
(No Transcript)
10
(No Transcript)
11
(No Transcript)
12
Looking for Trends

• Looking at information over time can give you
  keen insight into what trends have impacted the
  current condition.
• It can also predict possible future trends.
• Comparing your school trends with that of the
  corporation or state data can confirm that a
  trend is normal or unique to your school.

13
Free/Reduced Lunch - Current
14
Free/Reduced Lunch Over Time
15
Diplomas Earned Over Time
16
State Core 40 Diploma by Ethnicity
17
State Honors Diploma by Ethnicity
18
Looking for Trends Using ISTEP Data from
2002-2004

• Disaggregated Data for Gender and Special
  Education

19
(No Transcript)
20
(No Transcript)
21
(No Transcript)
22
(No Transcript)
23
(No Transcript)
24
(No Transcript)
25
Groups Within Groups

• Every main student group has multiple sub-groups
  within it, that when disaggregated, can show the
  effect of different variables on the total.
• When multiple variables are combined, data can
  dramatically portray how positive or negative
  elements interact.
• Improvement can be measured as a single variable
  or in any combination.

26
Partial 8th Grade English/Language Arts
Disaggregated Results 2004-05
27
Using ISTEP English / Language Arts Mean Scale
Score Results from 2002-03

• Looking at two levels of student group
  disaggregation

28
Definitions

• Scale ScoreStudent achievement levels relative
  to the Indiana Academic Standards are reported by
  ISTEP as scale scores. These three-digit,
  interval scores are expressed on unique scales by
  subject (English/language arts and mathematics).
  ISTEP scale scores typically range from about
  300 to 850.
• MeanThe mean is the arithmetic average of a
  group of scores. It is calculated by adding the
  scores and dividing the sum by the number of
  scores.

29
(No Transcript)
30
(No Transcript)
31
(No Transcript)
32
(No Transcript)
33
(No Transcript)
34
(No Transcript)
35
(No Transcript)
36
(No Transcript)
37
Using Disaggregated Data to Make A Point

• Make sure that the information that you present
  truly confirms the message that you are trying to
  convey.
• Be honest in your presentation of the
  information.
• If you have one point to make, dont clutter the
  presentation with other information that is not
  directly related to the specific point.

38
(No Transcript)
39
(No Transcript)
40
(No Transcript)
41
(No Transcript)
42
(No Transcript)
43
(No Transcript)
44
Using Statewide SAT Results

• Providing knowledge that can be applied locally

45
(No Transcript)
46
(No Transcript)
47
(No Transcript)
48
(No Transcript)
49
(No Transcript)
50
Local Data

• Individual Student Data Can Be Disaggregated by
• Attendance
• Disciplinary Referrals
• Extra-Curricular Participation
• Previous School
• Teacher
• Parental Information
• Other Areas Unique to Your School

51
Final Thoughts

• Disaggregation of data is not just an
  educationally-related phenomenon.
• Good data collection practices are needed to
  assure that your information is accurate.
• Dont waste time collecting information that is
  not relevant to your current situation or needed
  in the future.
• Disaggregated data must be convincing when it is
  used to promote change in the educational
  environment.

52
Gary Wallyn Director of School Data
Reporting Indiana Department of
Education 317-233-3716 gwallyn_at_doe.state.in.us