Using ISTEP , AYP, STN for NCLB

1
Using ISTEP, AYP, STN for NCLB P.L. 221

• Indiana Department of Education
• Education Information Systems
• Data Conference
• Indiana Government Center South Conference Center
• Indianapolis
• April 27th, 2005

2
Data Questions?????

• What data are required?
• How are these data used for accountability?
• Do the numbers make sense?
• How can you be sure the data are accurate?
• What other data should be considered?
• What does all mean?

3
Federal Accountability System

• No Child Left Behind (NCLB)

4
Determining Adequate Yearly Progress (AYP)

• Assessment and participation results for each
  group will be reported separately for the
  following areas
• Percent Passing English/Language Arts
• Percent Passing Mathematics
• Percent of the Overall and Group Tested
  Population

5
AYP Over Time
6
What Groups Are Reported

• Overall
• Economically Disadvantaged
• Special Education
• Limited English Proficient

• American Indian
• Asian
• Black
• Hispanic
• White

7
How is AYP Determined

• Multiple Ns are used
• 10 for reporting
• 30 for accountability
• 40 for 95 participation requirement
• AYP decisions are based on the higher of the most
  current performance or a three-year average.
• Only students enrolled for 162 days, Indianas
  NCLB definition for full academic year, are
  included in AYP determinations.

8
AYP Confidence Level

• A test of statistical significance is applied to
  AYP decisions. A school is considered as not
  making AYP only if there is 99 confidence that
  the school did not meet the annual goal.

9
AYP Safe Harbor Determination

• Safe Harbor applies if a student group does not
  meet AYP goal but the percentage of
  non-proficient students is reduced by 10 from
  the previous year and the group demonstrates
  improvement on the other indicator (or maintains
  performance at or above goal).
• A confidence level has also been added to the
  safe harbor calculation.

10
Other Indicators for NCLB

• Graduation rate for high schools and attendance
  rate for other schools, with initial goal of 95
  (any improvement is sufficient)
• Schools must also test at least 95 of all
  students and 95 of each group.

11
What Grade Level ISTEP Scores Will Count Towards
AYP?
12
Indiana Accountability System

• Public Law 221

13
P.L.221 Accountability Category System

• Five Categories
• Exemplary Progress
• Commendable Progress
• Academic Progress
• Academic Watch (Priority)
• Academic Probation (High Priority)
• The system is based on both performance of all
  students and improvement of a cohort group of
  students over time.
• The non-mobile cohort group of students includes
  students enrolled in the school for at least
  seventy percent (70) of the school year
  preceding testing. After data on the effects of
  inter-district and intra-district student
  mobility become available, it is the intent of
  the board to review and, if necessary, adjust the
  definition of non-mobile students.

14
School Performance

• School performance is based on the percentage of
  ALL students who pass mandatory annual
  assessments in English/language arts and
  mathematics calculated as an average rate across
  subject areas and grade levels.
• Number of all students passing Mathematics
• Number of all students passing English/Language
  Arts divided by the number of tests taken
  School Performance  

15
School Improvement

• School improvement is based on increases in
  achievement of a non-mobile cohort group of
  students as they progress through school.
  Increases in achievement will be measured by
  percentage point increases in students who pass
  mandatory annual assessments in English/language
  arts and mathematics calculated as an average
  rate across subject areas and grade levels.
• After the initial determinations of school
  improvement, the level of school improvement
  shall be determined by the average of the yearly
  improvement for the three-year period that
  includes the current year and the two (2)
  previous years (three-year rolling average).

16
Eventual Effect of AYP on P.L. 221

• A school that does not make AYP for two
  consecutive years (same subject) will be placed
  in a category no higher than Academic Progress.

17
(No Transcript)
18
School accountability has placed an even higher
emphasis on data. It is now absolutely imperative
that a schools data be reported accurately!!!
Remember that your school level data are
available to the public on the ASAP website and
can be compared with data from other schools. In
order to reflect a schools accomplishments in
the best possible light, we must all work
together to collect and report the most accurate
and reliable information possible.
19
Data Sources

• ISTEP Bar Code File
• Generates labels
• Can be updated
• Serves as a data source ONLY!
• Never compared to other files
• Does not change any data on STN
• What happens?
• Labels are used (or not) on tests
• New students enroll
• Schools change data by bubbling

20
ISTEP Correction File

• Represents reconciled data
• Bar code changes at school with test results
• Auditable (represents protected legal data on a
  student)
• Owned by the school/corporation
• Must be changed by the owner and with audit trail
• Not by DOE
• Not by CTB

21
AYP and STN

• AYP requires combining data from
• ISTEP Correction
• Multiple STN files over two school years
• AT
• PE
• PS
• LEP
• Dropout/Graduation
• To produce the AYP determinations

22
Student Test Number (STN) System

• The STN system
• has helped streamline the process for collecting
  data by eliminating some paper submissions.
• allows for easier access to your data.
• provides more reliable and accurate data
  reporting.
• provides opportunities to disaggregate data in
  new ways, such as
• School Mobility Rates
• Attendance by groups
• Ability to assign ISTEP scores back to the
  sending school.

23
Recommendations for Ensuring Data Accuracy

• Before sending information to the DOE, verify
  related statistics from previous reports to avoid
  errors.
• Statewide information cannot be announced until
  all schools have submitted their information.
  Please be timely.
• Combining data from multiple reports, collected
  on different dates, and stored in multiple
  databases can sometimes portray conflicting
  results.
• The DOE is working on consolidating similar data
  collections.

24
Recommendations for Ensuring Data Accuracy

• Unless you have a deep understanding of school
  statistics, it may not be wise to accept sole
  responsibility for your schools data on the STN
  system without a local procedure for data
  verification.
• An error in your information not only affects
  your schools data but changes overall and group
  totals for your corporation and the entire state.
• It can have an adverse effect on your AYP status.

25
Recommendations for Ensuring Data Accuracy

• Begin to compare relational data to see if what
  you are reporting makes sense. Here are some
  examples
• Compare the number of seniors pursuing a higher
  education with the number of seniors taking the
  SAT or ACT.
• Compare the number of free and reduced lunch
  count sent to the Division of School and
  Community Nutrition and the LEP count sent to the
  Division of Language Minority with their similar
  counts on the ISTEP report.
• Compare ISTEP and STN disaggregation reports
  from year to year to identify any unusually large
  changes in reported groups.

26
Recommendations for Ensuring Data Accuracy

• Periodically review the information on your
  school snapshot page for accuracy.
• Most of the information that is reported to the
  DOE can be viewed on the ASAP website at
  www.asap.state.in.us
• Remember, we are only able to report what you
  send us.
• Making corrections to data are not as simple as
  you might think. One correction may change
  multiple reports.

27
Getting It Right

• Dont be apprehensive about contacting the DOE to
  correct information. We just want to get it
  right. Accurate information benefits everyone.
• If an error is found, identify the report that
  had incorrect information and call the Department
  or individual that you originally sent the
  information to. They would ultimately be
  responsible for correcting the data.
• If it was an error on STN, you should be able to
  correct it yourself. If not, call EIS at
  317-232-0808.
• If it is an error that is reported on ASAP and
  you are unsure of what report the information
  came from, report the error on the ASAP feedback
  link at the top of the ASAP homepage and I will
  forward it to the appropriate individual.

28
Wes BruceAssistant Superintendent Indiana
Department of Educationwbruce_at_doe.state.in.us317
-232-9050 Gary WallynDirector of School Data
ReportingIndiana Department of
Educationgwallyn_at_doe.state.in.us317-233-3716