A1258150171zFUcJ

1
WELCOME!
2
K-12 ASSESSMENT

• Victoria Ash
• Victoria.Ash_at_fldoe.org
• [phone]

3
K-12 ADMINISTRATION
4
K-12 Assessment Link

• K-12 Assessment and General Information are
  available online at
• www.fldoe.org/asp/

5
Communication
FCAT Contractors Contact List
6
Communication

• Emails filtered through Leads
• DOE
• Victoria Ash Bureau Chief
• Jackie Mueller Director, Scoring and Reporting
• Lynn Ann Tabeling End-of-Course
• Daphne Csonka Administration
• Mario Zuniga Scoring and Reporting
• TDC
• Vince Verges Director
• Steve Ash Mathematics
• Lyla Springfield Reading
• Linda Oravetz Science
• Trish Lyons Interpretive Products

7
Assessment Schedules

• 2008-09 and 2009-10 FCAT Schedules
• 2008-09 Assessment Calendar
• Updates
• 2008-09 FCAT Schedule
• Test Dates
• March 10 19
• March 3 12 (Optional Schedule)
• Notification Deadline to the Department
  September 15
• Kira.Sullivan_at_fldoe.org
• Grade 11 Science
• Day 1, Day 2, Day 3, Day 4, or Day 5
• Must be a DISTRICT (not a school-by-school)
  decision
• Notification Deadline to the Department
  September 15
• Kira.Sullivan_at_fldoe.org
• Test Materials Shipment and Pickup Schedule

8
Whats New for 2008-09

• Recycling
• Current Strategies
• Recycling versus Reuse

9
Whats New for 2008-09

• No NRT administration
• No computer-based Retake
• High School Competency Test (HSCT)
• No contract for 2009 administration
• FCAT Retake administrations
• Concordant Study in progress

10
Whats New for 2008-09

• FCAT Writing
• NO multiple-choice sessions at any grade level
• Unsealed four-page folder
• No test group codes for the 2009 Writing
  administration
• Planning Sheets

11
Whats New for 2008-09

• FCAT Reading, Mathematics, and Science
• Test group codes on ALL answer documents,
  including Grades 3 and 4
• RETAKE PreID Labels
• One Reading Retake set
• One Mathematics Retake set
• No PINK Return Labels for Science
• All TO BE SCORED documents will be packaged with
  RED, PEACH, or BLUE return labels.

12
Whats New for 2008-09
13
Reminders

• Electronic Devices
• Testing Guidelines
• If a student starts a test and leaves campus
  without finishing (for an appointment, illness,
  etc.), he or she will NOT be allowed to complete
  the test.
• NO EXCEPTIONS will be made once the student
  leaves the campus therefore, if you have
  concerns about a student, you should not allow
  the student to begin.
• Consider administering the test to that student
  on one of the make-up days.
• Use ALL of the allotted time in each session.
• Test administrators must NOT administer the FCAT
  to their family members.

14
Reminders

• Students to be Tested
• All students enrolled in Grades 3 11
• Certificate of Completion Students
• Home Education Program Students
• Students MAY participate in the FCAT
  administration if their parent or guardian has
  identified the FCAT as the selected measure of
  their childs annual progress.
• McKay Scholarship Program Students
• Students enrolled in PRIVATE schools MAY
  participate.
• Students enrolled in PUBLIC schools ARE REQUIRED
  to participate in statewide assessments as
  outlined in their IEPs.
• Corporate Tax Credit (CTC) Scholarship Program
  Students
• A private school student enrolled in the CTC
  Scholarship Program MAY participate in the
  statewide assessments.
• A parent/guardian is responsible for contacting
  the district to register the student for the
  selected assessments and for transporting the
  student to and from the district-assigned
  location.

15
Reminders

• Students to be Tested (continued)
• Florida K-8 Virtual School Program Students
• Connections Academy and Florida Virtual Academy
• Do not confuse these students with Home Education
  Program students or high school students enrolled
  in classes with the Florida Virtual School.
• English Language Learners (ELLs)
• ALL ELLs are expected to participate in FCAT
  Reading and Writing however, if an ELL has been
  receiving services for one year or less AND the
  LEP committee determines that it is appropriate,
  the student may be exempt but must participate in
  an alternate assessment.
• ALL ELLs are expected to participate in the FCAT
  Mathematics and Science tests no matter how long
  these students have been receiving services.

16
Forms

• Forms located at www.ctb.com/fcat
• Comment FormsEnsure that the online comment
  forms are reviewed BEFORE testing so that
  feedback will address the concerns of the FDOE
  and the contractor.
• Test Administrator
• School Coordinator
• District Coordinator
• Required Administration Information
• Missing Materials
• Administration Irregularities and Breaches

17
PSAT and PLAN

• Florida Statute 1007.35(5)
• Pre-college entrance examinations for enrolled
  Grade 10 students in public high schools
• Test Dates
• PSAT October 15 and 18, 2008
• PLAN September to December, 2008
• Contacts
• PSAT Jesus Jara, The College Board, (850)
  521-4909
• PLAN Jacque Twiggs, ACT-Atlanta, [phone]
  
• Jenine Brewer, [phone]
• Broward, Dade, Duval, Hernando, Hillsborough,
  Manatee, Orange, Palm Beach, Pasco, Pinellas
• Ginger Green, [phone]
• All other districts

18
Comprehensive English Language Learning
Assessment

• CELLA Test Dates
• April 14 May 15
• ContactsAcademic Achievement through Language
  Acquisition
• Mark Drennan [phone]
• Pat Faircloth [phone]

19
K-12 Test AdministrationContact List

• Daphne Csonka, Supervisor [phone]
• Tamika Brinson, FCAT(850) 245-0786
• Susie Lee, FCAT(850) 245-0785
• Linda Rhea, FCAT ESE(850) 245-0742
• Kira Sullivan, FCAT, PSAT/PLAN(850) 245-0784

20
Misc. Assessment Topics

• Dr. Cornelia S. Orr
• Office of Assessment
• Florida Department of Education

21
Misc. Assessment Topics

• Senate Bill 1906 Alternative Credit Pilot
  Program
• Senate Bill 1908 Many Initiatives Writing
  Norm-referenced tests Test Prep Transitions to
  New Assessments Testing Schedules End-of-Course
  Assessments Expanded College Readiness Testing
• Assessment Appropriations
• MAP Clearinghouse
• FTCE Fee Increase

22
Legislative Update SB 1906

• Senate Bill 1906 Alternative Credit Pilot
  Program
• DOE approve end-of-course assessments and minimum
  passing scores
• Limited to assessments for Algebra 1a, Algebra
  1b, Algebra 1, Geometry, and Biology
• Assessments
• developed by the Florida Virtual School, or
• end-of-course statewide standardized assessments
  for these courses which may be adopted or
  developed by the department

23
Senate Bill 1908 Writing

• SB 1908 Removes MC items beginning 08-09
• SBE Concurrence (4/15/08) Remove the MC items
  from the FCAT Writing tests and delay its use as
  a graduation requirement.
• Rationale
• Budget Reduction Multiple-choice questions do
  not impact our state or federal accountability
  systems.
• Technical concerns Inconsistencies in 2007
  between scores on the essay and MC questions,
  making the combination into a single score
  problematic for high stakes student decisions
  (10th).
• Next Steps
• Revise SBE Rule 6A-1.09422 to delay FCAT Writing
  graduation requirement
• Prepare for future implementation of a revised
  writing test
• Revise pupil progression plans

24
Senate Bill 1908 Writing

• Beginning with the 2008-2009 school year, the
  commissioner shall discontinue administration of
  the selected response test items on the
  comprehensive assessments of writing. Beginning
  with the 2012-2013 school year, the comprehensive
  assessments of writing shall be composed of a
  combination of selected-response test items,
  short-response performance tasks, and
  extended-response performance tasks, which shall
  measure a student's content knowledge of writing,
  including, but not limited to, paragraph and
  sentence structure, sentence construction,
  grammar and usage, punctuation, capitalization,
  spelling, parts of speech, verb tense, irregular
  verbs, subject verb agreement, and noun-pronoun
  agreement.

25
Senate Bill 1908 Other Issues

• NRT removes the requirement that the statewide
  assessment program include norm-referenced tests
• Impact on Progression Plans local plan
  revisions needed
• Reading Retention Rule being revised
• Corporate Tax Credit Scholarship
• Test Prep - prohibits suspending regular
  curricula in order to administer practice tests
  or engage in other test-preparation activities
  for a statewide assessment (i.e., FCAT or
  end-of-course assessment). However, schools are
  permitted to
• Distribute sample tests and answer keys published
  by the Department of Education
• Provide individualized instruction for students
  who score at Level 1 or Level 2 on the FCAT or
  who are identified through diagnostic assessments
  as having deficiencies in the assessed content
  and
• Include test-taking strategies in curricula for
  intensive reading and mathematics courses.

26
Senate Bill 1908 Other Issues

• Transitions to New Assessments
• Directs the Commissioner to establish procedures
  for transitioning to new assessments that impact
  the testing requirements for high school
  graduation
• Testing Schedules - Beginning in 2010-2011
• Writing no earlier than the week of March 1 and
  other subjects no earlier than the week of April
  15
• Statewide end-of-course assessments within the
  last two weeks of a course
• Student test results reported by the final day of
  the regular school year for students

27
Senate Bill 1908 Other Issues

• End-of-Course Exams
• SB 1908 allows the Commissioner to incorporate
  end-of-course assessments into the statewide
  assessment program
• Current Plans Include
• Algebra II Pilot in 2008-09 (Handout)
• Other State Developed (Handout)
• Other State Implemented TBD

28
Senate Bill 1908 Other Issues

• Expanded Postsecondary Readiness Assessment for
  11th graders
• Requires the evaluation of the college readiness
  of selected students prior to grade 12, beginning
  with the 2008-2009 school year, based on minimum
  college placement test scores determined by the
  SBE.
• High schools, to the extent practicable, must
  provide 12th grade students access to remedial
  instruction prior to graduation.
• Students achieving minimum scores upon exit from
  remedial instruction and enrolling in a community
  college within 2 years, will not be required to
  enroll in remediation courses.

29
Misc. Assessment Topics

• Assessment Appropriation Cut 30
• Less Paper
• Fewer Products
• Move to more computer-based testing
• MAP Clearinghouse
• Request for Application Clearinghouse
  Management
• Invitation to Bid Item Bank

30
FTCE/FELE Fees
New Fees for First-time Takers New Fees for First-time Takers New Fees for First-time Takers
  PEd, SAE, or GK   FELE
PBT Regular On time 50 85
PBT Regular Late 50 15 85 30
PBT Regular Emergency 50 125 85 125
PBT Supplemental 50 100 85 100
CBT 50 85

• January 1, 2009

Current Fees Current Fees Current Fees
  PEd, SAE, or GK   FELE
PBT Regular On time 25 50
PBT Regular Late 25 15 50 30
PBT Regular Emergency 25 125 50 125
PBT Supplemental 25 100 50 100
CBT 25 50
New Fees for Retakes New Fees for Retakes New Fees for Retakes
  PEd, SAE, or GK   FELE
PBT Regular On time 100 100
PBT Regular Late 100 15 100 30
PBT Regular Emergency 100 125 100 125
PBT Supplemental 100 100 100 100
CBT 100 100
31
Misc. Assessment Topics

• Questions?

32
Next-Generation Sunshine State
StandardsAssessments and Interpretive Products

• Vince Verges
• Executive Director
• Test Development Center

33
Topics

• Test Development Center Staff Changes
• Reading, Mathematics, Science, and Writing
  Updates
• Interpretive Products
• Content Focus Report 2008
• Florida Reads! Writes! Solves! Inquires! CD
• Science Lessons Learned
• Released Tests
• Item Specifications for Grades 3-5, 6-8, High
  School
• Other Assessment News
• Questions

34
Staff Changes at the Test Development Center

• Lissa Cone, FCAT Writing Coordinator
• Sheila Veatch, FCAT Writing Specialist

35
Mathematics Standards Update

• Next Generation Standards
• Math standards were adopted in September 2007
• TDC Math Assessment Transition Crosswalk was
  released to district coordinators on June 4th
• New Assessment Timeline
• Currently developing items to match the new item
  specifications for the new standards will be
  reviewed by Item Review Committee in fall 2008
  will become field test items for 2010 test
• 2011 baseline year for new mathematics assessment

36
High School Mathematics Tests

• At this time, FDOE is preparing an Algebra I End
  of Course (EOC) test and a Grade 11 Comprehensive
  test.
• Grade 11 test topics may include Algebra topics
  related to number sense, concepts and operations
  Discrete Math Financial Literacy Geometry
  Probability Statistics and Trigonometry. The
  assessed benchmarks would be made available with
  the release of the FCAT Mathematics Test Item
  Specifications to be discussed later in this
  presentation. This test would not include
  performance tasks.
• Rule changes are being developed to address
  this effort to ensure that students are
  graduating with exposure to rigorous content
  outlined in the Next Generation SSS.

37
New Science Standards

• Adopted by State Board February 2008
• K-8 grade-level standards grouped into four
  Bodies of Knowledge (BOK) which are subdivided
  into Big Ideas
• High School standards organized by BOK
• The Nature of Science
• Earth and Space Science
• Physical Science
• Life Science

38
New Science Standards

• The Office of Mathematics and Science developed a
  crosswalk showing the transition between the old
  and new benchmarks. Available at
  http//www.fldoestem.org/page362.aspx
• The Office of Mathematics and Science in
  conjunction with Florida science educators
  revised the science course descriptions to match
  new standards (draft available at
  http//www.floridastandards.org/index.aspx)
• State Board of Education is expected to review
  the proposed descriptions at their October
  meeting.

39
New Science Assessment Timeline

• 2010 2011 last year for FCAT Science
• 2010 2011 field test new items written to new
  standards
• 2011- 2012 baseline (first) year of new
  standards assessment grades 5, 8, and EOC Biology
• 2012 2013 Standard Setting and reporting of
  achievement levels

40
High School End-of-Course (EOC) Science Exams

• At this time the Department is preparing to
  develop EOC for Biology (baseline 2011- 2012) and
  another science (baseline 2012- 2013)

41
New Science Standards Assessments

• Grade 5 and 8 Science Assessments will be
  comprehensive
• Grade 5 assessment will have items representing
  benchmarks for grades 3-5
• Grade 8 assessment will have items representing
  benchmarks for grades 6-8

42
New Science Standards Assessment

• Benchmarks are likely to be grouped or clustered
  by content and designated as annually assessed or
  content sampled
• Florida Standards Content Advisory Committee
  began reviewing and making recommendations for
  assessment of new standards in April (follow up
  meetings are scheduled for September 2008 and
  January 2009)

43
Released FCAT Science Test

• 2007 FCAT Science Grade 8 Test and Answer Key
• Answer Key has percentage of students who
  answered correctly, option statistics for
  multiple-choice items, benchmark and content
  focus information, and the cognitive difficulty
  (cognitive complexity) for each item

44
Released Student Responses for Grade 8 FCAT
Science 2007 Extended Response Item

• B131 Golf Ball Energy from 2007 Released FCAT
  Science Test currently on DOE website
• Scoring criteria (annotations) and student papers
  
• Example of a top-score response
• Three student examples of a 4-point response
• Three student examples of a 3-point response
• Three student examples of a 2-point response
• Three student examples of a 1-point response
• Two student examples of a 0-point response

45
Released Student Responses for Grade 8 FCAT
Science 2007 Extended Response Item

• Will include letter explaining intent and use of
  student responses
• FCAT Rubric for extended response
• Reader Bias
• Item Development and Handscoring Flowcharts
• To be posted to ww.fass.cecs.ucf.edu Fall 2008

46
FCAT Explorer

• FCAT Explorer for grades 5, 8, and 11 are now
  available on DOE website

47
FCAT Science Lessons Learned

• A look at student performance on FCAT Science
  2003 2006
• Purpose is to provide guidance to educators that
  can be used to effect positive change and enhance
  program effectiveness
• Available in print late fall 2008

48
FCAT Science Lessons Learned

• Includes Results by Cluster
• Mean percent correct for each reporting cluster
  for each year (2003 2006)
• Observations and information on what students are
  successful are able to do and what students have
  the greatest difficulty doing
• Sample items and performance statistics
• Suggestions for instruction

49
Language Arts Social Studies Standards Update

• Next Generation SSS Standards
• Language Arts standards will be revised again
• SB 1908 states that plan for accomplishing this
  should be in place by Dec. 31, 2008
• Social Studies standards will be revised
• At this time there is no plan for an FCAT in
  Social Studies

50
Language Arts Sunshine State Standards

• December 31, 2008- Review and establish an
  expedited schedule for adoption of the Next
  Generation Sunshine State Standards.

51
Sunshine State Standards . . .

• Specific requirements are prescribed for language
  arts, science, mathematics, and social studies
  standards.
• December 31, 2011 The Next Generation Sunshine
  State Standards must be adopted for each subject
  by the State Board of Education.
• Language Arts standards that were adopted in 2007
  must be reviewed and must identify significant
  literary genres and authors that encompass a
  comprehensive range of historical periods.

52
New Tests in Reading

• Last FCAT Reading Test - 2010
• Field Test new benchmarks - 2010
• New Assessment in Reading - 2011
• Performance tasks at grades 4, 8, 9.No
  Performance Tasks (PTs) at grade 10
• Retakes remain the same, no PTs

53
Proposed Graduation Progression
08-09 09-10 10-11 11-12 12-13 13-14
FCAT Only 9th 10th 11th 12th
FCAT/ New Test 9th 10th 11th 12th
New Test Only 9th 10th 11th 12th
Requirements for Grade 10, 2011 passing scores
are still TBD. In Grade 11, the 2013 cohort
would need to take an FCAT Retake because no
Retake would exist for the new assessment yet. A
policy for the Grade 12 students might include
offering FCAT or new test retake.
54
Writing Update

• Presently, writing as a graduation requirement
  has been delayed indefinitely.
• Writing test multiple-choice items will be
  removed from test beginning in 2008-2009 due to
  budget and concerns over year-to-year linking of
  MC and essays in the current design.
• New Writing Assessment in 2012-2013 will have MC,
  SR, and ER items in a way that provides stable
  links.
• New Writing Assessment will move to grades 4, 7,
  and 11
• Grades 7 and 11 are intended to be
  computer-based tests

55
When will FCAT Writing be administered?

• Field Test December 2-3, 2008
• Census Test February 10-12, 2009
• Tests will be given using unsealed Writing
  folders to avoid scanning errors

56
Writing Lessons Learned

• FCAT Writing Lessons Learned 2001-2008 Data
  Analyses and Instructional Implications
• Scheduled for delivery to districts in December
  2009
• PDF file posted To FDOE website after ADA
  compliance requirements - districts will be
  notified when it is available

57
Florida Reads!, Writes!, Solves!, Inquires! CD

• Delivered to Districts in July
• Packaged and labeled for each school
• Contains the released performance task for each
  grade and each subject
• Includes general information about scoring, the
  FCAT rubrics, the actual test item, an example of
  a top-score response, anchor papers,
  qualification papers, and annotations (scoring
  notes)

58
Test Item Specifications

• Appendix B for Reading and Mathematics to be
  released this Fall
• Spring release of Next-Generation Assessments
  Reading and Math Test Item Specifications after
  2009 testing

59
2008 FCAT Content Focus Report

• Now available on the DOE website
• Has the benchmarks and content focus for each
  item that counted towards student scores on the
  2008 FCAT
• Has total points for each reporting
  cluster/category
• Identifies the benchmarks that had performance
  tasks
• Reading, Mathematics, Writing have old to new
  benchmarks crosswalks

60
2009 Sample Test Materials

• Reading, Mathematics, and Science Reprints of
  08 materials
• No Writing STM
• Shipments to districts in early Nov. 08
• Per Legislature, delivery to schools should be
  after Jan. 1, 2009
• PDFs posted to DOE website in Jan. 09

61
Print Materials Delivery Times

• Keys to FCAT
• Print delivery and web posting mid-Jan. 09
• Understanding FCAT Reports
• Print delivery and web posting late April 09

62
FCAT Results Folder

• Reduced quantities
• Distribution
• Grade 3 students
• Overage for mobility
• Delivery early May 09

63
Projected Product Delivery Timeframes
Projected Product Delivery Timeframes Projected Product Delivery Timeframes Projected Product Delivery Timeframes
Product Due in District Posted to Web
Science Lessons Learned Early Nov. 08 Sept. 08
2009 Sample Test Materials Early Nov. 08 Jan. 09
Keys to FCAT 2009 Mid-Jan. 09 Mid-Jan. 09
Understanding FCAT Reports Late April 09 Late April 09
Results Folder Early May 09 Not posted
Math Test Item Specifications May 09 May 09
Reading Test Item Specifications May 09 May 09
09 FRWSI CD Late July 09 Not posted
64
DOE is going green!

• FCAT contractors already use eco-friendly
  production methods.
• DOE is now actively promoting recycling.

• Florida Recycles logo and
• statement will appear on non-secure FCAT
  materials.
• Support the effort in your district!

65
FCAT Interpretive ProductsOn the Web
website www.fcat.fldoe.org
DOE website www.fldoe.org
66
FCAT 2009 NonscannableTest Book Covers
67
FCAT 2009 NonscannableTest Book Covers
68
FCAT 2009 NonscannableTest Book Covers
69
FCAT Interpretive ProductsContact Information
Trish Lyons Publications Coordinator (850)
922-2584 ext. 227 SunCom 292-2584 ext. 227
lyonst_at_mail.leon.k12.fl.us
70
Other Contact Information

• Lyla Springfield, FCAT Reading Coordinatorspringf
  ieldl_at_mail.leon.k12.fl.us
• Steve Ash, FCAT Mathematics Coordinator
  ashs_at_mail.leon.k12.fl.us
• Renn Edenfield, Interim FCAT Writing Coordinator
  edenfieldr_at_mail.leon.k12.fl.us
• Linda Oravetz, FCAT Science Coordinator
  oravetzl_at_mail.leon.k12.fl.us
• Vince Verges, Executive Director Test
  Development Center vergesv_at_mail.leon.k12.fl.us

71
Florida Alternate AssessmentDistrict Assessment
Coordinators Mtg. September 3, 2008
72
Inspirational Quote
The human brain starts working the moment you are
born and never stops until you stand up to speak
in public. George Jessel
73
2008 Standard Setting
74
Initial Standard Setting

• April 7-11
• Field test data
• 14 standard setting panels
• Panels of special educators, general educators,
  administrators and parents
• Alternate achievement standards set for all grade
  levels and content areas

75
Initial Standard Setting

• Using descriptors of Levels of Complexity and
  Performance Level Descriptors
• Panelists set cuts for Levels of Complexity (LOC)
• Panelists set Performance Level cuts within each
  of the LOCs

76
Standard Setting
77
What are the Performance Levels?

• Basic Students at the basic performance level
  have little success with the challenging access
  points
• Proficient Students at the proficient level are
  having some success mastering the access points
• Advanced Students at the advanced level are very
  successful with the access points
• At each grade level and content area these are
  tied to specific access points measured on the
  assessment

78
Standard Setting Validation

• July 15-18
• Operational test data
• Same procedures
• Panelists set Performance Level cuts within each
  of the LOCs
• Preliminary results under review

79
Standard Setting - Next Steps

• State Board Rule under development
• Establishes the cut scores
• Out for comment in the Fall
• Revision to performance level descriptors and
  labels based on feedback from standard setting
  and Technical Advisory Committee

80
2008 Results
81
Spring 2008 Administration

• 27,683 answer sheets scanned
• 3,616 not assessed for various reasons
• 734 duplicates or invalid bubble
• 126 cannot be scored in any content area
• 23,207 students have at least one valid content
  score

82
Spring 2008 Administration

• Invalid Records
• Incomplete scoring within a content area
• Double bubbles
• Grade level and content area mismatch
• Invalid bubble filled in on document

83
Spring 2008 Administration

• Districts Received
• Individual student reports
• School reports
• District reports

84
Student and Parent Report
85
Student and Parent Report
86
Alternate Assessment Reading Participation
87
Alternate Assessment Reading Proficiency
88
Alternate Assessment Math Participation
89
Alternate Assessment Math Proficiency
90
Students with Disabilities Taking the Alternate
Assessments
91
Spring 2008 - 1 Cap

• Calculation
• Numerator Number of SWD reported as proficient
  or advanced on Florida Alternate Assessment in
  grades 3-10
• Denominator Number of students participating in
  an assessment in grades 3-10
• Calculated separately for reading and mathematics
• Calculated at the district level

92
Spring 2008 - 1 Cap

• Decision Rules
• If district exceeds cap, students with a primary
  exceptionality of specific learning disability
  and no other exceptionalities are reverted to
  non-proficient
• Calculations are re-run
• If district still exceeds the cap, they may apply
  for a waiver

93
Spring 2008 - 1 Cap

• Waiver consideration is given to districts who
  submit data in support of the following
  explanations
• House multi-district programs for students with
  significant cognitive disabilities
• Are very small, such that a slight change in
  number of students produces a large change in
  percentage

94
Spring 2008 - 1 Cap

• Waiver consideration is given to districts who
  submit data in support of the following
  explanations
• House high-quality, research based programs for
  students with significant cognitive disabilities
  that attract families from around the state and
  country

95
Spring 2009 - 1 Cap

• Districts will need to submit waiver requests by
  May 15, 2009
• Decisions about waiver requests will be made
  prior to final AYP calculations

96
Inspirational Quote
The more things change, the more they remain...
insane. Michael Fry and T. Lewis
97
2008-2009 Activities
98
Train-The-Trainer

• June 23 24
• Provided updated materials and information
• Reading fluency items
• Renaming of materials
• Test book wording Teacher will script
• Four field test items per content area

99
Content/Bias Review

• June 25 26
• Approximately 120 participants
• Panelists include content expects (general and
  special education teachers, and administrators
• New item review
• Eight items per grade in Reading, Mathematics,
  and Writing
• Twenty-five Items for Science based on newly
  approved standards

100
Item Specs for New Development

• Reading
• Readability not to exceed 3 years below tested
  grade maximum is 6th grade
• Addition of Reading fluency strand
• Elementary letter and word identification
• Secondary range from reading sentences to one
  to two paragraphs

101
Accommodations

• Accommodations Workgroup
• Met via conference call on August 13
• Approximately 25 special education teachers and
  administrators participated in one of three
  conference calls
• Developed recommendations for additional
  accommodations for VI, DHH, ASD, MH and ELL
  students

102
Web-Base Ordering

• Available through Piedra Data Services website
• Braille and tactile graphics for students with
  visual impairments
• One sided response booklets
• One sided materials will allow teachers to cut
  out items to have flexibility in item placement

103
Web-Base Ordering

• Available September 4-17, 2008
•  
• http//www.piedradata.com/VIS/Login.php

104
Practice Materials

• Released items from Spring 2008 administration
• Delivery to school district alternate assessment
  coordinators week of September 8th
• Includes two items per content area and grade

105
Practice Materials

• All grades and content areas packaged together
• Test Booklet
• Response Booklet
• Passage Booklet
• Cards Packet
• Strips Packet

106
Administration Manuals

• Teacher administration manuals will be delivered
  along with practice materials to school district
  alternate assessment coordinators
• Teachers should keep their binders and replace
  contents

107
Science Field Test

• Administration window October 13 24
• Demographics for student participation e-mailed
  to AA Coordinators in July
• 25 new items based on approved Sunshine State
  Standards Access Points

108
2009 Assessment

• Administration Window
• January 12 through February 27
• Assessment now has two forms (Form A and B)
• Each form will have 16 core items and four
  embedded field test items per content area for a
  total of 20 items

109
Project to Support Instruction

• Discretionary project to support teachers in
  curriculum/instruction and support implementation
  of alternate assessment
• Steering committee met in July to identify and
  prioritize needs
• National Inclusive Large Scale Standards and
  Assessment (ILSSA) Project assisting us

110
Inspirational Quote
I am easily satisfied with the very best. Winston
Churchill
111
Peer Review Status
112
Peer Review

• July, 2008 submission
• Results from April standard setting
• Individual, school, and district reports
• Planned studies
• Waiting for response letter

113
Peer Review

• Plan for December, 2008 submission
• Final standard setting results and cut scores
• Technical Manual
• Alignment study report

114
Peer Review

• Planned studies
• Alignment Fall 2008
• UNC Charlotte Links to Academic Learning Model
• Reliability - Spring 2009
• Videotapes of 2009 administrations independently
  scored
• Classroom walk through tool development
• Validity Spring 2009
• Teacher judgment and assessment performance

115
Inspirational quote
Not a shred of evidence exists in favor of the
idea that life is serious. Brendan Gill
116
Thank youBambi Lockman, Bureau ChiefBureau of
Exceptional Education and Student Services
117
Reminder

• Those districts participating in NAEP 2009 need
  to pick up their Resource Binders at the
  registration counter during the lunch break.

118
Scoring and Reporting

• Jackie Mueller
• Director

119
Data about the 2008 FCAT tests

• Number of students with test scores reported
• 1.77 million
• Number of individual tests scored and reported
• SSS - 4.4 million
• NRT - 3.1 million
• Number of Spring 2008 Retake students passing
  after manual rescore process completed
• 3 Reading and 20 Math
• Summer 2008 4 Math

120
Data Verification Processes

• Validation of scoring
• Analyzing data to detect scoring anomalies.
• We spend a large amount of our time trying to
  chase down correct information for a small
  portion of the students who tested
• Resolving duplicate testers
• Virtual School Students in correct schools
• Correcting SIDs

121
Common Test Administration Problems

• Examples
• Use of label with incorrect grade information gt
  Off-grade level testing flag - Score Reported
  Flag of 7
• Incorrect use of label with hand-gridded
  information for different studentgt duplicate
  records Score Reported Flag of 6
• Missing or incomplete hand-griddinggt missing
  SID, Name, Grade, other important information
• Testing in two separate documents gt Does not
  meet attemptedness - Score Reported Flag of 2
• Missing test group code information gt May
  require holding more students than necessary for
  investigations if this is missing

122
Fair Warning We are Trying to Reduce Time
until Reporting

• Off-Grade Level Testers NR7 In years past we
  have attempted to clean these up prior to
  reporting. We can no longer commit to trying to
  do that. It will be up to districts to check to
  see whether these students really tested in the
  correct grade level and should be reported. This
  should be one thing you check as soon as you
  receive your DSR.
• Example from this year We attempted to have
  districts supply missing SIDs when the SIDs were
  completely blank. This netted in our attempting
  to update about 7,700 SIDs. We will not be doing
  this again. Due diligence on the part of
  districts should be able to minimize this
  problem. We will check into whether we may be
  able to give districts early warning about which
  students have missing SIDs so they can be ready
  to update the accountability files.

123
Reporting

• Posting DSR files to Navigator
• Posting summary files to Navigator
• Posting .pdf files of reports
• Printing limited to
• Individual Student Reports
• School Lists of Students
• Grade 10 and Retake Results Labels
• Certificates of Achievement

124
Fall 2009 Retake

• Results Delivery Target
• November 21, 2008
• Due in District (DID) November 26, 2008

125
2009 Reporting Targets

• Results Delivery Targets
• Writing
• May 7, 2009 and DID May 14, 2009
• Spring Retakes
• May 7, 2009 and DID May 14, 2009
• Reading and Mathematics Grade 3
• May 18, 2009 and DID May 26, 2009
• Reading and Mathematics Grades 4-10
• May 29, 2009 and DID June 05, 2009
• Science Grades 5, 8, and 11
• May 29, 2009 and DID June 5, 2009

126
Scoring and Reporting Issues

• New Demographic Websitehttps//app1.fldoe.org/FCA
  TDemographics/
• Beginning with three years of data
• Will eventually expand to cover years 2000-2008
• Similar features to the old website
• Old website http//www.fcatresults.com/demog/
  will be active until November 2008
• Years 2000-2007

127
New Demographic Website
https//app1.fldoe.org/FCATDemographics/
128
New Demographic Web site Screen Shots
129
New Demographic Web site Screen Shots
130
New Demographic Web site Screen Shots
131
New Demographic Web site Screen Shots
132
New Demographic Web site Screen Shots
133
New Demographic Web site Screen Shots
134
New Demographic Web site Screen Shots
135
New Demographic Web site Screen Shots
136
New Demographic Web site Screen Shots
137
New Demographic Web site Screen Shots
138
New Demographic Web site Screen Shots
139
New Demographic Web site Screen Shots
140
New Demographic Web site Screen Shots
141
New Demographic Web site Screen Shots
142
New Demographic Web site Screen Shots
143
Contact Information

• Jackie Mueller, Director
• Jackie.Mueller_at_fldoe.org
• 850-245-0775
• Mario Zuniga, Supervisor
• Mario.Zuniga_at_fldoe.org
• 850-245-9059

144
FCAT Scoring Inquiry System

• Mario Zuniga
• Supervisor

145
Overview

• FCAT Scoring Inquiry System TA Paper (Draft)
• Types of Score Inquiries
• Score Anomalies (Desk Audits)
• Not Reported Scores
• Missing Scores
• Procedures for Submitting Score Inquiries
• New Web-Based System
• Implementation Time-Line
• Screen Shots of System
• Contact Information

146
Technical Assistance Paper

• Types of Score Inquiries
• Score Anomalies (Desk Audits)
• Is poor performance by itself an anomaly?
• Criteria for automatic audit and manual rescoring
  of Retake scores
• Within 25 scale score points of passing
• Anomalies are red flags based on previous student
  trends or large difference in performance
  compared to other measures
• May represent a bad assessment day for the
  student
• Investigated by staff to eliminate possible
  scoring errors or student bubbling errors

147
Technical Assistance Paper

• Types of Score Inquiries (continued)
• Not Reported (NR) Scores
• RMS Codes on Individual Student Report
• NR2 Did not meet attemptedness
• NR3 Marked as Do Not Score
• NR6 Recorded as duplicate record
• NR7 Grade mismatch
• NR8 Invalidated/held by FDOE for further review
• Writing Codes on Individual Student Report
• A Blank answer document
• B Off-topic
• C Illegible, Incomprehensible, or Insufficient
  Writing
• D Foreign Language
• U Response Unscorable

148
Technical Assistance Paper

• Types of Score Inquiries (continued)
• Missing Scores
• Student is shown as present on the schools
  attendance record but is shown as Not Tested
  (NT), or is not shown at all, on score reports
• Procedures for Submitting Score Inquiries
• Score inquiries should not be submitted for Not
  Reported scores
• Score inquiry submission deadlines established
  for each administration
• Score audits require additional documentation

149
New Web Based System

• System Walk-Through Ongoing
• FDOE Review
• District/Contractor Beta-Test
• Roll-Out Timeline
• Goal is to have this system available for the
  Fall 08 Retake administration
• Sept/Oct Beta Test
• Early Nov Final Design Approved
• Late Nov
• Districts provided User ID/Passwords
• System live by November 26, 2008

150
New Web Based System

• Benefits
• Available through secure FDOE web site
• System tracks inquiry FDOE and Contractor
  response time
• Auto-assigned tracking number
• Real-time status check available to districts
• Individual or batch submissions available
• Score audit documentation kept on file at
  district level
• Auto-assigned to FDOE specialist
• Eliminates FAX handling and manual tracking
• Risks
• Resistance to change
• Score audit documentation filed in the district
• User ID/Password security

151
Screen Shots of Web Based System

• Logon Screen
• Email address for user name
• User reset password
• One logon per district

152
Screen Shots of Web Based System

• Main Menu for District Use

153
Screen Shots of Web Based System

• Main Menu for District Use

154
Screen Shots of Web Based System

• Contact Information Form
• Maintain District Coordinator of Assessment
  Contact Information
• Potential to Update other FDOE Rosters from
  this Information

155
Screen Shots of Web Based System

• Main Menu for District Use

156
Screen Shots of Web Based System

• K-12 Missing Score/Desk Audit Inquiry

Drop Down Menus
157
Screen Shots of Web Based System

• Main Menu for District Use

158
Screen Shots of Web Based System

• Submit a Batch File of Inquiries

Excel Files Only File Format will be provided.
159
Screen Shots of Web Based System

• Main Menu for District Use

160
Screen Shots of Web Based System

• Track status of submitted inquiries

161
Screen Shots of Web Based System

• Track status of submitted inquiries

Sort on any column
162
Screen Shots of Web Based System

• Track status of submitted inquiries

Email to request a correction
163
Screen Shots of Web Based System

• Track status of submitted inquiries

Automatic reference to the student record log
number
164
Screen Shots of Web Based System

• Track status of submitted inquiries

165
Screen Shots of Web Based System

• Main Menu for District Use

166
Screen Shots of Web Based System

• On the FDOE and Contractor Side

167
Contact Information

• If you have any questions, please contact
• Mario Zuniga
• mario.zuniga_at_fldoe.org
• 850-245-9059
• Bernard Stevens
• bernard.stevens_at_fldoe.org
• 850-245-0778

168
Florida Parent Network

• District Coordinators Meeting
• Orlando, Florida
• September 3, 2008

169
Agenda

• FCAT Parent Network Overview
• Statistics
• Release Schedule
• Login Letters
• Release of Results
• Non PreID Process

170
FCAT Parent Network Overview

• Started in Spring 2006 allows secure online
  access to FCAT results for Florida parents
• Subjects Reading, Mathematics, Science, Writing,
  R/M Retakes
• Individual secure logins generated for all tested
  students for each test administration
• Results available in HTML and PDF format
• State Resources
• FAQs in English, Spanish and Haitian-Creole

171
Statistics

• 14 releases of data to date
• From March 2006 to present
• More than 6 million visits
• More than 158 million hits
• Spring and Summer 2008 so far
• More than 2.3 million visits
• More than 61 million hits
• Most active date 6/12/08 5,297,211 hits

Spring and Summer 2008
172
Home Page

• Updated when new results are available
• Expected release dates
• Available until dates
• English, Spanish Haitian Creole

173
Results Page

• Overview of Results
• Scale Score
• Performance Level
• Standard Error Measure
• PDF of Student Report
• Copy of ISR that will be received in print
• Separate tab for each test
• Reading Mathematics
• Writing (when applicable)
• Science (when applicable)
• Retakes (when applicable)

174
Release Overview

• Step 1 Login Letters
• 2-3 weeks prior to release for fall and Spring
• 1-2 weeks prior to testing for summer
• Step 2 Release of Results
• 48 hours after release of results to districts
  and schools
• Step 3 Non PreID Logins
• Available on Navigator site by the day of the
  results release

175
Step 1 Login Letters

• 2-3 weeks prior to release for Fall and Spring
• 1-2 weeks prior to testing for Summer
• Shipment includes
• District Coordinator Letter
• Principal Letter
• Login Lists for each school (PDF also available
  on Navigator)
• Sample Parent Letter
• Parent Letter with unique login and password for
  each student in the PreID file
• Login Page updated with expected data release
  dates
• New logins activated and parents receive a
  message indicating that results are not yet
  available

176
Step 2 Release of Results

• 48 hours after release of results to districts
  and schools
• Home Page updated to state that results are now
  available and expected timeframe for next release
• Results available at the same time for all
  students in the state (PreID and Non PreID)
• Results from previous administration (Fall,
  Spring, Summer) no longer available home page
  includes expected to be available until dates

177
Step 3 Non PreID Logins

• Available on Navigator site the day of the
  results release
• PDF lists of logins and passwords provided for
  district and school access to be distributed to
  parents (includes 5 of students across the
  state)
• Includes all students who do not have results in
  the data file associated with a PreID label
  (generated from final approved data file)
• Students not enrolled at the time of PreID
• Students who were in PreID, but label did not get
  used
• Students who were in PreID, but student moved to
  a new school or district prior to testing
• Students will receive a separate login for each
  subject that they did not have a PreID
  indicated in the data file
• Allows all students in the state to access their
  results on Parent Network

178
Navigator Website

• PDFs of Reports
• State Report of Districts (districts only)
• District Report of Schools
• School Report of Students
• District Summary
• PDF Copies of Parent Network PreID Login Lists
• Ex. Summer 08 Parent Network PreID Logins
• Ex. Summer 08 Parent network Non-PreID Logins
• PDFs of Non PreID Login Lists

179
Grow Customer Support

• support_at_grow.net
• 1-800- 481-GROW

Customer Support Rep, Miranda
180
Florida
National Assessment of Educational Progress
(NAEP) 2009 Assessments
District Assessment Coordinator Annual
Meeting September 2008
Michele Sonnenfeld NAEP State Coordinator Florida
Department of Education
181
State-Level NAEP Administrations in Florida
  Gr 4 Reading Gr 8 Reading Gr 4 Math Gr 8 Math Gr 4 Science Gr 8 Science Gr 4 Writing Gr 8 Writing Gr 12 Reading and Math
1998 X X           X  
2002 X X         X X  
2003 X X X X     X X  
2005 X X X X X X      
2007 X X X X       X  
2009 X X X X X X     X

• In 2009, Florida will also be participating in
• Internet Computer Tasks (ICT)
• Hands-on Tasks in Science (HOTS)
• High School Transcript Study (HSTS)
• Miami-Dade will receive results as part of the
  Trial Urban District Assessment (TUDA).

182
NAEP Special Studies for 2009

• Interactive Computer Tasks (ICT)-Westat will
  provide 15 laptop computers and flash drives
• Hands on Tasks (HOTS)-Westat provides kits that
  students will use in performing experiments
• High School Transcript Study (HSTS)
• Florida is the only state that will participate
  electronicallyno burden to the schools

183
NAEP 2009 Assessments

• Grade 12 Assessment
• In 2009, NAEP will administer a Grade 12 Pilot
  assessment in 11 states, including Florida, that
  were chosen to participate. This will be the
  first time state results will be available for
  Grade 12 in reading and mathematics.
• Florida will be able to compare its Grade 12
  reading and mathematics scores with those of
  Idaho, South Dakota, Iowa, Illinois, Arkansas,
  West Virginia, New Jersey, Massachusetts,
  Connecticut, and New Hampshire.

184
NAEP 2009 Assessments

• Trial Urban District Assessment (TUDA)
• TUDA is designed to report on the performance of
  Grades 4 and 8 public school students at the
  district level
• 2002 Atlanta, Chicago, Houston, Los Angeles,
  New York City
• 2003 added Boston, Charlotte, Cleveland, San
  Diego
• 2005 added Austin
• 2009 added Baltimore, Detroit, Fresno,
  Louisville, MIAMI-DADE, Milwaukee, and
  Philadelphia
• Washington, D.C. is also included as a TUDA

185
NAEP 2009Assessment Components

• Assessment Window January 26 March 4, 2009
• Subjects to be Assessed
• Grades 4, 8, and 12 Reading, Mathematics, or
  Science
• Grades 4, 8, and 12 Science Interactive
  Computer Tasks (ICT) or Hands-on Tasks (HOTs)
• Grades 4, 8, and 12 U.S. History, Civics, or
  Geography
• FLDOE will not select schools chosen for NAEP to
  be calibration schools for the FCAT

186
Contact Information
Contact Information
Michele Sonnenfeld NAEP State Coordinator Florida
Department of Education [phone] Michele.Son
nenfeld_at_fldoe.org
187
Florida
National Assessment of Educational Progress
(NAEP) 2009 Assessments
Selected District Assessment Coordinators
September 2008
Michele Sonnenfeld NAEP State Coordinator Florida
Department of Education
188
NAEP 2009 Assessment Components

• Assessment Window January 26 March 4, 2009
• Subjects to be Assessed
• Grades 4, 8, and 12 Reading, Mathematics, or
  Science
• Grades 4, 8, and 12 Science Interactive
  Computer Tasks (ICT) or Hands-on Tasks (HOTs) (31
  schools)
• Grades 4, 8, and 12 U.S. History, Civics, or
  Geography
• Most selected schools will participate in the
  Reading, Mathematics, or Science assessments. In
  Florida, 47 schools will also participate in the
  U.S. History, Civics, or Geography assessments.

189
Prior to the NAEP Assessment

• You were notified in July of the schools in your
  district that have been selected to parti