Tools for Aligning Instruction, Standards,

1
Tools for Aligning Instruction, Standards,
Assessments
Surveys of Enacted Curriculum

• St. Paul, MN
• August 5, 2009
• Rolf K. Blank
• RolfB_at_ccsso.org

2
Contact Information

• RolfB_at_ccsso.org
• 202 336 7044
• www.SECsurvey.org
• www.SEConline.org

3
What is/are the SEC?

• Practical, reliable set of data collection and
  analysis tools combining teacher data with
  content analysis by experts
• Online web-based surveys in Mathematics, English
  Language Arts, Science, Soc Studies
• Reporting instructional data and alignment in
  user-friendly charts
• Assist in Facilitating group discussions for
  observed differences across classrooms, schools,
  and districts

4
Session topics

• What is SEC?
• Why this approach to data?
• How SEC data address School
  Improvement?
• How are data collected/ reported / used?

5
What problem are we addressing?

• Teaching What produces change in instruction
  esp. to improve achievement? What is the role of
  data? How can we have teachers work together
  from data--on improvement?
• Research How do we measure classroom
  practices/teaching? How to compare differences
  among classes and teachers?
• Policy What is the effect of common standards
  and state accountability/assessments? What do we
  mean by evidence-based tools for improvement?

6
Data-informed School Improvement What is the
usual process?

• Large District Data cycle in Schools
• Annual Assessment data -- baseline
• Analysis discussion teachers, admin.
• Set targets from test results Identify possible
  explanations Sch improve plan
• Teachers responsible to make changes
• Benchmark assessments measure progress
• Review data provide TA
• Assessment data 1 yr, 2 yrs-- Gains ?

7
Key Question leading to SECResearch into Practice

• How can Educators obtain reliable, valid data to
  determine Alignment of instruction with required
  standards and assessments?
• Then

8
Next Question -- SEC DataResearch into Practice

• How are the curriculum data useful?
• OR
• (What is the importance of Alignment?)

9
Intended (3-4 State Math Stands.)
Assessment (3rd Grade Math Test)
10
Math Enacted (3rd Grade Teachers)
Intended (3rd Grade Math Standards)
11
Math/ Statistics (3rd Grade Teachers)
Intended (3rd Grade Stands Math)
12
ELA Enacted (9th Grade Teachers)
State ELA Intended (9th Grade Standards)
13
Reading First 3rd Grade Teachers
ELA State Sample 3rd Grade Teachers
14
2005 to 2008 ChangeGeo ConceptsGr 8 Instruction
14
15
(No Transcript)
16
Alignment as a Systemic Tool
Curriculum
Classroom Content
Alignment
Assessments
Standards
17
(No Transcript)
18
Surveys of Enacted Curriculum
The intended curriculum State content
standardsWhat students should learn
The assessed curriculum State (and other)
assessmentstested learning
The learned curriculum Student outcomes based
on school learning
The enacted curriculum What teachers teach
19
Education Improvement Questions

• Collecting Data How can in-depth subject content
  data be collected -not simple topic checklists-
  to analyze teaching content in relation to
  curriculum goals, standards, or assessments?
• Analyzing Data How can methods of teaching/
  practices be compared across classrooms, schools,
  districts, and states?
• Using Data And, how can the data then be used to
  improve instruction toward standards?
• Source Maine SEC Project

20
SEC Development

• The Surveys of Enacted Curriculum (SEC)
  Collaborative Project was initiated in 1998, to
  test a curriculum research tool for broader use
  in education to improve instruction.
• Over the past ten years the Council of Chief
  State School Officers (CCSSO), has worked with
  states and other partners thru the SEC
  Collaborative to develop the survey instruments,
  implement an Online System for data collection,
  analysis/reporting, and use with teachers.

21
Development (cont.)

• In 2003, CCSSO and UW-Madison/WCER developed an
  Online, Web-based system for data collection,
  reporting, and alignment analysis.
• Surveys are available K-12 for English Language
  Arts/Reading, Math, Science, Social Studies, and
  (new) ELD teachers.
• Key to effective use of SEC data is training and
  professional development.

22
Steps in SEC Development

• Research on course content and teacher decisions,
  Porter/Smithson, early 90s
• Surveys TIMSS, NAEP, Weiss/Nat S/M Survey 
• States development of content standards, mid '90s
  
• CCSSO Science Assessment project--Opportunity to
  Learn items
• State Collaborative 11 states '98-'01 (NSF
  grant) Development of SEC Survey models in M/S,
  Alignment analysis
• Use of SEC data in school improvement,
  experimental design study, 40 urban middle
  schools, '01-04
• English Language Arts/reading survey, developed
  '02-04 
• Evaluation of PD study 5 M/S Partnerships/NSF,
  '02 05
• Current projects 18 States, 4 Districts, 5 MSPs
  

23
States /Districts Active with SEC Tools and Data
2001 - present

• Michigan
• Minnesota (Standards coded)
• Mississippi
• Montana
• New Hampshire
• New York
• North Carolina
• Ohio

• Alabama
• Delaware
• Idaho
• Illinois
• Indiana
• Iowa
• Kansas
• Maine

24
(2) States /Districts Active with SEC Tools and
Data 2001 - present

• Oklahoma
• Oregon
• Pennsylvania
• Tennessee
• Utah
• Vermont
• Virginia
• Wisconsin

25
SEC by the Numbers annual

• 12,100 SEC Teacher Surveys (30 states)
• Math
• Science
• ELAR
• Soc Stud
• ELD (SEC ELL Consortium)
• 140 Standards or Assessment documents
• Alignment analysis

26
SEC Collaborating Organizations

• Council of Chief State School Officers
  www.SECsurvey.org
• Wisconsin Center for Education Research
  www.SEConline.org
• Learning Point Associates www.SECsupport.org
• TERC Using Data Project www.ra.terc.edu/DEC

27
SEC Collaborating Organizations

• Measured Progress www.measuredprogress.org
• The College Board www.collegeboard.com

28
The SEC Data-set
Science
Social Studies
29
Survey Sections

• Instructional Readiness
• Teacher Opinions
• Professional Development
• Types, Frequency
• Content , Active,
• Collegial, Coherence
• Instructional Content
• Topic x Cog. Demand

• School Class Description
• Instructional Activities
• General
• Problem Solving Activities
• Pairs Small Group Work
• Use of Hands-on Materials
• Use of Calculators/Computers other Ed. Tech.
• Assessment Use
• Instructional Influences

30
www.SEConline.org
31
(No Transcript)
32
Registration
33
Username and Password Confidentiality
34
SEC Survey Selection
35
Survey Menu
36
Multi-State Collaborative

• Build Knowledge of leaders
• Share Strategies
• Produce joint products, tools

37
SEC Collaborative offers

• Core Components of SEC tools/services
• Surveys with teachers report instruction
• Alignment analysis content code standards and
  assessments
• How to use Data knowledge, skills
• 4) Leader development 2-3 meetings/yr
• In-state workshops a) orientation
• b) use of data

38
(No Transcript)
39
Your progress will be noted on survey menu when
you return.
40
Taking the Online Survey

• Approximately 60-90 minutes to complete
• May be completed in multiple sittings
• Data is saved as each section is submitted
• Data reported online in pre-designed charts and
  content maps

41
(No Transcript)
42
Content Matrix--Math
43
adding levels of relative emphasis yields a 3-D
construct
44
(No Transcript)
45
(No Transcript)
46
Content Maps
47
(No Transcript)
48
(No Transcript)
49
Applications

• Alignment analysis --instruction, standards,
  assessments
• Instructional improvement in schools
• Needs assessment/ Evaluation
• Indicators for comparison, analysis, monitoring
  change over time

50
(No Transcript)