Pearson Benchmark Stage Setting

1
Pearson Benchmark Stage Setting

• January 12, 2006 900 1130 AM

2
Three questions

• Do you need your own curriculum framework in
  Benchmark? (SCoPe, Locally developed or copies
  and modified, or both)
• Will you be giving paper tests or electronic
  tests?
• Next steps?

3
Welcome (Glad to see you and why we are here
today.) Lake Orions success story (Human
aspects trump technology) SCoPE Model
Curriculum Framework vs. Curriculum (What it is
and what it is not. What is there now and what
is not.) Getting Started in Benchmark the Easy
Way (If paper and pencil will work for you,
consider the Answer Key Only option.) Wow!
Benchmark Reports (Getting instructionally useful
data or Grain size kills) Oakland School
Continuing Role (Bite-sized training models for
just in time implementation of Benchmark) Let
the User Groups Begin! (Who is doing what to
whom? What works? What doesnt work? Tips and
tricks, etc.)
4
Pearson Benchmark Implementation

• Lake Orion Community Schools
• 2005-2006

5
The Big Picture The District

• Board Goal (7 years)
• Student achievement
• Align Curriculum
• Communicate Curriculum
• Assessment Strategies
• MEAP
• Norm-referenced tests
• Common Assessments
• Benchmark Report Cards

6
Initial Challenges

• Teacher Fear
• Is the data going to be used for teacher
  evaluations?
• Benchmarks?
• Defining Common Assessments

7
Goal for high school

• By June 2006 every course in the high school will
  administer common assessments using Pearson
  Benchmark
• Scanned sheets
• Online
• rubrics

8
Timeline

• September 27 access to Benchmark partition
• October 26/27 testing/scanning
• Nov/Dec try out different assessment scenarios
• January/May additional course assessments add
  middle school assessments
• June create and administer benchmark
  assessments in all high school courses and
  selected middle school courses

9
Were going to do WHAT? .WHEN?

• Denial
• This too shall pass
• Panic
• Were not ready
• Are you ready?
• Relief
• This is easier than we thought!

10
(No Transcript)
11
Participation

• 6 departments
• Social Studies
• Science
• Mathematics
• World Languages
• Physical Education
• Business
• 17 courses
• 46 teachers
• 88 sections
• Over 5000 scan sheets (approximately 40 of
  students)

12
What Needs to Be Done

• Individual meetings with department heads
• Review exams with course teams
• Create answer keys
• Pre slug scan sheets
• Verify data (pre assessment)
• Course benchmarks
• Class rosters

13
After Assessment

• Scan Sheets
• Verify data (post assessment)
• Assessed students
• results
• Distribute basic results to participating
  teachers
• Review detailed reports with participating
  teachers (individually)
• All-staff professional development
• Share experiences
• Review reports

14

• This program doesnt give us answers
• it gives us questions!

15

• Is this a TEST
• Or
• an ASSESSMENT?

16
Impact of Participation

• Dialogue improved between teams
• Discussed and modified student assessment
• Assessment question issues
• Assessment design
• Increased participation
• Teachers comfort level of the common assessment
  process was eased

17
Challenges

• Assessment design
• Speed/Response time
• Benchmark structure
• Framework
• Creating items and tests
• Results
• Initial upload
• Deleting/correcting input errors

18
(November January)

• Create different assessment scenarios
• Online testing
• Rubrics
• Additional course benchmarks
• Build tests
• Identify/train department experts

19
Where Do We Go From Here?
20
(January March)

• Initiate middle school implementation
• Benchmarks
• Create common assessments for CORE courses
• collaborate with high school departments
• Coach high school teams
• Final exams (January, March)

21
(April August)

• Create and administer benchmark assessments in
  all high school courses
• Administer common assessments in middle schools
• Design/modify instructional practices based on
  data

22
Making It Work

• Be Organized
• Ask for 2 Answer Keys
• Be Available
• Do It Yourself
• Be a Cheerleader
• Be a Duck

23
Curriculum, Frameworks, and Other Forms of
Confusion
SCoPE

• Presented by the goddesses of the SCoPE
  Curriculum
• Kelly Carey and Heather Curton

24
Lets Talk Frameworks!
SCoPE

• Michigan Curriculum Framework (MCF) - Mathematics
  (GLCEs), Science, Social Studies, and English
  Language Arts (GLCEs)
• Model Core Curriculum and SCoPE Lessons Framework

25
Lets Talk Curriculum!
SCoPE

• Partial sample of the structure of
• Model Core Curriculum and SCoPE Lessons - Science
• Framework Tier Names
• Tier 1 Subject
• Tier 2 Grade
• Tier 3 Strand
• Tier 4 Standard
• Tier 5 Benchmark / Grade Level Content
  Expectations (GLCEs)
• Tier 6 Contextualized Benchmark / GLCEs

26

• Science
• Kindergarten
• I Constructing New Scientific Knowledge
• I.1 Constructing New Scientific Knowledge
• I.1.E.1 Generate questions about the world
  based on observation.
• I.1.E.1.01 Generate questions about the
  physical characteristics of plants or animals
  based on observation.
• I.1.E.2 Develop solutions to problems through
  reasoning, observation, and investigations.
• I.1.E.2.01 Create clues to help identify
  physical objects.
• I.1.E.2.02 Develop solutions to problems of
  waste management through reasoning.
• I.1.E.3 Manipulate simple devices that aid
  observations and data collection.
• I.1.E.4 Use simple measurement devices to
  make measurements in scientific
  investigations.
• I.1.E.5 Develop strategies and skills for
  information gathering and problem solving.
• I.1.E.6 Construct charts and graphs and
  prepare summaries of observation.
• I.1.E.6.01 Construct graphs based on
  observations of the physical characteristics of
  animals or plants.

SCoPE
27
What Attaches Where?

• Science - Sequence of Study, Grade Level Overview
  (K-11)
• Kindergarten - Units of Study (documents in
  their entirety), Grade Level Overview (K only)
• I Constructing New Scientific Knowledge
• I.1 Constructing New Scientific
  Knowledge
• I.1.E.1 Generate questions about
  the world based on observation. - Test Items
• I.1.E.1.01 Generate questions about the
  physical characteristics of plants or animals
  based on observation. - Lesson Plans, Test
  Items
• Resources to be attached (hyperlinked) in blue
  text.

28
An on-line demo of some of Lake Orions results
in Pearson Benchmark.
29
I adore simple pleasures. They are the last
refuge of the complex.
Quick Start

• -Oscar Wilde

30
... it is always the simple that produces the
marvelous.
Quick Start

• -Amelia E. Barr

31
Were trying to suggest that you start simple
with Pearson Benchmark
Quick Start

• that means giving your first few tests using
  Answer Key Only

32
Why Answer Key Only?
Quick Start

• You get up and running in the shortest amount of
  time
• You get up and running with the least amount of
  up front set-up
• You get access to content based reports
• You dont have to put items into Benchmark
• You can use the paper tests that you have been
  using all along
• Youve minimized your degrees of freedom which
  will maximize your chance for success!

33
Why NOT Answer Key Only?
Quick Start

• You wont get reports that include the actual
  test item.

34
Steps for AKO tests
Quick Start

• Tell Benchmark how many items there are on the
  test
• Tell Benchmark what the answers are
• Tell Benchmark how the items relate to the
  curriculum
• Assign/print/administer test
• Scan answer sheets
• Emerge from your office, victorious!

35
Such simple things, and we make of them
something so complex it defeats us, almost. Why
cant everything be simple again?...
Quick Start

• -John Ashbery

36
Oakland Schools Continuing Role in Pearson
Benchmark
OS Support

• Were here for youhelp is just a phone call away!

37
OS support will include
OS Support

• Maintaining and developing SCoPE within Benchmark
• Providing professional development in using
  Benchmark
• Help Desk (248.209.2060) Call us first!
• Psychometric / Data analysis support
• Support in using Benchmark data for school
  improvement

38
OS support of SCoPE
OS Support

• Maintaining alignment of the SCoPE framework to
  Michigans curriculum
• Developing / adding resources (lesson plans,
  etc.) to the framework
• Developing / providing items and assessments
  aligned to the SCoPE framework

39
A modularized notion of PD
OS Support

1. Test Item Input
2. Test Construction
3. Online Test Delivery
4. Reports
5. Test Diagnostics
6. Others?

1. Stage setting (planning)
2. System Administration training
3. AKO Use
4. Curriculum Management

40
A quick start training path
OS Support
41
Please note
OS Support
42
This model is still very much under development
OS Support

• we welcome your thoughts as to how this training
  could be designed to best suit your needs!

43
What user group(s) do we need?
User Groups
Listserv BenchmarkInform.oakland.k12.mi.us Pear
son will also support a statewide user
group. One group for both products specific
agendas (attend the part you want) Curriculum,
Assessment, Technology Student Information
System people. Frequency as needed