KeyMath3

1

• KeyMath3
• As an RtI Measure
• Presented by
• Susan Brown Wallace, PhD
  Measurement Consultant

2
Some of our Assessment Products
3

KeyMath3 and Essential Resources
(RtI) authored by Dr. Austin Connolly
4
KeyMath3 The Power of 3
Diagnostic Assessment
Essential Resources RtIs
ASSIST Computer Scoring Reporting
5
KeyMath3
Introduction

• Nationally standardized, norm and criterion
  referenced, individually administered, diagnostic
  assessment of mathematics covering grades Pre-K
  through 12
• Designed around the RtI Service Delivery
  Model (IDEA) for Levels II and III.

6
KeyMath3
Introduction

• Nationally standardized, norm and criterion
  referenced, individually administered, diagnostic
  assessment of mathematics concepts and
  skills
• Untimed, with content covering grades
• Pre-K through 12
  
• Designed around the RtI Service Delivery Model
  (IDEA) for Levels II and III.

7
KeyMath3 Overview

• Understanding and application of critical math
  concepts from Pre-K-Grade 9
• Ages 4.6 - 22.11, Grades K-12
• 30-90 minutes administration
• Enhanced computer scoring
• Visual and narrative descriptions
• Level 2 user qualifications

8
Diagnostic Assessment
KeyMath3

• Primary Users
• Educational Diagnosticians
• School Psychologists
• Special Education
• Title 1
• General Education
• Struggling Students

9
KeyMath3 Components

• KeyMath 3 Diagnostic Assessment Manual
• Parallel Forms A and B
• Two item easels for each form
• Record forms for Form A and B
• Student Response booklet for computation
• Computer ASSIST scoring and reporting
• With a direct link to Essential Resources
• Essential Resources (KeyMath RTI)
• Essential Resources Easel
• Essential Resources CD

10
Diagnostic Assessment
KeyMath3

• Key Features
• Aligned to National Council of Teachers of
  Mathematics (NCTM) Standards
• Most State Standards aligned to NCTM
• Broad Range of Ages/Grades
• Pre-K through Grade 9-12
• Normed ages 4.5-22.9
• Ability to measure progress in 3 month intervals
• Normed with statistically sound reliability
• Over 4,000 Students in standardization

11
KeyMath3 NCTM Standards Match

• 5 KeyMath Subtests NCTM Standards
• Numeration. ..Numeration Operations
• Algebra... ..Algebra
• Geometry ..Geometry
• Measurement.Measurement
• Data Analysis.. ..Data Analysis Probability

Process Standards Problem Solving,
Connections,
Communication, Representation,
Reasoning and Proof
12
KeyMath3 Areas of Coverage

• BASIC CONCEPTS
• Conceptual Knowledge
• OPERATIONS
• Computational Skills
• APPLICATION
• Problem Solving

13
Approximate Administration Time in
Minutes

• Grade Basic Operations Application
  Concepts
• Pre-K to 3 10-40 5-15 5-20
• 4 to 6 40-45 10-20 15-20
• 7 to 12 40-45 15-25 15-20

14
KeyMath3 Revision

• Whats New?
• All new items
• 372 full color in each form
• Algebra included at all level
• New subtests
• Updated norms
• Linked to interventions

15
KeyMath3 Content Areas and
Subtests
Basic Concepts Numeration, Algebra,
Geometry, Measurement, Data Analysis Probability
Operations Mental Computation Estimation,
Addition Subtraction, Multiplication Division
Applications Foundations of Problem Solving
Applied Problem Solving
16
Basic Concepts Subtests

• Numeration
• Algebra
• Geometry
• Measurement
• Data Analysis and Probability

17
Basic Concepts Numeration
Alternate Representation of Number 253
Process Standards Connections, Representation
18
Basic Concepts Numeration
Linking understanding of decimals fractions
Process Standard Connections
19
Basic Concepts Algebra
Connect Understanding to sets and Recognize
alternative representation
Process Standards Connection
Representation
20
Basic Concepts Algebra
Application of strategies to Identify
relationship and choose function
that represents relationship
Process Standards Problem Solving
Representation
21
Basic Concepts Measurement
Solution is not apparent. Application of trial
and error .
Process Standards Problem Solving
22
Basic Concepts Measurement
Develop argument explain language, apply in
real world-context
Process Standards Reasoning and
Proof, Communication, Connections
23
Basic Concepts Geometry
Express concept of similarity use reasoning
to formulate truth
Process Standards Communication and Reasoning
Proof
24
Basic Concepts
Data Analysis and Probability
Identify best option, explain reasoning, and
connects to topic familiar to students
Content Standards Reasoning Proof Communication
Connections
25
Basic Concepts
Data Analysis and Probability
Data represented in bar chart and
situation outside of math
Process Standards Representation and Connections
26
Operations Subtests

• Mental Computation and Estimation
• Written Computation
• Addition and Subtraction
• Written Computation
• Multiplication and Division

27
Operations Mental Computation and
Estimation
28
Operations Mental Computation and
Estimation
29
Operations Addition and Subtraction
30
Operations Addition and Subtraction
31
Operations Multiplication
Division
32
Operations Multiplication
Division
33
Operations Multiplication
Division
34
Applications Subtests

• Foundations of Problem Solving
• Applied Problem Solving
• Solution might not be evident

35
Applications Foundations of
Problem Solving
Representing information for word problems in
a number sentence
Content Standard Algebra
36
Applications Foundations of
Problem Solving
Connect information to volume while maintaining co
rrect units
Content Standard Measurement
37
Applications Applied Problem Solving
Numeration
Process Standards Communication, Solving,
Connections, Reasoning Proof
38
Applications Applied Problem Solving
Information is represented in a number sentence
Contend Standards Data Analysis Probability
39
Adaptive Administration
KeyMath3

• Basal and ceiling rules
• Present only items within Students functional
  range
• Start with Numeration subtest
• Performance predicts proficiencies in other
  subtests more accurately than grade level
• Parallel Forms A B
• Alternate every three months
• Forms matched statistically and by content

40
KeyMath3 Norms Development

• 4,000 individuals from 4.5 to 21.9 years old
• Both Age and Grade for Fall and Spring
• Norms developed in 2006 by
• Sex
• Ethnicity
• Socioeconomic status
• Region
• Disability

41
Technical Characteristics

• Reliabilities
• Split Half Fall Forms A .97 B .96
• Split Half Spring Forms A .97 B .98
• Forms A B (alternate form) .96
• Test-Retest (Odd-Even) .97
• Correlation KeyMath-R and KeyMath 3
• K-5 .92
• 6-12 .91

42
Technical Characteristics

• Analysis of Clinical Group Performance
• LD Math
• LD Reading
• LD Math and Reading
• ID (intellectual disability) Mild to Moderate
• ADHD
• Gifted and Talented

43
Concurrent Validity

• KeyMath 3 with Math sections of
• Basic Operations Applied Total
  Concepts Problem
  
  Solving
• KTEA II .79 .82 .68
  .83
• GMADE .83 .63 .75
  .82
• ITBS .78 .75 .75
  .79
• MAP .81 .80 .75
  .82
• KTEA II .85 .87 .76
  .82
• GRADE .83 .84 .74
  .88
• MAP .86 .87 .82
  .88

GR K-5
GR. 6-9
44
KeyMath3 Reliability

• Internal Consistency Form A
• Basic Operations Applications Total
• Fall .95 .93 .89
  .97
• Spring .96 .93 .88
  .97

45
Technical Characteristics
46
KeyMath3 Scores

• For Areas (Basic Concepts, Operations, and
  Applications) and Total Test
• Standard Scores (x100, SD15,Range 55-145)
• Confidence Intervals
• Grade and Age Equivalents
• Percentile Rank
• For Subtest
• Scaled Scores (x 10, SD3,Range 1-19)
• Confidence Intervals
• Grade and Age Equivalents

47
KeyMath3 Growth Scores

• Measuring Growth
• Grade Equivalents
• Age Equivalents
• Growth Scale Value (GSV)
• Available only with the ASSIST computer
  scoring program

48
KeyMath3 Measuring Growth

• Growth Scale Value (GSV)
• Based on IRT Ability Scale
• Designed for measuring change
• Reflects absolute performance like a raw score
  not relative standing (normative)
• Allows direct comparison of GSV scores obtained
  on the alternate forms of an area
• Useful for documenting progress (AYP)
• Critical in measuring RtI progress

49
KeyMath3 ASSISTAutomated System for Scoring

and Interpreting Standardized Tests

• Key Features
• Raw to Derived Score Conversion
• Pinpoints Strengths Weaknesses Based on
  Results
• Linked to Essential Resources (ER)
• Provides the Assessment Link in the RTI Chain
• Available in Network Client/Server Version (2008)
  

50
KeyMath3 ASSIST
Data Entry Options

• Raw Score Entry

Item Entry
51
KeyMath3 ASSIST

• Progress Report
• Students performance by functional area
• Growth Scale Value
• Least square regression line of change
• Provides means for evaluating RTI

131
52
Growth Scale Value (GSV)
53
ASSIST Data Entry Options
54
ASSIST Data Entry Options
55
KeyMath3 ASSIST Reports

• Comprehensive Narrative Report
• Score Summaries
• Area Comparisons
• Score Profiles
• Item and Functional Range Analysis
• Progress Report (GSV)
• Parent/Caregiver Letter

56
ASSIST Narrative Report

• Describes students subtest, area, and total test
  scores.
• Explains percentile ranks and descriptive
  categories
• Describes a students mathematical performance in
  relation to a nationally representative sample of
  individuals of the same grade or age

57

58
(No Transcript)
59
ASSIST Area Comparisons

• Allows comparison of performance in one area with
  other areas and there overall test performance
• Provide statistical significance of the
  difference between two area standard scores
• With frequency of differences observed in the
  norm sample

60
(No Transcript)
61
ASSIST Score Profiles

• Graphical representation of an subtest scale
  scores, and area plus total test standard scores
• Identifies students strengths and weaknesses
• Subtest scale scores and area plus total test
  standard scores are graphically plotted

62
(No Transcript)
63
(No Transcript)
64
ASSIST Item and Functional Range
Analysis

• Identifies DA items that fall within an
  individuals functional range
• Notes items that may require particular attention
• Presents the behavioral objective measured by
  each item in the analysis
• Identifies appropriate lessons in the KM
  Essential Resources

65
(No Transcript)
66
ASSIST Progress Report

• Evaluates effectiveness of intervention programs
• Individuals and/or groups
• GSVs have a significant advantage for measuring
• growth and tracking progress vs. status
  scores
• GSVs measure math knowledge and skills in
• terms of absolute proficiency
• Standard Scores and Percentile Ranks measure
• relative standing

67
ASSIST Progress Report

• Answers
• How much gain
• Is that gain significant?
• If not significant they are not responding
  adequately to the intervention
• If significant then they are showing progress
  that is reliably greater than zero (no growth)
• How does the students growth compare to the
  population?

68

69
ASSIST Parent Caregiver Report

• Provides a means of communicating test results
  to
• parents or caregivers through a one-page
  letter
• Describes features KeyMath3test and provides
• Percentiles for content area, total test and
• descriptive categories
• Useful in communicating an examinees test
• performance

70
(No Transcript)
71
KeyMath3 Essential Resources
72
KeyMath3 Essential Resources

• Integrated with KeyMath-3 content, organization,
  and range
• Three program levels
• Primary (Pre-K - grade 2)
• Intermediate (grades 3 - 5)
• Middle (grades 6 - 8) Releasing 2008

73
KeyMath3 Essential Resources

• ASSIST links you directly to recommended
  instructional materials based diagnostic results
  with the push of a button
• Material can also be used independently by
  incorporating these engaging activities into your
  ongoing math curriculum
• Conveniently organized for easy browsing

74
KeyMath3 Essential Resources

• Targeted materials for building a customized
• instructional program for your student(s)
• Over 400 lessons, with activities, per level
• Over 200 guided worksheets per level
• Over 450 independent worksheets per level
• Nearly 150 assessments per level including
  readiness, review, mastery and alternative
• Progress Monitoring Report one for each of the
  10 content strands

75
KeyMath3 Essential Resources
Automatically highlights recommended lessons
based on diagnostic results
76
KeyMath3 Essential Resources

• Thumbnails of all material

77
Easel Teacher Display

• Convenient teaching easel
• Reverse side of Student Display
• Specific Instructions

78
Student Display

• Engaging graphics
• Easel or CD for use with small or large groups
• Clip-ins-transparent and opaque

79
Guided Practice

• Used during the lesson-tied to lesson display
• Available on CD, unlimited prints

80
Independent Practice

• For additional practice or homework
• Reduced verbal load from the guided practice

81
Readiness Assessment

• Available at the cluster level
• Determines whether they have the pre-requisites
  needed to learn the lesson you are about to teach

82
Review Assessment

• Available at the cluster level
• Determine whether the student has mastered the
  concept

83
Mastery Assessment

• Similar to the review assessment
• Useful when re-teaching the lesson is
  necessary

84
Alternative Assessment
Useful with students who are unable to take
traditional assessments
85
Progress Monitoring

• Record for each of the 10 content strands
• Monitor individual student progress with
  Essential Resources assessments as you move
  through the lessons
• Monitor progress and determine any needed
  adjustments to student instructional plan

86
Progress Monitoring

• Track student performance over time
• Determine possible adjustments to education plan

87
KeyMath3 ASSIST Reports

• Comprehensive Narrative Report
• Item scores used to identify band of functioning
  within each subtest
• Describes concepts and skills developed as
  well as those needing development
• Provides instructional recommendations tied to
  the KeyMath Essential Resources

88
KeyMath3 ASSIST Reports

• Error Analysis Report
• Lists item objectives missed below individuals
  functional range
• Used to find commonalities that might suggest
  gaps in understanding
• Used to find commonalities that might suggest
  gaps in application or operations

89
KeyMath3 ASSIST Reports

• Progress Monitoring Report
• Measuring progress and/or Response to
  Intervention over time
• Alternating Forms A and B at specified intervals
• Quantifies the rate of change compared to the
  normative population
• Takes into account changes not attributed to
  the Standard Error of Measurement

90
KeyMath3 Interpretation Options

• Score Summary Norm Referenced Scores
• Totals and subtests
• Score Profile w/ Total and Subtest Scale Scores
• Identifying instructional intervention
• Graphically displayed
• Area comparisons
• Depicts differences in area performance
• Focus items
• Missed items falling well below level of
  functioning

91
KeyMath3 ASSIST

• Key Features
• Scores drive generated lesson plan
• Teacher Convenience
• Modify plan by adding/removing lessons based on
  performance.
• Lessons focus on at risk areas
• Available as Stand-a-lone Application
• Application is organized in clusters
• Manual selection creates lesson plans

92
KeyMath3 Essential Resources
93
KeyMath3 Essential Resources

• Integrated with KeyMath 3 content, organization,
  and range
• Three program levels
• Primary (Pre-K through grade 2)
• Intermediate (grades 3 through 5)
• Middle (grades 6 through 8) 2008

94
KeyMath3 Essential Resources

• Scoring ASSIST links directly to recommended
  instructional materials
• Based students results
• Materials can be used independently, for
  enhancing ongoing curriculum
• Conveniently organized for easy browsing

95
Essential Resources Benefits

• Provides targeted, focused instruction
• At a lesson or cluster level
• Uses an interventional model for instruction
• Readiness, review, and assessment
• Provides simple and concise directions
• For both limited and skilled math experience
• Supports instruction at all ability levels

96
KeyMath3 Essential Resources
Automatically highlights recommended lessons
based on KeyMath3 results
97
KeyMath3 Essential Resources

• Convenient preview thumbnails of all material

98
KeyMath3 Easel Teacher Display

• Convenient teaching easel
• Reverse side of Student Display
• Specific Instructions

99
KeyMath3 Student Display

• Engaging graphics
• Easel or CD for use with small or large groups
• Clip-ins
• Transparent (to write on)
• Opaque (to cover up)

100
KeyMath3 Essential Resources

• Units correlate with the 10 areas of the
  Diagnostic Assessment
• Documents in PDF format
• Search function
• Thumbnail preview functions
• New Look

101
KeyMath3 Essential Resources

• Targeted materials to build RtIs for students
• Over 400 Lessons with activities per level
• Over 200 guided worksheets per level
• 450 independent worksheets per level
• 150 assessments per level
• Including readiness, review, mastery and
  alternative
• Progress Monitoring Report one for each of the
  10 content strands

102
KeyMath3 Essentials Resources

• Content per Level Pages
• Instruction Material Activities 800
• Worksheets Assessments..1,000
• Transparency Masters...250

103
Essential Resources
KeyMath3
Mapping Diagnostic Results to Remediation

Essential Resources
KeyMath-3 Diagnostic Assessment
104
Essential Resources
KeyMath3

• Lesson Display
• Convenience
• Teaching Easel
• Also available on CD
• Engaging Graphics
• Tied to Guided
  Practice Worksheets

105
Essential Resources
KeyMath3

• Lesson Plan
• Convenience
• Reverse side of the Lesson Display
• Specific Instructions

106
Essential Resources
KeyMath3

• Practice Work Sheets
• Guided
• Independent

107
Essential Resources
KeyMath3

• Assessments
• Readiness
• Review
• Mastery
• Alternative
• For Monitoring Progress

108
KeyMath3 Essential Resources
109
KeyMath3 Essential Resources
110
KeyMath3
Summary
Diagnostic Assessment Identify
Analysis Determine RtI
Monitor Progress Re-assess
Intervention Essential Resources
111
KeyMath3

• Thank You!
• Susan Brown Wallace
• susan.wallace_at_pearson.com
• 703-569-6380, office
• 703-863-6575, cell