NCDPI Observer Calibration Tool

1
NCDPI Observer Calibration Tool
Introduction Demo
2
Welcome

• Observation Calibration Training (OCT)
• Approximately 20 participants
• Alleghany County Schools and Newton-Conover City
  Schools
• You are the first to review!

3
Why are you here?

• N.C. recognizes that the accurate and reliable
  evaluation of teachers is more important then
  ever
• High stakes decisions
• Teachers need and want coaching
• Clear message from principals, human resources
  and superintendents-
• We need more training on the NCEES.

4
(No Transcript)
5
(No Transcript)
6
Agenda

• Introductions and overview of platform
• Observation Engine overview and live demo
• BloomBoard overview and live demo
• Login and debrief information
• Q A

7
BloomBoard Observation Engine

• BloomBoard Empirical Education are partnering
  to provide access to a marketplace of calibration
  and training services for school administrators
  across the state
• The easy-to-use platform will combine
  BloomBoards Professional Development resources
  with Empiricals state-of-the-art observer
  training and calibration tool, Observation Engine
  - and will promote continuous NCEES improvements.

8
What is Observation Engine?

• An online tool that uses classroom videos to
  ensure accurate and reliable classroom
  observations
• Videos from the MET library have been
  master-scored on the NCEES teacher evaluation
  rubric to create learning opportunities for
  teacher evaluators in North Carolina.

9
Observation Engine will provide NC evaluators

• Observer Calibration Events Reporting
• Provides rating practice and helps increase rater
  agreement to target scores using Scoring Studies
• Supplemental Learning Exercises
• Provides targeted, self-paced online exercises
  focused on specific NCEES elements using Lessons

10
1. Calibrate through Scoring Studies

• Improves rater agreement to target scores
• Builds consensus among evaluation staff and helps
  establish a mutual understanding of the best
  ratings
• Facilitates group learning through discussion of
  areas of disagreement

3b Knows Content for Specialty 3d Makes
Instruction Relevant 4g Communicates
Effectively 4a Knows How Learning Takes
Place 4d Integrates Technology

Target Score




Video 1 Distribution of Ratings by NCEES Element
11
Calibration Reports sample figures
12
Calibration Reports sample figures contd
13
2. Rating practice through Lessons

• Self-paced practice exercises
• Watch and rate short video clips, focusing on one
  NCEES indicator at a time
• Receive immediate on-screen feedback

14
Live Demo
15
BloomBoard

• Easy access to a marketplace of supplemental
  professional growth opportunities, resources, and
  services tailored to each educators unique
  needs.
• Thousands of articles, videos/video clips, and
  links to web based resources at your fingertips.
• Further support the work youre doing through
  Observation Engines scoring studies and
  calibration events

16
BloomBoard - Live Demo
17
Thank you!

• Logins
• Check your email for instructions on how to login
  to your own demo accounts
• Debrief dates/times
• Thursday 7/10 1 p.m. EST
• Friday 7/11 11 a.m. EST
• Optional Individual Feedback Calls
• Q A