Centre of excellence

1
The Use of Synchronous Digital Video for
Observation of, and Feedback on, Teaching
Performance in the Learning and Skills
Sector.A presentation for the Standards Unit
of the Department for Education and Skills ITT
Reform Pilots

• Martin Dyke
• Alan Harding
• Sue Lajeunesse
• July 2006

2
Project Aims

• Aim
• To develop operational policy and procedures and
  to make recommendations for the remote
  observation, analysis and feedback of teaching
  performance.

3
Objectives

• To develop operational policy and procedures and
  to make recommendations for the remote
  observation, analysis and feedback of teaching
  performance.
• evaluate the observation of teaching performance
  and the experience and preferences of teachers,
  observers and other stakeholders.
• develop operational policy and procedures from
  the experience and evaluations of participants
  /stakeholders
• evaluate the use of digital technology in the
  observation, analysis and feedback on teaching
  performance
• Department for Education and Skills
• Standards Unit

4
Key Findings Consultation and Questionnaire

• Teachers at ease with the real time online
  observation
• 75 agreed to participate in project
• Majority would also agree to process being
  recorded
• 70 agree to recording for moderation purposes
• 66 agree to recording for research purposes
• 56 agree to recording for non-commercial teacher
  education purposes
• Majority ambivalent about process
• Prefer to know observer (33 prefer to 3 prefer
  not to)
• Prefer observer knows their college (39 prefer
  to 3 prefer not)
• Prefer subject specialist (31 prefer to 3
  prefer not)
• Small group strongly opposed to process (22)
• Two thirds of which convinced they would not
  change their mind
• Concerns expressed
• impersonal confidentiality intrusive
  disruptive loss of atmosphere uncomfortable
  with being seen on camera

5
Online Observation Configuration
Online Observation Configuration
Online Observer(s)
IP
TV
Network
TV
Teacher and Class
Observer
Remote control of pan and zoom of cameras Option
to record
6
Overview Observation of Teaching

• Partnership colleges and training organisations
• Live in real time
• As Communication not Surveillance Media
• Online Observer Present in Classroom
• Far End Camera Control
• Over Internet Protocol
• Process developed in Consultation with teachers
• Video Conference Technology

7
Methods

• Action Research Model
• Participatory Aspirations
• Consultation and Questionnaire
• 118 participants to date
• Protocol built upon feedback from consultation
• Direct Observation Data
• 25 Observations of teaching to date
• Used standard UK Quality Assurance criteria and
  classifications
• User Experience Interviews and Questionnaire

8
Key Findings Observation data

• Four of Twenty-four observations failed
• Firewall and Networking Configuration Problems
• Twenty-one observations fourteen combined online
  observation with observer in classroom.
• Spearman Rho 0.77 at 0.01 significance level
• Online observer graded closer to the mean
• Qualitative Descriptions of lesson similar

9
Conditions in which tested

• Observers shared cultural capital, close working
  relationship
• Observers close relationship with organisations
  and observed
• Adult classes in regular classrooms
• Good quality audio and video maintained
• Far End Camera Control
• Online observer presence in classroom

10
Key Findings Observation data

• Aperture and Context
• Online Observer Presence
• Communication Not Surveillance
• Far End Camera Control Essential
• Verification of Doubts
• Online Observation Intense
• Conscious deliberate active scanning
• Observed quickly forget cameras
• Observed positive about experience
• Observation etiquette

11
Challenges / Issues

• Ethical
• Organisational technical
• Firewalls and Networks
• Intensification of Work?
• Surveillance Power
• Semiotics
• Aperture
• Macro and Micro
• Need to Constantly Verify Doubt

12
Next Steps

• Video Rich Learning Environments
• Synchronous High End Video-communication
• Webcast development
• New configurations for eLearning
• Bringing together diverse communities of practice

• For further information contact
• Dr Martin Dyke
• School of Education
• University of Southampton
• Southampton SO17 1BJ UK
• M.Dyke_at_soton.ac.uk
• 0044 23 8059 5563