Classroom Observations: LoFTI

1
Classroom Observations LoFTI
IMPACT II MeetingUnion Middle SchoolDecember
11/2007

• Evaluation Resources Linkhttp//www.serve.org/Ev
  aluation/Capacity/

2
LoFTI Looking For Technology Integration
Classroom technology observation protocol
http//www.serve.org/Evaluation/Capacity/EvalFrame
work/resources/LoFTI.php
3
What is LoFTI?

• An observation protocol a standard way of
  getting data about technology use in classrooms
• A drop-in visit, not an immersion
• LoFTI is not a teacher evaluation!
• Review the paper-pencil LoFTI

4
What data does it collect?

• LoFTI gathers evidence of how technology is
  actually being used
• This is different from what people think or feel
  is happening
• Records instances of particular uses, not the
  quality of use
• Reports totals at the school level only

5
What data does it collect?

• Concepts examined by LoFTI
• Classroom organization
• Teacher and student activities
• Student-assessment methods
• Student engagement
• Technologys role as a learning tool
• Hardware and software use

6
Why would we use LoFTI?

• You want to ask
• How often is technology being used in classrooms?
• What do classrooms look like when technology is
  in use?
• What are teachers and students are doing with
  technology?

7
Why would we use LoFTI?

• You want to ask
• How engaged are students when using technology?
• What hardware and software are used most often by
  teachers and students?

8
How do we use LoFTI?

• Determine who will do LoFTI visits
• Practice using LoFTI and compare results among
  visitors
• Do a large number of LoFTI visits
• Make visits unannounced
• Stay only 5-10 minutes
• See rooms at different times and days
• Avoid non-instructional times

9
How do we use LoFTI?

• Avoid influencing class activities
• Think about visitor placement
• Avoid temptation to provide feedback to teachers
• Record only what is observed during the visit
• Keep track of visits but do not associate names
  or room numbers with data

10
What can we learn from it?

• Compare with STNA data to confirm classroom
  practices, student activities, and impact of
  technology
• Use results to inform decisions about improving
  project implementation
• Plan for how you will report results to staff
  members in a timely way

11
The Observer

• The observer doesnt have to be a principal in
  fact, its often desirable for teachers to
  observe each other.
• Its crucial that all observers be trained in how
  to use LoFTI before they actually use it. Its
  not the same as observing teachers for their
  performance review.

12
LoFTI page 1.

• Is technology in use?
• Students in Class vs. Students using
  technology
• Activities Check only if technology is being
  used

13
LoFTI page 1.

• There may be more than one response for each item
  check all that apply
• Content Area is defined by the learning goal(s)
  of the activity
• Use of Other response

14
LoFTI page 2.

• Student engagement Mark the percentage of
  students showing each positive indicator
• Technology used as a tool Adapted from
  Partnership for 21st Century Skill
• Hardware Definitions are broad

15
LoFTI page 3.

• Definition of use Record who is actually
  touching the technology
• Web applications are scripted programs, not types
  of resource (e.g., libraries)

16
Using The Protocol

• Visits are not scheduled.
• Keep a separate record of visits
• Avoid typical non-instructional times
  beginnings, endings, or transitions.
• Visit a given room at different times and days of
  the week.

17
Using The Protocol

• Visit more rooms for shorter times rather than
  fewer rooms for longer times.
• Spend at least 5 and not more than 10 minutes in
  each room.
• If technology is not in use, mark No and move
  on this is data.

18
Using The Protocol

• The observers presence will undoubtedly
  influence what they observe.
• Be mindful of the observers placement and
  interactions with students and teachers.
• Observers should record only what is observed
  during the actual visit.

19
Using The Protocol

• Teachers name or room number arent noted on the
  Observer Record.
• Since LoFTI is intended for school use, it
  shouldnt be used to give feedback to individual
  teachers.

20
The Data Tally Tool

• Emulates bar graph output of how often each
  instance occurs.
• Update the Data Tally Tool regularly to avoid
  embarrassing data build-up.
• Tallying is easiest with two people.

21
The Data Tally Tool

• Tally over a designated time or number of
  observations.
• Will accommodate new data until any row is full.

22
Interpreting LoFTI Data
Of the 60 visits technology-use was not observed
on 14 occasions. Technology-use was observed in
46 (or 77) instances.
23
Interpreting LoFTI Data

• Of the 46 instances in which technology-use was
  observed, the learning environment reflected that
  in
• 16 instances, technology-use was observed in the
  a classroom (35)
• 13 instances, technology-use was observed in a
  computer lab (28)
• 17 instances, technology-use was observed in the
  media center (37)

24
Interpreting LoFTI Data

• First level How often technology is used?
• Second level What technology tends to be in
  use?
• Third level What are the implications?

25
Interpreting LoFTI Data

• LoFTI data dont allow you to see correlations or
  associations (e.g., how often calculators are
  used to teach math).
• With this type of data, its not appropriate to
  do any further statistical analysis (e.g.,
  determining means).

26
Technology-Enabled LoFTI

• Electronic version of LoFTI is being developed
  for Pocket PC, Palm, and Windows operating
  systems.
• Data will be maintained on PC in each school, in
  Access databases.

27
Technology-Enabled LoFTI

• Electronic version of LoFTI is being developed
  for Pocket PC, Palm, and Windows operating
  systems.
• Data will be maintained on PC in each school, in
  Access databases.

28
LoFTI PDA Version

• When initiating a new LoFTI observation
• Select time in
• Select date
• Type, graffiti, or scroll to record the number of
  students in the classroom
• Type, graffiti, or scroll to record the number of
  students using technology

29
LoFTI PDA Version
30
LoFTI PDA Version
Scroll to select the question to be answered.
31
LoFTI PDA Version
Check box to respond to Yes/No questions and
Teacher/Student use.
32
LoFTI PDA Version
Type or graffiti notes for text other responses.
33
LoFTI PDA Version
Use scroll bar or type response to behavioral
involvement questions.
Save at any point and exit the observation file
34
LoFTI PDA Version

• LoFTI generates a file number for each
  observation.
• File name format is mm/dd/yyyy/hh/mm/ss
• Month/day/year/hour/minute/second