Overview of Data Collection Activities 200506

1
Overview of Data Collection Activities 2005-06

• Kelly Shapley, Ph.D.
• kelly.shapley_at_tasb.org
• Texas Center for Educational Research
• www.tcer.org

2
What is the Texas Center for Educational Research?

• TCER is a private non-profit research
  organization located in Austin.
• TCERs mission is to conduct and communicate
  nonpartisan research on education issues in order
  to serve as a resource for education policy in
  Texas.

3
eTxTIPEvaluation Purpose

• Conduct a scientifically based evaluation to test
  the effectiveness of technology immersion in
  increasing middle school students achievement.
• Examine the relationships that exist among
  contextual conditions, technology immersion,
  intervening factors (school, teacher, and
  student), and student achievement.

4
Additional Purpose

• Test the efficacy of empirical methods,
  practices, and instruments used
• Share information widely so that others may learn
  from and replicate the scientific approach

5
Instrumentation and Data Collection
6
Instrumentation and Data Collection
7
Student Cohorts
8
Data Collection Timeline2005-06

• See Table 4, page 3
• Calendar for eTxTIP events
• Includes TEA evaluation/progress report deadlines

9
Databases

• Teacher database
• Student database
• Teacher-student database
• TCER will collaborate with vendors to create
  common templates
• Submission
• Fall databases, September 9, 2005
• Spring databases, May 15, 2006

10
Site Visits

• No fall site visits (researchers may visit
  professional development activities)
• Spring site visits (March 1-May 5, 2006)
• Teams of one-three researchers
• Site Visit Scheduling
• Identify date for site visit January 2006
• Submit master schedule January 2006
• TCER constructs detailed schedule
• Campus principal/data coordinator confirm
  schedule and inform campus staff about visit

11
Data Collection forSite Visits

• School Measures
• Interviews
• Principal
• Technology person
• Central administrator
• Building walk through
• Update technology inventory

• Teacher Measures
• Focus groups (6th and 7th)
• Classroom observations (6th)
• Student Measures
• Focus groups (6th and 7th)

12
Other Measures

• School Measure
• Principal online survey
• New principals (Sept 5-30, 2005)
• All principals (April 3-May 5, 2006)
• Teacher Measures
• Teacher online survey
• New teachers (Sept 5-30, 2005)
• All teachers (April 3-May 5, 2006)

13
Teacher Assignments Student Work Samples

• Grades 6 and 7 ELA and math teachers
• Typical Assignments
• Submit 3 typical assignments
• Submit student work samples for 1 assignment
• Challenging Assignments
• Submit 3 challenging assignments
• Submit student work samples for 1 assignment

14
Submission of Assignments and Student Work
15
Student Measures

• Student survey
• 6th graders complete survey (Sept 5-30, 2005)
• 6th, 7th, and 8th graders complete survey (April
  3-May 5, 2006)
• Styles of Learning Inventory (SLI)
• 6th graders complete SLI (Sept 5-30, 2005)
• 6th and 7th graders complete SLI (April 3-May 5,
  2006)

16
Other Data Sources

• TCER submits data requests to TEA
• PEIMS and AEIS data
• Texas Assessment of Knowledge and Skills (TAKS)

17
Protection of Human Subjects

• Federal requirements
• Research as defined in Section 97.102(d)Systemat
  ic investigation, including research development,
  testing and evaluation, designed to develop or
  contribute to generalizable knowledge.
• Exception Research and demonstration projects
  approved by a federal agency
• TCER confidentiality agreements submitted to
  districts in fall 2004

18
Other Issues

• Revisions to Data Collection Plan
• Evaluation contacts will be assigned in fall 2005
• Reports to districts and campuses
• Individual campus reports with aggregate data
• Fall 2004 student technology proficiency
• Fall 2004 teacher technology proficiency
• Additional reports with fall-to-spring
  comparisons and grade-level comparisons will be
  forthcoming