Assessing Distance Learning Programs A Model

1
Assessing Distance Learning Programs A Model

• League for Innovation in the Community College
• Conference on Instructional Technology
• 2006

Mary Beth Orrange Professor of Mathematics Jason
L. Steinitz Professor of Social Science Erie
Community College
2
Session description in program

• Participants develop a national model for
  distance learning program assessment, including
  identifying the variables and discussing issues
  related to interpreting results. The assessment
  plan and the results of the two-year study of
  Erie Community Colleges distance learning
  program are presented and used as the starting
  point for the development of the assessment
  model. The goal is to have participants develop a
  list of variables that provide meaningful
  measures of student learning in distance learning
  programs.

3
Outline of this session

• Introduction
• Brief outline of the assessment of Erie Community
  Colleges distance learning program presented
• Session participants will brainstorm a list of
  variables for distance learning assessment using
  the think-pair-share collaborative learning
  technique
• Participants will then prioritize variables
• Participants develop a national model for
  distance learning program assessment
• Next years round table discussion on distance
  learning assessment will be planned.

4
Erie Community CollegeECC

• A three campus college with an approximate FTE
  count of 10,000
• Part of SUNY (State University of New York) but
  not part of SLN
• A full complement of programs (64) and courses
• Strong union environment

5
Distance Learning at Erie Community College

• Approximately 130 online courses each semester
• Approximately 30 telecourses each semester
• Approved by the Commission on Higher Education,
  Middle States Region, to offer programs at a
  distance
• Approved by the State Education Department of New
  York to offer programs at a distance

6
View ECCs Assessment Project Results

• Visit the website http//south.ecc.edu/dl
• Click on AssessmentgtPerkins Year 2

7
Assessment items

• Passing rates of courses taught at a distance
• Passing rates of seated versions of courses
  taught at a distance
• Determination of when the passing rates are
  significantly different between seated and
  distance courses using the chi-square test
• Pivot table in Excel for passing rates for all
  four semesters

8
Assessment items

• Demographics of students enrolled in distance
  courses
• Student satisfaction Survey administered to
  students enrolled in distance courses
• Self-assessment of skills improvement
  administered to students enrolled in online,
  telecourses, and seated courses
• Characteristics of faculty members teaching at a
  distance

9
Assessment items

• Reasons for withdrawal from courses at a distance
• Study of when students stopped working in courses
  at a distance vs when they withdrew
• Comparison of passing and withdrawal rates for
  pairs of courses taught by the same instructor in
  the same semester.

10
Develop a ModelThe think part

• Use the next five minutes to make a list of items
  that you think should be included in the
  assessment model.

11
Develop a ModelThe pair part

• Turn to someone seated near you and spend the
  next five minutes discussing your two lists.
  Combine the two lists into one.

12
Develop a ModelThe share part

• We will develop a master list of all the
  variables listed by each group in the room.

13
Develop a Model

• We will prioritize the list using the quizdome
  product.
• For each item, select
• a if you feel the item must be included
• b if you feel the item may be included
• c if the item does not belong in the model.

14
Implement the Model

• Return to your campus and collect data regarding
  one of the items we selected.

15
Refine the Model

• Come back next year and discuss your results at
  the roundtable session on the Assessment of
  Distance Learning.

16
Contact us

• Jason L. Seinitz, PhD
• steinitz_at_ecc.edu
• Professor of Social Science
• [phone]
• Mary Beth Orrange
• orrange_at_ecc.edu
• Professor of Mathematics
• [phone]

Erie Community College, South Campus 4041
Southwestern Blvd. Orchard Park, NY 14127
This PowerPoint show is available at
http//south.ecc.edu/orrange
See you next year!