Assessment and Evaluation for Online Courses

1
Assessment and Evaluation for Online Courses

• Associate Professor Dr.
• Annabel Bhamani Kajornboon (kannabel_at_chula.ac.th)
• CULIs 6th Intl Conference Facing ELT Challenges
  
• Nov. 27- 29, 2006

2
Focus

• Assessment
• Evaluation

3
Introduction

• Computers a part of education
• T technology pedagogical problems
• T concern attend seminars, conferences etc.
• In keeping with a learner-centered approach,
  evaluation and assessment should be part of the
  learning-teaching process, embedded in class
  activities and in the interactions between
  learners and teachers (Harasim et al. 1996167).

4
Terminology

• E-learning and online interchangeably
• Assessment
• -the act of judging or assessing a person,
  situation or event
• -learning outcomes assessment provides
  what ss know and can do at specific points
• designed to improve learning

5
Evaluation (1)

• Assess effectiveness of an ongoing program in
  achieving its objective(s)
• Relies on standards of project design to
  distinguish a programs effect from those of
  other forces
• Aims at program improvement through a
  modification of current operation

6
Evaluation (2)

• Collect infor. (assessments) to make informed
  decisions about continued instruction, programs,
  or activities.
• Evaluation can assess both the process and
  outcomes.
• Judging the quality, value or worth of a program
  or student performance using established
  criteria, using gathering data.

7
Evaluation (3)

• Process of determining the adequacy, value,
  outcomes and impact of instruction learning,
• Assessment at a point in time of the value, worth
  of impact of a project or program,
• Can be conducted at various points in a project.

8

Chart 1 Linkage of e-learning courses to
assessment and evaluation

s
Assessment Evaluation
9
Action-Reflection Cycle

• Planning
• Reflecting Acting
• Observing
• 
  

10
Websites Assessments

• Quiz
• Test
• Papers
• Let's look at examples of websites assessment

11
Examples of Websites Assessments

• Example A About English as a 2nd Language
  Prepositions of Place in/at/on-
• There are 15 questions. Ss click the mouse to
  answer the question.
• Ss are given 10 seconds to answer each question
  with only one correct answer.
• Feedback is provided at the end of the
  quiz.

12
Example A About English as a 2nd Language
Prepositions of Place in/at/on
13
Example A About English as a 2nd Language
Prepositions of Place in/at/on (2)

• Last line from previous example More
  prepositions quizzes
• Example B About English as a 2nd Language
  Prepositions of Place in/at/on-
• Feedback is given for correct answer

14
Example B About English Language Prepositions
of Place in/at/on-
15
Example C About English as a 2nd Language
Prepositions of Place in/at/on- If ss do not
click an answer the following appears
16
If students click the incorrect answer the
following appears look atExample D About
English as a 2nd Language Prepositions of Place
in/at/on-
17
Example D Prepositions of PlaceThat answer was
not correct.
18
Example E Lang. Prep. of Place (1)

• When students complete the quiz, the score will
  appear and other quizzes are offered.
• Lets look at the score and what else is offered.

19
Example E Lang. Prep. of Place (2)
20
Other form of assessments

• Electronic portfolios
• Computer-based work checklist
• Peer review
• Sheets
• Close texts
• Learning logs
• Multimedia projects

21
Example G Example of Portfolio Scoring Rubric
22
E-portfolio

• It is a collection of students work that shows
  students efforts, progress, and achievements in
  more or more areas or the curriculum.

23
Example H E-portfolio
24
Example I E-portfolio
25
What to include in an e-portfolio? Collection
can include

• Ss participation in selection content
• Criteria for selection
• Criteria for judging merits
• Evidence of ss self-reflection
• A collection of ss best work or efforts, ss
  choose samples to meet assignment. Show growth
  development.

26
What is necessary to create e-portfolio?

• Equipment
• Software
• Training
• Play
• Plan

• An assessment tool depending on knowledge level
  of T, time T have can invest

27
Example J Example of an e-portfolio
28
E-Portfolio

• An e-portfolio is an organized, purposeful
  collection of students work that displays
  knowledge, understanding, skills,
  accomplishments, interest and achievement over a
  period.
• Time and planning is essential.

29
Example l Sarahs work
30
Example M Ts feedback (1)
31
Evaluation(1)

• The evaluation can be conducted via qualitative
  methods which are often used.
• They tell the programs story by capturing and
  communicating the participants stories.
• The action-reflection cycle can be used.

32
Evaluation (2)

• It would be assessing the program.
• Systematic collection of information about the
  activities characteristics, and outcomes of
  programs to make judgments about the program,
  improve program effectiveness and/or inform
  decisions about future programs.

33
An Example of Evaluation (Research) (1)

• Ajarns teaching oral com. courses were
  interviewed to find out the predicaments they
  were facing.
• What were some of the problems they had
  encountered teaching,
• The interviews were analyzed.
• The data was presented in a matrix form to find a
  common thread.

34
An Example of Evaluation (Research) (2)

• Kajornboon (2005) investigated issues that
  teachers face in teaching oral com. in the Thai
  context and examined existing teaching method in
  oral communication that teachers found effective
  and productive.
• The study aimed to provide a practical guideline
  or checklist to assist ajarns in teaching oral
  communication in order to improve students
  language development.

35
Conclusion

• Web assessment evaluation can take many
  dimensions.
• T set their goal and know what they want to
  measure, such as the course, students, or
  program.
• T choose to do assessment or evaluation that is
  best for their students and course.

36
Q A

• Comments
• Questions
• Thank you
• Email kannabel_at_chula.ac.th
• annabelbk_at_yahoo
• Subj. assessment/evaluation