Online Assessment and Evaluation Techniques at the K-12 Level

1
Online Assessment and Evaluation Techniques at
the K-12 Level

• Dr. Curtis J. Bonk
• Indiana University and CourseShare.com
• http//php.indiana.edu/cjbonk
• cjbonk_at_indiana.edu

2
Online Student Assessment
3
How the Internet Will Help Large-Scale
Assessment Reinvent Itself (2001, Feb).
Education Policy Analysis Archives, Volume 9
Number 5, By Randy Elliot Bennett, Educational
Testing Service, U.S.A.

• In the same way that the Internet is already
  helping to revolutionize commerce, education, and
  even social interaction, this technological
  advance will help revolutionize the business and
  substance of large-scale assessment.

4
Assessments Possible

• Online Portfolios of Work
• Discussion/Forum Participation and Feedback
• Online Mentoring
• Weekly Reflections or Logs
• Tasks Attempted or Completed, Usage
• Quizzes, Tests, Problems, Cases, Group Work???

5
Students as Infotectives (Jamie McKenzie,
Grazing the Internet Rasing a generation of
free-ranging students. Sept. 1998, pp. 26-31,
Phi Delta Kappan)

• Inquiry and Detective Skills
• changing course, asking for help,
• framing essential questions and subsidiary
  questions,
• planning voyage,
• screening garbage, analyzing data.
• Suggesting and testing hypotheses
• Envisioning whats possible, invent, rearrange
• Seeing whats missing
• Suspending judgment

6
Students as Authors of Knowledge (Lehrer, 1993)

• Ability to use electronic databases
• Locate and select information
• Segment information into useful categories
• Interpret and summarize information from multiple
  sources

7
Issues to Consider

1. Bonus pts for participation?
2. Peer evaluation of work?
3. Assess improvement?
4. Is it timed? Give unlimited time to complete?
   Allow retakes?
5. How measure competency? How demo learning?
6. Cheating. Is it that student?

8
Reducing Cheating Online(7-30/page,
http//www.syllabus.com/ January, 2002, Phillip
Long, Plagiarism IT-Enabled Tools for Deceit?)

• http//www.plagiarism.org/ (resource)
• http//www.turnitin.com/ (software, 100, free 30
  day demo/trial)

9
What is Available?

1. Online Rubric Examples/Builders
2. Online Gradebooks
3. Online Test Tools Exam Reviews
4. Survey and Polling Tools
5. E-Portfolios (Student and Teacher)

10
I. Online Rubrics
11
(No Transcript)
12
(No Transcript)
13
(No Transcript)
14
(No Transcript)
15
(No Transcript)
16
(No Transcript)
17
(No Transcript)
18
(No Transcript)
19
(No Transcript)
20
(No Transcript)
21
II. Electronic Gradebooks (Vockell Fiore, 1993)

• Calculate scores, store info
• Weight scores
• Flag students with certain characteristics
• Print reports by individual or group
• Provide prompt feedback
• But inflexible, impersonal, can be incorrect

22
(No Transcript)
23
(No Transcript)
24
III. Online Testing Tools
25
Courseware Test Tools
26
(No Transcript)
27
eduTest from Lightspan

• Tailored Assessments for You
• Customize and design assessments to meet your
  district and state objectives.
• Control assessment content and delivery.
• Access a powerful search engine with over 60,000
  test items.
• Create and add tailored test items.
• Develop your own test items in additional
  languages and in other subject areas.

28
Test Selection Criteria (Hezel, 1999 Perry
Colon, 2001)

• Easy to Configure Items and Test
• Handle Symbols, Timed Tests
• Scheduling of Feedback (immediate?)
• Flexible Scoring and Reporting
• (first, last, ave, by individual or group)
• Easy to Pick Items for Randomizing
• Randomize Answers Within a Question
• Weighting of Answer Options
• Web Resource http//www.indiana.edu/best/

29
(No Transcript)
30
(No Transcript)
31
(No Transcript)
32
(No Transcript)
33
Fun and Games Testing
34
(No Transcript)
35
(No Transcript)
36
IV. Online Survey Tools for Assessment
37
Web-Based Survey Advantages

• Faster collection of data
• Standardized collection format
• Computer graphics may reduce fatigue
• Computer controlled branching and skip sections
• Easy to answer clicking
• Wider distribution of respondents

38
Sample Survey Tools

• Zoomerang (http//www.zoomerang.com)
• IOTA Solutions (http//www.iotasolutions.com)
• QuestionMark (http//www.questionmark.com/home.htm
  l)
• SurveyShare (http//SurveyShare.com from
  Courseshare.com)
• Survey Solutions from Perseus (http//www.perseusd
  evelopment.com/fromsurv.htm)
• Infopoll (http//www.infopoll.com)

39
Survey Student Opinions (e.g., InfoPoll,
SurveySolutions, Zoomerang, SurveyShare.com)
40
(No Transcript)
41
V. Digital Portfolios

• A purposeful collection of work, captured by
  electronic means, that serves as an exhibit of
  individual efforts, progress, and achievements in
  one or more areas. (i.e., demo how they know
  what came to know how knowledge increased and
  evolved)
• Terry Wiedmar, 1998

42
Learning Logs (Paul Hickman, Northeastern
University)

• Combines journal writing and portfolios.
• Interactive (student-student, student-tchr)
• Collaborative (share thoughts, consensus)
• Electronic (word processed exchanged)
• Essentially portfolios of student work.
• Generate qs, summarize articles, reflect on what
  learned, test models, propose explanations for
  results

43
E-Portfolios What might they include?

• Multimedia presentations (video, animation,
  voice-over testimonials)
• Examples of work
• Personal statement
• Self-reflections on that work
• Connections between experiences
• Standard biographical info
• i.e., progress, achievements, efforts
• Large, complex, time to grade

44
E-Portfolios Skills Learned(Sanders, 2000)

• Planning, design, and reflection on work
• Revision and evaluation of work
• Communication of work
• Consideration of audience
• Track personal improvements and accomplishments

45
(No Transcript)
46
(No Transcript)
47
Sample Portfolio Scoring Dimensions(10 pts
each)(see http//php.indiana.edu/cjbonk/p250syl
a.htm)

1. Richness
2. Coherence
3. Elaboration
4. Relevancy
5. Timeliness
6. Completeness
7. Persuasiveness
8. Originality

1. Insightful
2. Clear/Logical
3. Original
4. Learning
5. Fdback/Responsive
6. Format
7. Thorough
8. Reflective
9. Overall Holistic

48
What about Teacher E-Portfolios

• Digital pictures of student activities
• Handouts from coursework
• Philosophy statements
• Videotapes of teaching
• Audio recordings
• Lesson plans

• Letters to parents
• Letters of rec
• Sample writing
• Newspaper clippings of their activities
• Work from students
• Student evaluations
• Self-evaluations

49
(No Transcript)
50
(No Transcript)
51
TICKIT Teacher Institute for Curriculum
Knowledge about the Integration of Technology
(http//www.indiana.edu/tickit)

• TICKIT Training and Projects
• Web Web quests, Web search, Web
  editing/publishing.
• Write Electronic newsletters.
• Tools Photoshop, Inspiration, PPt.
• Telecom e-mail with Key pals.
• Computer conferencing Nicenet.
• Web Course HighWired.com, MyClass.net,
  Lightspan.com, eBoard.com
• Digitizing using camera, scanning, digitizing.

52
Technology Integration Ideas

• Collab with students in other countries
• Make Web resources accessible
• Experts via computer conferencing (or interview
  using e-mail)
• Reflect Discuss on ideas on the Web.
• Put lesson plans on Web.
• Peer mentoring.
• Other role play, scav hunts.

53
(No Transcript)
54
(No Transcript)
55
(No Transcript)
56
(No Transcript)
57
(No Transcript)
58
(No Transcript)
59
(No Transcript)
60
(No Transcript)
61
(No Transcript)
62
(No Transcript)
63
(No Transcript)
64
(No Transcript)
65
(No Transcript)
66
Self-Assessment
67
Quest Atlantis Project

• Quest Atlantis is a Web-based community-driven,
  meta-game built using 3D technologies and that
  combines elements of play, role playing,
  adventure, and learning,
• allowing 9-14 year old children from diverse
  socio-economic backgrounds to virtually travel to
  3-D, worlds where they select engaging quests,
  talk with other Questers and mentors, and build
  virtual persona.

68
Legend of Atlantis

• Atlantis is facing impending disaster
• Disaster is a result of lost values and corrupt
  leadership
• A Council of Elders opened a portal to find help
• Children of the Earth can use this portal to save
  Atlantis
• Centers have been created to access the portal
• Children must save Atlantis and avoid our common
  fate

69
(No Transcript)
70
Future Testing Trends???

• Computerized Writing Assessments
• Project Essay Grade (PEG)
• Computer Adaptive Testing (CAT)
• E-Portfolios Standard
• Language Translation
• Digitized Expert Performances (standards)

71
Tips on Online Authentification

• Today
• Check e-mail access against list
• Use password access
• Provide keycode, PIN, or ID
• Future
• Palm Print, fingerprint, voice recognition, iris
  scanning, facial scanning, handwriting
  recognition, picture ID)

72
So, Where is Korea Headed???