Seen Tests

1
Seen Tests

• An Initiative at DWC

2
The Concept

• Closer to real life situations.
• Motivate students to read more in depth.
• Provide readings to be used as resources.
• Maintain the core values of assessment
  reliability, and validity.
• Wider range of skills than the traditional tests.
• E.g., reviewing, reflecting and long term
  retention.

3
The Rationale

• Focus on matching assessment tasks with skills
  that have been identified by employers at the
  local level.
• Via Graduate Skills Survey
• Employer Forums
• Felt unseen tests did not effectively measure
  students abilities to enter a work environment.

4
The Rationale Continued

• Projects meant we need a workplace-like
  environment.
• We wanted something that could be a resource for
  students.

5
What we did

• Provided a practice for students to familiarize
  with format.
• Took the readings and
• Removed underlines, italics, etc.,
• Handed out on the Wednesday (all students signed
  for it).
• Test given on Saturday.
• Old copies handed in.
• New copies handed out.
• Students worked on new copy.
• Teachers did not answer questions.
• Students were expected to work together.

6
Results

• First assessment overall pass rate approaching
  90.
• One of our highest pass rates ever.
• Assessment 2 our pass rate dipped to 62.43.
• Overall years pass rate was 85.5 ,
• Previous year with unseen was 78.8 .
• Students and teachers felt test was a better
  overall assessment.

7
Student Comments 1st Try March 2004
8
1st Try Continued
9
2nd Try May 2004
10
2nd Try Continued
11
October 2004
12
October 2004 Continued
13
What teachers said
14
Benefits

• Transparency
• Students are now being tested from materials that
  they would see in their projects.
• Students can now use as resources.
• Authenticity
• Tests replicates work-type reading more.
• Student work on the papers
• They put an enormous effort into the papers.
• Study time increased
• Vocabulary retention increased.

15
Issues

• Students not present to receive exams.
• Baby with the bathwater.
• Provide as many different chances as possible.
• Continue to do unseen as well.
• Electronic vs. paper.
• Security.
• Washback from IELTS.

16
Contact Us

• Andrew OSullivan
• andrew.osullivan_at_hct.ac.ae
• Cheri MacLeod
• cheri.macleod_at_hct.ac.ae
• Derrick Millard
• derrick.millard_at_hct.ac.ae