??????? IS 204420

1
??????? IS 204420 ??????????????????????????? ???
????? 3 ????????????? (Design) 3.4
????????????????
2
3.4 ????????????????
3.4.1 ??????????????????????? 3.4.2
???????????????????????????????????? 3.4.3
????????????????????????????????? 3.4.4
????????????????? 3.4.5 ???????????????????? 3.4.
6 ????????????????????????????
3
3.4.1 ???????????????????????

• ?????????????????????????? ????????????????
• ???????????????????????
• ???????????????????? ISD ???????????????????????
• ??????????? ????????????? ?????????????????
• ???????

4
3.4.2 ????????????????????????????????????
(Achievement Tests)
1) Criterion - referenced Tests - CRTs 2) Norm
- referenced Tests - NRTs
5
1) Criterion - referenced Tests - CRTs

• Criterion - referenced test ??????????? Content
  -
• referenced test ???? Objective - referenced
  test
• ????????????????????????????????????????????????
  ???????
• ???????????????????????????????????????????????
  ???????????
• ????????????????? CRT ??????????????????????????
  ????????
• ????????????????????????????????????????????

6
1) Criterion - referenced Tests - CRTs ???

• ??????????????? CRT ????????????????????????????
  ???
• ??????????????????????????????
  ???????????????????????????
• ???????????????
• CRT ????????????????????????????????
• ??????????????????????????????????? CRT
  ??????????????
• ???????????????????????? ??????????????????????
  ?????????
• ???????????? ?????????????????????

7
2) Norm - referenced Tests - NRTs

• ????????????????????????????????????????????????
  ?
• ???????????????????????????????????????????????
  ?????????
• ???????????????????????????? ??????????????
• ??????????????????? NRT ????????????????????????
  ??????
• ???????????????????????????????????????????????
  ??????
• ??????? NRT ????????????????????????????????????
  ???
• ?????????????????????????????????????????????

8
3.4.3 ?????????????????????????????????
1) ???????????????????????? (Pre -
assessments) 2) ????????????????????????
(Embedded Items) 3) ????????????????????????
(Post - assessments)
9
3.4.4 ?????????????????
1) ??????????????? (Cognitive Tests) 2)
?????????????????? (Performance Tests)
10
1) ??????????????? (Cognitive Tests)

• ????????????????????????????????????????????????
  ???????????
• ????????????????????????????????????????????????
  ??
• ?????????????????
• ???????????????????????????????????????
  multiple
• choice, true - false, fill - in, matching,
  short
• answer, essay

11
2) ?????????????????? (Performance Tests)

• ?????????????????????????????????????????????????
  ????
• ???????????? ?
• ?????? Performance ??????????? Procedures
• (Process) Products ??? Portfolios
• ??? OUTPUT ?? INPUT/ACTION/OUTPUT Diagram
• ???????????????????????? ??????????????????????
  ????
• ?????????
• ??? OUTPUT ????????? ?????????????????????
• ?????????????????????????????????

12
3.4.5 ????????????????????
1) ????????? (Validity) 2) ????????????
(Reliability)
13
???????????????????????????????

• ??????? (Validity) ?????????????????????????????
• ???????????? ??????????? ?????????????????
• (Content Validity) ???????????????????????????
• ??????????
• ?????????? (Reliability) ??????????????????????
• ????? ???????????????????????????????????? ?
  ?????
• ???????????????????????????? 2 ????????? ????
• ??? (Validity) ????????????? (Reliability)

14
??????????????????????????????? ???

• ????????????????????????????????????????????
• ???????????????????????????? ?
• ??????????????????????? ? ??????????????????????
  ??????
• ??????????????????????? ???????????????????????
  ???
• ????????????????????????????????????????? 2 ???

15
3.4.6 ????????????????????????????
1) Task / Objective / Criterion Charts 2) Table
of Specification 3) Error Matrices
16
1) ???????? Task / Objective / Criterion Chart

• Task ???????????????????? Task Inventory
• Objective ??????????????????????????????????????
  ?????
• ????? TPO/EO
• Criterion ??????????????????????????????????????
  ?????
• ???????????????? Objective
• ???????? Task / Objective / Criterion Chart
  ?????
• ??????????????????????????????????????????

17
???????? Task / Objective / Criterion Chart
Task Objective Criterion
(TPO/EO) - ??????????????? ???????????????
4 ????????????????? ?????????????? 4
???????????????????? ???. ?????? ????
?????? ??????? ????????? ???????
????????????????????? ??????? ??????
???????????????????? ??????????
??????? ??????????? ?? ???.
?????? ?????????????????? ??????????
?????????? ??????????????
18
2) ???????? Table of Specifications

• ?????????????????????????????????????????????
• ????????????????????????????????????????
• ????????????????????????????????????????
• ??????????????????????????? Task / Objective /
• Criterion Chart

19
???????? Table of Specifications
??????? ?????????? ???????
??? ???????? ???????
1. ??????????????? 2 - 2
Multiple Choice 2. ??????????????? - 2
2 Checklist 3. ?????????????? -
1 1 Checklist 4. ????????? -
1 1 Multiple Choice 5.
??????????????? - 1 1
Multiple Choice 6. ??????????? - 1
1 Checklist 7. ?????????? - 1
1 Checklist ??? 2 7
9
20
????????????????
?????? ?????????????????????????????????????
1. ??????
??????????????????????? ?. ???????????? ?.
???????? ?. ????? ?. ??????
21
?????? ?????????????????????????????????????????
????? ?????????? 1-14 ?????????????????????????
?? .......... ??????????????????? ..........
?????? .......... ?????????????????? .......
... ?????? .......... ?????????
..........???????? ..........
??????????????????????? ..........????????????
???? .......... ?????????????
..........????????????????
.......... ????????????????????????
..........?????????????? ..........
????????????????????????????
..........????????????????
22
?????? ????????????????????????????????????
??????????????????
.......... ??????????? ..........
??????????? .......... ??????????? ..........
??????????? .......... ??????????
23
???????? Checklist
??????? ?????
?? ?????
1. ?????????????????????????? ? 2.
?????????????????? 3. ???????????????????????????
??????????? 4. ?????????????????????
???????????????????? 5. ????????????????????????
24
?????????????????????????????????????????????????
????????
????????????????? ?????
???????? ???????????
OBJECTIVE True False C
Efficient for items with only two
logical responses Completion C
Natural for brief Responses
Multiple-Choice C Use when
answer is long, reduces effect of
guessing, so can have fewer items
Matching C Efficient but not for
higher level learning tasks
25
?????????????????????????????????????????????????
???????? ???
????????????????? ?????
???????? ???????????
ESSAY Essay C Score
systematically Extended Report
C Clarify required components ACTIVITY Lab
Reports C Type of learning used for
depends on content and structure
Exercises C, P Separate use for testing
from use for instruction Projects
C, P, A Good for interactive domain
learning
26
?????????????????????????????????????????????????
???????? ???
????????????????? ?????
???????? ???????????
OBSERVATION Checklists P,
A Excellent for procedural knowledge and
practice Rating Scales P, A Self or
observational, degrees of subjectivity
Anecdotes A Subjective (self-report)
Interviews A Revealing, can have degree
of objectivity
27
?????????????????????????????????????????????????
???????? ???
????????????????? ?????
???????? ???????????
APPLICATION Problem Solving C, A For
higher level of learning Product C, P,
A Especially for interactive domain
learning
C Cognitive (??????????) A Affective
(????????) P Psychomotor (?????????)
28
3) ???????? Error Matrices

• ???????????????????????????????????????????????
• ??????????
• ????????????????????????????????????????????????
  
• ???????????????????? ???????????????????????
• ?????????????????????????????????

29
???????? An Error Matrix
????????????/?????? 1 2 3 4 5 6 7 8
9 ????????
6 ???????? 1 ?????????
1 ???? 1 ???? 4
????????? 1 ??? 2 2 1
6 1 1 1 0 0 14
X
X
X
X
X
X
X
X
X
X
X
X
X
X