Student assessment Research findings

1
Student assessmentResearch findings

• Zadar Tempus projectReform of Croatian legal
  education

2
Research methodology

• Ana Baric, LL.B. (in spe)

3

• basic framework
• questionnaire with 80 questions
• 17 exams with written and oral part of the exam
• 12 oral exams
• 10 students conducting research
• 76 professors included in the research
• exam terms in January and February
• around 300 student working hours altogether

4
Provisional and incompleteresults arising from
the questionnaire

• Prof. Dr. Alan Uzelac

5
Elements of the research

• Methods
• analysis of the annual statistics
• (24.602 exams)
• analysis of one exam term (February)
• (3.760 applications,1.809 exams)

• Parts of evaluation
• preparation for exams
• applications for examination
• techniques of examination
• oral/written
• applied methods of examination
• publicity
• results

6
COMPULSORY SUBJECTS ELECTIVE SUBJECTS
Roman private law Legal psychology
General history of law and state International maritime law
Croatian legal history in European context English I
General theory of law and state English II
Sociology German I
Political economy German II
Economic policy
Family law
Criminal procedure
Criminal law
Statistics and information science
Civil procedure
Civil law
International law
Financial law and financial science
Administrative science
Labour law and social security
Commercial law
Private international law
Administrative law
Company law
Maritime and general transport law
Constitutional law
23
6
12
17
7
Preparation for the examsIs teaching useful at
all?
8
Frequency Percent
Seminars are recommended and greatly facilitate success in exams 9 42,9
Seminars are useful but literature is more important 10 47,6
Seminars arent useful, it is better to learn from the literature 1 4,8
Seminars dont take place 1 4,8
Total 21 100,0
Frequency Percent
Lectures are recommended and facilitate pass 4 19,0
Lectures are useful but literature is more important 17 81,0
Lectures arent useful, it is better to learn from the literature 0 0,0
Lectures dont take place 0 0,0
Total 21 100,0
9
Seminarists privileges?
10
Techniques of examinationWriting v. Orality
11
Methods of written tests

• Written test 17 courses (v. 12)
• Anonymous none (at the term)
• Multi-part (test and essay) 5 (yes) v. 12 (no)
• Quitting without fall 5 (no) v. 12 (yes)
• Types of written tests
• multiple choice (28)
• filling-in the form (22)
• essays (10)
• longer questions (7)
• shorter questions (20)

12
Methods of oral examination
13
Methods of oral examination
How do students take oral examination? How do students take oral examination? Frequency Percent
One student alone in the room 7 9,7
One student, others listen 45 62,5
Oscillating between students who take exam 20 27,8
TOTAL 72 100,0
14
Relation of written and oral part

• Common elements
• pass at written part necessary for taking of the
  oral examination
• minor exceptions
• (new) statutory option for examination boards
• borderline cases
• The meaning of pass at written exam?
• possible options
• only ticket to oral part
• correction of grading
• great influence on grading
• automatic pass
• with the grade from the written part
• with only the passing grade
• differences even within the same course

15
Publicity of exams
16
Announcing the written test results
17
Publicity of oral examination

• generally, exams are made in public
• first layer students who take the exam
• group exams 7 (individual) 65 (other students
  who take the exam present)
• second layer other interested students
• 5 reported cases of no public at the oral
  examination
• reasons stated
• request of the teacher (1)
• request of the student (1)
• other (alleged lack of space) - 3

18
(No Transcript)
19
Results
20
First to last year of study average success
2,82
3,15
3,02
2,80
21
Comparison annual and monthly statistics
Compatibility grades during the year to the
grades on this term
22
Grades percentage of success
1
5
2
4
3
2
3
4
5
1
23
Success/methods
Grades regarding if the exam is only oral or
written and oral
24
Success in individual courses
25
Reliability of comparison negative grades
26
Success in individual courses
27
Diploma (final exam) success story
28
Number of defended final papers
29
Diploma (final exam) success story
The final paper was defended before The final paper was defended before Frequency Percent
3 teachers, continously 10 52,6
Mainly 3, sometimes 2. 4 21,1
Rarely 3, more often 1 or 2. 5 26,3
Total 19 100,0
30
Output number of graduated students
Year Inscr. Grad.
91/92 561 203
92/93 811 272
93/94 1123 237
94/95 1231 242
95/96 1496 268
96/97 1440 294
97/98 1552 366
98/99 1427 354
99/00 1145 396
00/01 1133 426
01/02 956 453
02/03 1111 453
03/04 969 445
04/05 1006 497
05/06 1050 216
TOTAL
31
Final Questionsfor not so Final Solution

• Prof. Dr. Hrvoje Sikiric

32
Open questions ???????????

• Teaching (lectures, seminars) / Exams
• Number of exam terms per year, plan of terms
• Avoiding overlapping of terms
• Distribution of exams into subsections
• Techniques of examination writing v. orality
• Written exams Standards unanimity v.
  diversity
• Anonymity
• Structure questions, case analysis, essays
• Evaluation grading, selectiveness
• Duration
• Oral exams
• Ensuring objectivity?
• Publicity

33
Thank you for your attention!
34
(No Transcript)