I’m sitting down to write this blog with a sigh of relief. I’m deserting the large majority of 150 first year examination scripts that demand marking. I’ve already gone through enough to have seen the highlights and lowlights and to have discovered that there are ways of getting the questions wrong that I hadn’t dreamed of when I set the paper. But overall the students are doing pretty well. In short, all my interest in the process has gone.
I know we have at least one other teacher out there, and everyone who has been a teacher has faced the same state of desperation. Paper follows paper, nothing new under the sun. One invents excuses for coffee, to do email, to phone this one or that one, to check the stock market, to write a blog. Anything but face the remaining hundreds of papers. And when eventually the excuses are so petty that you can’t abide them any more (I remember emptying the wastepaper baskets on one occasion), you are left with a taste of ashes. What is it all for? Does it make any sense to assess a student’s understanding and knowledge of a course on the basis of a one and a half hour examination where much of the result will be determined by memory, repetitive exercises and garbling the text book and the English language? I’m sure that some students are convinced that the staircase marking method is in actual use. (This is a system where the marker throws the examination scripts down the stairs and awards marks on the basis of how far they travel.) What other reason can explain a student filling three exam booklets in one and a half hours?
|No scripts were hurt in making this picture.|
Assessment is divided between summative and formative. The former should be designed to determine to what extent the student has met the goals of the course. (Unlike in the dark ages where it sometimes seemed that the goal of a course was for the instructor to start at the beginning and to see how far he got, it is universal practice these days to share with the students in advance what you are going to do and what you expect them to do. While this does reduce the element of surprise, it introduces an element of fairness into an otherwise somewhat random process. But I digress. Anything to keep away from the marking.)
Formative assessment is much more interesting. Here the idea is that the student benefits from the process, seeing his mistakes, correcting her misconceptions. Unfortunately this often just reduces to handing back the marked papers so that the students can complain about their marks.
The sad part is that a lot of very thoughtful people have put a lot of worthwhile time into thinking about these issues. Multiple choice questions – marked by computer – can be valuable in both types of assessment if properly designed. (Incidentally Stan designed one of the first systems of this type.) Computers have finite but large (gigabytes and megahertz) of patience. They are quite willing to keep testing students, giving canned feedback, presenting further questions and so on. But intuitively we feel that eventually a human has to read the material if deep learning is to be assessed. Well, maybe not. It turns out that the word structure of the answers can be assessed by computers too if the computers are trained with appropriate model answers.
The question is, is a formal examination the best way to assess students at all? Look at what we do. Tell them to swot everything up for a certain specific day, learn as much as possible by heart, and forget it immediately thereafter. This is just what they are going to do in their future careers, right? Work in isolation, leave the project unfinished after a set period of time, and do so with no reference to their notes, books, colleagues or the internet.
So why don’t we use other forms of assessment? Project work, open book examinations, on-going assessment, group work and so on. Well, it’s hard. I do that with my fourth year students. They find it demanding. The open-book or take-home exams are harder (and harder to set and mark), one worries about copying and how to handle it, how to assess the individual contributions within the group. There are plenty of ways that these issues can be addressed, but it needs time and work and acceptance by all the stakeholders. For 150 freshmen? I don’t know. I can do it, but can they?
Churchill famously said: “Democracy is the worst form of government, except for all those other forms that have been tried from time to time.” I have an awful feeling that examinations are the worst form of summative assessment, except for all those other forms that have been tried from time to time.
Okay, I can’t put it off any longer. 100 papers are queuing for my attention.
Michael – Thursday.