Wednesday, September 21, 2011

Is there a case for summative assessment?

This was written by David Didau who is a Head of English at Priory Community School. Davidblogs here and tweets here.

by David Didau

I’ve written a lot on the importance of formative assessment recently and feel pretty cear in my own mind of its efficacy. In contrast I see summative assessment as existing only as an external measure of success or failure. I know it exists and I know it’s fairly important to my students’ life chances. It’s also one of the primary means by which my professional practice is judged, so I’d better take notice of it. This seems like a necessary evil, not something to be celebrated.

Cristina Milos and Jennifer Borgioli have challenged this view and asserted that actually, summative assessment has its place in the classroom and fulfils a useful purpose. Cristina says that summative assessment “need not be constructed in terms of pass/fail” and Jennifer suggests that “quality assessment is about balance” and using the right tool and the right time. She also says that the problem with using formative assessment to evaluate whether learning has occurred is that it is “unethical to evaluate a learner while they are still learning”.

Now, I consider myself to be an open minded chap, so it seemed reasonable to check out what’s been written on the subject to see if there is merit in their views.

Firstly, let’s define our terms. Summative Assessment is the formal testing of what has been learned in order to produce marks or grades which may be used for reports of various types. This is different from Formative Assessment, in which the emphasis is on on-going assessments of different types used to judge how best to help pupils learn further. Have I got this right? I’d be very grateful if anyone would like to (politely) set me straight.

Research suggests that while summative assessment can be motivating for some students, it has a negative effect on others:
  • After summative assessment, low-achieving pupils had lower self-esteem than higher-achievers, whereas there had been no correlation between self-esteem and achievement before
  • Repeated practice tests reinforce low self-esteem of low achievers
  • When results of summative assessment are presented as primarily relating to individual pupils the negative effect on low-achievers is more pronounced than when the results are for evaluation of school or authority standards.
  • Secondary age low-achievers may deliberately underperform in summative assessments because they are failing anyway
  • Summative assessments can be limiting for the most able
  • “Big bang” tests cause anxiety in pupils, especially girls and widen the gap between high and low achievers’ motivation
  • Summative assessment promotes “extrinsic” motivation, in which pupils respond to the promise of some kind of reward rather than “intrinsic” motivation in which they perform because they are interested and want to do the work
Summative assessment can also produces problems for the curriculum and with teaching:
  • The curriculum can be narrowed by “teaching to the test” which can take away from curriculum content
  • It can produce distortion in terms of teaching techniques
  • Summative test questions may not be framed in the same way as those preferred for formative assessment
  • Teachers can spend a lot of time on summative assessment which does not directly improve pupils’ learning
  • Teachers sometimes adopt a more didactic “transmission” style of teaching which disadvantages those who don’t respond well to it
Now, I accept that many of these problems can be planned for so that their effects are minimised if not avoided all together. Here are some of the ways to avoid some of the pitfalls:
  • Intrinsic interest in tasks can be encouraged
  • Students’ awareness of learning goals rather than test performance goals can be developed
  • A wide range of types of understanding can be included in summative assessment
  • Some formative assessment evidence may be included in summative reports
  • Peer- and self-assessment could be included in summative records
  • Tests don’t need to be formal written assessments
  • The comparison of individual pupils on the basis of scores can be avoided
  • Summative tests can be placed before the end of a teaching block so that there is some opportunity for follow-up based on the results, and even reassessment
  • Summative judgements can be made on the basis of a variety of tests (varied both in form and content)
  • Students could carry forward lessons from assessments even into the next school session (eg in the form of a copy of their school report)
  • Feedback can be given to pupils in terms of the learning goals rather than just a test mark
  • Tests might be devised to assess separate elements of the course separately
  • In practising for summative assessment, pupils can make up and answer their own questions. (Research has shown this to be an effective strategy)
  • Tests can be timed according to pupil readiness rather than leaving them to the end of the block of work
  • Summative assessment can be presented realistically, as being limited
  • Tests can provide evidence for evaluating courses and teaching approaches
  • Whole-school discussion of such assessment principles can be helpful
The problem is though that these measures, whilst all very worthy, only provide a way to cope with something that is essentially damaging. Look how tentative the language is: the potential harm of summative assessment can, could, might be ameliorated by conducting it in a more formative way. If that’s the case, why bother? Why not simply ensure that all assessment provides opportunities for formative feedback which enable the teacher to redirect teaching and the learner to make progress?
Maybe I’m being dense but I really struggle with the idea the summative assessment is useful for anything other than providing data on students’ (and teachers’) success and failure. I’m not being bombastic and I like to think that I don’t deal in “vague rhetoric” as Cristina accuses me. In fact I’m desperately keen to be shown the error of my ways and will respond positively and graciously to any comments. 

Over to you.

6 comments:

  1. If the class is using ongoing formative assessments and judging how best to teach they would have to know essentially the root cause of any student struggling on assignments and must be able to clarify through frequent skills achievement tests for each grade level if it is a basic reading weakness that has developed in judging how best to teach. If we focus on the result we see summative or test as making students low achievers or have low esteem and do not bother to look for the root cause of their low achievement and lack of assurance. Consider what would be causing low achievement such as basic reading and cursive writing skills and then judge how best to teach and watch self-esteem, creativity and ownership grow. Research (that is intended to provide clarity) suggests that learning basic grammar decoding reading and cursive writing skills is not like a ‘switch’ it is a process and requires repetition and perhaps this fear of ‘repetition’ or not being a happy safe school characteristic or environment has begun to affect perceptions and attitudes. What would be wrong with a student being presented with a formative assessment often to evaluate whether learning has occurred and knows that a summative assessment is coming and knows there is an expectation of effort, proficiency or correctness?
    I apologize for not completely reading the article however found it hard to deal with a deficit perception that any secondary student would deliberately underperform in any assessment, perhaps the public could expect any form of assessment to more accurately judge and identify root cause of why the student may be struggling without blame and prevent difficulties.
    BLogan

    ReplyDelete
  2. Hi Joe,

    I do not teach in school but teach engineering to young apprentices that are learning to be the next generation of engineers in the UK. I agree with a great deal of what you say in your many postings regarding summative assessment and that formative assessment is more likely to provide the encouragement for students to learn. I have particular concerns about my students seeing the 'summative assesment' of a unit of study as the 'endpoint of learning' on a particular topic. I have a view that this has been built into the students' minds somewhat because of 'teaching to the test'. It is very important that student engineers moving into real work need to be prepared for the fact that they need to carry on learning for the remainder of their working lives and that there will not always be a friendly teacher to tell them how to do it.

    I do however have the opinion that there are cases in my teaching for summative assessment of key parts of an engineers abilities particularly practical ones that might inviolve them being assessed as capable of carrying out a function that might affect the safety of others (bleeding the brakes on a car for instance).

    I will be interested to hear if you have any views to counter my comments.

    Mike Betts

    ReplyDelete
  3. I'm testing to see if my comment will publish.

    ReplyDelete
  4. Hi Joe,

    I find it pretty distressing if not dishonest to present only David's side of the story and not the comments that both Jennifer and I made.
    Because he eventually came to the conclusion that he practiced and has seen summative assessment in a particular way which matched neither my view nor Jennifer's.

    ReplyDelete
  5. Below are our replies:
    Jennifer's http://tinyurl.com/6o82uzw
    and mine http://tinyurl.com/6o82uzw

    ReplyDelete
  6. Cristina, are you assuming that I censored comments from you or Jennifer?

    If this is your assumption it is as irresponsible as it is incorrect. If you or Jennifer wish to post a comment in regards to this post, go right ahead.

    The only thing distressing about this situation is that you have jumped to accusing me of being dishonest before engaging in a conversation about why a comment of yours did not post. If you are having technical difficulties, I suggest you take this up with the appropriate people.

    In the mean time, feel free to comment on the content of this post just like everyone else.

    Joe

    ReplyDelete