McGeeWoodM_etal.pdf (523.47 kB)
Download file

What students really say

Download (523.47 kB)
conference contribution
posted on 26.05.2006, 10:41 by Mary McGee Wood, John Sargeant, Craig Jones
The Assess By Computer (ABC) project (Sargeant et al 2004) follows a Human-Computer Collaborative (HCC) approach to assessment. We focus on constructed answers such as text and diagrams rather than answers requiring mere selection between alternatives. The HCC assessment process is an active collaboration between humans and a software system, where the software does the routine work and the humans make the important judgements. Similar approaches in Artificial Intelligence research are developed in Englebart 1962, Grosz 2004, and Potter et al 2004, among others. Our students, through their answers to questions, also implicitly collaborate in the development of resources. We can develop marking support tools which handle the nature and range of variation found in real exam data, and we can adapt marking judgements and feedback - even, in the longer term, our teaching material - in the light of what students really say. In this paper we focus on the reality of student text answers. We present student data from on-line examinations showing a remarkably wide range of acceptable answers to even the most straightforward of questions. We show how the analysis of these examples is supported by the ABC tools, especially the Keyword Manager and answer clustering options.

History

School

  • University Academic and Administrative Support

Department

  • Professional Development

Research Unit

  • CAA Conference

Pages

536032 bytes

Citation

MCGEE WOOD, SARGEANT and JONES, 2005.What students really say. IN: Proceedings of the 9th CAA Conference, Loughborough: Loughborough University

Publisher

© Loughborough University

Publication date

2005

Notes

This is a conference paper.

Language

en

Usage metrics

Categories

Keywords

Exports