manuscript_with_author_details_selim_buyrukoglu_10_10_2018.pdf (472.48 kB)

Improving marking efficiency for longer programming solutions based on a semi-automated assessment approach

Download (472.48 kB)
journal contribution
posted on 05.11.2018, 13:32 by Selim Buyrukoglu, Firat Batmaz, Russell Lock
In recent years, many students in higher education have begun to learn programming languages. In doing so they will complete a variety of programming tasks of varying degrees of complexity. The students need to get consistent and personalised feedback to develop their programming skills. Human markers can provide personalised feedback using traditional manual approaches to assessment, but they may provide inconsistent feedback (especially for long programming solutions) since marking the programming solutions of multiple students can represent a significant workload for them. While full-automated assessment systems are the best to provide consistent feedback, they may not provide sufficiently personalised feedback for novice programmers. This study develops a novel semi-automated assessment approach in order to improve efficiency of human marker in the marking process and increase consistency of feedback (for both short and long programming solutions). It advocates the reuse of human marker’s comments for similar code snippets, defined as segmented marking in this study. New full and partial marking models are developed based on segmented marking and they are tested by expert markers. The findings show that the two models are similar in efficiency, but that a partial marking approach potentially offers an improved efficiency for longer programming solutions. Such a finding has significant potential to reduce time spent on marking throughout the sector, which would have significant impact on both resourcing and timeliness of feedback.

History

School

  • Science

Department

  • Computer Science

Published in

Computer Applications in Engineering Education

Citation

BUYRUKOGLU, S., BATMAZ, F. and LOCK, R., 2019. Improving marking efficiency for longer programming solutions based on a semi-automated assessment approach. Computer Applications in Engineering Education, 27(3), pp. 733-743.

Publisher

© Wiley

Version

AM (Accepted Manuscript)

Publisher statement

This is the peer reviewed version of the following article: BUYRUKOGLU, S., BATMAZ, F. and LOCK, R., 2019. Improving marking efficiency for longer programming solutions based on a semi-automated assessment approach. Computer Applications in Engineering Education, 27(3), pp. 733-743, which has been published in final form at https://doi.org/10.1002/cae.22094. This article may be used for non-commercial purposes in accordance with Wiley Terms and Conditions for Use of Self-Archived Versions.

Acceptance date

22/10/2018

Publication date

2019-01-07

ISSN

1061-3773

eISSN

1099-0542

Language

en

Exports