SPIE2017.pdf (221.06 kB)
Download file

Exploring the potential of analysing visual search behaviour data using FROC (free-response receiver operating characteristic) method: an initial study

Download (221.06 kB)
conference contribution
posted on 06.04.2017, 11:11 by Leng Dong, Yan Chen, Sarah Dias, William Stone, Joseph Dias, John Rout, Alastair G. Gale
Visual search techniques and FROC analysis have been widely used in radiology to understand medical image perceptual behaviour and diagnostic performance. The potential of exploiting the advantages of both methodologies is of great interest to medical researchers. In this study, eye tracking data of eight dental practitioners was investigated. The visual search measures and their analyses are considered here. Each participant interpreted 20 dental radiographs which were chosen by an expert dental radiologist. Various eye movement measurements were obtained based on image area of interest (AOI) information. FROC analysis was then carried out by using these eye movement measurements as a direct input source. The performance of FROC methods using different input parameters was tested. The results showed that there were significant differences in FROC measures, based on eye movement data, between groups with different experience levels. Namely, the area under the curve (AUC) score evidenced higher values for experienced group for the measurements of fixation and dwell time. Also, positive correlations were found for AUC scores between the eye movement data conducted FROC and rating based FROC. FROC analysis using eye movement measurements as input variables can act as a potential performance indicator to deliver assessment in medical imaging interpretation and assess training procedures. Visual search data analyses lead to new ways of combining eye movement data and FROC methods to provide an alternative dimension to assess performance and visual search behaviour in the area of medical imaging perceptual tasks.



  • Science


  • Computer Science

Published in

SPIE Medical Imaging


DONG, L. ... et al, 2017. Exploring the potential of analysing visual search behaviour data using FROC (free-response receiver operating characteristic) method: an initial study. IN: Kupinski, M.A. and Nishikawa, R.M. (eds). Medical Imaging 2017: Image Perception, Observer Performance, and Technology Assessment, Proceedings of SPIE, Vol. 10136, 1013604, Orlando, Florida, United States, 10th March 2017, doi:10.1117/12.2255901.




VoR (Version of Record)

Publication date



Copyright © 2017 SPIE. Society of Photo Optical Instrumentation Engineers. One print or electronic copy may be made for personal use only. Systematic reproduction and distribution, duplication of any material in this paper for a fee or for commercial purposes, or modification of the content of the paper are prohibited.








Orlando, Florida, United states