User-centred evaluation of complex IT&T within an operational environment

The aim of this paper is to provide guidance for the user-centred evaluation of new and complex Information Technology and Telecommunication systems within an industrial operational environment. This paper draws upon practical and methodological experience gained over a period of nearly a decade in order to: • Discuss the efficacy or otherwise of some typical Human Factors evaluation techniques • Describe the common constraints that are likely to arise during an industriallybased evaluation process • Provide guidance for overcoming these barriers to a successful and informative evaluation process Specifically, this paper aims to identify some of the key requirements for undertaking a successful evaluation process within a challenging environment and presents recommendations to maximise the efficacy of the evaluation effort.