Loughborough University
Browse

File(s) under permanent embargo

Reason: This item is currently closed access.

A new engineering approach to reveal correlation of physiological change and spontaneous expression from video images

conference contribution
posted on 2016-03-23, 09:50 authored by Fenglei Yang, Sijung HuSijung Hu, Xiaoyun Ma, Harnani Hassan, Dongqing Wei
Spontaneous expression is associated with physiological states, i.e., heart rate, respiration, oxygen saturation (SpO2%), and heart rate variability (HRV). There have yet not sufficient efforts to explore correlation of physiological change and spontaneous expression. This study aims to study how spontaneous expression is associated with physiological changes with an approved protocol or through the videos provided from Denver Intensity of Spontaneous Facial Action Database. Not like a posed expression, motion artefact in spontaneous expression is one of evitable challenges to be overcome in the study. To obtain a physiological signs from a region of interest (ROI), a new engineering approach is being developed with an artefact-reduction method consolidated 3D active appearance model (AAM) based track, affine transformation based alignment with opto-physiological mode based imaging photoplethysmography. Also, a statistical association spaces is being used to interpret correlation of spontaneous expressions and physiological states including their probability densities by means of Gaussian Mixture Model. The present work is revealing a new avenue of study associations of spontaneous expressions and physiological states with its prospect of applications on physiological and psychological assessment.

Funding

The authors are grateful to all the members from Shanghai University, Loughborough University and Shanghai Jiaotong University for their enthusiastic support. Also, the authors would like to thank the financial support of NSFC (Grants No. 61371149).

History

School

  • Mechanical, Electrical and Manufacturing Engineering

Published in

Progress in Biomedical Optics and Imaging - Proceedings of SPIE

Volume

9315

Citation

YANG, F. ... et al., 2015. A new engineering approach to reveal correlation of physiological change and spontaneous expression from video images. Proceedings of SPIE, 9315, DOI: 10.1117/12.2077120.

Publisher

© SPIE

Version

  • VoR (Version of Record)

Publisher statement

This work is made available according to the conditions of the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0) licence. Full details of this licence are available at: https://creativecommons.org/licenses/by-nc-nd/4.0/

Publication date

2015

Notes

This document is Closed Access.

ISSN

0277-786X

eISSN

1996-756X

Language

  • en