MultimodalDatabaseofEmotionalSpeechVideoandGestures.pdf (4.94 MB)
Download file

Multimodal database of emotional speech, video and gestures

Download (4.94 MB)
conference contribution
posted on 10.06.2019, 09:40 by Tomasz Sapinski, Dorota Kaminska, Adam Pelikant, Cagri Ozcinar, Egils Avots, Gholamreza Anbarjafari
People express emotions through different modalities. Integration of verbal and non-verbal communication channels creates a system in which the message is easier to understand. Expanding the focus to several expression forms can facilitate research on emotion recognition as well as human-machine interaction. In this article, the authors present a Polish emotional database composed of three modalities: facial expressions, body movement and gestures, and speech. The corpora contains recordings registered in studio conditions, acted out by 16 professional actors (8 male and 8 female). The data is labeled with six basic emotions categories, according to Ekman’s emotion categories. To check the quality of performance, all recordings are evaluated by experts and volunteers. The database is available to academic community and might be useful in the study on audio-visual emotion recognition.

Funding

This work is supported Estonian Research Council Grant (PUT638), the Scientific and Technological Research Council of Turkey (TUB ITAK) (Proje 1001 - 116E097), Estonian-Polish Joint Research Project, the Estonian Centre of Excellence in IT (EXCITE) funded by the European Regional Development Fund

History

School

  • Loughborough University London

Published in

International Conference on Pattern Recognition International Conference on Pattern Recognition

Pages

153 - 163

Citation

SAPINSKI, T. ... et al., 2018. Multimodal database of emotional speech, video and gestures. IN: Zhang, Z. ... (eds.) Pattern Recognition and Information Forensics. ICPR 2018 International Workshops, CVAUI, IWCF, and MIPPSNA, Beijing, China, August 20-24, 2018, Revised Selected Papers. Cham: Springer, pp. 153 - 163.

Publisher

© Springer

Version

AM (Accepted Manuscript)

Publisher statement

This is a pre-copyedited version of a contribution published in Zhang, Z. ... (eds.) Pattern Recognition and Information Forensics. ICPR 2018 International Workshops, CVAUI, IWCF, and MIPPSNA published by Springer. The definitive authenticated version is available online via https://doi.org/10.1007/978-3-030-05792-3.

Acceptance date

01/05/2018

Publication date

2018-12-19

ISBN

9783030057916

ISSN

0302-9743

eISSN

1611-3349

Book series

Image Processing, Computer Vision, Pattern Recognition, and Graphics (LNIP);11188

Language

en

Location

Springer, Cham

Usage metrics

Categories

Exports