Emotional pictures and sounds: A review of multimodal interactions of emotion cues in multiple domains


Gerdes, Antje B. M. ; Wieser, Matthias J. ; Alpers, Georg W.


[img] PDF
fpsyg-05-01351.pdf - Published

Download (303kB)

DOI: https://doi.org/10.3389/fpsyg.2014.01351
URL: http://journal.frontiersin.org/article/10.3389/fps...
URN: urn:nbn:de:bsz:180-madoc-375759
Document Type: Article
Year of publication: 2014
The title of a journal, publication series: Frontiers in Psychology
Volume: 5
Issue number: Article Nr. 1351
Page range: 1-13
Place of publication: Lausanne
Publishing house: Frontiers Research Foundation
ISSN: 1664-1078
Publication language: English
Institution: School of Social Sciences > Klinische u. Biologische Psychologie u. Psychotherapie (Alpers 2010-)
Pre-existing license: Creative Commons Attribution 4.0 International (CC BY 4.0)
Subject: 150 Psychology
Abstract: In everyday life, multiple sensory channels jointly trigger emotional experiences and one channel may alter processing in another channel. For example, seeing an emotional facial expression and hearing the voice's emotional tone will jointly create the emotional experience. This example, where auditory and visual input is related to social communication, has gained considerable attention by researchers. However, interactions of visual and auditory emotional information are not limited to social communication but can extend to much broader contexts including human, animal, and environmental cues. In this article, we review current research on audiovisual emotion processing beyond face-voice stimuli to develop a broader perspective on multimodal interactions in emotion processing. We argue that current concepts of multimodality should be extended in considering an ecologically valid variety of stimuli in audiovisual emotion processing. Therefore, we provide an overview of studies in which emotional sounds and interactions with complex pictures of scenes were investigated. In addition to behavioral studies, we focus on neuroimaging, electro- and peripher-physiological findings. Furthermore, we integrate these findings and identify similarities or differences. We conclude with suggestions for future research.




Dieser Eintrag ist Teil der Universitätsbibliographie.

Das Dokument wird vom Publikationsserver der Universitätsbibliothek Mannheim bereitgestellt.




Metadata export


Citation


+ Search Authors in

+ Download Statistics

Downloads per month over past year

View more statistics



You have found an error? Please let us know about your desired correction here: E-Mail


Actions (login required)

Show item Show item