Developmental Changes in Gaze Behavior and the Effects of Auditory Emotion Word Priming in Emotional Face Categorization
In: Multisensory ResearchSearch for other papers by Michael Vesker in
Current site
Google Scholar
Search for other papers by Daniela Bahn in
Current site
Google Scholar
Search for other papers by Christina Kauschke in
Current site
Google Scholar
Search for other papers by Gudrun Schwarzer in
Current site
Google Scholar
Abstract
Social interactions often require the simultaneous processing of emotions from facial expressions and speech. However, the development of the gaze behavior used for emotion recognition, and the effects of speech perception on the visual encoding of facial expressions is less understood. We therefore conducted a word-primed face categorization experiment, where participants from multiple age groups (six-year-olds, 12-year-olds, and adults) categorized target facial expressions as positive or negative after priming with valence-congruent or -incongruent auditory emotion words, or no words at all. We recorded our participants’ gaze behavior during this task using an eye-tracker, and analyzed the data with respect to the fixation time toward the eyes and mouth regions of faces, as well as the time until participants made the first fixation within those regions (time to first fixation, TTFF). We found that the six-year-olds showed significantly higher accuracy in categorizing congruently primed faces compared to the other conditions. The six-year-olds also showed faster response times, shorter total fixation durations, and faster TTFF measures in all primed trials, regardless of congruency, as compared to unprimed trials. We also found that while adults looked first, and longer, at the eyes as compared to the mouth regions of target faces, children did not exhibit this gaze behavior. Our results thus indicate that young children are more sensitive than adults or older children to auditory emotion word primes during the perception of emotional faces, and that the distribution of gaze across the regions of the face changes significantly from childhood to adulthood.
Purchase
Buy instant access (PDF download and unlimited online access):
Institutional Login
Log in with Open Athens, Shibboleth, or your institutional credentials
Personal login
Log in with your brill.com account
-
Bahn, D., Kauschke, C., Vesker, M. and Schwarzer, G. (2018). Perception of valence and arousal in German emotion terms: a comparison between 9-year-old children and adults, Appl. Psycholinguist. 39, 463–481. DOI:10.1017/S0142716417000443.
-
Bahn, D., Vesker, M., García Alanis, J. C., Schwarzer, G. and Kauschke, C. (2017). Age-dependent positivity-bias in children’s processing of emotion terms, Front. Psychol. 8, 1268. DOI:10.3389/fpsyg.2017.01268.
-
Bodenschatz, C. M., Kersting, A. and Suslow, T. (2019). Effects of briefly presented masked emotional facial expressions on gaze behavior: an eye-tracking study, Psychol. Rep. 122, 1432–1448. DOI:10.1177/0033294118789041.
-
Calvo, M. G., Fernández-Martín, A., Gutiérrez-García, A. and Lundqvist, D. (2018). Selective eye fixations on diagnostic face regions of dynamic emotional expressions: KDEF-dyn database, Sci. Rep. 8, 17039. DOI:10.1038/s41598-018-35259-w.
-
Campanella, S. and Belin, P. (2007). Integrating face and voice in person perception, Trends Cogn. Sci. 11, 535–543. DOI:10.1016/j.tics.2007.10.001.
-
Carroll, N. C. and Young, A. W. (2005). Priming of emotion recognition, Q. J. Exp. Psychol. A 58, 1173–1197. DOI:10.1080/02724980443000539.
-
Collignon, O., Girard, S., Gosselin, F., Roy, S., Saint-Amour, D., Lassonde, M. and Lepore, F. (2008). Audio-visual integration of emotion expression, Brain Res. 1242, 126–135. DOI:10.1016/j.brainres.2008.04.023.
-
de Boer, M. J., Başkent, D. and Cornelissen, F. W. (2020). Eyes on emotion: dynamic gaze allocation during emotion perception from speech-like stimuli, Multisens. Res. 34, 17–47. DOI:10.1163/22134808-bja10029.
-
De Sonneville, L. M. J., Verschoor, C. A., Njiokiktjien, C., Op het Veld, V., Toorenaar, N. and Vranken, M. (2002). Facial identity and facial emotions: speed, accuracy, and processing strategies in children and adults, J. Clin. Exp. Neuropsychol. 24, 200–213. DOI:10.1076/jcen.24.2.200.989.
-
Eisenbarth, H. and Alpers, G. W. (2011). Happy mouth and sad eyes: scanning emotional facial expressions, Emotion 11, 860–865. DOI:10.1037/a0022758.
-
Filippi, P., Ocklenburg, S., Bowling, D. L., Heege, L., Güntürkün, O., Newen, A. and de Boer, B. (2017). More than words (and faces): evidence for a Stroop effect of prosody in emotion word processing, Cogn. Emot. 31, 879–891. DOI:10.1080/02699931.2016.1177489.
-
Gao, X. and Maurer, D. (2010). A happy story: developmental changes in children’s sensitivity to facial expressions of varying intensities, J. Exp. Child Psychol. 107, 67–86. DOI:10.1016/j.jecp.2010.05.003.
-
Glück, C. W. (2011). Wortschatz- und Wortfindungstest für 6- bis 10-Jährige: WWT 6–10. Urban & Fischer/ Elsevier, Munich, Germany.
-
Kauschke, C., Bahn, D., Vesker, M. and Schwarzer, G. (2017). Die semantische Repräsentation von Emotionsbegriffen bei Kindern im Grundschulalter, Kindheit Entwicklung 26, 251–260. DOI:10.1026/0942-5403/a000238.
-
Kauschke, C., Bahn, D., Vesker, M. and Schwarzer, G. (2019). The role of emotional valence for the processing of facial and verbal stimuli — positivity or negativity bias?, Front. Psychol. 10, 1654. DOI:10.3389/fpsyg.2019.01654.
-
Lansing, C. R. and McConkie, G. W. (2003). Word identification and eye fixation locations in visual and visual-plus-auditory presentations of spoken sentences, Percept. Psychophys. 65, 536–552. DOI:10.3758/BF03194581.
-
Mancini, G., Agnoli, S., Baldaro, B., Ricci Bitti, P. E. and Surcinelli, P. (2013). Facial expressions of emotions: recognition accuracy and affective reactions during late childhood, J. Psychol. 147, 599–617. DOI:10.1080/00223980.2012.727891.
-
Nakano, T., Tanaka, K., Endo, Y., Yamane, Y., Yamamoto, T., Nakano, Y., Ohta, N., Kato, N. and Kitazawa, S. (2010). Atypical gaze patterns in children and adults with autism spectrum disorders dissociated from developmental changes in gaze behaviour, Proc. R. Soc. B Biol. Sci. 277, 2935–2943. DOI:10.1098/rspb.2010.0587.
-
Nemrodov, D., Anderson, T., Preston, F. F. and Itier, R. J. (2014). Early sensitivity for eyes within faces: a new neuronal account of holistic and featural processing, NeuroImage 97, 81–94. DOI:10.1016/j.neuroimage.2014.04.042.
-
Nummenmaa, L. and Calvo, M. G. (2015). Dissociation between recognition and detection advantage for facial expressions: a meta-analysis, Emotion 15, 243–256. DOI:10.1037/emo0000042.
-
Paulmann, S. and Pell, M. D. (2011). Is there an advantage for recognizing multi-modal emotional stimuli?, Motiv. Emot. 35, 192–201. DOI:10.1007/s11031-011-9206-0.
-
Pell, M. D. (2005). Nonverbal emotion priming: evidence from the “facial affect decision task”, J. Nonverbal Behav. 29, 45–73. DOI:10.1007/s10919-004-0889-8.
-
Pollux, P. M. J., Hall, S. and Guo, K. (2014). Facial expression training optimises viewing strategy in children and adults, PLoS ONE 9, e105418. DOI:10.1371/journal.pone.0105418.
-
Robinson, C. W., Hawthorn, A. M. and Rahman, A. N. (2018). Developmental differences in filtering auditory and visual distractors during visual selective attention, Front. Psychol. 9, 2564. DOI:10.3389/fpsyg.2018.02564.
-
Rodger, H., Vizioli, L., Ouyang, X. and Caldara, R. (2015). Mapping the development of facial expression recognition, Dev. Sci. 18, 926–939. DOI:10.1111/desc.12281.
-
Rossion, B., Kaiser, M. D., Bub, D. and Tanaka, J. W. (2009). Is the loss of diagnosticity of the eye region of the face a common aspect of acquired prosopagnosia?, J. Neuropsychol. 3, 69–78. DOI:10.1348/174866408X289944.
-
Scheller, E., Büchel, C. and Gamer, M. (2012). Diagnostic features of emotional expressions are processed preferentially, PloS ONE 7, e41792. DOI:10.1371/journal.pone.0041792.
-
Schurgin, M. W., Nelson, J., Iida, S., Ohira, H., Chiao, J. Y. and Franconeri, S. L. (2014). Eye movements during emotion recognition in faces, J. Vis. 14, 14. DOI:10.1167/14.13.14.
-
Smith, H. M. J., Dunn, A. K., Baguley, T. and Stacey, P. C. (2016). Matching novel face and voice identity using static and dynamic facial images, Atten. Percept. Psychophys. 78, 868–879. DOI:10.3758/s13414-015-1045-8.
-
Vatikiotis-Bateson, E., Eigsti, I.-M., Yano, S. and Munhall, K. G. (1998). Eye movement of perceivers during audiovisual speech perception, Percept. Psychophys. 60, 926–940. DOI:10.3758/bf03211929.
-
Vesker, M., Bahn, D., Degé, F., Kauschke, C. and Schwarzer, G. (2018a). Developmental changes in the categorical processing of positive and negative facial expressions, PLoS ONE 13, e0201521. DOI:10.1371/journal.pone.0201521.
-
Vesker, M., Bahn, D., Degé, F., Kauschke, C. and Schwarzer, G. (2018b). Perceiving arousal and valence in facial expressions: differences between children and adults, Eur. J. Dev. Psychol. 15, 411–425. DOI:10.1080/17405629.2017.1287073.
-
Vesker, M., Bahn, D., Kauschke, C., Tschense, M., Degé, F. and Schwarzer, G. (2018c). Auditory emotion word primes influence emotional face categorization in children and adults, but not vice versa, Front. Psychol. 9, 618. DOI:10.3389/fpsyg.2018.00618.
-
Võ, M. L. H., Conrad, M., Kuchinke, L., Urton, K., Hofmann, M. J. and Jacobs, A. M. (2009). The Berlin affective word list reloaded (BAWL-R), Behav. Res. Meth. 41, 534–538. DOI:10.3758/BRM.41.2.534.
-
Vo, M. L. H., Smith, T. J., Mital, P. K. and Henderson, J. M. (2012). Do the eyes really have it? Dynamic allocation of attention when viewing moving faces, J. Vis. 12, 3. DOI:10.1167/12.13.3.
-
Widen, S. C. and Russell, J. A. (2003). A closer look at preschoolers’ freely produced labels for facial expressions, Dev. Psychol. 39, 114–128. DOI:10.1037/0012-1649.39.1.114.
-
Widen, S. C. and Russell, J. A. (2010). The “disgust face” conveys anger to children, Emotion 10, 455–466. DOI:10.1037/a0019151.
-
Williams, L. M., Senior, C., David, A. S., Loughland, C. M. and Gordon, E. (2001). In search of the “Duchenne smile”: evidence from eye movements, J. Psychophysiol. 15, 122–127. DOI:10.1027//0269-8803.15.2.122.
-
Xu, Q.-R., He, W. C., Ye, C.-X. and Luo, W.-B. (2019). Attentional bias processing mechanism of emotional faces: anger and happiness superiority effects, Acta Psychol. Sin. 71, 86–94. DOI:10.13294/j.aps.2018.0098.
| All Time | Past Year | Past 30 Days | |
|---|---|---|---|
| Abstract Views | 593 | 141 | 25 |
| Full Text Views | 30 | 16 | 4 |
| PDF Views & Downloads | 49 | 21 | 8 |
Developmental Changes in Gaze Behavior and the Effects of Auditory Emotion Word Priming in Emotional Face Categorization
In: Multisensory ResearchSearch for other papers by Michael Vesker in
Current site
Google Scholar
PubMed
Search for other papers by Daniela Bahn in
Current site
Google Scholar
PubMed
Search for other papers by Christina Kauschke in
Current site
Google Scholar
PubMed
Search for other papers by Gudrun Schwarzer in
Current site
Google Scholar
PubMed
Abstract
Social interactions often require the simultaneous processing of emotions from facial expressions and speech. However, the development of the gaze behavior used for emotion recognition, and the effects of speech perception on the visual encoding of facial expressions is less understood. We therefore conducted a word-primed face categorization experiment, where participants from multiple age groups (six-year-olds, 12-year-olds, and adults) categorized target facial expressions as positive or negative after priming with valence-congruent or -incongruent auditory emotion words, or no words at all. We recorded our participants’ gaze behavior during this task using an eye-tracker, and analyzed the data with respect to the fixation time toward the eyes and mouth regions of faces, as well as the time until participants made the first fixation within those regions (time to first fixation, TTFF). We found that the six-year-olds showed significantly higher accuracy in categorizing congruently primed faces compared to the other conditions. The six-year-olds also showed faster response times, shorter total fixation durations, and faster TTFF measures in all primed trials, regardless of congruency, as compared to unprimed trials. We also found that while adults looked first, and longer, at the eyes as compared to the mouth regions of target faces, children did not exhibit this gaze behavior. Our results thus indicate that young children are more sensitive than adults or older children to auditory emotion word primes during the perception of emotional faces, and that the distribution of gaze across the regions of the face changes significantly from childhood to adulthood.
| All Time | Past Year | Past 30 Days | |
|---|---|---|---|
| Abstract Views | 593 | 141 | 25 |
| Full Text Views | 30 | 16 | 4 |
| PDF Views & Downloads | 49 | 21 | 8 |