Save

Orienting Auditory Attention through Vision: the Impact of Monaural Listening

In: Multisensory Research
Authors:
Silvia Turri Centro Interdipartimentale Mente/Cervello — CIMeC, Università di Trento, 38068 RoveretoItaly
Dipartimento di Psicologia e Scienze Cognitive, Università di Trento, 38068 Rovereto, Italy

Search for other papers by Silvia Turri in
Current site
Google Scholar
PubMed
Close
https://orcid.org/0000-0002-0100-0112
,
Mehdi Rizvi Faculty of Computer Science, Free University of Bozen-Bolzano, 39100 Bolzano, Italy

Search for other papers by Mehdi Rizvi in
Current site
Google Scholar
PubMed
Close
https://orcid.org/0000-0001-8386-5779
,
Giuseppe Rabini Centro Interdipartimentale Mente/Cervello — CIMeC, Università di Trento, 38068 RoveretoItaly

Search for other papers by Giuseppe Rabini in
Current site
Google Scholar
PubMed
Close
https://orcid.org/0000-0002-1273-8825
,
Alessandra Melonio Faculty of Computer Science, Free University of Bozen-Bolzano, 39100 Bolzano, Italy

Search for other papers by Alessandra Melonio in
Current site
Google Scholar
PubMed
Close
https://orcid.org/0000-0001-6655-1946
,
Rosella Gennari Faculty of Computer Science, Free University of Bozen-Bolzano, 39100 Bolzano, Italy

Search for other papers by Rosella Gennari in
Current site
Google Scholar
PubMed
Close
https://orcid.org/0000-0003-0063-0996
, and
Francesco Pavani Centro Interdipartimentale Mente/Cervello — CIMeC, Università di Trento, 38068 RoveretoItaly
IMPACT, Centre de Recherche en Neurosciences de Lyon (CRNL), 69500 Bron, France

Search for other papers by Francesco Pavani in
Current site
Google Scholar
PubMed
Close
https://orcid.org/0000-0003-0426-5578
Download Citation Get Permissions

Access options

Get access to the full article by using one of the access options below.

Institutional Login

Log in with Open Athens, Shibboleth, or your institutional credentials

Login via Institution

Purchase

Buy instant access (PDF download and unlimited online access):

$40.00

Abstract

The understanding of linguistic messages can be made extremely complex by the simultaneous presence of interfering sounds, especially when they are also linguistic in nature. In two experiments, we tested if visual cues directing attention to spatial or temporal components of speech in noise can improve its identification. The hearing-in-noise task required identification of a five-digit sequence (target) embedded in a stream of time-reversed speech. Using a custom-built device located in front of the participant, we delivered visual cues to orient attention to the location of target sounds and/or their temporal window. In Exp. 1 ( n = 14), we validated this visual-to-auditory cueing method in normal-hearing listeners, tested under typical binaural listening conditions. In Exp. 2 ( n = 13), we assessed the efficacy of the same visual cues in normal-hearing listeners wearing a monaural ear plug, to study the effects of simulated monaural and conductive hearing loss on visual-to-auditory attention orienting. While Exp. 1 revealed a benefit of both spatial and temporal visual cues for hearing in noise, Exp. 2 showed that only the temporal visual cues remained effective during monaural listening. These findings indicate that when the acoustic experience is altered, visual-to-auditory attention orienting is more robust for temporal compared to spatial attributes of the auditory stimuli. These findings have implications for the relation between spatial and temporal attributes of sound objects, and when planning devices to orient audiovisual attention for subjects suffering from hearing loss.

Content Metrics

All Time Past Year Past 30 Days
Abstract Views 986 190 19
Full Text Views 53 21 1
PDF Views & Downloads 103 42 3