Save

Explaining the Effect of Likelihood Manipulation and Prior Through a Neural Network of the Audiovisual Perception of Space

In: Multisensory Research
Authors:
Mauro Ursino Department of Electrical, Electronic and Information Engineering, University of Bologna, Bologna, Italy

Search for other papers by Mauro Ursino in
Current site
Google Scholar
PubMed
Close
,
Cristiano Cuppini Department of Electrical, Electronic and Information Engineering, University of Bologna, Bologna, Italy

Search for other papers by Cristiano Cuppini in
Current site
Google Scholar
PubMed
Close
,
Elisa Magosso Department of Electrical, Electronic and Information Engineering, University of Bologna, Bologna, Italy

Search for other papers by Elisa Magosso in
Current site
Google Scholar
PubMed
Close
,
Ulrik Beierholm Department of Psychology, Durham University, United Kingdom

Search for other papers by Ulrik Beierholm in
Current site
Google Scholar
PubMed
Close
, and
Ladan Shams Department of Psychology, Department of BioEngineering, Interdepartmental Neuroscience Program, University of California, Los Angeles, CA, USA

Search for other papers by Ladan Shams in
Current site
Google Scholar
PubMed
Close
Download Citation Get Permissions

Access options

Get access to the full article by using one of the access options below.

Institutional Login

Log in with Open Athens, Shibboleth, or your institutional credentials

Login via Institution

Purchase

Buy instant access (PDF download and unlimited online access):

$40.00

Abstract

Results in the recent literature suggest that multisensory integration in the brain follows the rules of Bayesian inference. However, how neural circuits can realize such inference and how it can be learned from experience is still the subject of active research. The aim of this work is to use a recent neurocomputational model to investigate how the likelihood and prior can be encoded in synapses, and how they affect audio-visual perception, in a variety of conditions characterized by different experience, different cue reliabilities and temporal asynchrony. The model considers two unisensory networks (auditory and visual) with plastic receptive fields and plastic crossmodal synapses, trained during a learning period. During training visual and auditory stimuli are more frequent and more tuned close to the fovea. Model simulations after training have been performed in crossmodal conditions to assess the auditory and visual perception bias: visual stimuli were positioned at different azimuth (±10° from the fovea) coupled with an auditory stimulus at various audio-visual distances (±20°). The cue reliability has been altered by using visual stimuli with two different contrast levels. Model predictions are compared with behavioral data. Results show that model predictions agree with behavioral data, in a variety of conditions characterized by a different role of prior and likelihood. Finally, the effect of a different unimodal or crossmodal prior, re-learning, temporal correlation among input stimuli, and visual damage (hemianopia) are tested, to reveal the possible use of the model in the clarification of important multisensory problems.

Content Metrics

All Time Past Year Past 30 Days
Abstract Views 1282 67 2
Full Text Views 189 51 29
PDF Views & Downloads 126 21 1