Sensory substitution devices have the potential to provide individuals with visual impairments with more information about their environments, which may help them recognize objects and achieve more independence in their daily lives. However, many of these devices may require extensive training and might be limited in the amount of information that they can convey. We tested the effectiveness and assessed some of the limitations of the BrainPort device, which provides stimulation through a 20 × 20 electrode grid array on the tongue. Across five experiments, including one with blind individuals, we found that subjects were unable to accurately discriminate between simple shapes as well as different line orientations that were briefly presented on the tongue, even after 300 trials of practice with the device. These experiments indicate that such a minimal training regimen with the BrainPort is not sufficient for object recognition, raising serious concerns about the usability of this device without extensive training.
Auditory scene analysis and sonified visual images. Does consonance negatively impact on object formation when using complex sonified stimuli?Front. Psychol.61522. DOI:10.3389/fpsyg.2015.01522.
KhooW.OlmschenkG.ZhuZ.RoT. (2015). Evaluating crowd sourced navigation for the visually impaired in a virtual environment in: IEEE 4th International Conference on Mobile Services (MS 2015) June 27–July 2 2015 New York NY USA pp. 431–437.
KhooW. L.SeidelE. L.ZhuZ. (2012). Designing a virtual environment to evaluate multimodal sensing for assisting the visually impaired in: 13th International Conference on Computers Helping People with Special Needs (ICCHP) July 11–13 2012 Linz Austria pp. 573–580.
Beyond visual, aural and haptic movement perception: hMT+ is activated by electrotactile motion stimulation of the tongue in sighted and in congenitally blind individualsBrain Res. Bull.82264–270.
NauA. C.PintarC.ArnoldussenA.FisherC. (2015).
Acquisition of visual perception in blind adults using the BrainPort artificial vision deviceAm. J. Occup. Ther.696901290010p1-8. DOI:10.5014/ajot.2015.011809.
Increased functional connectivity between language and visually deprived areas in late and partial blindnessNeuroImage136162–173.
Wicab Inc. (2008). BrainPort® technology tongue interface characterization Tactical Underwater Navigation System (TUNS): interim report for November 2006 to June 2008. Wright-Patterson AFB OH: Air Force Research Laboratory Human Effectiveness Directorate Biosciences and Protection Division Aircrew Performance and Protection Branch.