Despite the large number of studies on the multisensory aspects of tactile perception, very little is known regarding the effects of visual and auditory sensory modalities on the tactile hedonic evaluation of textures, especially when the presentation of the stimuli is mediated by a haptic device. In this study, different haptic virtual surfaces were rendered by varying the static and dynamic frictional coefficients of a Geomagic® Touch device. In Experiment 1, the haptic surfaces were paired with pictures representing everyday materials (glass, plastic, rubber and steel); in Experiment 2, the haptic surfaces were paired with sounds resulting from the haptic exploration of paper or sandpaper. In both the experiments, participants were required to rate the pleasantness and the roughness of the virtual surfaces explored. Exploration times were also recorded. Both pleasantness and roughness judgments, as well as the durations of exploration, varied as a function of the combinations of the visuo-tactile and the audio-tactile stimuli presented. Taken together, these results suggest that vision and audition modulate haptic perception and hedonic preferences when tactile sensations are provided through a haptic device. Importantly, these results offer interesting suggestions for designing more pleasant, and even more realistic, multisensory virtual surfaces.
AltinsoyM. E. (2008).
The effect of auditory cues on the audiotactile roughness perception: modulation frequency and sound pressure level in:
International Workshop on Haptic and Audio Interaction Design HAID 2008PirhonenA.BrewsterS. (Eds) Lecture Notes in Computer ScienceVol. 5270 pp.
120–129. SpringerBerlin and Heidelberg, Germany.
Haptic-auditory rendering and perception of contact stiffness in:
International Workshop on Haptic and Audio Interaction Design HAID 2006McGookinD.BrewsterS. (Eds) Lecture Notes in Computer ScienceVol. 4129 pp.
24–35. SpringerBerlin and Heidelberg, Germany.
CampionG.GoslineA. H.HaywardV. (2008).
Does judgment of haptic virtual texture roughness scale monotonically with lateral force modulation? in:
International Conference on Human Haptic Sensing and Touch Enabled Computer ApplicationsFerreM. (Ed.) Lecture Notes in Computer ScienceVol. 5024 pp.
718–723. SpringerBerlin and Heidelberg, Germany.
EllingsenD. M.WessbergJ.ChelnokovaO.OlaussonH.LaengB.LeknesS. (2014).
In touch with your emotions: oxytocin and touch change social impressions while others’ facial expressions can alter touchPsychoneuroendocrinology3911–20.
GallaceA.NgoM. K.SulaitisJ.SpenceC. (2011).
Multisensory presence in virtual reality: possibilities and limitations in:
Multiple Sensorial Media Advances and Applications: New Developments in MulSeMediaGhineaG.AndresF.GulliverS. (Eds) pp.
1–38. IGI GlobalVancouver, BC, Canada.
GuestS.DessirierJ. M.MehrabyanA.McGloneF.EssickG.GescheiderG.FontanaA.XiongR.AckerleyR.BlotK. (2011).
The development and validation of sensory and emotional scales of touch perceptionAtten. Percept. Psychophys.73531–550.
LedermanS. J.AbbottS. G. (1981).
Texture perception: studies of intersensory organization using a discrepancy paradigm, and visual versus tactual psychophysicsJ. Exp. Psychol. Hum. Percept. Perform.7902–915.
Yubi-Toko: finger walking in snowy scene using pseudo-haptic technique on touchpad in:
SA ’15 SIGGRAPH Asia 2015 Emerging TechnologiesKobe, Japanart. 29.
WeisenbergerJ. M.PolingG. L. (2004).
Multisensory roughness perception of virtual surfaces: effects of correlated cues in:
Proceedings of the 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systs pp.
161–168. Chicago, IL, USA.