Auditory and Visual Crossmodal Correspondences With Haptically Perceived Liquid Viscosity
In: Multisensory ResearchSearch for other papers by Jennah Asad in
Current site
Google Scholar
Search for other papers by Mary Jane Spiller in
Current site
Google Scholar
Search for other papers by Clare Jonas in
Current site
Google Scholar
Past research on crossmodal correspondences as they relate to tactile perception has largely been restricted to solid substances. We investigated the role of haptically explored liquid viscosity in crossmodal correspondences with visually presented luminance, saturation, roundedness, size, number and visual elevation, as well as pure-tone pitch and kiki–bouba-type letter strings. In Experiment 1, we presented two tactile and two visual or auditory stimuli simultaneously, and found significant inter-participant agreement () when pairing viscosity with luminance, saturation, roundedness, size, pitch and letter string type. To assess whether these crossmodal correspondences were relative or absolute, another 32 participants were presented, in Experiment 2, with two tactile stimuli but only one visual/auditory stimulus per trial. In this second experiment, we found that high viscosity was paired with low luminance, roundness, low saturation, and the bouba-type letter string, while low viscosity was paired with high pitch. However, the inverse associations (e.g. low viscosity with high luminance, high viscosity with low pitch) were not significant. These findings indicate that viscosity can be added to the list of dimensions that invoke crossmodal correspondences, and that the majority of crossmodal correspondences involving viscosity are absolute rather than relative, since they appear without explicit comparisons along the visual/auditory dimensions we measured.
Purchase
Buy instant access (PDF download and unlimited online access):
Institutional Login
Log in with Open Athens, Shibboleth, or your institutional credentials
Personal login
Log in with your brill.com account
-
Bach-y-Rita P., Kaczmarek K. A., Tyler M. E., Garcia-Lara J. (1998). Form perception with a 49-point electrotactile stimulus array on the tongue: a technical note, J. Rehabil. Res. Dev. 35, 427–430.
-
Belkin K., Martin R., Kemp S. E., Gilbert A. N. (1997). Auditory pitch as a perceptual analogue to odor quality, Psychol. Sci. 8, 340–342.
-
Benjamini Y., Hochberg Y. (1995). Controlling the false discovery rate: a practical and powerful approach to multiple testing, J. R. Stat. Soc. B Methodol. 57, 289–300.
-
Churchill A., Meyners M., Griffiths L., Bailey P. (2009). The cross-modal effect of fragrance in shampoo: modifying the perceived feel of both product and hair during and after washing, Food Qual. Pref. 20, 320–328.
-
Deroy O., Valentin D. (2011). Tasting liquid shapes: investigating the sensory basis of cross-modal correspondences, Chemosens. Percept. 4, 80–90.
-
D’Onofrio A. (2014). Phonetic detail and dimensionality in sound–shape correspondences: refining the bouba–kiki paradigm, Lang. Speech 57, 367–393.
-
Eitan Z., Rothschild I. (2010). How music touches: musical parameters and listeners’ audio–tactile metaphorical mappings, Psychol. Music 39, 449–467.
-
Eitan Z., Timmers R. (2010). Beethoven’s last piano sonata and those who follow crocodiles: cross-domain mappings of auditory pitch in a musical context, Cognition 114, 405–422.
-
Etzi R., Spence C., Zampini M., Gallace A. (2016). When sandpaper is ‘Kiki’ and satin is ‘Bouba’: an exploration of the associations between words, emotional states, and the tactile attributes of everyday materials, Multisens. Res. 29, 133–155.
-
Evans K. K., Treisman A. (2010). Natural cross-modal mappings between visual and auditory features, J. Vis. 10, 6. DOI:10.1167/10.1.6.
-
Fox C. W. (1935). An experimental study of naming, Am. J. Psychol. 47, 545–579.
-
Gallace A., Spence C. (2006). Multisensory synesthetic interactions in the speeded classification of visual size, Atten. Percept. Psychophys. 68, 1191–1203.
-
Gilbert A. N., Martin R., Kemp S. E. (1996). Cross-modal correspondence between vision and olfaction: the color of smells, Am. J. Psychol. 109, 335–351.
-
Hanson-Vaux G., Crisinel A.-S., Spence C. (2013). Smelling shapes: crossmodal correspondences between odors and shapes, Chem. Senses 38, 161–166.
-
Harrar V., Spence C. (2013). The taste of cutlery: how the taste of food is affected by the weight, size, shape, and colour of the cutlery used to eat it, Flavour 2, 21. DOI:10.1186/2044-7248-2-21.
-
Hevner K. (1937). An experimental study of the affective value of sounds in poetry, Am. J. Psychol. 49, 419–434.
-
Jonas C., Spiller M. J., Hibbard P. (in prep.). Summation of visual attributes in auditory–visual crossmodal correspondences.
-
Ludden G. D. S., Van Rompay T. J. L. (2015). How does it feel? Exploring touch on different levels of product experience, J. Eng. Design 26, 157–168.
-
Ludwig V. U., Simner J. (2013). What colour does that feel? Tactile–visual mapping and the development of cross-modality, Cortex 49, 1089–1099.
-
Marks L. E. (1987). On cross-modal similarity: auditory–visual interactions in speeded discrimination, J. Exp. Psych. Hum. Percept. Perform. 13, 384–394.
-
Martino G., Marks L. E. (2000). Cross-modal interaction between vision and touch: the role of synesthetic correspondence, Perception 29, 745–754.
-
Michel C., Velasco C., Spence C. (2015). Cutlery matters: heavy cutlery enhances diners’ enjoyment of the food served in a realistic dining environment, Flavour 4, 26. DOI:10.1186/s13411-015-0036-y.
-
Morrot G., Brochet F., Dubourdieu D. (2001). The color of odors, Brain Lang. 79, 309–320.
-
Nava E., Grassi M., Turati C. (2015). Audio–visual, visuo–tactile and audio–tactile correspondences in preschoolers, Multisens. Res. 289, 93–111.
-
Palmer S. E., Schloss K. B., Xu Z., Prado-León L. R. (2013). Music–color associations are mediated by emotion, Proc. Natl. Acad. Sci. 110, 8836–8841.
-
Parise C. V., Spence C. (2012). Audiovisual crossmodal correspondences and sound symbolism: a study using the implicit association test, Exp. Brain Res. 220, 319–333.
-
Piqueras-Fiszman B., Spence C. (2012a). The influence of the feel of product packaging on the perception of the oral-somatosensory texture of food, Food Qual. Pref. 26, 67–73.
-
Piqueras-Fiszman B., Spence C. (2012b). The weight of the container influences expected satiety, perceived density, and subsequent expected fullness, Appetite 58, 559–562.
-
Risso P., Maggioni E., Olivero N., Gallace A. (2015). The association between the colour of a container and the liquid inside: an experimental study on consumers’ perception, expectations and choices regarding mineral water, Food Qual. Pref. 44, 17–25.
-
Rudmin F., Cappelli M. (1983). Tone–taste synaesthesia: a replication, Percept. Mot. Skills 56, 118.
-
Seo H.-S., Arshamian A., Schemmer K., Scheer I., Sander T., Ritter G., Hummel T. (2010). Cross-modal integration between odors and abstract symbols, Neurosci. Lett. 478, 175–178.
-
Slobodenyuk N., Jraissati Y., Kanso A., Ghanem L., Elhajj I. (2015). Cross-modal associations between color and haptics, Atten. Percept. Psychophys. 77, 1379–1395.
-
Spence C. (2011). Crossmodal correspondences: a tutorial review, Atten. Percept. Psychophys. 73, 971–995.
-
Spence C. (2012). Managing sensory expectations concerning products and brands: capitalizing on the potential of sound and shape symbolism, J. Consum. Psychol. 22, 37–54.
-
Spence C., Gallace A. (2011). Multisensory design: reaching out to touch the consumer, Psychol. Mark. 28, 267–308.
-
Spence C., Hobkinson C., Gallace A., Piqueras-Fiszman B. (2013). A touch of gastronomy, Flavour 2, 14. DOI:10.1186/2044-7248-2-14.
-
Tu Y., Yang Z., Ma C. (2015). Touching tastes: the haptic perception transfer of liquid food packaging materials, Food Qual. Pref. 39, 124–130.
-
Walker P. (2012). Cross-sensory correspondences and cross talk between dimensions of connotative meaning: visual angularity is hard, high-pitched, and bright, Atten. Percept. Psychophys. 74, 1792–1809.
-
Walker P., Smith S. (1985). Stroop interference based on the multimodal correlates of haptic size and auditory pitch, Perception 14, 729–736.
-
Walker P., Walker L. (2012). Size–brightness correspondence: crosstalk and congruity among dimensions of connotative meaning, Atten. Percept. Psychophys. 74, 1226–1240.
-
Walker L., Walker P. (2016). Cross-sensory mapping of feature values in the size–brightness correspondence can be more relative than absolute, J. Exp. Psychol. Hum. Percept. Perform. 42, 138–150.
-
Walker P., Francis B. J., Walker L. (2010). The brightness–weight illusion, Exp. Psychol. 57, 462–469.
-
Walker L., Walker P., Francis B. (2012). A common scheme for cross-sensory correspondences across stimulus domains, Perception 41, 1186–1192.
-
Walker P., Walker L., Francis B. (2015). The size–brightness correspondence: evidence for crosstalk among aligned conceptual feature dimensions, Atten. Percept. Psychophys. 77, 2694–2710.
-
Walsh V. (2003). A theory of magnitude: common cortical metrics of time, space and quantity, Trends Cogn. Sci. 7, 483–488.
-
Ward J., Banissy M. J., Jonas C. (2008). Haptic perception in synaesthesia, in: Human Haptic Perception: Basics and Applications, Grunwald M. (Ed.), pp. 259–265. Birkhäuser, Basel, Switzerland.
| All Time | Past Year | Past 30 Days | |
|---|---|---|---|
| Abstract Views | 715 | 145 | 6 |
| Full Text Views | 214 | 13 | 0 |
| PDF Views & Downloads | 73 | 12 | 0 |
Auditory and Visual Crossmodal Correspondences With Haptically Perceived Liquid Viscosity
In: Multisensory ResearchSearch for other papers by Jennah Asad in
Current site
Google Scholar
PubMed
Search for other papers by Mary Jane Spiller in
Current site
Google Scholar
PubMed
Search for other papers by Clare Jonas in
Current site
Google Scholar
PubMed
Past research on crossmodal correspondences as they relate to tactile perception has largely been restricted to solid substances. We investigated the role of haptically explored liquid viscosity in crossmodal correspondences with visually presented luminance, saturation, roundedness, size, number and visual elevation, as well as pure-tone pitch and kiki–bouba-type letter strings. In Experiment 1, we presented two tactile and two visual or auditory stimuli simultaneously, and found significant inter-participant agreement () when pairing viscosity with luminance, saturation, roundedness, size, pitch and letter string type. To assess whether these crossmodal correspondences were relative or absolute, another 32 participants were presented, in Experiment 2, with two tactile stimuli but only one visual/auditory stimulus per trial. In this second experiment, we found that high viscosity was paired with low luminance, roundness, low saturation, and the bouba-type letter string, while low viscosity was paired with high pitch. However, the inverse associations (e.g. low viscosity with high luminance, high viscosity with low pitch) were not significant. These findings indicate that viscosity can be added to the list of dimensions that invoke crossmodal correspondences, and that the majority of crossmodal correspondences involving viscosity are absolute rather than relative, since they appear without explicit comparisons along the visual/auditory dimensions we measured.
| All Time | Past Year | Past 30 Days | |
|---|---|---|---|
| Abstract Views | 715 | 145 | 6 |
| Full Text Views | 214 | 13 | 0 |
| PDF Views & Downloads | 73 | 12 | 0 |