On the Relative Nature of (Pitch-Based) Crossmodal Correspondences
In: Multisensory ResearchAbstract
This review deals with the question of the relative vs absolute nature of crossmodal correspondences, with a specific focus on those correspondences involving the auditory dimension of pitch. Crossmodal correspondences have been defined as the often-surprising crossmodal associations that people experience between features, attributes, or dimensions of experience in different sensory modalities, when either physically present, or else merely imagined. In the literature, crossmodal correspondences have often been contrasted with synaesthesia in that the former are frequently said to be relative phenomena (e.g., it is the higher-pitched of two sounds that is matched with the smaller of two visual stimuli, say, rather than there being a specific one-to-one crossmodal mapping between a particular pitch of sound and size of object). By contrast, in the case of synaesthesia, the idiosyncratic mapping between inducer and concurrent tends to be absolute (e.g., it is a particular sonic inducer that elicits a specific colour concurrent). However, a closer analysis of the literature soon reveals that the distinction between relative and absolute in the case of crossmodal correspondences may not be as clear-cut as some commentators would have us believe. Furthermore, it is important to note that the relative vs absolute question may receive different answers depending on the particular (class of) correspondence under empirical investigation.
Purchase
Buy instant access (PDF download and unlimited online access):
Institutional Login
Log in with Open Athens, Shibboleth, or your institutional credentials
Personal login
Log in with your brill.com account
-
Adams, W. J., Graf, E. W. and Ernst, M. O. (2004). Experience can change the ‘light-from-above’ prior, Nat. Neurosci. 7, 1057–1058.
-
Belkin, K., Martin, R., Kemp, S. E. and Gilbert, A. N. (1997). Auditory pitch as a perceptual analogue to odor quality, Psychol. Sci. 8, 340–342.
-
Ben-Artzi, E. and Marks, L. E. (1995). Visual–auditory interaction in speeded classification: role of stimulus difference, Percept. Psychophys. 57, 1151–1162.
-
Bernstein, I. H. and Edelstein, B. A. (1971). Effects of some variations in auditory input upon visual choice reaction time, J. Exp. Psychol. 87, 241–247.
-
Bernstein, I. H., Eason, T. R. and Schurman, D. L. (1971). Hue–tone interaction: a negative result, Percept. Mot. Skills 33, 1327–1330.
-
Bien, N., ten Oever, S., Goebel, R. and Sack, A. T. (2012). The sound of size: crossmodal binding in pitch-size synesthesia: a combined TMS, EEG, and psychophysics study, NeuroImage 59, 663–672.
-
Braaten, R. (1993). Synesthetic correspondence between visual location and auditory pitch in infants. Paper presented at the 34th Annual Meeting of the Psychonomic Society, Washington, DC, USA.
-
Brunel, L., Carvalho, P. F. and Goldstone, R. L. (2015). It does belong together: cross-modal correspondences influence cross-modal integration during perceptual learning, Front. Psychol. 6, 358. DOI:10.3389/fpsyg.2015.00358.
-
Brunetti, R., Indraccolo, A., Del Gatto, C., Spence, C. and Santangelo, V. (2018). Are crossmodal correspondences relative or absolute? Sequential effects on speeded classification, Atten. Percept. Psychophys. 80, 527–534.
-
Caivano, J. L. (1994). Color and sound: physical and psychophysical relations, Color Res. Appl. 19, 126–133.
-
Carnevale, M. J. and Harris, L. R. (2016). Which direction is up for a high pitch?, Multisens. Res. 29, 113–132.
-
Carroll, J. B. and Greenberg, J. H. (1961). Two cases of synesthesia for color and musical tonality associated with absolute pitch ability, Percept. Mot. Skills 13, 48. DOI:10.2466/pms.1961.13.1.48.
-
Chang, S. and Cho, Y. S. (2015). Polarity correspondence effect between loudness and lateralized response set, Front. Psychol. 6, 683. DOI:10.3389/fpsyg.2015.00683.
-
Chiou, R. and Rich, A. N. (2012). Cross-modality correspondence between pitch and spatial location modulates attentional orienting, Perception 41, 339–353.
-
Chiou, R. and Rich, A. N. (2015). Volitional mechanisms mediate the cuing effect of pitch on attention orienting: the influences of perceptual difficulty and response pressure, Perception 44, 169–182.
-
Collier, W. G. and Hubbard, T. L. (2001). Judgements of happiness, brightness, speed and tempo change of auditory stimuli varying in pitch and tempo, Psychomusicology 17, 36–55.
-
Collier, W. G. and Hubbard, T. L. (2004). Musical scales and brightness evaluations: effects of pitch, direction, and scale mode, Music. Sci. 7, 151–173.
-
Coward, S. W. and Stevens, C. J. (2004). Extracting meaning from sound: nomic mappings, everyday listening, and perceiving object size from frequency, Psychol. Rec. 54, 349–364.
-
Crisinel, A.-S. and Spence, C. (2010a). As bitter as a trombone: synesthetic correspondences in non-synesthetes between tastes and flavors and musical instruments and notes, Atten. Percept. Psychophys. 72, 1994–2002.
-
Crisinel, A. S. and Spence, C. (2010b). A sweet sound? Exploring implicit associations between basic tastes and pitch, Perception 39, 417–425.
-
Cytowic, R. E. and Eagleman, D. M. (2009). Wednesday Is Indigo Blue: Discovering the Brain of Synesthesia. MIT Press, Cambridge, MA, USA.
-
Davis, J. W. (1979). A response to W. Garner’s observation on the relationship between colour and music, Leonardo 12, 218–219.
-
Deroy, O. and Spence, C. (2013a). Are we all born synaesthetic? Examining the neonatal synaesthesia hypothesis, Neurosci. Biobehav. Rev. 37, 1240–1253.
-
Deroy, O. and Spence, C. (2013b). Weakening the case for ‘weak synaesthesia’: why crossmodal correspondences are not synaesthetic, Psychon. Bull. Rev. 20, 643–664.
-
Deroy, O., Crisinel, A.-S. and Spence, C. (2013). Crossmodal correspondences between odors and contingent features: odors, musical notes, and geometrical shapes, Psychon. Bull. Rev. 20, 878–896.
-
Deroy, O., Fernandez-Prieto, I., Navarra, J. and Spence, C. (2018). Unravelling the paradox of spatial pitch, in: Spatial Biases in Perception and Cognition, T. L. Hubbard (Ed.), pp. 77–93. Cambridge University Press, Cambridge, UK.
-
Deutsch, D., Dooley, K. and Henthorn, T. (2008). Pitch circularity from tones comprising full harmonic series, J. Acoust. Soc. Am. 124, 589–597.
-
Dolscheid, S., Hunnius, S., Casasanto, D. and Majid, A. (2014). Prelinguistic infants are sensitive to space–pitch associations found across cultures, Psychol. Sci. 25, 1256–1261.
-
Eitan, Z. (2017). Musical connections: cross-modal connections, in: The Routledge Companion to Music Cognition, R. Ashley and R. Timmers (Eds), pp. 213–224. Routledge, New York, NY, USA.
-
Eitan, Z. and Timmers, R. (2010). Beethoven’s last piano sonata and those who follow crocodiles: cross-domain mappings of auditory pitch in a musical context, Cognition 114, 405–422.
-
Eitan, Z., Schupak, A., Gotler, A. and Marks, L. E. (2014). Lower pitch is larger, yet falling pitches shrink, Exp. Psychol. 61, 273–284.
-
Ernst, M. O. (2007). Learning to integrate arbitrary signals from vision and touch, J. Vis. 7, 7. DOI:10.1167/7.5.7.
-
Evans, K. K. and Treisman, A. (2010). Natural cross-modal mappings between visual and auditory features, J. Vis. 10, 6. DOI:10.1167/10.1.6.
-
Faragó, T., Pongrácz, P., Miklósi, Á., Huber, L., Virányi, Z. and Range, F. (2010). Dogs’ expectation about signalers’ body size by virtue of their growls, PLoS One 5, e15175. DOI:10.1371/journal.pone.0015175.
-
Fernández-Prieto, I. and Navarra, J. (2017). The higher the pitch the larger its crossmodal influence on visuospatial processing, Psychol. Music 45, 713–724.
-
Fernández-Prieto, I., Navarra, J. and Pons, F. (2015). How big is this sound? Crossmodal association between pitch and size in infants, Infant Behav. Dev. 38, 77–81.
-
Fernandez-Prieto, I., Spence, C., Pons, F. and Navarra, J. (2017). Does language influence the vertical representation of auditory pitch and loudness?, i-Perception 8, 2041669517716183. DOI:10.1177/2041669517716183.
-
Fitch, W. T. (2000). The evolution of speech: a comparative review, Trends Cogn. Sci. 4, 258–267.
-
Gallace, A. and Spence, C. (2006). Multisensory synesthetic interactions in the speeded classification of visual size, Percept. Psychophys. 68, 1191–1203.
-
Gardner, H. (1974). Metaphors and modalities: how children project polar adjectives onto diverse domains, Child Dev. 45, 84–91.
-
Garner, W. R. (1974). The Processing of Information and Structure. Lawrence Erlbaum Associates, Oxford, UK.
-
Garner, W. (1978). The relationship between colour and music, Leonardo 11, 225–226.
-
Garner, W. R. (1983). Asymmetric interactions of stimulus dimensions in perceptual information processing, in: Perception, Cognition, and Development: Interactional Analyses, T. J. Tighe and B. E. Shepp (Eds), pp. 1–38. Lawrence Erlbaum Associates, Hillsdale, NJ, USA.
-
Getz, L. M. and Kubovy, M. (2018). Questioning the automaticity of audiovisual correspondences, Cognition 175, 101–108.
-
Gilbert, A. N., Fridlund, A. J. and Lucchina, L. A. (2016). The color of emotion: a metric for implicit color associations, Food Qual. Pref. 52, 203–210.
-
von Goethe, J. W. (1810). Zur Farbenlehre (Theory of Colours; trans. Charles Lock Eastlake, 1840). John Murray, London, UK.
-
Grassi, M. (2005). Do we hear size or sound: balls dropped on plates, Percept. Psychophys. 67, 274–284.
-
Guzman-Martinez, E., Ortega, L., Grabowecky, M., Mossbridge, J. and Suzuki, S. (2012). Interactive coding of visual spatial frequency and auditory amplitude-modulation rate, Curr. Biol. 22, 383–388.
-
Henning, H. (1927). Psychologische Studien am Geschmackssinn, in: Handbuch der Biologischen Arbeitsmethoden, F. Abderhalden (Ed.), pp. 627–740. Urban and Schwarzenberg, Berlin, Germany.
-
Holt-Hansen, K. (1968). Taste and pitch, Percept. Mot. Skills 27, 59–68.
-
Holt-Hansen, K. (1976). Extraordinary experiences during cross-modal perception, Percept. Mot. Skills 43, 1023–1027.
-
Hubbard, T. L. (1996). Synesthesia-like mappings of lightness, pitch, and melodic interval, Am. J. Psychol. 109, 219–238.
-
Isbilen, E. S. and Krumhansl, C. L. (2016). The color of music: emotion-mediated associations to Bach’s Well-Tempered Clavier, Psychomusicol. Music Mind Brain 26, 149–161.
-
Jamal, Y., Lacey, S., Nygaard, L. and Sathian, K. (2017). Interactions between auditory elevation, auditory pitch and visual elevation during multisensory perception, Multisens. Res. 30, 287–306.
-
Jonas, C., Spiller, M.-J. and Hibbard, P. (2017). Summation of visual attributes in auditory–visual crossmodal correspondences, Psychon. Bull. Rev. 24, 1104–1112.
-
Keetels, M. and Vroomen, J. (2011). No effect of synesthetic congruency on temporal ventriloquism, Atten. Percept. Psychophys. 73, 209–218.
-
Klapetek, A., Ngo, M. K. and Spence, C. (2012). Does crossmodal correspondence modulate the facilitatory effect of auditory cues on visual search?, Atten. Percept. Psychophys. 74, 1154–1167.
-
Klein, R. M., Brennan, M. and Gilani, A. (1987). Covert cross-modality orienting of attention in space. Paper presented at the Annual Meeting of the Psychonomics Society, Seattle, WA.
-
Knöferle, K. and Spence, C. (2012). Crossmodal correspondences between sounds and tastes, Psychon. Bull. Rev. 19, 992–1006.
-
Kunkler-Peck, A. J. and Turvey, M. T. (2000). Hearing shape, J. Exp. Psychol. Hum. Percept. Perform. 26, 279–294.
-
Lacey, S., Martinez, M., McCormick, K. and Sathian, K. (2016). Synesthesia strengthens sound-symbolic cross-modal correspondences, Eur. J. Neurosci. 44, 2716–2721.
-
Lakatos, S., McAdams, S. and Caussé, R. (1997). The representation of auditory source characteristics: simple geometric form, Percept. Psychophys. 59, 1180–1190.
-
Lakens, D. (2012). Polarity correspondence in metaphor congruency effects: structural overlap predicts categorization times for bipolar concepts presented in vertical space, J. Exp. Psychol. Learn. Mem. Cogn. 38, 726–736.
-
Lewkowicz, D. J. and Turkewitz, G. (1980). Cross-modal equivalence in early infancy: auditory-visual intensity matching, Dev. Psychol. 16, 597–607.
-
Lidji, P., Kolinsky, R., Lochy, A. and Morais, J. (2007). Spatial associations for musical stimuli: a piano in the head?, J. Exp. Psychol. Hum. Percept. Perform. 33, 1189–1207.
-
Loui, P., Zamm, A. and Schlaug, G. (2012). Absolute pitch and synesthesia: two sides of the same coin? Shared and distinct neural substrates of music listening, ICMPC 2012, 618–623.
-
Lowe, M. L. and Haws, K. L. (2017). Sounds big: the effects of acoustic pitch on product perceptions, J. Mark. Res. 54, 331–346.
-
Ludwig, V. U., Adachi, I. and Matzuzawa, T. (2011). Visuoauditory mappings between high luminance and high pitch are shared by chimpanzees (Pan troglodytes) and humans, Proc. Natl Acad. Sci. USA 108, 20661–20665.
-
Lynott, D. and Coventry, K. (2014). On the ups and downs of emotion: testing between conceptual-metaphor and polarity accounts of emotional valence–spatial location interactions, Psychon. Bull. Rev. 21, 218–226.
-
Maeda, F., Kanai, R. and Shimojo, S. (2004). Changing pitch induced visual motion illusion, Curr. Biol. 14, R990–R991.
-
Makovac, E. and Gerbino, W. (2010). Sound–shape congruency affects the multisensory response enhancement, Vis. Cogn. 18, 133–137.
-
Marks, L. E. (1974). On associations of light and sound: the mediation of brightness, pitch, and loudness, Am. J. Psychol. 87, 173–188.
-
Marks, L. E. (1975). On colored-hearing synesthesia: cross-modal translations of sensory dimensions, Psychol. Bull. 82, 303–331.
-
Marks, L. (1978). The Unity of the Senses: Interrelations among the Modalities. Academic Press, New York, NY, USA.
-
Marks, L. E. (1987). On cross-modal similarity: auditory–visual interactions in speeded discrimination, J. Exp. Psychol. Hum. Percept. Perform. 13, 384–394.
-
Marks, L. E. (2004). Cross-modal interactions in speeded classification, in: Handbook of Multisensory Processes, G. A. Calvert, C. Spence and B. E. Stein (Eds), pp. 85–105. MIT Press, Cambridge, MA, USA.
-
Marks, L. E., Szczesiul, R. and Ohlott, P. (1986). On the cross-modal perception of intensity, J. Exp. Psychol. Hum. Percept. Perform. 12, 517–534.
-
Marks, L. E., Hammeal, R. J. and Bornstein, M. H. (1987). Perceiving similarity and comprehending metaphor, Monogr. Soc. Res. Child Develop. 52, 1–102.
-
Marks, L. E., Ben-Artzi, E. and Lakatos, S. (2003). Cross-modal interactions in auditory and visual discrimination, Int. J. Psychophysiol. 50, 125–145.
-
Martino, G. and Marks, L. E. (1999). Perceptual and linguistic interactions in speeded classification: tests of the semantic coding hypothesis, Perception 28, 903–923.
-
Martino, G. and Marks, L. E. (2000). Cross-modal interaction between vision and touch: the role of synesthetic correspondence, Perception 29, 745–754.
-
McCormick, K., Lacey, S., Stilla, R., Nygaard, L. C. and Sathian, K. (2018). Neural basis of the crossmodal correspondence between auditory pitch and visuospatial elevation, Neuropsychologia 112, 19–30.
-
McMahon, T. A. and Bonner, J. T. (1983). On Size and Life. Scientific American, New York, NY, USA.
-
Meier, B. P. and Robinson, M. D. (2004). Why the sunny side is up: associations between affect and vertical position, Psychol. Sci. 15, 243–247.
-
Meier, B. P., Hauser, D. J., Robinson, M. D., Friesen, C. K. and Schjeldahl, K. (2007). What’s “up” with God? Vertical space as a representation of the divine, J. Personal. Soc. Psychol. 93, 699–710.
-
Melara, R. D. (1989a). Dimensional interaction between color and pitch, J. Exp. Psychol. Hum. Percept. Perform. 15, 69–79.
-
Melara, R. D. (1989b). Similarity relations among synesthetic stimuli and their attributes, J. Exp. Psychol. Hum. Percept. Perform. 15, 212–231.
-
Melara, R. D. and Marks, L. E. (1990). Processes underlying dimensional interactions: correspondences between linguistic and nonlinguistic dimensions, Mem. Cogn. 18, 477–495.
-
Melara, R. D. and Mounts, J. R. W. (1994). Contextual influences on interactive processing: effects of discriminability, quantity, and uncertainty, Percept. Psychophys. 56, 73–90.
-
Melara, R. D. and O’Brien, T. P. (1987). Interaction between synesthetically corresponding dimensions, J. Exp. Psychol. Gen. 116, 323–336.
-
Miller, J. O. (1991). Channel interaction and the redundant-targets effect in bimodal divided attention, J. Exp. Psychol. Hum. Percept. Perform. 17, 160–169.
-
Mondloch, C. J. and Maurer, D. (2004). Do small white balls squeak? Pitch–object correspondences in young children, Cogn. Affect. Behav. Neurosci. 4, 133–136.
-
Morton, E. S. (1977). On the occurrence and significance of motivation-structural rules in some bird and mammal sounds, Am. Nat. 111, 855–869.
-
Mossbridge, J. A., Grabowecky, M. and Suzuki, S. (2011). Changes in auditory frequency guide visual–spatial attention, Cognition 121, 133–139.
-
Mudd, S. A. (1963). Spatial stereotypes of four dimensions of pure tone, J. Exp. Psychol. 66, 347–352.
-
Newton, I. (1952). Opticks or a Treatise on the Reflections, Refractions, Inflections and Colours of Light. Dover Publications, New York, NY, USA. (Originally published 1730).
-
O’Boyle, M. W. and Tarte, R. D. (1980). Implications for phonetic symbolism: the relationship between pure tones and geometric figures, J. Psycholinguist. Res. 9, 535–544.
-
Occelli, V., Spence, C. and Zampini, M. (2009). Compatibility effects between sound frequencies and tactile elevation, Neuroreport 20, 793–797.
-
Orchard-Mills, E., Van der Burg, E. and Alais, D. (2013). Amplitude-modulated auditory stimuli influence selection of visual spatial frequencies, J. Vis. 13, 6. DOI:10.1167/13.3.6.
-
Orchard-Mills, E., Van der Burg, E. and Alais, D. (2016). Crossmodal correspondence between auditory pitch and visual elevation affects temporal ventriloquism, Perception 45, 409–424.
-
Palmer, S. E., Schloss, K. B., Xu, Z. and Prado-León, L. R. (2013). Music–color associations are mediated by emotion, Proc. Natl Acad. Sci. USA 110, 8836–8841.
-
Panek, W. and Stevens, S. S. (1966). Saturation of red: a prothetic continuum, Percept. Psychophys. 1, 59–66.
-
Parise, C. V. (2016). Crossmodal correspondences: standing issues and experimental guidelines, Multisens. Res. 29, 7–28.
-
Parise, C. and Spence, C. (2008). Synaesthetic congruency modulates the temporal ventriloquism effect, Neurosci. Lett. 442, 257–261.
-
Parise, C. V. and Spence, C. (2009). ‘When birds of a feather flock together’: synesthetic correspondences modulate audiovisual integration in non-synesthetes, PLoS One 4(5), e5664. DOI:10.1371/journal.pone.0005664.
-
Parise, C. V. and Spence, C. (2012). Audiovisual crossmodal correspondences and sound symbolism: a study using the implicit association test, Exp. Brain Res. 220, 319–333.
-
Parise, C. V., Knorre, K. and Ernst, M. O. (2014). Natural auditory scene statistics shapes human spatial hearing, Proc. Natl Acad. Sci. USA 111, 6104–6108.
-
Parkinson, C., Kohler, P. J., Sievers, B. and Wheatley, T. (2012). Associations between auditory pitch and visual elevation do not depend on language: evidence from a remote population, Perception 41, 854–861.
-
Patching, G. R. and Quinlan, P. T. (2002). Garner and congruence effects in the speeded classification of bimodal signals, J. Exp. Psychol. Hum. Percept. Perform. 28, 755–775.
-
Pedley, P. E. and Harper, R. S. (1959). Pitch and the vertical localization of sound, Am. J. Psychol. 72, 447–449.
-
Petrovic, M., Antovic, M., Milankovic, V. and Acic, G. (2012). Interplay of tone and color: absolute pitch and synesthesia, in: Proceedings of the 12th International Conference on Music Perception and Cognition and the 8th Triennial Conference of the European Society for the Cognitive Sciences of Music (ESCOM), pp. 799–806. Thessaloniki, Greece.
-
Pitteri, M., Marchetti, M., Priftis, K. and Grassi, M. (2017). Naturally together: pitch-height and brightness as coupled factors for eliciting the SMARC effect in non-musicians, Psychol. Res. 81, 243–254.
-
Pratt, C. C. (1930). The spatial character of high and low tones, J. Exp. Psychol. 13, 278–285.
-
Pridmore, R. W. (1992). Music and color: relations in the psychophysical perspective, Color Res. Appl. 17, 57–61.
-
Proctor, R. W. and Cho, Y. S. (2006). Polarity correspondence: a general principle for performance of speeded binary classification tasks, Psychol. Bull. 132, 416–442.
-
Ratcliffe, V. F., Taylor, A. M. and Reby, D. (2016). Cross-modal correspondences in non-human mammal communication, Multisens. Res. 29, 49–91.
-
Roffler, S. K. and Butler, R. A. (1968). Factors that influence the localization of sound in the vertical plane, J. Acoust. Soc. Am. 43, 1255–1259.
-
Rosenthal, R. (1979). The file drawer problem and tolerance for null results, Psychol. Bull. 86, 638–641.
-
Rudmin, F. and Cappelli, M. (1983). Tone–taste synesthesia: a replication, Percept. Mot. Skills 56, 118. DOI:10.2466/pms.1983.56.1.118.
-
Rusconi, E., Kwana, B., Giordano, B. L., Umiltà, C. and Butterworth, B. (2006). Spatial representation of pitch height: the SMARC effect, Cognition 99, 113–129.
-
Sadaghiani, S., Maier, J. X. and Noppeney, U. (2009). Natural, metaphoric, and linguistic auditory direction signals have distinct influences on visual motion processing, J. Neurosci. 29, 6490–6499.
-
Schietecat, A. C., Lakens, D., IJsselsteijn, W. A. and de Kort, Y. A. (2018a). Predicting context-dependent cross-modal associations with dimension-specific polarity attributions. Part 1 — brightness and aggression, Collabra Psychol. 4(1), 14. DOI:10.1525/collabra.110.
-
Schietecat, A. C., Lakens, D., IJsselsteijn, W. A. and de Kort, Y. A. W. (2018b). Predicting context-dependent cross-modal associations with dimension-specific polarity attributions. Part 2: red and valence, Collabra Psychol. 4(1), 21. DOI:10.1525/collabra.126.
-
Shayan, S., Ozturk, O. and Sicoli, M. A. (2011). The thickness of pitch: crossmodal metaphors in Farsi, Turkish, and Zapotec, Senses Soc. 6(1), 96–105.
-
Shepard, R. N. (1964). Circularity in judgments of relative pitch, J. Acoust. Soc. Am. 36, 2346–2353.
-
Smith, L. B. and Sera, M. D. (1992). A developmental analysis of the polar structure of dimensions, Cogn. Psychol. 24, 99–142.
-
Smith, E. L., Grabowecky, M. and Suzuki, S. (2007). Auditory-visual crossmodal integration in perception of face gender, Curr. Biol. 17, 1680–1685.
-
Sonnadara, R. R., Gonzalez, D. A., Hansen, S., Elliott, D. and Lyons, J. L. (2009). Spatial properties of perceived pitch: influence on reaching movements, Ann. N. Y. Acad. Sci. 1169, 503–507.
-
Spence, C. (2011). Crossmodal correspondences: a tutorial review, Atten. Percept. Psychophys. 73, 971–995.
-
Spence, C. (2018). Crossmodal correspondences: a tutorial review, in: Senses and Sensation: Critical and Primary Sources, Vol. III, D. Howes (Ed.), pp. 91–125. Bloomsbury Academic, London, UK.
-
Spence, C. (submitted). Crossmodal correspondences involving musical stimuli, Psychol. Bull.
-
Spence, C. and Deroy, O. (2012). Crossmodal correspondences: innate or learned?, i-Perception 3, 316–318.
-
Spence, C. and Deroy, O. (2013). How automatic are crossmodal correspondences?, Conscious. Cogn. 22, 245–260.
-
Spence, C. and Sathian, K. (in press). Audiovisual crossmodal correspondences: behavioural consequences and neural underpinnings, in: Multisensory Perception: From Laboratory to Clinic, K. Sathian and V. S. Ramachandran (Eds), Elsevier.
-
Stekelenburg, J. J. and Keetels, M. (2016). The effect of synesthetic associations between the visual and auditory modalities on the Colavita effect, Exp. Brain Res. 234, 1209–1219.
-
Stevens, S. S. (1957). On the psychophysical law, Psychol. Rev. 64, 153–181.
-
Stevens, J. C. and Marks, L. E. (1965). Cross-modality matching of brightness and loudness, Proc. Natl Acad. Sci. U.S.A. 54, 407–411.
-
Stevens, S. S. and Volkmann, J. (1940). The relation of pitch to frequency: a revised scale, Am. J. Psychol. 53, 329–353.
-
Stumpf, K. (1883). Tonpsychologie I. Hirzel, Leipzig, Germany.
-
Trimble, O. C. (1934). Localization of sound in the anterior-posterior and vertical dimensions of “auditory” space, Br. J. Psychol. 24, 320–334.
-
Van der Burg, E., Olivers, C. N. L., Bronkhorst, A. W. and Theeuwes, J. (2008). Pip and pop: non-spatial auditory signals improve spatial visual search, J. Exp. Psychol. Hum. Percept. Perform. 34, 1053–1065.
-
Velasco, C., Adams, C., Petit, O. and Spence, C. (2019). On the localization of tastes and tasty products in 2D space, Food Qual. Pref. 71, 438–446.
-
Walker, P. (2016). Cross-sensory correspondences: a theoretical framework and their relevance to music, Psychomusicol. Music Mind Brain 26, 103–116.
-
Walker, P. and Smith, S. (1984). Stroop interference based on the synaesthetic qualities of auditory pitch, Perception 13, 75–81.
-
Walker, P. and Smith, S. (1985). Stroop interference based on the multimodal correlates of haptic size and auditory pitch, Perception 14, 729–736.
-
Walker, P. and Smith, S. (1986). The basis of Stroop interference involving the multimodal correlates of auditory pitch, Perception 15, 491–496.
-
Walker, P. and Walker, L. (2012). Size–brightness correspondence: crosstalk and congruity among dimensions of connotative meaning, Atten. Percept. Psychophys. 74, 1226–1240.
-
Walker, L. and Walker, P. (2016). Cross-sensory mapping of feature values in the size–brightness correspondence can be more relative than absolute, J. Exp. Psychol. Hum. Percept. Perform. 42, 138–150.
-
Walker, P., Bremner, J. G., Mason, U., Spring, J., Mattock, K., Slater, A. and Johnson, S. P. (2010). Preverbal infants’ sensitivity to synesthetic cross-modality correspondences, Psychol. Sci. 21, 21–25.
-
Walker, L., Walker, P. and Francis, B. (2012). A common scheme for cross-sensory correspondences across stimulus dimensions, Perception 41, 1186–1192.
-
Walker, P., Scallon, G. and Francis, B. (2017). Cross-sensory correspondences: heaviness is dark and low-pitched, Perception 46, 772–792.
-
Walsh, V. (2003). A theory of magnitude: common cortical metrices of time, space and quality, Trends Cogn. Sci. 7, 483–488.
-
Wells, A. (1980). Music and visual color: a proposed correlation, Leonardo 13, 101–107.
-
Wicker, F. W. (1968). Mapping the intersensory regions of perceptual space, Am. J. Psychol. 81, 178–188.
-
Widmann, A., Kujala, T., Tervaniemi, M., Kujala, A. and Schröger, E. (2004). From symbols to sounds: visual symbolic information activates sound representations, Psychophysiology 41, 709–715.
-
Xu, J., Yu, L., Rowland, B. A., Stanford, T. R. and Stein, B. E. (2012). Incorporating cross-modal statistics in the development and maintenance of multisensory integration, J. Neurosci. 32, 2287–2298.
-
Yau, J. M., Olenczak, J. B., Dammann, J. F. and Bensmaia, S. J. (2009). Temporal frequency channels are linked across audition and touch, Curr. Biol. 19, 561–566.
| All Time | Past Year | Past 30 Days | |
|---|---|---|---|
| Abstract Views | 1681 | 626 | 46 |
| Full Text Views | 167 | 41 | 9 |
| PDF Views & Downloads | 189 | 77 | 12 |
On the Relative Nature of (Pitch-Based) Crossmodal Correspondences
In: Multisensory ResearchAbstract
This review deals with the question of the relative vs absolute nature of crossmodal correspondences, with a specific focus on those correspondences involving the auditory dimension of pitch. Crossmodal correspondences have been defined as the often-surprising crossmodal associations that people experience between features, attributes, or dimensions of experience in different sensory modalities, when either physically present, or else merely imagined. In the literature, crossmodal correspondences have often been contrasted with synaesthesia in that the former are frequently said to be relative phenomena (e.g., it is the higher-pitched of two sounds that is matched with the smaller of two visual stimuli, say, rather than there being a specific one-to-one crossmodal mapping between a particular pitch of sound and size of object). By contrast, in the case of synaesthesia, the idiosyncratic mapping between inducer and concurrent tends to be absolute (e.g., it is a particular sonic inducer that elicits a specific colour concurrent). However, a closer analysis of the literature soon reveals that the distinction between relative and absolute in the case of crossmodal correspondences may not be as clear-cut as some commentators would have us believe. Furthermore, it is important to note that the relative vs absolute question may receive different answers depending on the particular (class of) correspondence under empirical investigation.
| All Time | Past Year | Past 30 Days | |
|---|---|---|---|
| Abstract Views | 1681 | 626 | 46 |
| Full Text Views | 167 | 41 | 9 |
| PDF Views & Downloads | 189 | 77 | 12 |