Music-to-Color Associations of Single-Line Piano Melodies in Non-synesthetes
In: Multisensory ResearchSearch for other papers by Stephen E. Palmer in
Current site
Google Scholar
Search for other papers by Thomas A. Langlois in
Current site
Google Scholar
Search for other papers by Karen B. Schloss in
Current site
Google Scholar
Prior research has shown that non-synesthetes’ color associations to classical orchestral music are strongly mediated by emotion. The present study examines similar cross-modal music-to-color associations for much better controlled musical stimuli: 64 single-line piano melodies that were generated from four basic melodies by Mozart, whose global musical parameters were manipulated in tempo (slow/fast), note-density (sparse/dense), mode (major/minor) and pitch-height (low/high). Participants first chose the three colors (from 37) that they judged to be most consistent with (and, later, the three that were most inconsistent with) the music they were hearing. They later rated each melody and each color for the strength of its association along four emotional dimensions: happy/sad, agitated/calm, angry/not-angry and strong/weak. The cross-modal choices showed that faster music in the major mode was associated with lighter, more saturated, yellower (warmer) colors than slower music in the minor mode. These results replicate and extend those of Palmer et al. (, Proc. Natl Acad. Sci. 110, 8836–8841) with more precisely controlled musical stimuli. Further results replicated strong evidence for emotional mediation of these cross-modal associations, in that the emotional ratings of the melodies were very highly correlated with the emotional associations of the colors chosen as going best/worst with the melodies ( for happy/sad, strong/weak, angry/not-angry and agitated/calm, respectively). The results are discussed in terms of common emotional associations forming a cross-modal bridge between highly disparate sensory inputs.
Purchase
Buy instant access (PDF download and unlimited online access):
Institutional Login
Log in with Open Athens, Shibboleth, or your institutional credentials
Personal login
Log in with your brill.com account
-
Arnheim R. (1986). New Essays on the Psychology of Art. University of California Press, Berkeley, CA, USA.
-
Barbiere J. M., Vidal A., Zellner D. A. (2007). The color of music: correspondence through emotion, Empir. Stud. Arts 25, 193–208.
-
Bernstein I. H., Edelstein B. A. (1971). Effects of some variations in auditory input upon visual choice reaction time, J. Exp. Psychol. 87, 241–247.
-
Bond B., Stevens S. S. (1969). Cross-modality matching of brightness to loudness by 5-year-olds, Percept. Psychophys. 6, 337–339.
-
Bresin R. (2005). What is the color of that music performance?, in: Proceedings of the International Computer Music Conference — ICMC 2005, San Francisco, CA, USA, pp. 367–370.
-
Calvert G., Spence C., Stein B. E. (Eds) (2004). The Handbook of Multisensory Processes. MIT Press, Cambridge, MA, USA.
-
Collier G. L. (1996). Affective synesthesia: extracting emotion space from simple perceptual stimuli, Motiv. Emot. 20, 1–32.
-
Cytowic R. E., Eagleman D. (2009). Wednesday is Indigo Blue: Discovering the Brain of Synesthesia. MIT Press, Cambridge, MA, USA.
-
Driver J., Spence C. (1998). Cross-modal links in spatial attention, Philos. Trans. R. Soc. Lond. B Biol. Sci. 353(1373), 1319–1331.
-
Evans K. K., Treisman A. (2010). Natural cross-modal mappings between visual and auditory features, J. Vis. 10, 6, 1–12.
-
Grossenbacher P. G., Lovelace C. T. (2001). Mechanisms of synesthesia: cognitive and physiological constraints, Trends Cogn. Sci. 5, 36–41.
-
Heinlein C. P. (1928). The affective characteristics of the major and minor modes in music, J. Comp. Psychol. 8, 101–142.
-
Hevner K. (1935). The affective character of the major and minor modes in music, Am. J. Psychol. 47, 103–118.
-
Hubbard T. L. (1996). Synesthesia-like mappings of lightness, pitch and melodic interval, Am. J. Psychol. 109, 219–238.
-
Huron D. (2008). A comparison of average pitch height and interval size in major- and minor-key themes: evidence consistent with affect-related pitch prosody, Empir. Musicol. Rev. 3, 59–63.
-
Huron D. (2012). Understanding music-related emotion: lessons from ethology, in: Proceedings of the 12th International Conference on Music Perception and Cognition, Thessaloniki, Greece, pp. 473–482.
-
Juslin P. N., Sloboda J. A. (2001). Music and Emotion: Theory and Research. Oxford University Press, Oxford, UK.
-
Karwoski T. F., Odbert H. S., Osgood C. E. (1942). Studies in synesthetic thinking: II. The rôle of form in visual responses to music, J. Gen. Psychol. 26, 199–222.
-
Kivy P. (1980). The Corded Shell: Reflections on Musical Expression. Princeton University Press, Princeton, NJ, USA.
-
Krumhansl C. L. (1997). An exploratory study of musical emotions and psychophysiology, Can. J. Exp. Psychol. 51, 336.
-
Langer S. K. (1942). Philosophy in a New Key: a Study in the Symbolism of Reason, Rite, and Art. Harvard University Press, Cambridge, MA, USA, p. 214.
-
Lewkowicz D. J., Turkewitz G. (1980). Cross-modal equivalence in early infancy: auditory–visual intensity matching, Dev. Psychol. 16, 597–607.
-
Lidji P., Kolinsky R., Lochy A., Morais J. (2007). Spatial associations for musical stimuli: a piano in the head? J. Exp. Psychol. Hum. Percept. Perform. 33, 1189–1207.
-
Marks L. E. (1974). On associations of light and sound: the mediation of brightness, pitch and loudness, Am. J. Psychol. 87, 173–188.
-
Marks L. E., Hammeal R. J., Bornstein M. H. (1987). Perceiving similarity and comprehending metaphor, Monogr. Soc. Res. Child Dev. 52, 1–102.
-
Martino G., Marks L. E. (2001). Synesthesia: strong and weak, Curr. Dir. Psychol. Sci. 10, 61–65.
-
McMahon T. A., Bonner J. T. (1983). On Size and Life. Scientific American Books/W. H. Freeman & Co., New York, NY, USA.
-
Mehrabian A., Russell J. A. (1974). An Approach to Environmental Psychology. MIT Press, Cambridge, MA, USA.
-
Osgood C. E., Suci G. J., Tannenbaum P. H. (1957). The Measurement of Meaning. University of Illinois Press, Urbana, IL, USA.
-
Palmer S. E., Schloss K. B. (2010). An ecological valence theory of human color preference, Proc. Natl Acad. Sci. 107, 8877–8882.
-
Palmer S. E., Schloss K. B., Xu Z., Prado-Leon L. (2013a). Music–color associations are mediated by emotion, Proc. Natl Acad. Sci. 110, 8836–8841.
-
Palmer S. E., Schloss K. B., Whiteford K. L. (2013b). Music–color associations to classical music in synesthetes and non-synesthetes: the surprising role of emotion, in: 13th Annual Meeting of the Vision Science Society, Naples, FL, USA.
-
Ramachandran V. S., Hubbard E. M. (2001). Synaesthesia — a window into perception, thought and language, J. Cons. Stud. 8(12), 3–34.
-
Rusconi E., Kwan B., Giordano B. L., Umilta C., Butterworth B. (2006). Spatial representation of pitch height: the SMARC effect, Cognition 99, 113–129.
-
Schifferstein H. N. J., Tanudjaja I. (2004). Visualising fragrances through colours: the mediating role of emotions, Perception 33, 1249–1266.
-
Sebba R. (1991). Structural correspondence between music and color, Color Res. Appl. 16, 81–88.
-
Seo H. S., Arshamian A., Schemmer K., Scheer I., Sander T., Ritter G., Hummel T. (2010). Cross-modal integration between odors and abstract symbols, Neurosci. Lett. 478, 175–178.
-
Sievers B., Polansky L., Casey M., Wheatley T. (2013). Music and movement share a dynamic structure that supports universal expressions of emotion, Proc. Natl Acad. Sci. 110, 70–75.
-
Spence C. (2011). Crossmodal correspondences: a tutorial review, Atten. Percept. Psychophys. 73, 971–995.
-
Spence C., Driver J. (2004). Crossmodal Space and Crossmodal Attention. Oxford University Press, Oxford, UK, USA.
-
Stevens J. C., Marks L. E. (1965). Cross-modality matching of brightness and loudness, Proc. Natl Acad. Sci. 54, 407–411.
-
Ward J., Huckstep B., Tsakanikos E. (2006). Sound–colour synaesthesia: to what extent does it use cross-modal mechanisms common to us all? Cortex 42, 264–280.
-
Whiteford K. L., Schloss K. B., Palmer S. E. (2013). Music–color associations from Bach to the blues: emotional mediation in synesthetes and non-synesthetes, in: 13th Annual Meeting of the Vision Science Society, Naples, FL, Italy.
-
Wicker F. W. (1968). Mapping the intersensory regions of perceptual space, Am. J. Psychol. 81, 178–188.
-
Zajonc R. B. (1980). Feeling and thinking: preferences need no inferences, Am. Psychol. 35, 151–175.
| All Time | Past Year | Past 30 Days | |
|---|---|---|---|
| Abstract Views | 1804 | 321 | 22 |
| Full Text Views | 500 | 31 | 0 |
| PDF Views & Downloads | 268 | 50 | 0 |
Music-to-Color Associations of Single-Line Piano Melodies in Non-synesthetes
In: Multisensory ResearchSearch for other papers by Stephen E. Palmer in
Current site
Google Scholar
PubMed
Search for other papers by Thomas A. Langlois in
Current site
Google Scholar
PubMed
Search for other papers by Karen B. Schloss in
Current site
Google Scholar
PubMed
Prior research has shown that non-synesthetes’ color associations to classical orchestral music are strongly mediated by emotion. The present study examines similar cross-modal music-to-color associations for much better controlled musical stimuli: 64 single-line piano melodies that were generated from four basic melodies by Mozart, whose global musical parameters were manipulated in tempo (slow/fast), note-density (sparse/dense), mode (major/minor) and pitch-height (low/high). Participants first chose the three colors (from 37) that they judged to be most consistent with (and, later, the three that were most inconsistent with) the music they were hearing. They later rated each melody and each color for the strength of its association along four emotional dimensions: happy/sad, agitated/calm, angry/not-angry and strong/weak. The cross-modal choices showed that faster music in the major mode was associated with lighter, more saturated, yellower (warmer) colors than slower music in the minor mode. These results replicate and extend those of Palmer et al. (, Proc. Natl Acad. Sci. 110, 8836–8841) with more precisely controlled musical stimuli. Further results replicated strong evidence for emotional mediation of these cross-modal associations, in that the emotional ratings of the melodies were very highly correlated with the emotional associations of the colors chosen as going best/worst with the melodies ( for happy/sad, strong/weak, angry/not-angry and agitated/calm, respectively). The results are discussed in terms of common emotional associations forming a cross-modal bridge between highly disparate sensory inputs.
| All Time | Past Year | Past 30 Days | |
|---|---|---|---|
| Abstract Views | 1804 | 321 | 22 |
| Full Text Views | 500 | 31 | 0 |
| PDF Views & Downloads | 268 | 50 | 0 |