There is a widespread tendency to associate certain properties of sound with those of colour (e.g., higher pitches with lighter colours). Yet it is an open question how sound influences chroma or hue when properly controlling for lightness. To examine this, we asked participants to adjust physically equiluminant colours until they ‘went best’ with certain sounds. For pure tones, complex sine waves and vocal timbres, increases in frequency were associated with increases in chroma. Increasing the loudness of pure tones also increased chroma. Hue associations varied depending on the type of stimuli. In stimuli that involved only limited bands of frequencies (pure tones, vocal timbres), frequency correlated with hue, such that low frequencies gave blue hues and progressed to yellow hues at 800 Hz. Increasing the loudness of a pure tone was also associated with a shift from blue to yellow. However, for complex sounds that share the same bandwidth of frequencies (100–3200 Hz) but that vary in terms of which frequencies have the most power, all stimuli were associated with yellow hues. This suggests that the presence of high frequencies (above 800 Hz) consistently yields yellow hues. Overall we conclude that while pitch–chroma associations appear to flexibly re-apply themselves across a variety of contexts, frequencies above 800 Hz appear to produce yellow hues irrespective of context. These findings reveal new sound–colour correspondences previously obscured through not controlling for lightness. Findings are discussed in relation to understanding the underlying rules of cross-modal correspondences, synaesthesia, and optimising the sensory substitution of visual information through sound.
EstermanM.VerstynenT.IvryR. B.RobertsonL. C. (2006).
Coming unbound: disrupting automatic integration of synesthetic color and graphemes by transcranial magnetic stimulation of the right parietal lobeJ. Cogn. Neurosci.181570–1576.
GiannakisK. (2001). Sound mosaics: a graphical user interface for sound synthesis based on audio-visual associations. Doctoral dissertation Middlesex University UK. Retrieved from http://eprints.mdx.ac.uk/6634/1/Konstantinos-sound_mosaics.phd.pdf.
GoodyearB. G.MenonR. S. (1998).
Effect of luminance contrast on BOLD fMRI response in human primary visual areasJ. Neurophysiol.792204–2207.
Hamilton-FletcherG.MengucciM.MedeirosF. (2016b). Synaestheatre: sonification of coloured objects in space in: Proceedings of the International Conference on Live Interfaces 2016 Sussex Brighton UK pp. 252–256.
Hamilton-FletcherG.ObristM.WattenP.MengucciM.WardJ. (2016c). ‘I always wanted to see the night sky’: blind user preferences for sensory substitution devices in: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems San Jose CA USA pp. 2162–2174.
HupéJ. M.DojatM. (2015).
A critical review of the neuroimaging literature on synesthesiaFront. Hum. Neurosci.9103. DOI:10.3389/fnhum.2015.00103.
ISO (2003). Acoustics — Normal Equal-Loudness Level Contours. International Organisation for Standardisation Geneva Switzerland.
Color-tone analogies: a systematic presentation of the principles of correspondence in:
Audiovisuology: Compendium. A Multidisciplinary Survey of Audiovisual CultureDanielsD.NaumannS.ThobenJ. (Eds) pp.
338–347. König, Köln, Germany.
Sound level dependence of the primary auditory cortex: simultaneous measurement with 61-channel EEG and fMRINeuroimage2849–58.
OrlandatouK. (2012). The role of pitch and timbre in the synaesthetic experience in: Proceedings of the 12th International Conference on Music Perception and Cognition and the 8th Triennial Conference of the European Society for the Cognitive Sciences of Music Thessaloniki Greece pp. 751–758.
PalmerS. E.SchlossK. B.XuZ.Prado-LeónL. R. (2013).
Music–color associations are mediated by emotionProc. Natl Acad. Sci. USA1108836–8841.
SharpeL. T.StockmanA.JägleH.NathansJ. (1999).
Opsin genes, cone photopigments, color vision, and color blindness in:
Color Vision: from Genes to PerceptionGegenfurtnerK. R.SharpeL. T. (Eds) pp.
3–51. Cambridge University PressCambridge, UK.