City Research Online

Hearing through your eyes: neural basis of audiovisual cross-activation, revealed by transcranial alternating current stimulation

Fassnidge, C., Ball, D., Kazaz, Z. , Knudsen, S., Spicer, A., Tipple, A. & Freeman, E. D. ORCID: 0000-0001-7234-824X (2019). Hearing through your eyes: neural basis of audiovisual cross-activation, revealed by transcranial alternating current stimulation. Journal of Cognitive Neuroscience, 31(6), pp. 922-935. doi: 10.1162/jocn_a_01395


Some people experience auditory sensations when seeing visual flashes or movements. This prevalent synaesthesia-like ‘visual-evoked auditory response’ (vEAR) could result either from over-exuberant cross-activation between brain areas, and/or reduced inhibition of normally-occurring cross-activation. We have used transcranial alternating current stimulation (tACS) to test these theories. We applied tACS at 10Hz (alpha-band frequency) or 40Hz (gamma-band), bilaterally either to temporal or occipital sites, while measuring same/different discrimination of paired auditory (A) versus visual (V) 'Morse code' sequences. At debriefing, participants were classified as vEAR or non-vEAR depending on whether they reported 'hearing' the silent flashes.

In non-vEAR participants, temporal 10Hz tACS caused impairment of A performance, which correlated with improved V; conversely under occipital tACS, poorer V performance correlated with improved A. This reciprocal pattern suggests that sensory cortices are normally mutually inhibitory, and that alpha-frequency tACS may bias the balance of competition between them. vEAR participants showed no tACS effects, consistent with reduced inhibition, or enhanced cooperation between modalities. In addition, temporal 40Hz tACS impaired V performance, specifically in individuals who showed a performance advantage for V (relative to A). Gamma-frequency tACS may therefore modulate the ability of these individuals to benefit from recoding flashes into the auditory modality, possibly by disrupting cross-activation of auditory areas by visual stimulation.

Our results support both theories, suggesting that vEAR may depend on disinhibition of normally-occurring sensory cross-activation, which may be expressed more strongly in some individuals. Furthermore, endogenous alpha and gamma-frequency oscillations may function respectively to inhibit or promote this cross-activation.

Publication Type: Article
Additional Information: Accepted for publication in Journal of Cognitive Neuroscience. ©Massachusetts Institute of Technology Press, 2019.
Publisher Keywords: Synaesthesia, perception, neurostimulation, audiovisual integration, individual differences, psychophysics
Subjects: B Philosophy. Psychology. Religion > BF Psychology
R Medicine > RC Internal medicine > RC0321 Neuroscience. Biological psychiatry. Neuropsychiatry
R Medicine > RE Ophthalmology
Departments: School of Health & Psychological Sciences > Psychology
Text - Accepted Version
Download (1MB) | Preview



Downloads per month over past year

View more statistics

Actions (login required)

Admin Login Admin Login