Cookies on this website

We use cookies to ensure that we give you the best experience on our website. If you click 'Accept all cookies' we'll assume that you are happy to receive all cookies and you won't see this message again. If you click 'Reject all non-essential cookies' only necessary cookies providing core functionality such as security, network management, and accessibility will be enabled. Click 'Find out more' for information on how to change your cookie settings.

This study was designed to investigate the complex interplay between multisensory processing, top-down processes related to the task relevance of sensory signals, and sensory switching. Thirty-five adults completed either a speeded detection or a discrimination task using the same auditory and visual stimuli and experimental setup. The stimuli consisted of unisensory and multisensory presentations of the letters 'b' and 'd'. The multisensory stimuli were either congruent (e.g., the grapheme 'b' with the phoneme /b/) or incongruent (e.g., the grapheme 'b' with the phoneme /d/). In the detection task, the participants had to respond to all of the stimuli as rapidly as possible while, in the discrimination task, they only responded on those trials where one prespecified letter (either 'b' or 'd') was present. Incongruent multisensory stimuli resulted in faster responses as compared to unisensory stimuli in the detection task. In the discrimination task, only the dual-target congruent stimuli resulted in faster RTs, while the incongruent multisensory stimuli led to slower RTs than to unisensory stimuli; RTs were the slowest when the visual (rather than the auditory) signal was irrelevant, thus suggesting visual dominance. Switch costs were also observed when switching between unisensory target stimuli, while dual-target multisensory stimuli were less likely to be affected by sensory switching. Taken together, these findings suggest that multisensory motor enhancements and sensory switch costs are influenced by top-down modulations determined by task instructions, which can override the influence of prior learnt associations.

Original publication

DOI

10.1007/s00221-020-06014-3

Type

Journal article

Journal

Exp Brain Res

Publication Date

30/01/2021

Keywords

Audition, Modality-switch effect (MSE), Multisensory, Switch cost, Top–down, Vision