Does a “stoplight!” improve processing a stoplight? Cross-modal influences of time-compressed spoken denotations on automotive icon classification

Abstract

Findings from three experiments support the conclusion that semantic auditory primes facilitate processing of complex warning icons in the automotive context. In Experiment 1, we used a cross-modal icon identification task with auditory primes and visual icons as targets, presented in a high perceptual load context. Responses were faster for congruent priming in comparison to neutral or incongruent priming. This effect also emerged for different levels of time-compression of auditory primes. In Experiment 2, participants took part in a driving simulation with target icons on a gantry road sign. Participants had to categorize the color of the icons. Again, compressed auditory primes facilitated responses in cases of congruency (compared with incongruent and neutral primes). This result was replicated in Experiment 3 with more complex responses (i.e., braking, switching lanes). Our results suggest semantic object-based auditory-visual interactions, which rapidly increase the denoted target object’s salience.