Poster F115, Tuesday, March 28, 8:00 – 10:00 am, Pacific Concourse
Multi-sensory Connections: Matching Stimuli across Auditory and Visual Domains
Lauren Hendrickson1, Ferrinne Spector1; 1Edgewood College
Although adults do not usually see colors and shapes while hearing music, there are consistencies between individuals when asked to match stimuli across these sensory dimensions. Examining such consistencies may reveal clues into underlying perceptual processes, particularly when combined with the experiences of individuals with synesthesia who do experience extraneous concrete percepts in response to sensory stimuli. In a previous study (Callahan, Bertz & Spector, 2016), non-synesthetic and synesthetic adults created drawings in response to music clips. The purpose of the current study was to examine whether non-synesthetic adults match visualizations to the music for which each visualization was created. Across three experiments, non-synesthetic adults (n=40) listened to music clips and made a forced-choice between a congruent or incongruent visualization. The congruent visualizations were created by either a non-synesthete (Experiments 1 & 2) or an audio-visual synesthete (Experiment 3) in response to the target music clip. The incongruent visualizations were created in response to a different clip of music by either the same non-synesthete (Experiment 1), a different non-synesthete (Experiment 2), or a different audio-visual synesthete (Experiment 3). We randomized trial presentation within each experiment and counterbalanced experiment order across participants. Preliminary results suggest that non-synesthetic adults consistently match congruent visualizations to the target music clips, and that congruent matching is more likely when visualizations are created by different people. These results support the hypothesis that sensory information can be reliably matched across sensory domains, which may reflect inherent neural organization and provide insight into the processes underlying multisensory perception.
Topic Area: PERCEPTION & ACTION: Multisensory