Lip-read me now, hear me better later

Rosenblum’s paper, “Lip-Read Me Now, Hear Me Better Later: Crossmodal Transfer of Talker Familiarity Effects,” will appear in the May issue of the journal Psychological Science, published by the Association for Psychological Science.

Sixty college undergraduates were asked to lip-read sentences from a silent videotape of a talker's face. These subjects all had normal hearing and vision and had no formal lip reading experience.

After an hour of lip reading, the students were asked to listen to sentences heard against a background of noise and to identify as many words as they could. Half of the students heard sentences from the same talker they had just lip-read, while the other half heard sentences by a new talker. The undergraduates who lip-read and heard speech from the same talker were better at identifying the noisy sentences than those who lip-read from one talker and heard speech from another.

These findings suggest that when we watch a person speak, we become familiar with characteristics of their speaking style which also are present in the sound of their speech. This allows talker familiarity to be transferred from lip reading to listening, thereby making a talker easier to hear. These results have implications for individuals with hearing impairments as well as for brain lesion patients, Rosenblum said.

Source: Association for Psychological Science