When the Tongue Slips, the Eyes Have It

“People typically look at objects before naming them, it’s part of the way they plan the words they are going to say, said Zenzi Griffin, assistant professor of psychology at Georgia Tech. “So, if people are rushing or being inattentive you might expect if they made an error that they spent less time looking at the object. But I found almost no difference in the amount of time people spent looking at an object when they made an error compared to when they didn’t. In fact, people who made an error spent slightly more time looking at the object.”

In the study, Griffin asked participants to name two or three line-drawn objects or describe the action in a scene, while she tracked their eye movements using video cameras outfitted with special software. She identified 41 full or partial speech errors uttered by 33 participants during eye-tracking experiments.

The results, said Griffin, show that at some level people know what they meant to say and that looking at the object doesn’t help to ensure that they will name it correctly. They also suggest that when a person makes a speech error, knowing what they are looking at may be more informative of their intentions than the words they say.

That may be useful to designers of speech recognition software, said Griffin. “Gaze can potentially provide clues to what uncertain words are - at least when people are talking about things in their immediate environment, like in a cockpit or an automobile,” she said. “Gaze can also help to disambiguate which object you are referring to, so if you say ‘Open the door,’ the software could know to which door you are referring.”

Source: Georgia Institute of Technology