Predictive powers: a robot that reads your intention? (w/Video)

June 5, 2009 Predictive powers: a robot that reads your intention? (w/Video)

(PhysOrg.com) -- European researchers in robotics, psychology and cognitive sciences have developed a robot that can predict the intentions of its human partner. This ability to anticipate (or question) actions could make human-robot interactions more natural.

The walking, talking, thinking robots of are far removed from the automated machines of today. Even today's most are little more than slaves - programmed to do our bidding.

Many research groups are trying to build robots that could be less like workers and more like companions. But to play this role, they must be able to interact with people in natural ways, and play a pro-active part in joint tasks and decision-making. We need robots that can ask questions, discuss and explore possibilities, assess their companion's ideas and anticipate what their partners might do next.

The EU-funded JAST project brings a multidisciplinary team together to do just this. The project explores ways by which a can anticipate/predict the actions and intentions of a human partner as they work collaboratively on a task.

Who knows best?

You cannot make human-robot interaction more natural unless you understand what 'natural' actually means. But few studies have investigated the that are the basis of joint activity (i.e. where two people are working together to achieve a common goal).

A major element of the JAST project, therefore, was to conduct studies of human-human collaboration. These experiments and observations could feed into the development of more natural robotic behaviour.

The researchers participating in JAST are at the forefront of their discipline and have made some significant discoveries about the cognitive processes involved in joint action and decision-making. Most importantly, they scrutinised the ways in which observation plays an important part in joint activity.

FLV player

Scientists have already shown that a set of 'mirror neurons' are activated when people observe an activity. These neurons resonate as if they were mimicking the activity; the brain learns about an activity by effectively copying what is going on. In the JAST project, a similar resonance was discovered during joint tasks: people observe their partners and the brain copies their action to try and make sense of it.

In other words, the brain processes the observed actions (and errors, it turns out) as if it is doing them itself. The brain mirrors what the other person is doing either for motor-simulation purposes or to select the most adequate complementary action.

Resonant robotics

The JAST robotics partners have built a system that incorporates this capacity for observation and mirroring (resonance).

“In our experiments the is not observing to learn a task,” explains Wolfram Erlhagen from the University of Minho and one of the project consortium's research partners. “The JAST robots already know the task, but they observe behaviour, map it against the task, and quickly learn to anticipate [partner actions] or spot errors when the partner does not follow the correct or expected procedure.”

The robot was tested in a variety of settings. In one scenario, the robot was the 'teacher' - guiding and collaborating with human partners to build a complicated model toy. In another test, the robot and the human were on equal terms. “Our tests were to see whether the human and robot could coordinate their work,” Erlhagen continues. “Would the robot know what to do next without being told?”

By observing how its human partner grasped a tool or model part, for example, the robot was able to predict how its partner intended to use it. Clues like these helped the robot to anticipate what its partner might need next. “Anticipation permits fluid interaction,” says Erlhagen. “The robot does not have to see the outcome of the action before it is able to select the next item.”

The robots were also programmed to deal with suspected errors and seek clarification when their partners’ intentions were ambiguous. For example, if one piece could be used to build three different structures, the robot had to ask which object its partner had in mind.

From JAST to Jeeves

But how is the JAST system different to other experimental robots?

“Our robot has a neural architecture that mimics the resonance processing that our human studies showed take place during joint actions,” says Erlhagen. “The link between the human psychology, experimentation and the robotics is very close. Joint action has not been addressed by other robotics projects, which may have developed ways to predict motor movements, but not decisions or intentions. JAST deals with prediction at a much higher cognitive level.”

Before robots like this one can be let loose around humans, however, they will have to learn some manners. Humans know how to behave according to the context they are in. This is subtle and would be difficult for a robot to understand.

Nevertheless, by refining this ability to anticipate, it should be possible to produce robots that are proactive in what they do.

Not waiting to be asked, perhaps one day a robot may use the JAST approach to take initiative and ask: “Would you care for a cup of tea?”

More information: http://www.euprojects-jast.net/

Provided by ICT Results


print this article email this article download pdf blog this article bookmark this article     Stumble it Digg this share on Facebook retweet share on Reddit add to delicious
Rate this story - 4.7 /5 (10 votes)

Rank Filter

Move the slider to adjust rank threshold, so that you can hide some of the comments.


Display comments: newest first

  • Nan2 - Jun 05, 2009
    • Rank: not rated yet
    Hurry up! We have a rapidly aging population who will eventually require assistance with daily living activities. Creating a robot that can monitor health/medication compliance, help with meal preparation, seek help when necessary and perform basic household tasks that become out of reach for the aging, injured and ill would be a boon. The conundrum would be making it affordable for those in need vs a human paid companion or institutionalizing/warehousing aging, injured or even the post-operative patient without family to care for them outside of a hospital setting. Robots have the potential in providing a positive and profound difference for 'aging in place' which would allow a better quality of life and perhaps cost savings ultimately.

    This will become a pressing issue in the not too distant future which will strain resources (financial and otherwise) and the health infrastructures. Our ability to provide for the aging/seriously chronically ill is currently inadequate not only in the USA but elsewhere.

June 5, 2009 all stories

Comments: 1

4.7 /5 (10 votes)
  • Stumble this up

  • Digg this

  • share this

  • hide
  • Related Stories

  • Scientists study robot-human interactions
    created Aug 30, 2006 | popularity not rated yet | comments 0
  • Can you trust a robot to work safely with you in the kitchen?
    created May 14, 2008 | popularity not rated yet | comments 0
  • As robots learn to imitate
    created Dec 22, 2004 | popularity not rated yet | comments 0
  • New robot to adopt human thought processes
    created May 04, 2005 | popularity not rated yet | comments 0
  • Robots Detect Behavioral Cues to Follow Humans
    created Aug 21, 2008 | popularity not rated yet | comments 0



  • hide
  • Relevant PhysicsForums posts

  • System PDEs - Comsol
    created 6 hours ago
  • Making 4'x8' sign inkjet printer - need nozzles - help?
    created 21 hours ago
  • Calculating Velocity
    created Nov 06, 2009
  • shear stress distribution in triangular steel profile
    created Nov 06, 2009
  • Polygonal mirror reflection beam Problem
    created Nov 05, 2009
  • Help with a Basic design
    created Nov 05, 2009
  • More from Physics Forums - General Engineering

Other News

Samsung launches a new vacuuming robot

Samsung launches a new vacuuming robot

Electronics / Consumer & Gadgets

created Nov 06, 2009 | popularity 4.4 / 5 (7) | comments 7

(PhysOrg.com) -- Samsung Electronics has launched its latest autonomous robot vacuum cleaner, the Tango, which is capable of vacuuming hardwood floors, carpets, and even beds without human assistance.


new iphone

Touchscreen smartphones being snatched up in US

Electronics / Consumer & Gadgets

created Nov 03, 2009 | popularity 2.7 / 5 (3) | comments 3

US smartphone buyers can't wait to get their hands on touchscreen devices, according to figures released Tuesday by industry tracker comScore.


Robot fish could monitor water quality

Robot fish could monitor water quality

Electronics / Robotics

created Nov 02, 2009 | popularity not rated yet | comments 2

Nature inspires technology for an engineer and an ecologist teamed up at Michigan State University. They're developing robots that use advanced materials to swim like fish to probe underwater environments.


Review: Motorola's Droid is a serious smart phone (AP)

Review: Motorola's Droid is a serious smart phone

Electronics / Consumer & Gadgets

created Nov 04, 2009 | popularity 4.6 / 5 (5) | comments 0

(AP) -- Since its debut in 2007, millions of people have gravitated toward Apple's iPhone, wooed by its sleek hardware, simple user interface and abundance of applications.


UCI robot to aid brain research

UCI robot to aid brain research

Electronics / Robotics

created Nov 04, 2009 | popularity 5 / 5 (1) | comments 0

(PhysOrg.com) -- A robot powered by a computerized model of a rodent brain will help researchers from UC Irvine and UC San Diego understand how people recognize and adapt to change.