Robots Detect Behavioral Cues to Follow Humans

August 21, 2008 by Lisa Zyga Robots Detect Behavioral Cues to Follow Humans

A follower robot follows a leader robot (with UC Davis logo). Using behavioral cues, the follower can make its mission more reliable and accurate. Image credit: Chueh, et al. ©2008 IEEE.

Robots can be ironic. Even though they might not have emotions of their own, they can still detect and respond to humans’ emotions. A recent study has shown that, by picking up on human emotional traits, as well as a variety of other conscious and unconscious behavioral cues, robots may be able to act more naturally and accurately with humans.

The researchers, from the University of California, Davis, have developed a system that allows follower robots to use behavioral cues from human leaders and other robots in order to track and follow them. The ability to follow will likely be essential as robots continue to work alongside people more and more, such as in office buildings, hospitals, and airports.

“As humans, we constantly incorporate other peoples' current actions as clues (cues) as to what they may do in the future,” Sanjay Joshi of the University of California, Davis, told PhysOrg.com. “For instance, we have a ‘sixth sense’ on the highway to know that a certain car will swerve into our lane soon, based on the driver's current driving patterns. Then, we may become more defensive in our own driving. In our work, we wanted to begin the process of allowing robots to use behavioral cues (of humans or other robots), to make the robot's mission more reliable and accurate. In social work environments populated by numerous people and robots, these types of cues should be abundant.”

In their robot-following system, the researchers integrated information provided by behavioral cues to improve the performance of robot followers along with other tracking methods, such as cameras. The system continuously estimates the future predicted position of the leader as it moves, and then directs the follower robot to the predicted position.

The researchers’ aim was to reduce the amount of instructions or technical expertise required from human leaders to robots. As the authors noted, robots may be accepted if they are helpful, but can easily be rejected if they are difficult to work with.

The researchers explained that behavioral cues that robots might use could include any action or signal that the leader exhibits that hints at a future action. These might be intended behaviors, such as pointing or waving. Other cues might be unconscious, such as behaviors that indicate stress or sadness, since they may indicate generally quick or slow movement patterns. Also, studies on human walking have shown that people unconsciously turn their head up to 25 degrees about 200 milliseconds before turning.

In experiments, the researchers tested how well a follower robot (Evolution Robotics’ Scorpion) could follow a leader robot (another Scorpion) as it zig-zagged and turned a corner of a hallway. Turning was the more difficult action to follow, since the leader robot escaped the sight of the follower robot. Without using behavioral cues, the follower robot would initiate a searching algorithm by turning and looking around. If the leader wasn’t too far away, the follower could detect it and continue following; otherwise, it would be lost and stop moving.

The addition of the behavioral-cue controller significantly helped the follower robot to keep track of the leader. By detecting the leader’s subtle behaviors, the follower could anticipate when the leader was about to turn and predict its future path. Even though it lost sight of the leader, it kept close enough to its path so that it could find the leader again after the “blind” turn.

Overall, the behavioral-cue model had advantages in cases where the leader robot made drastic turns that would otherwise leave the follower robot lost. But since other controllers also had advantages, the researchers suggest that a supervisory control system that coordinates multiple controllers could be useful. They also anticipate that a wide range of behavioral cues should lead to highly successful robot followers.

“In the future, we hope to explore relevant behavioral cues for other robot tasks in human-robot work environments, and work on the robotics and computer science tools needed to make effective use of those cues,” Joshi said.

More information: Chueh, Michael; Au Yeung, Yi Lin William; Lei, Kim-Pang Calvin; and Joshi, Sanjay S. “Following Controller for Autonomous Mobile Robots Using Behavioral Cues.” IEEE Transactions on Industrial Electronics, Vol. 55, No. 8, August 2008.

Copyright 2008 PhysOrg.com.
All rights reserved. This material may not be published, broadcast, rewritten or redistributed in whole or part without the express written permission of PhysOrg.com.


print this article email this article download pdf blog this article bookmark this article     Stumble it Digg this share on Facebook retweet share on Reddit add to delicious
Rate this story - 4 /5 (25 votes)

Rank Filter

Move the slider to adjust rank threshold, so that you can hide some of the comments.


Display comments: newest first

  • smiffy - Aug 22, 2008
    • Rank: 2 / 5 (1)
    Why not have the leader robot simply indicate which way it's going to turn? As even people in cars do.
  • NOM - Aug 28, 2008
    • Rank: 4 / 5 (1)
    Why not have the leader robot simply indicate which way it's going to turn? As even people in cars do.
    That would help with robot to robot communication, but the article is discussing combinations of humans and robots.
  • wrapper - Sep 04, 2008
    • Rank: not rated yet
    Why not have the leader robot simply indicate which way it's going to turn? As even people in cars do.

    This is about learning not receiving directions, the driver anticipates anothers movement, without signaling. And Behavioral Cues concept is outstanding.
  • smiffy - Sep 19, 2008
    • Rank: not rated yet
    Anthropization of robots is for toymakers.

August 21, 2008 all stories

Comments: 4

4 /5 (25 votes)
  • Stumble this up

  • Digg this

  • share this

  • hide
  • Related Stories

  • This smart wheelchair has laser vision
    created Nov 10, 2009 | popularity not rated yet | comments 0
  • AIDA Robot Aims To Change The Way We Interact With Our Car (w/ Video)
    created Nov 01, 2009 | popularity not rated yet | comments 0
  • Robot's gentle touch aids delicate cancer surgery
    created Aug 21, 2009 | popularity not rated yet | comments 0
  • Beyond Apollo: Moon Tech Takes a Giant Leap
    created Apr 09, 2009 | popularity not rated yet | comments 0
  • Robots that monitor emotions of ASD children
    created Feb 17, 2009 | popularity not rated yet | comments 0



  • hide
  • Relevant PhysicsForums posts

  • Trying to adapt a fuel gage circuit
    created 8 hours ago
  • Pushing the piston.
    created 13 hours ago
  • Do Camcorders/ Video camera have Sensors in them?
    created 18 hours ago
  • Aspiring Engineering major looking for general answers
    created Nov 19, 2009
  • Calculating max load of square tube (steel)
    created Nov 19, 2009
  • Passive Chemical Heating
    created Nov 19, 2009
  • More from Physics Forums - General Engineering

Other News

Robotic clam digs in mudflats

Electronics / Robotics

created 15 hours ago | popularity 5 / 5 (3) | comments 0

To design a lightweight anchor that can dig itself in to hold small underwater submersibles, Anette (Peko) Hosoi of MIT borrowed techniques from one of nature's best diggers -- the razor clam.


'Rationalizer' bracelet tells traders when they're stressed

'Rationalizer' bracelet tells traders when they're stressed

Electronics / Consumer & Gadgets

created Nov 17, 2009 | popularity 4.3 / 5 (6) | comments 4

(PhysOrg.com) -- Philips Electronics and the Dutch bank ABN AMRO have joined forces to develop a "Rationalizer" bracelet system that detects stress levels and displays a warning to help day-traders avoid making ...


Qualcomm's next e-book to use a mirasol display

Qualcomm's next e-book to use a mirasol display

Electronics / Consumer & Gadgets

created Nov 20, 2009 | popularity 4.7 / 5 (11) | comments 2

(PhysOrg.com) -- Qualcomm subsidiary Mirasol is developing a new e-book reader with a color display that uses ambient light. The reader will be capable of displaying video smoothly, but the new features will ...


Oak Ridge 'Jaguar' supercomputer is World's fastest

Oak Ridge 'Jaguar' supercomputer is World's fastest

Electronics / Hardware

created Nov 16, 2009 | popularity 4.5 / 5 (13) | comments 2

An upgrade to a Cray XT5 high-performance computing system deployed by the Department of Energy has made the "Jaguar" supercomputer the world's fastest. Located at Oak Ridge National Laboratory, Jaguar is ...


South Koreans to get Apple's iPhone this week (AP)

South Koreans to get Apple's iPhone this week

Electronics / Consumer & Gadgets

created Nov 22, 2009 | popularity not rated yet | comments 0

(AP) -- Apple Inc's iPhone is coming to South Korea this week, a local carrier announced Sunday, bringing the iconic communications device to one of the world's most sophisticated mobile phone markets.