Biology knows best -- human-like vision lets robots navigate naturally

June 30, 2009

(PhysOrg.com) -- A robotic vision system that mimics key visual functions of the human brain promises to let robots manoeuvre quickly and safely through cluttered environments, and to help guide the visually impaired.

It’s something any toddler can do - cross a cluttered room to find a toy.

It's also one of those seemingly trivial skills that have proved to be extremely hard for computers to master. Analysing shifting and often-ambiguous visual data to detect objects and separate their movement from one’s own has turned out to be an intensely challenging problem.

Three years ago, researchers at the European-funded research consortium Decisions in Motion decided to look to nature for insights into this challenge.

In a rare collaboration, neuro- and cognitive scientists studied how the visual systems of advanced mammals, primates and people work, while computer scientists and roboticists incorporated their findings into neural networks and mobile robots.

The approach paid off. Decisions in Motion has already built and demonstrated a robot that can zip across a crowded room guided only by what it “sees” through its twin video cameras, and are hard at work on a head-mounted system to help visually impaired people get around.

“Until now, the algorithms that have been used are quite slow and their decisions are not reliable enough to be useful,” says project coordinator Mark Greenlee. “Our approach allowed us to build algorithms that can do this on the fly, that can make all these decisions within a few milliseconds using conventional hardware.”

How do we see movement?

The Decisions in Motion researchers used a wide variety of techniques to learn more about how the brain processes , especially information about movement.

These included recording individual neurons and groups of neurons firing in response to movement signals, to track the moment-by-moment interactions between different brain areas as people performed visual tasks, and neuropsychological studies of people with visual processing problems.

The researchers hoped to learn more about how the visual system scans the environment, detects objects, discerns movement, distinguishes between the independent movement of objects and the organism’s own movements, and plans and controls motion towards a goal.

One of their most interesting discoveries was that the primate brain does not just detect and track a moving object; it actually predicts where the object will go.

“When an object moves through a scene, you get a wave of activity as the brain anticipates its trajectory,” says Greenlee. “It’s like feedback signals flowing from the higher areas in the visual cortex back to neurons in the primary visual cortex to give them a sense of what’s coming.”

Greenlee compares what an individual visual neuron sees to looking at the world through a peephole. Researchers have known for a long time that high-level processing is needed to build a coherent picture out of a myriad of those tiny glimpses. What's new is the importance of strong anticipatory feedback for perceiving and processing motion.

“This proved to be quite critical for the Decisions in Motion project,” Greenlee says. “It solves what is called the ‘aperture problem’, the problem of the neurons in the primary visual cortex looking through those little peepholes.”

Building a better robotic brain

Armed with a better understanding of how the human brain deals with movement, the project’s computer scientists and roboticists went to work. Using off-the-shelf hardware, they built a neural network with three levels mimicking the brain’s primary, mid-level, and higher-level visual subsystems.

They used what they had learned about the flow of information between brain regions to control the flow of information within the robotic “brain”.

“It’s basically a neural network with certain biological characteristics,” says Greenlee. “The connectivity is dictated by the numbers we have from our physiological studies.”

The computerised brain controls the behaviour of a wheeled robotic platform supporting a moveable head and eyes, in real time. It directs the head and eyes where to look, tracks its own movement, identifies objects, determines if they are moving independently, and directs the platform to speed up, slow down and turn left or right.

Greenlee and his colleagues were intrigued when the found its way to its first target - a teddy bear - just like a person would, speeding by objects that were at a safe distance, but passing nearby obstacles at a slower pace.

”That was very exciting,” Greenlee says. “We didn’t program it in - it popped out of the algorithm.”

In addition to improved guidance systems for robots, the consortium envisions a lightweight system that could be worn like eyeglasses by visually or cognitively impaired people to boost their mobility. One of the consortium partners, Cambridge Research Systems, is developing a commercial version of this, called VisGuide.

More information: http://www.decisio … nmotion.org/

Provided by ICT Results

4.5 /5 (4 votes)  

Rank 4.5 /5 (4 votes)
Related Stories
Relevant PhysicsForums posts
  • Calling function with no input argument
    created3 hours ago
  • Force free body diagram problem on gym equipment
    created4 hours ago
  • Empirical data regarding shower heads and water
    created12 hours ago
  • feed hold button on CNC lathe
    createdFeb 09, 2012
  • RFAC in Fortran
    createdFeb 09, 2012
  • dynamics 2/32
    createdFeb 08, 2012
  • More from Physics Forums - General Engineering

More news stories

Japan scientist makes 'Avatar' robot

A Japanese-developed robot that mimics the movements of its human controller is bringing the Hollywood blockbuster "Avatar" one step closer to reality.

Electronics / Robotics

created 9 hours ago | popularity 5 / 5 (5) | comments 4

Google to make home entertainment system: report

Google will mirror Apple's winning hardware-software formula with an Android-powered entertainment system that wirelessly streams content through homes, the Wall Street Journal reported on Thursday.

Electronics / Consumer & Gadgets

created 21 hours ago | popularity 4.5 / 5 (2) | comments 0

Barriers fall between TV, Internet

You say TV, I say Internet. Toe-mate-o, toe-mah-to.

Electronics / Consumer & Gadgets

created 23 hours ago | popularity not rated yet | comments 0

Intel packs performance and reliability into its latest SSD 520 series

Intel Corporation announced today its fastest, most robust client/consumer solid-state drive (SSD) to date, the Intel Solid-State Drive 520 Series (Intel SSD 520), a 6 gigabit-per-second (gbps) SATA III SSD ...

Electronics / Hardware

created Feb 07, 2012 | popularity 5 / 5 (1) | comments 4

Google rumored to have built Heads-Up-Display glasses prototype

(PhysOrg.com) -- 9to5Google is reporting that they have received a tip from someone they believe to be a reliable source saying that Google is working on a Heads-Up-Display (HUD) pair of eye-glasses. The per ...

Electronics / Consumer & Gadgets

created Feb 08, 2012 | popularity 4.3 / 5 (8) | comments 2 | with audio podcast weblog


Putting the squeeze on planets outside our solar system

(PhysOrg.com) -- Using high-powered lasers, scientists at Lawrence Livermore National Laboratory and collaborators discovered that molten magnesium silicate undergoes a phase change in the liquid state, abruptly ...

Employers feel no love for unscrupulous practice of 'service sweethearting'

A new study led by two Florida State University marketing professors finds that some frontline service employees who are rewarded for hikes in customer loyalty and satisfaction also may engage in "service ...

US issues guidelines to avoid heparin contamination

Four years after US drug-maker Baxter International's blood thinner heparin was contaminated in China, causing dozens of deaths, US regulators on Friday issued draft guidelines for safe production.

Expat French get Internet vote for first time

French citizens will for the first time this year be able to vote in a parliamentary election over the Internet, an experiment that could be extended to other elections if successful.

"Twisted Metal" gamers get shot at real gunplay

Fans of "Twisted Metal" will get to welcome a long-awaited sequel of the car-battle videogame with a real-world bang by blasting an ice cream truck to bits with a machine gun.

The power of estrogen -- male snakes attract other males

A new study has shown that boosting the estrogen levels of male garter snakes causes them to secrete the same pheromones that females use to attract suitors, and turned the males into just about the sexiest ...