New sequential decision making model could be key to artificial intelligence

November 8, 2006 feature

“Decision making,” Mikhail Rabinovich tells PhysOrg.com, “is everywhere, and not just with humans. Animals use it, and robots do. But the traditional approach to decision making is too simple.”

Rabinovich and his colleague at the Institute for Nonlinear Science at the University of California, San Diego, Ramon Huerta, along with Valentin Afraimovich at the Institute for the Investigation of Optical Communication at the University of San Luis Potosi in Mexico, present a new model for understanding decision making. Their paper, titled “Dynamics of Sequential Decision Making,” has been published on Physical Review Letters.

The idea behind sequential decision making is fairly simple: if an intelligence has to decide between two items, something will follow, based on the decision made. “In the traditional, simplistic model,” says Rabinovich, the decision maker has to answer a simple question — left or right for instance — choosing between two attractors.” This results in a simple “if-then” equation. However, when real decision making is in question, there is more than a simple “if-then” at work. “In reality,” he says, “it’s much more complex and interesting.”

Rabinovich explains that a sequential approach is needed: an approach that combines dynamic and probabilistic steps. And that, he says, is precisely what he, Huerta and Afraimovich are proposing. “This is a new class of model,” he says. “We have found a window to consciousness, and now we can generalize this into other cognitive functions.” He lists sequential attention, working memory and planning as other cognitive areas that could be benefited by this research into sequential decision making.

But it’s not just the knowledge of how we humans might do something that makes Rabinovich and his colleagues’ work so interesting. “This can be applied to the artificial brain,” Rabinovich insists. “If we are going to create an intelligent brain for a robot, we have to think of these independent elements.” Basically, a process is needed for modeling a robot brain that could work as a human or animal brain. This is a model for getting there: “We have to be able to answer these questions in a qualitative way.”

“If you are talking about an animal trying to flee from a predator, you have to look at the complex landscape. The prey has more than one decision to make. It has to decide which way to go not only at this moment, but at each moment for the length of its life. And there are other factors that influence the decision as well.” Rabinovich continues his illustration: “The same is with a robot that we put on another planet. It has to make a decision at many critical moments, not only about direction, but also about speed, whether or not to go, and other decisions at each decision making moment.”

The paper describes this new class of models using differential equations with finite possibilities, as well as suggesting rules for solving uncertainty. Rabinovich, Huerta and Afraimovich use an approach based on competition between cognitive states that are possible with the use of transient dynamics. Environmental decision making criterion are used to model how the sequential steps of the process are controlled. The paper finds that the length of life for the process depends on the number of choices, as well as the cognitive agents involved which both characterize the level of system intelligence.

Rabinovich clearly sees many benefits in further developing this work. “This is important,” he says. “Any kind of real life needs some kind of sequential decision making activity.”

By Miranda Marquit, Copyright 2006 PhysOrg.com

3.4 /5 (98 votes)  

Rank 3.4 /5 (98 votes)
Tags

Relevant PhysicsForums posts
  • Wind Turbine Power
    created2 hours ago
  • Steam Table issues
    created4 hours ago
  • electrostatic induction in a conductor should be immpossible
    created7 hours ago
  • Help! Physics Momentum/Impulse problem!
    created10 hours ago
  • Gauss' law cubes, how to prove
    created12 hours ago
  • what is significance of torque
    created13 hours ago
  • More from Physics Forums - General Physics

More news stories

SLAC, Stanford team focuses on high-energy electrons to treat cancer

Accelerator physicists at SLAC and cancer specialists from Stanford are working on a new technology that could dramatically reduce the time needed for cancer radiation treatments. The team ran an initial experiment ...

Physics / General Physics

created 1 hour ago | popularity not rated yet | comments 0

Measurements from high-energy collisions lead to better understanding of why meson particles disappear

For several years, physicists at the Relativistic Heavy Ion Collider (RHIC) at Brookhaven National Laboratory (BNL), USA, have studied an unusual state of matter called the quark–gluon plasma, which they ...

Physics / General Physics

created 2 hours ago | popularity not rated yet | comments 0

Quantum physicist explains $100K offer for proof scaled-up quantum computing is impossible

(PhysOrg.com) -- MIT researcher Scott Aaronson has certainly riled the physics community with his offer this past Friday, of $100,000 to anyone who can prove that scaled-up quantum computing is impossible. ...

Physics / Quantum Physics

created Feb 08, 2012 | popularity 4.1 / 5 (11) | comments 32 | with audio podcast weblog

Explained: Sigma

It's a question that arises with virtually every major new finding in science or medicine: What makes a result reliable enough to be taken seriously? The answer has to do with statistical significance -- but ...

Physics / General Physics

created Feb 09, 2012 | popularity 5 / 5 (13) | comments 26

Physicists 'record' magnetic breakthrough

An international team of scientists has demonstrated a revolutionary new way of magnetic recording which will allow information to be processed hundreds of times faster than by current hard drive technology.

Physics / General Physics

created Feb 07, 2012 | popularity 4.5 / 5 (39) | comments 14 | with audio podcast


Curry spice component may help slow prostate tumor growth

Curcumin, an active component of the Indian curry spice turmeric, may help slow down tumor growth in castration-resistant prostate cancer patients on androgen deprivation therapy (ADT), a study from researchers ...

Netflix light on flicks as viewers soak up TV shows

Like most fresh faces that arrive in Hollywood, Netflix wanted to be a movie star. But now it's learning what many in Tinseltown have known for decades: Movies are sexy, but the real money is in television.

To avoid early labor and delivery, weight and diet changes not the answer

One of the strongest known risk factors for spontaneous or unexpected preterm birth – any birth that occurs before the 37th week of pregnancy, most often without a known cause – is already having had one. For women ...

Arthritic knees, but not hips, have robust repair response

Researchers at Duke University Medical Center used new tools they developed to analyze knees and hips and discovered that osteoarthritic knee joints are in a constant state of repair, while hip joints are not.

Sony's Hirai refuses to abandon dire TV business

Struggling Japanese entertainment giant Sony will not abandon its cash-bleeding television business, its incoming CEO says, but he acknowledges tough decisions lie ahead including over redundancies.

The power of estrogen -- male snakes attract other males

A new study has shown that boosting the estrogen levels of male garter snakes causes them to secrete the same pheromones that females use to attract suitors, and turned the males into just about the sexiest ...