Want responsible robotics? Start with responsible humans

July 29, 2009 by Pam Frost Gorder

(PhysOrg.com) -- When the legendary science fiction writer Isaac Asimov penned the "Three Laws of Responsible Robotics," he forever changed the way humans think about artificial intelligence, and inspired generations of engineers to take up robotics.

In the current issue of journal IEEE Intelligent Systems, two engineers propose alternative laws to rewrite our future with robots.

The future they foresee is at once safer, and more realistic.

"When you think about it, our cultural view of robots has always been anti-people, pro-robot," explained David Woods, professor of integrated systems engineering at Ohio State University. "The philosophy has been, 'sure, people make mistakes, but robots will be better -- a perfect version of ourselves.' We wanted to write three new laws to get people thinking about the human-robot relationship in more realistic, grounded ways."

Asimov's laws are iconic not only among engineers and enthusiasts, but the general public as well. The laws often serve as a starting point for discussions about the relationship between humans and robots.

But while evidence suggests that Asimov thought long and hard about his laws when he wrote them, Woods believes that the author did not intend for engineers to create robots that followed those laws to the letter.

"Go back to the original context of the stories," Woods said, referring to Asimov's I, among others. "He's using the three laws as a literary device. The plot is driven by the gaps in the laws -- the situations in which the laws break down. For those laws to be meaningful, robots have to possess a degree of social intelligence and moral intelligence, and Asimov examines what would happen when that intelligence isn't there."

"His stories are so compelling because they focus on the gap between our aspirations about robots and our actual capabilities. And that's the irony, isn't it? When we envision our future with robots, we focus on our hopes and desires and aspirations about robots -- not reality."

In reality, engineers are still struggling to give robots basic vision and language skills. These efforts are hindered in part by our lack of understanding of how these skills are managed in the human brain. We are far from a time when humans may teach robots a moral code and responsibility.

Woods and his coauthor, Robin Murphy of Texas A&M University, composed three laws that put the responsibility back on humans.

Woods directs the Cognitive Systems Engineering Laboratory at Ohio State, and is an expert in automation safety. Murphy is the Raytheon Professor of Computer Science and Engineering at Texas A&M, and is an expert in both rescue robotics and human-robot interaction.

Together, they composed three laws that focus on the human organizations that develop and deploy robots. They looked for ways to ensure high safety standards.

Here are Asimov's original three laws:

  • A robot may not injure a human being, or through inaction, allow a human being to come to harm.
  • A robot must obey orders given to it by human beings, except where such orders would conflict with the First Law.
  • A robot must protect its own existence as long as such protection does not conflict with the First or Second Law.
And here are the three new laws that Woods and Murphy propose:
  • A human may not deploy a robot without the human-robot work system meeting the highest legal and professional standards of safety and ethics.
  • A robot must respond to humans as appropriate for their roles.
  • A robot must be endowed with sufficient situated autonomy to protect its own existence as long as such protection provides smooth transfer of control which does not conflict with the First and Second Laws.
The new first law assumes the reality that humans deploy robots. The second assumes that robots will have limited ability to understand human orders, and so they will be designed to respond to an appropriate set of orders from a limited number of humans.

The last law is the most complex, Woods said.

"Robots exist in an open world where you can't predict everything that's going to happen. The robot has to have some autonomy in order to act and react in a real situation. It needs to make decisions to protect itself, but it also needs to transfer control to humans when appropriate. You don't want a robot to drive off a ledge, for instance -- unless a human needs the robot to drive off the ledge. When those situations happen, you need to have smooth transfer of control from the robot to the appropriate human," Woods said.

"The bottom line is, robots need to be responsive and resilient. They have to be able to protect themselves and also smoothly transfer control to humans when necessary."

Woods admits that one thing is missing from the new laws: the romance of Asimov's fiction -- the idea of a perfect, moral that sets engineers' hearts fluttering.

"Our laws are little more realistic, and therefore a little more boring," he laughed.

More information:

http://doi.ieeecom … /MIS.2009.69
http://en.wikipedi … _of_Robotics

Source: The Ohio State University (news : web)

3.5 /5 (8 votes)  

Filter


Move the slider to adjust rank threshold, so that you can hide some of the comments.


Display comments: newest first

docknowledge
Jul 29, 2009

Rank: 4 / 5 (3)
Having worked in Artificial Intelligence for many years, I can say flatly that Asimov's laws aren't the place to start almost any scholarly discussion. They are a crock, and so obviously flawed that Asimov was immediately able to write stories about how unworkable they are.

The fact that the public thinks they are somehow important is ... evidence of why some issues should never be put to a popular vote.

Woods and Murphy haven't improved the laws at all. Have they ever talked with a lawyer? What "high legal standards" are lawyers supposed to embody? Oh, the sneaky, self-serving, combative, expensive ones.

The rest of Woods and Murphy is equally naive and unworkable. I am so thankful I didn't have to go to Ohio State.
Izzmo
Jul 29, 2009

Rank: not rated yet
Having worked in Artificial Intelligence for many years, I can say flatly that Asimov's laws aren't the place to start almost any scholarly discussion. They are a crock, and so obviously flawed that Asimov was immediately able to write stories about how unworkable they are.



The fact that the public thinks they are somehow important is ... evidence of why some issues should never be put to a popular vote.



Woods and Murphy haven't improved the laws at all. Have they ever talked with a lawyer? What "high legal standards" are lawyers supposed to embody? Oh, the sneaky, self-serving, combative, expensive ones.



The rest of Woods and Murphy is equally naive and unworkable. I am so thankful I didn't have to go to Ohio State.

You didn't say anything in your little speech as to why they will and cannot work... so why?
just_doug
Jul 29, 2009

Rank: 5 / 5 (2)
Do those guys get significant military funding? The despots define legal and professional standards and also decide what your role is and therefore if any robot should pay any attention to what you had to say. Cannon fodder, serf or tax revenue producer aren't likely to be listened to, and those are the main roles in modern society.
docknowledge
Jul 30, 2009

Rank: 1 / 5 (1)
Little speech? I thought it was a great speech.

Heh, kidding. It's just an issue I've been regularly confronted with for years. So I've had a chance to think it through.

There are problems with the three laws...coming from several different angles. Let's go for something that's pretty to the point...

Assume I am a terrorist. I live in Iran or N. Korea. I don't want a robot that follows the first law. I want a robot that kills as many people as possible before it is taken down. The more Americans that die, the better.

No "first law".
RayCherry
Jul 30, 2009

Rank: 5 / 5 (1)
Obviously Robots will not require Political Correctness either. You live in a place where the laws apply only if you get caught and cannot afford an effective judicial defence. What consequences will Robots face when they (also) conveniently forget the laws?
wiyosaya
Jul 30, 2009

Rank: 5 / 5 (1)
I have to agree that these laws are a crock, and Asimov's laws were a literary gimmick, far from anything that will be realistically possible for years to come.

The third law that these "professionals" state is an extreme example of the "crockedness" of these laws. To me, it implies an extreme of artificial intelligence that real technology, i.e., technology that is in everyday use, is nowhere near achieving.

So, the robot makes a decision about protecting its own existence. Just what does this mean? If you tell the robot to power down and turn off, does the robot refuse because turning off would endanger its existence?

Technology is nowhere near the level of artificial intelligence required for a robot to be able to make such decisions. Such decisions are currently made by the program that the robot's computer is executing. I am willing to bet that even with the world's most advanced robots, i.e., those that possess the highest levels of artificial intelligence, that it would be an extraordinary effort to even get them to recognize situations where their existence would be in danger, sensory input aside. Given the right sensory input, a robot could be programmed to stop if it senses that there is a cliff in front of it. In that case, though, the robot itself does not make the decision, nor does it need "artificial intelligence" to make the decision. It is the programmer that made the decision for the robot. To have this done by A.I., though, sounds like an immense challenge, and it certainly seems like there are things on which the time would be better spent.
COCO
Jul 31, 2009

Rank: 5 / 5 (1)
did no one see Terminator!! Rules are for girlie boys - soon Amerika will be able to replace its regular armed goons with robots who kill based on skin colour - productivity improvememt for sure - what are we going to do with those red-neck psychos then?
ketanco
Jul 31, 2009

Rank: not rated yet
These "laws" mean nothing, when there is no AI that "understands" them... These laws are only for us to understand - at least until we have a human level AI.
docknowledge
Aug 01, 2009

Rank: not rated yet
ketanco, good thinking, except the laws themselves don't make sense -- there's nothing to "understand". They are inherently contradictory.

Having worked with NASA, and being a science-fiction fan, I was rather surprised bumping into major sci-fi authors a couple times. Two of them couldn't have cared less that I had technical information related to their work. (Shrug of the shoulders, "It's fiction.") One who I did not meet, Arthur C. Clarke, was a keen fan of a project I was associated with. Although Clarke had the intelligence and interest to understand the project (which superficially was not very technical), all I ever saw him do was parrot the official project documentation put out by the project marketing. (Material which I came to realize was quite misleading.)

The moral of the story is: the three laws are fiction.
docknowledge
Aug 04, 2009

Rank: not rated yet
This quote came from a BBC article today:

"The problem is that this is all based on artificial intelligence, and the military have a strange view of artificial intelligence based on science fiction."

http://news.bbc.c...2003.stm
Rank 3.5 /5 (8 votes)
Related Stories
Relevant PhysicsForums posts
  • Calling function with no input argument
    created14 hours ago
  • Force free body diagram problem on gym equipment
    created15 hours ago
  • Empirical data regarding shower heads and water
    created22 hours ago
  • feed hold button on CNC lathe
    createdFeb 09, 2012
  • RFAC in Fortran
    createdFeb 09, 2012
  • dynamics 2/32
    createdFeb 08, 2012
  • More from Physics Forums - General Engineering

More news stories

Google users warned of threat to smartphone wallets

Users of Google smartphone wallets were being warned on Friday that there is a way to crack pass codes intended to thwart thieves from going on illicit shopping sprees.

Technology / Internet

created 6 hours ago | popularity 5 / 5 (2) | comments 0

Anonymous knocks CIA website offline (Update)

The website of the Central Intelligence Agency was inaccessible on Friday after the hacker group Anonymous claimed to have knocked it offline.

Technology / Internet

created 8 hours ago | popularity 5 / 5 (8) | comments 13

New error-correcting codes guarantee the fastest possible rate of data transmission

Error-correcting codes are one of the triumphs of the digital age. They’re a way of encoding information so that it can be transmitted across a communication channel — such as an optical fiber o ...

Technology / Computer Sciences

created 16 hours ago | popularity 4.9 / 5 (8) | comments 6 | with audio podcast

New power source discovered

(PhysOrg.com) -- Researchers at the Massachusetts Institute of Technology (MIT) and RMIT University have made a breakthrough in energy storage and power generation.

Technology / Energy & Green Tech

created 15 hours ago | popularity 4.8 / 5 (25) | comments 8 | with audio podcast

Small modular reactor design could be a 'SUPERSTAR'

(PhysOrg.com) -- Though most of today's nuclear reactors are cooled by water, we've long known that there are alternatives; in fact, the world's first nuclear-powered electricity in 1951 came from a reactor ...

Technology / Energy & Green Tech

created 16 hours ago | popularity 4.3 / 5 (12) | comments 22 | with audio podcast


Humans may have helped the decline of African rainforests 3000 years ago

(PhysOrg.com) -- Large areas of rainforests in Central Africa mysteriously disappeared over three thousand years ago, to be replaced by savannas. The prevailing theory has been that the cause was a change ...

Complex wiring of the nervous system may rely on a just a handful of genes and proteins

Researchers at the Salk Institute have discovered a startling feature of early brain development that helps to explain how complex neuron wiring patterns are programmed using just a handful of critical genes. ...

The power of estrogen -- male snakes attract other males

A new study has shown that boosting the estrogen levels of male garter snakes causes them to secrete the same pheromones that females use to attract suitors, and turned the males into just about the sexiest ...

Putting the squeeze on planets outside our solar system

(PhysOrg.com) -- Using high-powered lasers, scientists at Lawrence Livermore National Laboratory and collaborators discovered that molten magnesium silicate undergoes a phase change in the liquid state, abruptly ...

Could Venus be shifting gear?

(PhysOrg.com) -- ESA’s Venus Express spacecraft has discovered that our cloud-covered neighbour spins a little slower than previously measured. Peering through the dense atmosphere in the infrared, the ...

Fool's gold may prove an unlikely alternative to overexploited catalytic materials

Catalytic materials, which lower the energy barriers for chemical reactions, are used in everything from the commercial production of chemicals to catalytic converters in car engines. However, with current catalytic materials ...