It's All Relative: UCSD's Einstein Robot Has 'Emotional Intelligence' (Video)

February 13, 2009 It's All Relative: UCSD's Einstein Robot Has 'Emotional Intelligence' (Video)

Enlarge

The research team chose Albert Einstein as the model for their emotionally intelligent robot "because he's an icon of creativity, intelligence and science; he's emotionally accessible; he's lovable and visually recognizable very easily around the world," says Hanson.

(PhysOrg.com) -- Albert Einstein may have written his last scientific theory more than half a century ago, but he's still honing his emotional intelligence in a laboratory at the University of California, San Diego.

Scientists at UC San Diego's California Institute for Telecommunications and Information Technology (Calit2) have equipped a robot modeled after the famed theoretical physicist with specialized software that allows it to interact with humans in a relatively natural, conversational way. The so-called "Einstein Robot," which was designed by Hanson Robotics of Dallas, Texas, recognizes a number of human facial expressions and can respond accordingly. Scientists consider it an unparalleled tool for understanding how both robots and humans perceive emotion, as well as a potential platform for teaching, entertainment, fine arts and even cognitive therapy.

FLV player

Watch Einstein in action.

"In the short-term, Einstein is being used to develop computer vision so we can see how computers perceive facial expressions and develop hardware to visually react," says Javier Movellan, a research scientist in the Calit2-based UCSD Machine Perception Laboratory (MPL). "This robot is a scientific instrument that we hope will tell us something about human-robot interaction, but also human-to-human interaction.

"When a robot interacts in a way we feel is human, we can't help but react. Developing a robot like this one teaches us how sensitive we are to biological movement and facial expressions, and when we get it right, it's really astonishing."

The Einstein Robot — a head-and-shoulders automaton complete with unruly white hair and bushy mustache — made its public debut at the Technology, Entertainment and Design (TED) conference in Long Beach last week. David Hanson, the robot's primary designer and owner of Hanson Robotics, amazed a crowd of 1,500 with Einstein's capacity to understand and mimic expressions. Several graduate students from the MPL accompanied Hanson to the conference, which was established to facilitate creative collaborations among scientists, entrepreneurs and designers.

Evoking realistic facial expressions in a machine made of wires and gears is no small feat, Hanson says. For Einstein to crack a smile, 17 of the robot's 31 motors must whir into action and subtly adjust multiple points of articulation around his mouth and piercing brown eyes. To express confusion, Einstein furrows his brow, but even that movement — which is second nature for most humans — is difficult to re-create in a robot. To achieve a realistic result, Hanson constructed Einstein's face from a patented, flesh-like material known as Frubber™, which he created after extensive research into facial anatomy, physiology, materials science and soft-bodied mechanical engineering. Hanson even went so far as to fashion the Frubber™ with realistic pores that measure in the macro-molecular scale at 4 to 40 nanometers — requiring him to take a crash course in nanotechnology.

"I know how the face needs to look when it deforms into a given expression, and I can see when an expression looks good," notes Hanson, a former Disney Imagineer. "But in addition to all these science and engineering studies, there's a certain magic of facial aesthetics that's beyond the scope of scientists. Artists understand it somehow, and are able to externalize facial movements and conversational interaction in external media like sculpture and film animation. However, this has not been successfully imported to robotics. Instead of sculpting it in marble, I have to get the Frubber™ material and the internal mechanisms to move into that expression on demand, and achieve that expression in the context of an interaction with a human."

The robot's internal facial recognition software is what provides that context. Developed by Movellan and a team of graduate students at Calit2, the software is based on a series of computational algorithms derived from an analysis of more than one million facial images. It allows Einstein to understand and respond to a number of "perceptual primitives," such as expressions of sadness, anger, fear, happiness and confusion, as well as facial cues suggesting age and gender (even whether the person interacting with the robot is wearing glasses). The robot's parallel facial action coding system can detect simple gestures like nods, and mimic those reactions.

Movellan, working with Jacobs School of Engineering computer science professor Yoav Freund, also succeeded in getting the robot to respond to audio cues such as clapping, which might prove helpful were Einstein to be used in an educational setting, for example. Movellan says he's hoping to have the robot's operational system fully integrated by June so that it can be deployed as a prototype robot teacher in a local high school, in much the same way that MPL's RUBI robot has been used to teach pre-schoolers.

Another important part of the robot's inner workings is its Character Engine Artificial Intelligence Control Software, which allows the programmer to author and define the persona of the character so it can hold a conversation.

"Einstein has pretty broad conversational abilities, although not like a human," Hanson notes. "In the demo mode, he might say something like, 'I'm an advanced perceptual robot bringing together many technologies into a whole that's greater than the sum of my parts, but here's what some of my parts can do. I can see your facial expressions and mimic them. I can see your age and gender. So why don't we demo some of these technologies?'"

During a demo, Einstein might turn his head, lock eyes with you, and then flash a dashing smile to mimic your own. But as loveable as the robot is, its developers have had to contend with a paradox familiar to all designers of humanoid robots: The more human-like the robot, the creepier it is to actual humans. And that's of crucial importance when one of the primary motivations behind the robot is to get humans to interact with it in a natural way.

"Some scientists believe strongly that very human-like robots are so inherently creepy that people can never get over it and interact with them normally," Hanson says, alluding to Japanese roboticist Masahiro Mori's "uncanny valley" theory. Mori speculated that when robots look and act like actual humans, it creates a response of revulsion among human observers. "But these are some of the questions we're trying to address with the Einstein robot," explains Hanson. "Does software engage people more when you have a robot that's more aware of you? Are human-like robots inherently creepy, and if so is that a barrier, or is it not a barrier?

"We're trying to get past the novelty of the technology to a certain extent so that people can socially engage with the robots and get lost in that social engagement," he continues. "And in a sense, we naturally do that with other humans. If I have a big piece of spinach in my teeth or I have something cosmetically atypical about me, it might be difficult to get past those superficial barriers so that we can have a more meaningful conversation."

"As people get more comfortable with them, these robots are becoming more popular," adds Movellan (think Johnny Depp as the "Captain Jack Sparrow" automaton at Disneyland's "Pirates of the Caribbean"). "Although we're thinking of Einstein as a tool for science right now, in the future, I could see it being used in museums or as a way to teach people from other cultures how to interact with one another. You could, in principle, program the robot to interact in a more Japanese way, or a more Middle Eastern way. We're also exploring the use of the robot for children with autism. It could be used as a way to teach them facial expression recognition."

But for now, manufacturing robots like Einstein remains cost-prohibitive.

"This isn't yet a real manufacturing business — these robots are still being built by engineers, so they're still very expensive," Hanson cautions. "Right now it costs $50,000 and up for a robot with very few degrees of freedom; something full-featured like Einstein will cost $75,000 and up. But our aspiration and our core discoveries are targeting mass production and trying to get the robots made for under $200."

All applications and cost factors aside, Hanson and Movellan say their ultimate goal is to develop a creative, intelligent machine that rivals or exceeds a human level of intelligence — and perhaps most importantly — does so without compromising civilization and humanity.

"This is something on the order of an Apollo project or a Manhattan project or a Linux initiative," Hanson explains. "It requires a lot of people at a lot of institutions cooperating and competing with each other to find the best way of creating a complete mind for a robot. If things go really well, we're maybe 10 years away from that happening. But it's very important that we develop empathic machines, machines that have compassion, machines that understand what you're feeling. If these robots do become as intelligent as human beings, we want this infrastructure of compassion and empathy to be in place so the machines are prepared to use their intellectual powers for the good of civilization rather than in ways that undermine the stability of civilization. In a way, we're planting the seeds for the survival of humanity."

Provided by UC San Diego


print this article email this article download pdf blog this article bookmark this article     Stumble it Digg this share on Facebook retweet share on Reddit add to delicious
Rate this story - 4.1 /5 (10 votes)

Rank Filter

Move the slider to adjust rank threshold, so that you can hide some of the comments.


Display comments: newest first

  • moj85 - Feb 13, 2009
    • Rank: not rated yet
    repeat post. about 3 times already.
  • WolfAtTheDoor - Feb 13, 2009
    • Rank: not rated yet
    I think it's funny that we have this fear of building a machine that will "take over the world". It's so absurd to think that we have that kind of power.

    What match is a machine to millions of years of evolution. I contend that humankind has dealt with far more formidable opponents than anything we could create in a lab.
  • x646d63 - Feb 14, 2009
    • Rank: 3.7 / 5 (3)
    Machines are the result of evolution. Think of it that way. They are more evolved than we are.
  • Noumenon - Feb 14, 2009
    • Rank: 5 / 5 (1)
    Robots like this are nothing but toys, neat, but I'm less impressed with it than I am with the internet and search engines. The internet to me is the best that AI can do, except dressed in a fancy search engine designed to fool someone rather than mimic thought as such. The turing test is misunderstood, its not about fooling someone off the street, its about someone TRYING to determine through questions wether its AI or human.

    There is no 'mind' where there is no consciousness.
  • No_name - Feb 14, 2009
    • Rank: not rated yet
    "I think it's funny that we have this fear of building a machine that will "take over the world". It's so absurd to think that we have that kind of power."
    -----------------------------------------------------
    WolfAtTheDoor - Feb 13, 2009WolfAtTheDoor - Feb 13, 2009
    ____________________________________________________
    What is even more amusing is people who say what is and is not possible with their incredibly limited knowledge of such things. To people like yourself, everything we have today would have been impossible to you if you lived even fifty years ago, I can guarantee that.

    If someone told you in 1900 that you would have a box in your home that would connect you to the world and would allow you to search for information on every subject imaginable and download movies you would have said the same thing you say now about robots, GUARANTEED.
    =====================================================

    "Machines are the result of evolution. Think of it that way. They are more evolved than we are."
    ---------------------------------------------------
    x646d63 - 22 hours ago
    _____________________________________________________

    No. Evolution does not include intelligent design, and robots are 100% intelligently designed. They are in no way a part of evolution, they are a creation of human beings.
  • Dhanne - Mar 18, 2009
    • Rank: not rated yet
    "Evolution does not include intelligent design, and robots are 100% intelligently designed."

    Well, machines are still a result of evolution, at least the result of evolution of design if you prefer that human-made things are not part of natural evolution.

    I'm not very concerned about that robots will someday surpass us hence biological humans will step aside and die out gradually to make space for their decendants. It's just natural continuum. Biological human is not a final top of evolution, it never was.

    That does not mean I would kill myself if an AI asks for it. No, I merely approve that the future belongs to technology-melded humans and intelligent robots because the paradigm shift will eventually happen in future anyway.

February 13, 2009 all stories

Comments: 6

4.1 /5 (10 votes)
  • Stumble this up

  • Digg this

  • share this

  • hide
  • Related Stories

  • Robots primed for 'are you being served' role in Arabic
    created Nov 03, 2009 | popularity not rated yet | comments 0
  • Inventor Demonstrates Humanoid Robot's Latest AI Abilities (w/ Video)
    created Aug 25, 2009 | popularity not rated yet | comments 0
  • New robots help humans cope with illness
    created Aug 02, 2009 | popularity not rated yet | comments 0
  • Robot Learns to Smile and Frown (w/ Video)
    created Jul 08, 2009 | popularity not rated yet | comments 0
  • Japan child robot mimicks infant learning
    created Apr 05, 2009 | popularity not rated yet | comments 0



  • hide
  • Relevant PhysicsForums posts

  • Relative pressure & specific volume
    created 6 hours ago
  • Making 4'x8' sign inkjet printer - need nozzles - help?
    created Nov 06, 2009
  • Calculating Velocity
    created Nov 06, 2009
  • shear stress distribution in triangular steel profile
    created Nov 06, 2009
  • Polygonal mirror reflection beam Problem
    created Nov 05, 2009
  • Help with a Basic design
    created Nov 05, 2009
  • More from Physics Forums - General Engineering

Other News

Samsung launches a new vacuuming robot

Samsung launches a new vacuuming robot

Electronics / Consumer & Gadgets

created Nov 06, 2009 | popularity 4.4 / 5 (7) | comments 8

(PhysOrg.com) -- Samsung Electronics has launched its latest autonomous robot vacuum cleaner, the Tango, which is capable of vacuuming hardwood floors, carpets, and even beds without human assistance.


new iphone

Touchscreen smartphones being snatched up in US

Electronics / Consumer & Gadgets

created Nov 03, 2009 | popularity 2.7 / 5 (3) | comments 3

US smartphone buyers can't wait to get their hands on touchscreen devices, according to figures released Tuesday by industry tracker comScore.


Robot fish could monitor water quality

Robot fish could monitor water quality

Electronics / Robotics

created Nov 02, 2009 | popularity not rated yet | comments 2

Nature inspires technology for an engineer and an ecologist teamed up at Michigan State University. They're developing robots that use advanced materials to swim like fish to probe underwater environments.


Review: Motorola's Droid is a serious smart phone (AP)

Review: Motorola's Droid is a serious smart phone

Electronics / Consumer & Gadgets

created Nov 04, 2009 | popularity 4.6 / 5 (5) | comments 0

(AP) -- Since its debut in 2007, millions of people have gravitated toward Apple's iPhone, wooed by its sleek hardware, simple user interface and abundance of applications.


UCI robot to aid brain research

UCI robot to aid brain research

Electronics / Robotics

created Nov 04, 2009 | popularity 5 / 5 (1) | comments 0

(PhysOrg.com) -- A robot powered by a computerized model of a rodent brain will help researchers from UC Irvine and UC San Diego understand how people recognize and adapt to change.