Computer scientist turns his face into a remote control
June 25, 2008
A UC San Diego computer science Ph.D. student can turn his face into a remote control that speeds and slows video playback. The proof-of-concept demonstration is part of a larger project to use automated facial expression recognition to make robots more effective teachers. Credit: UC San Diego Jacobs School of Engineering
New work at nexus of facial expression recognition research and automated tutoring
A computer science Ph.D. student can turn his face into a remote control that speeds and slows video playback. The proof-of-concept demonstration is part of a larger project to use automated facial expression recognition to make robots more effective teachers.
Jacob Whitehill, a computer science Ph.D. student from UC San Diego's Jacobs School of Engineering, is leading this project. It builds on technology for detecting facial expressions being developed at UC San Diego's Machine Perception Laboratory (MPLab), part of the Institute for Neural Computation, and housed in the UCSD Division of Calit2.
In a recent pilot study, Whitehill and colleagues demonstrated that information within the facial expressions people make while watching recorded video lectures can be used to predict a person's preferred viewing speed of the video and how difficult a person perceives the lecture at each moment in time.
This new work is at the intersection of facial expression recognition research and automated tutoring systems.
"If I am a student dealing with a robot teacher and I am completely puzzled and yet the robot keeps presenting new material, that's not going to be very useful to me. If, instead, the robot stops and says, 'Oh, maybe you're confused,' and I say, 'Yes, thank you for stopping,' that's really good," said Whitehill, the computer science Ph.D. student leading the project.
In the pilot study, the facial movements people made when they perceived the lecture to be difficult varied widely from person to person. Most of the 8 test subjects, however, blinked less frequently during difficult parts of the lecture than during easier portions of the lecture, which is supported by findings in psychology.
One of the next steps for this project is to determine what facial movements one person naturally makes when they are exposed to difficult or easy lecture material. From here, Whitehill could then train a user specific model that predicts when a lecture should be sped up or slowed down based on the spontaneous facial expressions a person makes, explained Whitehill.
To collect examples of the kinds of facial expressions involved in teaching and learning, Whitehill taught a group of people in his lab about German grammar and recorded the sessions using video conferencing software.
"I wanted to see the kinds of cues that students and teachers use to try to modulate or enrich the instruction. To me, it's about understanding and optimizing interactions between students and teachers," said Whitehill.
"I can see you nodding right now, for instance," said Whitehill during the interview. "That suggests to me that you're understanding, that I can keep going with what I am saying. If you give me a puzzled look, I might back up for a second."
Watch Jacob Whitehill turn his face into a remote control in a three minute video at:
http://video-jsoe. … iego.wmv.asx
A one minute video Jacob Whitehill created to communicate his research results:
The work is being presented in June 2008 at two peer-reviewed academic conferences. On June 25, Whitehill presents his findings at the Intelligent Tutoring Systems conference. On Saturday, June 28, Marian Stewart Bartlett, a co-director of the Machine Perception Laboratory, will present this work at the 2008 IEEE International Workshop on Computer Vision and Pattern Recognition for Human Communicative Behavior Analysis.
Source: University of California - San Diego
-
Engineers build first sub-10-nm carbon nanotube transistor
Feb 01, 2012 |
5 / 5 (21) |
19
-
Something old, something new: Evolution and the structural divergence of duplicate genes
Jan 31, 2012 |
4.6 / 5 (7) |
1
-
The hidden nanoworld of ice crystals: Revealing the dynamic behavior of quasi-liquid layers
Jan 30, 2012 |
5 / 5 (2) |
1
-
Stock market network reveals investor clustering
Jan 27, 2012 |
4.1 / 5 (21) |
8
-
Of microchemistry and molecules: Electronic microfluidic device synthesizes biocompatible probes
Jan 26, 2012 |
not rated yet |
0
-
Tennis Court Speed Measurement
12 hours ago
-
Fastest way to cool water
20 hours ago
-
Counter-weights
Feb 02, 2012
-
Composite electric glass heating elements
Feb 02, 2012
-
pipe stress analysis
Feb 02, 2012
-
Interested in average household energy consumption in 2011...
Feb 01, 2012
- More from Physics Forums - General Engineering
More news stories
Hackers intercept FBI, Scotland Yard call (Update)
(AP) -- Trading jokes and swapping leads, investigators from the FBI and Scotland Yard spent the conference call strategizing about how to bring down the hacking collective known as Anonymous, responsible ...
13 hours ago |
5 / 5 (7) |
22
Japanese entrepreneurs aim for Silicon Valley
For an emerging generation of Japanese innovators, the dream isn't a job for life at a big company. They have new ambitions, and they're determined to go places. Especially Silicon Valley.
11 hours ago |
5 / 5 (1) |
1
A 'natural' solution for transportation
As the United States transitions away from a primarily petroleum-based transportation industry, a number of different alternative fuel sourcesethanol, biodiesel, electricity and hydrogenhave each ...
Technology / Energy & Green Tech
14 hours ago |
3 / 5 (2) |
13
Hackers deface website of lawyers for US Marine
Members of the hacker group Anonymous defaced the website on Friday of the law firm that defended a US Marine who faced charges in connection with the 2005 killing of 24 Iraqi civilians.
8 hours ago |
5 / 5 (2) |
2
TV executives crave viewers who watch 2 screens
Forget the small screen and the big screen. The hottest new thing in television is the "second screen" - the one on the tablet computer or cell phone that an increasing number of viewers keep an eye on while they're watching ...
7 hours ago |
1 / 5 (2) |
0
Amazon fungi found that eat polyurethane, even without oxygen
(PhysOrg.com) -- Until now polyurethane has been considered non-biodegradable, but a group of students from Yale University in the US has found fungi that will not only eat and digest it, they will do so even in the absence ...
Scientists chart high-precision map of Milky Way's magnetic fields
(PhysOrg.com) -- Scientists at the Naval Research Laboratory (NRL) are part of an international team that has pooled their radio observations into a database, producing the highest precision map to date of ...
Whole exome sequencing identifies cause of metabolic disease
Sequencing a patient's entire genome to discover the source of his or her disease is not routine yet. But geneticists are getting close.
Hearing metaphors activates brain regions involved in sensory experience
When a friend tells you she had a rough day, do you feel sandpaper under your fingers? The brain may be replaying sensory experiences to help understand common metaphors, new research suggests.
Renowned physicist invents microscope that can peer at living brain cells
(PhysOrg.com) -- Ever since scientists began studying the brain, theyve wanted to get a better look at what was going on. Researchers have poked and prodded and looked at dead cells under electron microscopes, ...
New kind of high-temperature photonic crystal could someday power everything from smartphones to spacecraft
A team of MIT researchers has developed a way of making a high-temperature version of a kind of materials called photonic crystals, using metals such as tungsten or tantalum. The new materials which ...
Jun 25, 2008
Rank: not rated yet
Jun 25, 2008
Rank: 5 / 5 (1)
This is a pretty big idea here.