Hybrid Human Faces Could Populate Google Street View

July 30th, 2008 by Lisa Zyga Face swapping

From left to right: the original photo, a photo selected for swapping certain features, and the resulting hybrid.

Due to privacy concerns, Google has been blurring the faces of people caught on Google Street View cameras. But rather than blurring people's faces and diminishing the reality of the scene, researchers have demonstrated a new way to automatically depersonalize the faces - by creating hybrids.

The new face-swapping technology, developed by Neeraj Kumar and colleagues at Columbia University in New York, finds faces in a photograph and swaps their features with those from a library of faces, such as picture-sharing sites like Flickr.com. Their software then automatically chooses one or more suitable faces for swapping the eyes, nose, and mouth out of the original image, resulting in a facial composite.

As a final step, to weed out inferior replacements, the system ranks the resulting images according to how well the hybrid face fits the surrounding region in the original photograph, and chooses the highest ranked replacement for insertion.

Unlike other programs, the new technique is fully automatic, and generates plausible results across a variety of lighting conditions, viewpoints, and skin tones. The researchers performed a case study in which they asked participants to identify real and fake faces from a set. They found that people are almost equally likely to classify real facial images and the hybrid facial images as being real. Of 12 people tested, 58% of the hybrid face images were misidentified as real, and 75% of real images were correctly marked real.

Besides de-identifying faces, the same technology could be used by photographers for creating an optimal group photograph from several similar shots. As the researchers explain, the "burst" mode found on most cameras can take several images at once. Then, an automatic face replacement technique could be applied to swap blinking or frowning faces with better faces taken from the other images. The result would be a single composite image with all the best faces.

More information on the researchers´ face-swapping technique can be found at tinyurl.com/6ehog5.

via: New Scientist


print this article email this article download pdf blog this article bookmark this article     Digg this Stumble it share on Facebook share on Reddit add to delicious save to Yahoo! bookmarks
4.1/5 after 16 votes

Rank Filter

Move the slider to adjust rank threshold, so that you can hide some of the comments.


Display comments: newest first

  • x646d63 - Jul 30, 2008
    • Rank: not rated yet
    Does this mean I can slightly alter Tiger Woods' appearance and use that "hybrid" to advertise my new golf software?

    That would be much cheaper than having to pay Tiger.

    Some interesting legal battles on the horizon.
  • SmartK8 - Jul 30, 2008
    • Rank: not rated yet
    Well.. now they just have to ensure that those hybrid pictures won't look like anyone in existance.
  • DoctorKnowledge - Jul 30, 2008
    • Rank: 1 / 5 (1)
    Right. A picture 75 feet outside of my place clearly shows my neighbor, taking her usual constitutional. Her clothes, her gait, her posture. Changing her face will conceal her identity? Nope.

    This is a corporate ploy to reduce the amount of impact to themselves.
  • GaryB - Jul 30, 2008
    • Rank: not rated yet
    This scheme won't work because of what they are not looking at. The Google face detector seems to have many false positives all over the scene, slightly blurring car tires, bricks in a wall etc. Now this scheme will put phantom faces there.
    Actually, that might look pretty cool as face like textures take on faces.
  • brant - Jul 30, 2008
    • Rank: not rated yet
    The babe with the mustache and earrings is a hotty..
  • KB6 - Jul 31, 2008
    • Rank: not rated yet
    Conan O'Brien has been doing this for years with his celebrity "if they mate" shtick.

July 30th, 2008 all stories
Technology / Computer Sciences

Comments: 6
Rank: 4.1/5 after 16 votes

  • Stumble this up

  • Digg this

  • Share it:
  • share on Facebook
  • share on MySpace
  • share on Slashdot
  • rss-newsfeed
  • share on Google
  • share on Reddit
  • add to delicious
  • save to Yahoo! bookmarks
  • share on Windows Live
  • Add to Mixx!
Rating: 4.1/5 after 16 votes


Tags

faces, images, real

  • Physicists Demonstrate Quantum Memory with Matter Qubits
    Physicists Demonstrate Quantum Memory with Matter Qubits
    Physics / General Physics
    created Jul 03, 2009 | popularity 4.4 / 5 (17) | comments 1
  • 'Holey' Nanosheets for Wastewater Dye Removal
    Nanotechnology / Nanomaterials
    created Jul 01, 2009 | popularity 5 / 5 (5) | comments 1
  • Jellyfish Robot Swims Like its Biological Counterpart
    Jellyfish Robot Swims Like its Biological Counterpart
    Electronics / Robotics
    created Jun 26, 2009 | popularity 4.4 / 5 (8) | comments 1
  • Could Maxwell's Demon Exist in Nanoscale Systems?
    Could Maxwell's Demon Exist in Nanoscale Systems?
    Physics / General Physics
    created Jun 24, 2009 | popularity 4.4 / 5 (18) | comments 29
  • Living Safely with Robots, Beyond Asimov's Laws
    Living Safely with Robots, Beyond Asimov's Laws
    Electronics / Robotics
    created Jun 22, 2009 | popularity 4.6 / 5 (52) | comments 40
  • Other News

    Japan demands 119 million dlrs in tax from Amazon: report

    Technology / Business

    created 18 hours ago | popularity 3.6 / 5 (5) | comments 1

    Japanese authorities told a sales affiliate of US retail giant Amazon.com to pay about 119 million dollars in tax for unreported income over a three-year period, a newspaper said Sunday.


    Iconic skyscrapers find new luster by going green (AP)

    Iconic skyscrapers find new luster by going green

    Technology / Energy

    created 19 hours ago | popularity 1 / 5 (1) | comments 0

    (AP) -- When owners of the Empire State Building decided to blanket its towering facade this year with thousands of insulating windows, they were only partly interested in saving energy. They also needed ...


    Geeks double as scourges and sages at media summit

    Technology / Business

    created 14 hours ago | popularity not rated yet | comments 0

    (AP) -- The media moguls attending an annual powwow staged by investment bank Allen & Co. used to be able to rest comfortably in the Idaho mountains as they mulled their next moves.


    Downturn dating: Hearts flutter as markets stutter (AP)

    Downturn dating: Hearts flutter as markets stutter

    Technology / Internet

    created 19 hours ago | popularity not rated yet | comments 0

    (AP) -- Credit the recession for "staycations" and bringing us more game-night parties at home. But also give it a shout for spurring more first dates.


    UK spy chief's family details posted on Facebook

    Technology / Internet

    created 19 hours ago | popularity not rated yet | comments 0

    (AP) -- He's the spy who came in from the beach.