Creating 3D models with a simple webcam (w/ Video)

November 11, 2009 Creating 3D models with a simple webcam

Enlarge

Object 3D reconstruction with texture mapping

(PhysOrg.com) -- Constructing virtual 3D models usually requires heavy and expensive equipment, or takes lengthy amounts of time. A group of researchers at the University of Cambridge, Qi Pan, Dr Gerhard Reitmayr and Dr Tom Drummond have created a program able to build 3D models of textured objects in real-time, using only a standard computer and webcam. This allows 3D modeling to become accessible to everybody.

Qi, Gerhard and Tom presented the system at the 20th British Machine Vision Conference (BMVC'09), in London.

During the last few years, many methods have been developed to build a realistic 3D model of a real object. Various equipment has been used: 2D/, (in visible spectrum or other wave lengths), , , camera, etc. These pieces of equipment are usually expensive, complicated to use or inconvenient and the model is not built in real-time. The data (for example laser information or photos) must first be acquired, before going through the lengthy reconstruction process to form the model. If the 3D reconstruction is unsatisfactory, then the data must be acquired again.

The method proposed by Qi and his colleagues needs only a simple webcam. The object is moved about in front of the webcam and the software can reconstruct the object "on-line" while collecting live video. The system uses points detected on the object to estimate object structure from the motion of the camera or the object, and then computes the Delaunay tetrahedralisation of the points (the extension of the 2D Delaunay triangulation to 3D). The points are recorded in a mesh of tetrahedra, within which is embedded the surface mesh of the object.

Creating 3D models with a simple webcam
Enlarge

Left to right (a) Object rotated by hand in front of camera. (b) Point cloud obtained from on-line structure from motion estimation followed by bundle adjustment. (c) Delaunay Tetrahedralisation of point cloud, partitioning the convex hull into tetrahedra. (d) Carved mesh obtained from recursive probabilisitic tetrahedron carving. (e) Texture-mapped surface mesh.

The software can then tidy up the final reconstruction by taking out the invalid tetrahedra to obtain the surface mesh based on a probabilistic carving algorithm, and the object texture is applied to the 3D mesh in order to obtain a realistic model. Thanks to this simple and cheap system, 3D reconstruction can become accessible to everybody.

The project won "Best Demo Prize" at a conference called ISMAR 2009 (International Symposium of Mixed and Augmented Reality).

Provided by University of Cambridge (news : web)


print this article email this article download pdf blog this article bookmark this article     Stumble it Digg this share on Facebook retweet share on Reddit add to delicious
Rate this story - 5 /5 (24 votes)

Rank Filter

Move the slider to adjust rank threshold, so that you can hide some of the comments.


Display comments: newest first

  • designmemetic - Nov 11, 2009
    • Rank: 1 / 5 (1)
    fantastic, I want it now. why are there artifacts on the chimney?. they look like spider webs connecting the chimeney to the roof or filling in the interior corners. . . it seems to have generated the 3d model incorrectly because of the the spider web artifacts. I guess I could clean it up manually, but it should be easy enough to use the same process to clean up the mistakes from examing additional views. or maybe they were introduced by the hand being in the scene?
  • antialias_physorg - Nov 11, 2009
    • Rank: not rated yet
    Such procedures have a lot of problems with concave structures. But for simple objects it works well.
  • SincerelyTwo - Nov 11, 2009
    • Rank: 5 / 5 (1)
    Well, real world objects just are not made out of simple polygons, irl everything is grainy. This is obviously proof of concept, you could easily get significant improvements by post-processing algorithms to identify and adjust groups of polygons based on certain conditions.

    The software by default was likely designed to convert what it sees as it is, and that includes a lot of details you might not want in a final scan.

    Don't bother getting carried away with demos, what's important here is the technology, the results can be processed as needed.

    Of course, understanding that is taken for granted in the context of science, it's always implied that proof of concept technology isn't going to be production ready.
  • definitude - Nov 12, 2009
    • Rank: not rated yet
    It will be a mix of conformity and innovation that drives the use of this modeling engine. Not every real world condition can be accounted for, however I am thinking more along the line of cost estimating and the like.

    I see the long run implications of triangulated planes limiting. Model compilation may tend toward some more comprehensive geometric analysis.

    Either way, the management of information will still be needed for non-coplanar vector sets. These are good guidelines and design tools for voluming as it is presented here.
  • Assaad33 - Nov 12, 2009
    • Rank: not rated yet
    Is there a demo version of this software?
  • HellCook - Nov 16, 2009
    • Rank: not rated yet
    Model compilation may tend toward some more comprehensive geometric analysis.

    There are very efficients mesh's decication algorithms that could do it.

November 11, 2009 all stories

Comments: 6

5 /5 (24 votes)
  • Stumble this up

  • Digg this

  • share this

  • hide
  • Related Stories

  • New robot skier takes to the slopes (w/ Video)
    created Oct 23, 2009 | popularity not rated yet | comments 0
  • BlackBerry Storm 2 coming soon (w/ Video)
    created Oct 20, 2009 | popularity not rated yet | comments 0
  • Flying MAV Navigates Without GPS (w/ Video)
    created Nov 02, 2009 | popularity not rated yet | comments 0
  • Li-Air: Argonne opens new chapter in battery research (w/ Video)
    created Sep 23, 2009 | popularity not rated yet | comments 0
  • Superior 3D Graphics for the Web a Step Closer
    created Sep 22, 2009 | popularity not rated yet | comments 0



  • hide
  • Relevant PhysicsForums posts

  • Help with a camera choice
    created Nov 18, 2009
  • casio calculator that's similar to TI-89
    created Nov 08, 2009
  • Advice on what cell phone to get
    created Nov 08, 2009
  • Changing the language options on your phone.
    created Nov 03, 2009
  • More from Physics Forums - Computing & Technology

Other News

Suit over search-engine keywords tries new angle

Technology / Internet

created 4 hours ago | popularity 2.5 / 5 (2) | comments 0

(AP) -- A lawsuit in Wisconsin is bringing a fresh challenge to the practice of paying for keywords on Google and other search engines to boost one company's link over a rival's.


Screen of a computer featuring a search of the word "edition" on the home page of Google's website

Google books hearing set for February 18

Technology / Internet

created 6 hours ago | popularity not rated yet | comments 0

A US judge set February 18 for a hearing on the revised legal settlement between Google and US authors and publishers that would allow the Internet giant to scan and sell millions of books online.


Newspapers are displayed at a newsstand

US newspaper ad revenue down nearly 28 percent

Technology / Business

created 4 hours ago | popularity not rated yet | comments 0

US newspaper advertising revenue fell by nearly 28 percent in the third quarter, continuing a slide which has led to layoffs, bankruptcies and the closure of several dailies.


Trust Linux!

Trust Linux!

Technology / Software

created 10 hours ago | popularity 4.3 / 5 (3) | comments 0

(PhysOrg.com) -- A team of researchers has implemented support for 'trusted computing' in a commercially available version of the open source operating system Linux, breaking new ground in the global drive ...


Cisco has released a Web security app for iPhone

Cisco releases Web security app for iPhone

Technology / Software

created 6 hours ago | popularity 4.5 / 5 (2) | comments 0

Cisco on Friday announced the release of a free iPhone application for anyone who wants to stay on top of the latest trojans, worms, or other threats marauding on the Internet.