Images for 3D Video Games Without High Price Tags or Stretch Marks

August 12, 2008 Images for 3-D Video Games Without High Price Tags or Stretch Marks

Enlarge

The stretching that plagues images for 3-D video games (see top) dissappears when new algorithms from UC San Diego are used to create high quality images for interactive applications such as 3-D video games "on the fly." Image: UC San Diego Jacobs School of Engineering

(PhysOrg.com) -- The images of rocks, clouds, marble and other textures that serve as background images and details for 3D video games are often hand painted and thus costly to generate. A breakthrough from a UC San Diego computer science undergraduate now offers video game developers the possibility of high quality yet lightweight images for 3D video games that are generated "on the fly" and are free of stretch marks, flickering and other artifacts.

The advance is being presented this week at one of the most prestigious computer graphics conference in the world, SIGGRAPH 2008.

"It should be pretty easy for video game developers to integrate our research into new games. As a game developer myself, I know first hand that stretched out and flickering backgrounds and details are no longer acceptable in 3D video games," said Alex Goldberg, the computer science undergraduate from UC San Diego's Jacobs School of Engineering who did much of the work. Computer science professors Matthias Zwicker from UC San Diego, and Frédo Durand from the Massachusetts Institute of Technology, also contributed to the research project.

"People are looking for ways to get rid of these distortions, preferably without having to pay artists to generate background and detail images by hand. We have come up with a way to do this, and we are planning to provide code for download soon," explained Goldberg, who recently graduated from UC San Diego and is now working for San Diego video game studio PixelActive Inc.

The 2008 SIGGRAPH paper marks an important improvement over Perlin noise, an established technique in which small computer programs create many layers of noise that are piled on top of each other. The layers are then manipulated -- like layers of paint on a canvas -- in order to develop detailed and realistic textures such as rock, soil, cloud, water and marble that serve as background images and details for 3D video games.

"The existing methods for using computer generated noise to make images for backgrounds and details for 3D video games are fast, but the images that you get don't look very good. Our work gives you the full computational benefit of noise but without many of the tradeoffs such as distortion and flickering," said Goldberg.

The new approach also eliminates the need to store the textures as huge images that take up valuable memory. Instead the textures are generated by computer programs on the fly every time an image is rendered, explained computer science professor Matthias Zwicker from UC San Diego's Jacobs School of Engineering.

"The graphics generated from the procedural approach that we explored in this project are very small. Illustrating video games with small images is going to be increasingly important in the future as more and more games are downloadable," said Zwicker.

Undergrad. Overachiever.

Alex Goldberg did the bulk of this work as an undergraduate computer science student at UC San Diego. After taking Zwicker's rendering class (CSE168), Goldberg pursued this research both in his free time and through formalized independent study classes supervised by Zwicker. Goldberg also took the famed video game crash course (CSE125) in which teams of UC San Diego computer science undergraduates create 3D networked video games in 12 weeks.

"Getting a paper into SIGGRAPH is an accomplishment for any senior researcher in computer graphics. Presenting a paper in SIGGRAPH based on work done as an undergraduate is astonishing. We're very proud of Alex and his work," said Keith Marzullo, professor and chair of the Department of Computer Science and Engineering at UC San Diego's Jacobs School of Engineering.

"I've never given a talk in front of more than 30 or 40 people. At SIGGRAPH, the audience will be 300 or 400," Goldberg said. "But I'm excited. These are exactly the people I want to show my work to."

Pixel Packing (More technical info)

Both the stretch marks and the flickering in 3D video game backgrounds often stem from the same technical issue: choosing what color to make individual pixels.

"When one pixel covers a large area in a 3D video game landscape…what color should that pixel be? It can only be one color, but the area it covers may contain many different colors," UC San Diego computer science professor Matthias Zwicker explained.

Color averaging is one solution. For example, if a pixel covers a patch of tiny black bumps on a piece of armor on a soldier far in the distance, and if these armor bumps are partially lit up with white light, then averaging the colors and turning the pixel gray is often in order. But before you can average colors, you have to determine the exact region of the scene that needs to be squeezed into one particular pixel. A simple solution is to slide circular areas of scenes into circle shaped pixels. But when you are trying to map areas of 3D scenes back to 2D pixels, circular areas of background images are not the best option even though the pixels are circles themselves, according to the computer graphics researchers.

In the SIGGRAPH paper, the computer scientists mapped elliptical areas of background images back to circular pixels and found that their technique yielded higher quality background images with less stretching and other distortions.

The reason elliptical shapes are a better fit for circular pixels in backgrounds for 3D video games goes back to basic geometry: when a cone that extends from a circular pixel intersects with the background of a 3D video game scene, the region of the cone that hits the background is an ellipse rather than a circle.

On the Net: Anisotropic Noise -- http://graphics.ucsd.edu/~matthias/Papers/AnisotropicNoise.pdf

Provided by University of California - San Diego


   
Rate this story - 4.6 /5 (18 votes)

Rank Filter

Move the slider to adjust rank threshold, so that you can hide some of the comments.


Display comments: newest first

  • Soylent - Aug 12, 2008
    • Rank: 5 / 5 (3)
    Procedural textures have been around since forever; the only invention here appears to be better anti-aliasing, but the article refuses to elucidate.

    It's interesting to note that procedural textures are almost the exact opposite of Carmack's megatexturing technique, which consists of streaming and caching small chunks of texture from the relevant mip-maps of a huge texture(up to 128000×128000 pixels in ID tech 5) to allow unique texturing on large areas of terrain.

August 12, 2008 all stories

Comments: 1

4.6 /5 (18 votes)

  • hide
  • Related Stories

  • Microsoft and NSF enable research in the cloud
    created Feb 04, 2010 | popularity not rated yet | comments 0
  • New Hubble Maps of Pluto Show Surface Changes (w/ Video)
    created Feb 04, 2010 | popularity not rated yet | comments 0
  • Merging galaxies create a binary quasar (w/ Video)
    created Feb 03, 2010 | popularity not rated yet | comments 0
  • Google tailoring tablet computer software
    created Feb 02, 2010 | popularity not rated yet | comments 0
  • Bias towards negativity predicts vulnerability to stress
    created Feb 02, 2010 | popularity not rated yet | comments 0



  • hide
  • Relevant PhysicsForums posts

  • Computer 5V or 0V output to Sensaphone Express II
    created Feb 04, 2010
  • Ti-89 ROM Image
    created Jan 29, 2010
  • TV ads
    created Jan 29, 2010
  • Apple introduces latest iNonsense
    created Jan 27, 2010
  • cheap scientific calculator that does matrix operations
    created Jan 27, 2010
  • Power consumption: Residential vs. Commercial
    created Jan 22, 2010
  • More from Physics Forums - Computing & Technology

Other News

A general view of the arrival area of the Whistler Creek Alpine Skiing venue

Google Maps climbs to Olympic peaks

Technology / Internet

created 47 minutes ago | popularity not rated yet | comments 0

Google sent snowmobiles rigged with cameras into Canadian mountains so folks snug and warm at home will get views of slopes at the Winter Olympic Games kicking off on Friday.


Handling emergencies online

Technology / Internet

created 17 minutes ago | popularity not rated yet | comments 0

Online social networking sites could solve many problems plaguing information dissemination and communications when disaster strikes, according to a report from US researchers in a recent issue of the International Journal of ...


Warner CEO sees e-book 'fracas' as helping music

Technology / Business

created 1hour ago | popularity not rated yet | comments 0

(AP) -- The head of Warner Music Group expressed hope on Tuesday that the recent "fracas" over the price of e-books would help give content creators such as his company more pricing power over device makers.


Spanish Minister of industry Miguel Sebastian (C) sits in an electric car with Jean Pierre Laurent

EU ministers call for common electric car strategy

Technology / Energy

created 2 hours ago | popularity 3 / 5 (1) | comments 1

EU industry ministers on Tuesday pressed the European Commission to establish a common strategy to develop electric cars.


PayPal's India transaction block could last months

Technology / Business

created 1hour ago | popularity not rated yet | comments 0

(AP) -- Online payments service PayPal says its suspension of certain transactions in India could last months.