Jump into the screen with 360-degree immersive video

February 27, 2008 by Lisa Zyga Immersive Media Camera

Immersive Media´s Dodeca 2360 camera.

As you watch a video, have you ever wondered what's happening beyond the camera frame? If you could jump inside the video and look around, you would have a 360-degree view of the world in your TV screen or computer monitor.

A company based in Calgary, Alberta, called Immersive Media Corp. is trying to achieve exactly this type of immersive experience with a new camera and software technology. When watching a video filmed with the Immersive Viewer (IMViewer) system, users can control the scene, seamlessly moving the perspective up, down, sideways, or even behind the original frame.

The technology is based on a Dodeca 2360 camera, which can record eleven image streams that are arranged in a geodesic geometry. The camera captures images at a resolution of more than 100 million pixels per second - significantly more than HDTV. The 20-pound camera also has four built-in microphones for simultaneous omni-directional audio recording. When recording, camera operators can check each individual lens to see what´s being recorded at every angle.

Immersive Media's software then turns the video files into "telemersion" files. A processor compresses, records, and synchronizes up to 12 channels at once.

Then, the videos can be viewed on computer monitors, video screens, head-mounted displays, or projected onto a dome screen. When watching video on a computer monitor, viewers use the mouse to turn the viewing in any 360-degree direction (demos available at Immersive Media's Web site). The viewing engine essentially blends camera image streams together in real time to make a movable window. With a head-mounted display, a viewer can see different angles simply by turning their head.

To enhance the immersion experience, viewers can also "direct" the video by rewinding, pausing, speeding up, slowing down, or zooming in on certain areas. The technology is also compatible with GPS or other metadata, enabling viewers to determine the location they´e viewing.

The software can also blend the entire 360-degree scene onto a single 2D screen, called a "sphere movie." These sphere movies show the whole environment in motion at once, without having to direct the field of view. Sphere movies can be watched on standard software such as Quicktime or Windows Media Player, or recorded on DVDs. They're also compatible with MPEG-2 and MPEG-4, and can be broadcast using HDTV-resolution channels.

With another feature, viewers can watch three frames on a single screen: the controllable video, the full sphere movie (with crosshairs that correspond to where you are looking in the controllable frame), and a GPS frame telling you your location as you move.

While Immersive's camera technology was developed three years ago, it was originally used by the FBI to study street routes of visiting dignitaries for security purposes. More recently, Google Earth has used the technology to create its StreetView videos. Immersive also hopes to use the technology for applications such as urban planning, oil and gas resource management, emergency response and first responder operations, and commercial media.

One notable company taking advantage of the technology is Adidas, which has featured videos incorporating the immersion capability on its Web site. Viewers can zoom in on their favorite basketball players and replay scenes to see reaction shots - in short, experiencing the event with a personal perspective.

More information: Immersive Media Demos


print this article email this article download pdf blog this article bookmark this article     Stumble it Digg this share on Facebook retweet share on Reddit add to delicious
Rate this story - 4.5 /5 (43 votes)

Rank Filter

Move the slider to adjust rank threshold, so that you can hide some of the comments.


Display comments: newest first

  • gopher65 - Feb 27, 2008
    • Rank: 3.7 / 5 (3)
    This could be really useful in certain situations. Great idea!
  • earls - Feb 27, 2008
    • Rank: 3 / 5 (1)
    A great start to bring reality online... It would be nice if there were no camera anchor point however. As in you could not just "zoom" on the distance, but actually move into the distance. You would control the camera's location instead of the camera's location controlling what you see. In due time, I suppose.
  • meco - Feb 27, 2008
    • Rank: 1 / 5 (1)
    Actually if you look at the videos on the demo page, it looks like the camera is portable. Some of them show the camera moving into the distance, like you described. You're always going to have an anchor point for your camera, but its cool that the camera can also move at the same time as the viewer is looking around. Very cool!
  • phuesken - Feb 27, 2008
    • Rank: 1 / 5 (1)
    ...like these people did 4 years ago:
    http://www.vrhotw...eo6.html
  • googleplex - Feb 27, 2008
    • Rank: 1 / 5 (1)
    Cool

February 27, 2008 all stories

Comments: 5

4.5 /5 (43 votes)
  • Stumble this up

  • Digg this

  • share this

  • hide
  • Related Stories

  • 'Immersive Dome' -- don't just watch, join the action
    created Aug 14, 2009 | popularity not rated yet | comments 0
  • Take a virtual ride in an RC toy car
    created May 19, 2008 | popularity not rated yet | comments 0
  • From 2-D pictures to 3 dimensions
    created Mar 03, 2008 | popularity not rated yet | comments 0
  • Broadband Report: Urge opens
    created May 19, 2006 | popularity not rated yet | comments 0
  • New video-conferencing method cheaper, more sophisticated
    created Apr 19, 2006 | popularity not rated yet | comments 0



  • hide
  • Relevant PhysicsForums posts

  • Aspiring Engineering major looking for general answers
    created Nov 19, 2009
  • Calculating max load of square tube (steel)
    created Nov 19, 2009
  • Passive Chemical Heating
    created Nov 19, 2009
  • Shortening Boat Trailer
    created Nov 18, 2009
  • More from Physics Forums - General Engineering

Other News

Hackers leak e-mails, stoke climate debate

Technology / Internet

created 4 hours ago | popularity 4.6 / 5 (9) | comments 4

(AP) -- Computer hackers have broken into a server at a well-respected climate change research center in Britain and posted hundreds of private e-mails and documents online - stoking debate over whether some scientists have ...


plug-in hybrid electric vehicle

Pulling the plug on hybrid myths

Technology / Energy

created Nov 19, 2009 | popularity 3.8 / 5 (12) | comments 17

(PhysOrg.com) -- Whether you call them myths, urban legends, fables or old wives' tales, there's a lot of misinformation out there about plug-in electric hybrid vehicles. These vehicles, abbreviated PHEVs, ...


UK police make 2 Trojan computer virus arrests

Technology / Internet

created Nov 18, 2009 | popularity 5 / 5 (1) | comments 10

(AP) -- A couple suspected of helping spread some of the Internet's most aggressive computer viruses has been arrested in the English city of Manchester, police said Wednesday.


A sign marks the entrance to IBM Corporate Headquarters

IBM makes Big Blue cloud

Technology / Software

created Nov 16, 2009 | popularity 2.9 / 5 (8) | comments 8

IBM on Monday announced it has created the world's largest business computing "cloud" capable of holding an amount of digital data on a par with 250 billion iTunes songs.


Google SPDY

Google's SPDY will speed up downloads

Technology / Internet

created Nov 16, 2009 | popularity 4.4 / 5 (16) | comments 7

(PhysOrg.com) -- As part of its effort to speed up the Web, Google is experimenting with SPDY, a new application layer protocol, that it hopes will speed up the conversation between browsers and Web servers ...