G-Speak will make the keyboard and mouse obsolete (w/ Video)

March 1, 2010 by Lin Edwards report
G-Speak will make the keyboard and mouse obsolete

Enlarge

(PhysOrg.com) -- The mouse may soon become obsolete, with interfaces that interpret gestures rapidly approaching a stage at which they can be released for general consumers.

A new system being developed by Oblong Industries harnesses gesture technology that uses special surfaces and displays that can track hand movements, providing the operator is wearing the special conducting . The system works with images and videos, and has been dubbed the “G-Speak” spatial operating environment (SOE).

In a G-Speak environment everything on screen can be directly manipulated by gestures such as pointing, and the system simplifies the control of real-world objects such as robots or vehicles, and allows physical tools and interfaces to be used as input devices.

John Underkoffler, co-founder of Oblong Industries, says G-Speak should be available for consumers within five years, and its combination of interpretation of , real-world pixels and recombinant networking represents the biggest step forward in computer interfaces since 1984.

Underkoffler says applications for the new interface technology include the operation of 3-D interfaces, processing of large data sets, integration of multiple computers and large screens into building-scale work environments. G-speak networking’s collection of library components allows applications to scale dynamically and transparently across multiple computers, and in a LAN network this makes more effective use of CPU power and provides support for applications enabling collaborative work over the network. It will also be possible to add new people and computers to the network, and to add new code at run-time.

G-speak controls applications through hand poses, pointing, and hand movements, with input from several hands simultaneously being fully supported. Hand and finger motions are tracked to an accuracy of 0.1 mm at 100 Hz.

Using gestural I/Os is much more efficient at complex navigation tasks and selection/sorting, than the mouse and keyboard, but both will still be available for use when appropriate.

G-Speak is already in use by Fortune 50 companies, and by some universities and government agencies, and a software development kit running on Linux and Mac is already available.

More information:
-- Oblong.com - http://oblong.com/ … DcktAf9.html
-- More videos: http://vimeo.com/u … 22585/videos
-- Another video on YouTube: http://www.youtube … =KqyHM29VNqM

© 2010 PhysOrg.com

2.8 /5 (20 votes)  

Filter


Move the slider to adjust rank threshold, so that you can hide some of the comments.


Display comments: newest first

cmn
Mar 01, 2010

Rank: 4.4 / 5 (8)
So, they replaced the simple, inexpensive 3-button mouse with expensive gloves and complex gestures?
electrichead
Mar 01, 2010

Rank: 4.9 / 5 (8)
I've been trying out some of these techniques and really, after a few minutes, your hands get really tired. I don't think this tech will go very far without addressing that.
CreepyD
Mar 01, 2010

Rank: 4.3 / 5 (6)
I think the whole touch screen / gesture thing is an absolute gimmick, totally unusable in the real world.
Can you imagine using this kind of thing for 3-4 hours straight? Your arms would be dying!
A mouse is extremely pinpoint accurate, fast, and requires very tiny movements. You cannot improve on a good mouse.
DaffyDuck
Mar 01, 2010

Rank: 4.9 / 5 (7)
I agree. The mouse is here to stay until a direct brain interface comes about. This is obviously inspired by Minority Report.
TheBigYin
Mar 01, 2010

Rank: 2.3 / 5 (3)
The whole triple screen is powered by three genetic mutants floating in a tank out of sight.
Justavian
Mar 01, 2010

Rank: 5 / 5 (1)
Just preaching to the choir here - a few years ago i bought a P5 glove interface. It was supposed to be mostly for games, but i was more interested in developing new ways for interacting with the main OS. I wrote some new software for it, but like a few here already mentioned, your arms get tired after a relatively short period of time. The only way i could see this system would be useful is if it did NOT require a glove interface, and could be tethered to various computers around your house. You could walk by and interact with it quickly without sitting down with a keyboard and mouse.
otto1923
Mar 01, 2010

Rank: 1 / 5 (1)
Why not 2 cameras reading your hands in 3d? I would like to be able to manipulate a model in 3d, spinning it, moving faces, adding elements until my arms got tired. This with a mouse-like touchpad and keyboard would be good. Mechanics, cooks, etc use their arms all the time- maybe you'd get used to it, as in exercise.
Skeptic_Heretic
Mar 01, 2010

Rank: 2.3 / 5 (3)
I've used systems silimar to this one a year ago. They were excellent then and they'll be even more excellent going forward.

You'd think it would make you tired but it really doesn't after the first few uses. When it comes to sorting through large data stacks technology like this is invaluable.
danman5000
Mar 01, 2010

Rank: 1 / 5 (2)
Well at least this would help eliminate carpal tunnel syndrome, since your movements are more natural. You might just develop a case of arm-al tunnel syndrome though.
TheBigYin
Mar 01, 2010

Rank: 5 / 5 (2)
I thinkt he problem with this system is you have to hold your arms out in front of you.... very tiring.

If you think of a the way a craftsman manipulates small objects - hands on his lap, or wrists resting on the table in front of him, and small movements with hands and fingers - not the huge gestures of 'Minority Report'
S_Bilderback
Mar 01, 2010

Rank: 4.7 / 5 (3)
What would happen if someone approached you as you are at your computer and your hands grab a stack of papers, or you swat at a fly, scratch your nose, or anything else causes hand gestures not intended for computer interactions?
Skeptic_Heretic
Mar 01, 2010

Rank: 1 / 5 (1)
What would happen if someone approached you as you are at your computer and your hands grab a stack of papers, or you swat at a fly, scratch your nose, or anything else causes hand gestures not intended for computer interactions?

Depends on the software and hardware. The ones I used had a "trigger" button on the palm. You had to put pressure on it to have your movements register.
jimbo92107
Mar 01, 2010

Rank: 5 / 5 (1)
Which will take longer to arrive, g-speak or affordable giant flat screen monitors?
ShotmanMaslo
Mar 01, 2010

Rank: 1 / 5 (2)
The best use for this would be to emulate mouse without a mouse. Imagine you are somewhere out with a notebook and dont have a mouse with you. Touchpad is impractical. Just use your hand like you would with a mouse, easy and not exhausting.
Skeptic_Heretic
Mar 01, 2010

Rank: not rated yet
Which will take longer to arrive, g-speak or affordable giant flat screen monitors?

http://www.pcmag....6,00.asp
Bob_B
Mar 01, 2010

Rank: 3 / 5 (2)
Gee, I broke my clavicle (collar bone) now I can't use that computer for many weeks - waving an arm connected to the shoulder of the broken clavicle is extremely painful.

Gee, I came back from Iraq with just one arm, now I can't use that computer.

And so on and so on.

Requiring arms to do what one wrist and a finger does is overkill.
Skeptic_Heretic
Mar 01, 2010

Rank: 1 / 5 (1)
Requiring arms to do what one wrist and a finger does is overkill.

How do you feel about that whole "hands at 10 and 2" thing when you drive?
rincewind
Mar 01, 2010

Rank: 3 / 5 (2)
There are 100s of muscles/fibers in our faces and forearms ready to be mapped directly to input.

Before we get to fully neural interfaces, I expect we will see a massive improvement over the keyboard/mouse paradigm by taking advantage of the many subtle twitches & contractions that our muscles can perform for a very small energy cost.
cspotrun
Mar 01, 2010

Rank: 5 / 5 (1)
This is all for people who never learned how to type. I don't see how anything short of a neural interface can be more efficient than twitching your fingers and your wrists occasionally.
MorituriMax
Mar 01, 2010

Rank: 5 / 5 (1)
amen cmn, yeah lets get rid of the precision of the mouse, where you move your hands very small distances to get large changes... no, that's so... old school. Let's make ourselves look like complete dorks waving our hands all over the place like an idiot.

I just don't think these people get it. It's not a brand new way of controlling your computer, it's just trading gloves for a mouse and you STILL MOVE THEM IN SPECIFIC WAYS to get a result.

When these guys come up with something that lets the OS literally react and respond to what I am thinking I want to do, THEN I'll be impressed.
MorituriMax
Mar 01, 2010

Rank: 5 / 5 (2)
How are you supposed to watch porn with this?


Very carefully... as they showed near the end of the Family Guy Empire Strike Back episode, where "Luke" gets a new cybernetic hand and asks the doc if he's good to go, the doc answers "Practice with the new hand, or you'll rip your ******* right off."
Arikin
Mar 02, 2010

Rank: 1 / 5 (1)
One idea is to have a set area where your hands (without gloves) are tracked. A virtual keyboard is displayed on the bottom of that area for simple data entry. Then when your hands are above and not touching the virtual keyboard below you can manipulate any object on the screen.
- Arms can rest on the desk (elbows on the table)
- Small movements for simple data entry (virtual keyboard).
- Any display can be used.
- Small tracking area makes for small movements overall.

On the other hand touch screens on a larger scale would be just as affective too. And those are current marketable technologies.
solar2030
Mar 02, 2010

Rank: 5 / 5 (1)
I prefer brain-computer interfaces
This is no practical in my opinion, especially for the masses, maybe for some specifical nisches and it could be used only for short period of time....
Sky_Marshall
Mar 03, 2010

Rank: 1 / 5 (3)
I enjoy see all the lazy people who sit at there computer complain about needing to work to accomplish a task on a computer. maybe... just maybe, an interface like this will turn people off of sitting in front of their computer for hours at a time, and actually get out and get fresh air and excersize.
Skeptic_Heretic
Mar 03, 2010

Rank: 5 / 5 (4)
maybe... just maybe, an interface like this will turn people off of sitting in front of their computer for hours at a time, and actually get out and get fresh air and excersize

Perhaps you need to spend a little less time outside exercising and a little more time on dictionary.com and grammar.net.
trekgeek1
Mar 06, 2010

Rank: 3 / 5 (2)
I think we're holding on to a dinosaur here. It is like watching the original Star Trek and seeing toggle switches and reels on computers. The better solution is no physical interface. Use brain interface technology which has been featured on this site.
Riff
Mar 07, 2010

Rank: not rated yet
Geez, what was his last invention?.. a pen the size of a welding tank on a 12x12ft notepad? I agree with everybody. Id rather move a mouse a couple inches than have to bone up on airplane tarmac marshalling techniques. I also agree that that the mouse is so efficient, that its most effective replacement will be a neuro interface.
Rank 2.8 /5 (20 votes)
Related Stories
Relevant PhysicsForums posts
  • Calling function with no input argument
    created14 hours ago
  • Force free body diagram problem on gym equipment
    created14 hours ago
  • Empirical data regarding shower heads and water
    created22 hours ago
  • feed hold button on CNC lathe
    createdFeb 09, 2012
  • RFAC in Fortran
    createdFeb 09, 2012
  • dynamics 2/32
    createdFeb 08, 2012
  • More from Physics Forums - General Engineering

More news stories

Google users warned of threat to smartphone wallets

Users of Google smartphone wallets were being warned on Friday that there is a way to crack pass codes intended to thwart thieves from going on illicit shopping sprees.

Technology / Internet

created 6 hours ago | popularity 5 / 5 (2) | comments 0

Anonymous knocks CIA website offline (Update)

The website of the Central Intelligence Agency was inaccessible on Friday after the hacker group Anonymous claimed to have knocked it offline.

Technology / Internet

created 8 hours ago | popularity 5 / 5 (8) | comments 13

New error-correcting codes guarantee the fastest possible rate of data transmission

Error-correcting codes are one of the triumphs of the digital age. They’re a way of encoding information so that it can be transmitted across a communication channel — such as an optical fiber o ...

Technology / Computer Sciences

created 16 hours ago | popularity 4.9 / 5 (8) | comments 6 | with audio podcast

New power source discovered

(PhysOrg.com) -- Researchers at the Massachusetts Institute of Technology (MIT) and RMIT University have made a breakthrough in energy storage and power generation.

Technology / Energy & Green Tech

created 15 hours ago | popularity 4.8 / 5 (25) | comments 8 | with audio podcast

Small modular reactor design could be a 'SUPERSTAR'

(PhysOrg.com) -- Though most of today's nuclear reactors are cooled by water, we've long known that there are alternatives; in fact, the world's first nuclear-powered electricity in 1951 came from a reactor ...

Technology / Energy & Green Tech

created 16 hours ago | popularity 4.3 / 5 (12) | comments 22 | with audio podcast


Humans may have helped the decline of African rainforests 3000 years ago

(PhysOrg.com) -- Large areas of rainforests in Central Africa mysteriously disappeared over three thousand years ago, to be replaced by savannas. The prevailing theory has been that the cause was a change ...

Complex wiring of the nervous system may rely on a just a handful of genes and proteins

Researchers at the Salk Institute have discovered a startling feature of early brain development that helps to explain how complex neuron wiring patterns are programmed using just a handful of critical genes. ...

The power of estrogen -- male snakes attract other males

A new study has shown that boosting the estrogen levels of male garter snakes causes them to secrete the same pheromones that females use to attract suitors, and turned the males into just about the sexiest ...

Putting the squeeze on planets outside our solar system

(PhysOrg.com) -- Using high-powered lasers, scientists at Lawrence Livermore National Laboratory and collaborators discovered that molten magnesium silicate undergoes a phase change in the liquid state, abruptly ...

Could Venus be shifting gear?

(PhysOrg.com) -- ESA’s Venus Express spacecraft has discovered that our cloud-covered neighbour spins a little slower than previously measured. Peering through the dense atmosphere in the infrared, the ...

Fool's gold may prove an unlikely alternative to overexploited catalytic materials

Catalytic materials, which lower the energy barriers for chemical reactions, are used in everything from the commercial production of chemicals to catalytic converters in car engines. However, with current catalytic materials ...