NHK develops an automatic sign language translation system for TV (w/ video)

June 6, 2011 by Katie Gatto weblog

(PhysOrg.com) -- Researchers at the NHK Science & Technology Research laboratories in Japan have developed a new animated sign language translation system. The system takes a string of words, in Japanese obviously, and converts them into the gestures that make up sign language.

The goal of the project is to create more effective broadcasts for deaf television viewers. The system could be used to allow for more effective communications in the event of a state of emergency or important breaking news, though it does have the potential to be used in entertainment capacity as well.

While there is a current form of communication in place, subtitles, they are not always an effective way of communicating with those who were born deaf, as research has shown that they may have more difficulty understanding the subtitles than they would seeing the message signed. This system can enhance the level of comprehension in the event of a disaster.

The system takes the text, and translates it to signing. The system can also convert the existing words directly to signing and replacing the words that do not have a direct translation with a synonym in order to get the word across. The system then shows the signing done by a virtual avatar that is dressed like a reporter.

Current testing of the system shows that the hearing impaired were able to get a basic message from the system, through the whole message may not be a fluid as a live translator would be in the same situation. The system will still have a built-in manual system where a human can go in and fix the translations for enhanced accuracy.

© 2010 PhysOrg.com


Rank 5 /5 (2 votes)
Related Stories
Relevant PhysicsForums posts

More news stories

Stanford research team cracks animated NuCaptcha

(PhysOrg.com) -- The research team from Stanford University, led by Elie Bursztein, that previously had cracked regular CAPTCHAs and then audio CAPTCHAs, now has also successfully cracked the animated version called NuCapt ...

Technology / Computer Sciences

created 17 hours ago | popularity 5 / 5 (3) | comments 6 | with audio podcast report

Tiny, implantable medical device can propel itself through bloodstream

Someday, your doctor may turn to you and say, "Take two surgeons and call me in the morning." If that day arrives, you may just have Ada Poon to thank.

Technology / Engineering

created 16 hours ago | popularity 5 / 5 (9) | comments 8 | with audio podcast

Italian engineer invents floating solar panels

Rays of the winter sun bounce off gleaming mirrors on the tiny lake of Colignola in Italy, where engineers have built a cost-effective prototype for floating, rotating solar panels.

Technology / Energy & Green Tech

created 20 hours ago | popularity 4.7 / 5 (6) | comments 5

Microsoft hits Motorola, Google with EU complaint

Microsoft on Wednesday lodged a formal complaint with the European Union's competition regulator against Motorola Mobility and its soon-to-be owner Google, saying Motorola's aggressive enforcement of patent ...

Technology / Business

created 16 hours ago | popularity 2 / 5 (1) | comments 2

Calif. pledges better mobile privacy disclosures

(AP) -- Mobile applications seeking to collect personal information will have to forewarn users as part of an agreement reached in California.

Technology / Internet

created 8 hours ago | popularity not rated yet | comments 0


Researchers build first physical 'metatronic' circuit

(PhysOrg.com) -- The technological world of the 21st century owes a tremendous amount to advances in electrical engineering, specifically, the ability to finely control the flow of electrical charges using ...

Spitzer finds solid buckyballs in space

(PhysOrg.com) -- Astronomers using data from NASA's Spitzer Space Telescope have, for the first time, discovered buckyballs in a solid form in space. Prior to this discovery, the microscopic carbon spheres ...

Faster than light neutrinos? More like faulty wiring

You can shelf your designs for a warp drive engine (for now) and put the DeLorean back in the garage; it turns out neutrinos may not have broken any cosmic speed limits after all.

CT colonography shown to be comparable to standard colonoscopy

Computerized tomographic (CT) colonography (CTC), also known as virtual colonoscopy, is comparable to standard colonoscopy in its ability to accurately detect cancer and precancerous polyps in people ages 65 and older, according ...

Physicists surprised by disappearing and reappearing superconductivity in iron selenium chalcogenides

Superconductivity is a rare physical state in which matter is able to conduct electricity -- maintain a flow of electrons -- without any resistance. This phenomenon can only be found in certain materials at low temperatures, ...

Study: Virtual colonoscopy effective screening tool for adults over 65

Computed tomography (CT) colonography can be used as a primary screening tool for colorectal cancer in adults over the age of 65, according to a new study published online in the journal Radiology.