Coming soon: Gloves that turn gestures into speech


WASHINGTON: Researchers have developed a set of gloves that turn hand gestures into speech using computer technology, offering hope to millions of speech-impaired people to communicate better.
The device consists of a set of sensors, an accelerometre, compass, gyroscope and flex sensors in the fingers, which translate movement into signals that a computer converts into speech. The person wearing the gloves draws a shape in the air and that information is transmitted to them via bluetooth to a smartphone, which matches the shape up against a set stored in memory. A match produces a sound.
The gloves were designed by Pasternikov Anton, Osika Maksim, Yasakov Valeriy and Stepanov Anton, researchers at the Donetsk branch of the 'Step' Computer Academy.
However, the device has certain limitations. Firstly, the gestures stored in the computer are not yet sign language. Morover, sign language is as complex as any other language, and differs from one country to another. So far, the system can only read a dozen or so movements.
Another challenge is durability and usefulness. Most people, deaf or not, don't walk around wearing gloves.

No comments:

Post a Comment