Engineering news

Smart glasses turn sights into sound for blind users

Professional Engineering

A research team member who is blind uses acoustic touch to locate and reach for an item on the table (Credit: Lil Deverell)
A research team member who is blind uses acoustic touch to locate and reach for an item on the table (Credit: Lil Deverell)

New smart glasses that turn sights into sound could “transform the lives” of people who are blind or have low vision, the device’s creators have claimed.

Developed by researchers at the University of Technology Sydney and the University of Sydney, together with local start-up Aria Research, the ‘acoustic touch’ glasses translate visual information into distinct sound ‘icons’.

About 39m people worldwide are blind, according to the World Health Organisation, and an additional 246m people live with low vision, affecting their ability to take part in everyday activities.

“Smart glasses typically use computer vision and other sensory information to translate the wearer’s surrounding into computer-synthesized speech,” said Distinguished Professor Chin-Teng Lin, from the University of Technology Sydney.

“However, acoustic touch technology ‘sonifies’ objects, creating unique sound representations as they enter the device's field of view. For example, the sound of rustling leaves might signify a plant, or a buzzing sound might represent a mobile phone.”

A study to test the acoustic touch technology, led by Dr Howe Zhu from the University of Technology Sydney, involved 14 participants – seven people with blindness or low vision, and seven blindfolded sighted people who served as a control group.

They found that the wearable device significantly enhanced the ability of blind or low-vision individuals to recognise and reach for objects, without causing too much mental effort.

“The auditory feedback empowers users to identify and reach for objects with remarkable accuracy,” said Dr Zhu. “Our findings indicate that acoustic touch has the potential to offer a wearable and effective method of sensory augmentation for the visually impaired community.”

The research underscores the importance of developing assistive technology to overcome challenges, such as locating specific household items and personal belongings, the researchers said.

“By addressing these day-to-day challenges, the acoustic touch technology opens new doors for individuals who are blind or have low vision, enhancing their independence and quality of life,” the research announcement said.

“With ongoing advancements, the acoustic touch technology could become an integral part of assistive technologies, supporting individuals to access their environment more efficiently and effectively than ever before.”

The work was published in PLOS ONE.


Want the best engineering stories delivered straight to your inbox? The Professional Engineering newsletter gives you vital updates on the most cutting-edge engineering and exciting new job opportunities. To sign up, click here.

Content published by Professional Engineering does not necessarily represent the views of the Institution of Mechanical Engineers.

Share:

Read more related articles

Professional Engineering magazine

Professional Engineering app

  • Industry features and content
  • Engineering and Institution news
  • News and features exclusive to app users

Download our Professional Engineering app

Professional Engineering newsletter

A weekly round-up of the most popular and topical stories featured on our website, so you won't miss anything

Subscribe to Professional Engineering newsletter

Opt into your industry sector newsletter

Related articles