EyeMusic: Seeing with Sound

A man using EyeMusic reaches for an apple

Many research teams are experimenting with ways to allow blind people to navigate their surroundings and locate objects. Have you seen this one?

It’s called EyeMusic and it turns visual data into music so that blind users can hear what’s around them. This is called a sensory substitution device (SSD). Users of EyeMusic wear glasses with a small video camera mounted on the frame. The camera scans the images in front of the user then transmit music back through an ear piece.

Obviously the trick here is to create a music map that is easy to learn and interpret. Here’s how EyeMusic works:

“EyeMusic … represent[s] colors using different sounds (white = vocals, blue = trumpet, red = reggae organ) and brighter objects are made to sound louder. The system scans the image left to right and plays the audio representation along with the scan. So objects on the left side sound first and ones on the right sound last.”

Want to learn more? Check out this page with images that have been scanned by EyeMusic. You can listen to the musical representation of the images by clicking the speaker icon (my favorite is the rainbow).

You can read the full article about EyeMusic here.


Related Posts

three photos of feelif camera at work

Assistive Technology

Feelif is making photos and the environment more accessible for kids who are blind!

Feelif just released two applications that will help blind and visually impaired users have a better understanding of their surroundings and of photos.

fingers touching a Feelif screen

Assistive Technology, iPad Apps and Accessibility

Feelif: The Accessible Tactile Tablet for Kids who are Visually Impaired

Feelif is a tactile tablet that is able to combine native features of the Samsung tablet, like vibrations and the built-in screenreader, with a tactile surface to create a whole...

Ivan and his switch

Assistive Technology, Communication

Switch Play: Using a switch for communication and play!

For children who are non-verbal or have low motor coordination, switches can be a great way to augment their play. If you're just getting started with a switch you may...