SOUND·OF·SIGHT
Developed as a data-driven experiment focused on sound, Sound of Sight is an interactive program that allows the user to ‘hear’ and learn about electrical activity that sparks from the retina in response to light. With the intention for clinical integration, the program focuses on demonstrating how this electrical activity changes for those with diabetic retinopathy and the potential for detecting these changes before vision loss occurs.
-
An interaction recording is provided below alongside a downloadable .exe.
-
Absolutely. If you do use it for communication purposes, I’d love to hear about it!
-
Currently, only a .exe is available. If you’re interested in a Mac-friendly version, please don’t hesitate to contact me.
Hear electrical activity from the eye.
Learn the basics of electroretinograms.
See how neurons changes with diabetes.
Hear electrical activity from the eye.
Learn the basics of electroretinograms.
See how neurons changes with diabetes.
How was Sound of Sight made?
-
Electroretinograms
As part of my research, electrical activity was recorded from the diabetic retina in response to flashes of dim light.
-
Data Transformation
After filtering and analyzing ERGs, recorded electrical activity data was transformed into 3D objects in Blender.
-
Audio Generation
Audio representations of 3D objects for retinal electrical activity were created in an oscilloscope environment via OsciStudio
-
Animation and Audio
Animations and final audio components were created with Adobe Creative Cloud to accompany ERGs.
-
Program Development
Using Electron framework, Sound of Sight was finalized as a desktop application for interaction and ease of access.