A Sensory Substitution Device Inspired By The Human Visual System
2018 11TH INTERNATIONAL CONFERENCE ON HUMAN SYSTEM INTERACTION (HSI)(2018)
摘要
The purpose of this paper is to introduce and initially evaluate an experimental sensory substitution device (SSD), which converts color to audible sound. Our system, called Colorophone provides continuous information about the color, light intensity and distance. The color sonification method is inspired by the human visual system. While designing sonification method we took into consideration mismatch in sensory bandwidth, possible sensory overload, nature of sensory spatiotemporal continuity and cross-modal correspondences between colors and sounds. We conducted a preliminary experimental evaluation of the color and object recognition abilities as well as orientation ability. We show that blindfolded participants can easily acquire the color information coded in the auditory stimuli generated by the Colorophone system after a short learning session. Our preliminary experiments indicate that sonified color information helps in object identification and enhances orientation ability. The Colorophone proved to be an easy to understand and intuitive visual-to-auditory coding system, which shows promising results in future visual rehabilitation of the blind.
更多查看译文
关键词
Assistive devices, sensory substitution, image sonification, blindness, sensory aids
AI 理解论文
溯源树
样例
![](https://originalfileserver.aminer.cn/sys/aminer/pubs/mrt_preview.jpeg)
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要