Multimodal Approach for the Diagnosis of Neurodegenerative Disorders Using Augmented Reality.
IEEE Conference on Virtual Reality and 3D User Interfaces(2024)
Abstract
This study introduces an innovative multimodal strategy for diagnosing neurodegenerative disorders by integrating Augmented/Mixed Reality. Our primary focus involves harnessing AR goggles to capture Parkinson's Disease symptoms, reshaping our comprehension of brain-related disorders. Through meticulous sensor data and technical intricacies like hand movements, gait and gaze analysis, our system offers a transformative approach to patient care. At its core, our work features an autonomous game-alike experience - a 30-minute journey encompassing 17 varied tasks seamlessly inte-grating motor skills, gait and gaze exercises, speech tasks, memory challenges, and cognitive exercises. This gamified platform, coupled with clinical tests, delivers a holistic assessment of patients' physical and cognitive capabilities. By automating tasks and leveraging AR glasses for enhanced patient comfort, our approach not only capti-vates patients but also emerges as a potent diagnostic tool, heralding an era of interactive neurodiagnostics where innovation converges with patient engagement.
MoreTranslated text
Key words
Applied computing—Life and medical sciences—Health informatics—,Mixed Reality—Multimodal signals—Gait analysis—Hand-related analysisSpeech analysisGaze analysisPosture stability
AI Read Science
Must-Reading Tree
Example
![](https://originalfileserver.aminer.cn/sys/aminer/pubs/mrt_preview.jpeg)
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined