Explainable AI-powered Graph Neural Networks for HD EMG-Based Gesture Intention Recognition

The ability to recognize fine-grained gestures enables several applications in different domains, including healthcare, robotics, remote control, and human-computer interaction. Traditional gesture recognition systems rely on data acquired from cameras, depth sensors, or smart gloves. More recently, techniques for recognizing gestures based on signals acquired by high-density (HD) EMG electrodes worn on the forearm have been proposed. An advantage of these techniques is that they do not rely on the use of external devices, and they are feasible also to people who underwent amputation. Unfortunately, the extraction of complex features from raw HD EMG signals may introduce delays that deter the real-time requirements of the system. To address this issue, in a preliminary investigation we proposed to use graph neural networks for gesture recognition from raw HD EMG data. In this paper, we extend our previous work by exploiting Explainable AI algorithms to automatically refine the graph topology based on the data in order to improve recognition rates and reduce the computational cost. We performed extensive experiments with a large dataset collected from 20 volunteers regarding the execution of 65 fine-grained gestures, comparing our technique with state-of-the-art methods based on handcrafted features and different machine learning algorithms. Experimental results show that our technique outperforms the state of the art in terms of recognition performance while incurring significantly lower computational cost at run-time.