Exploring the relationship between children's facial emotion processing characteristics and speech communication ability using deep learning on eye tracking and speech performance measures

The ability of efficient facial emotion recognition (FER) plays a significant role in successful human communication and is closely associated with multiple speech communication disorders (SCD) in children. Despite the relevance, little is known about how speech communication abilities (SCA) and FER are correlated or of their underlying mechanism. To address this, we monitored eye movements of 115 children while watching human faces with different emotions and designed a machine-learning based SCD prediction model to explore the underlying pattern of eye movements during the FER task as well as their correlation with SCA. Strong and detailed correlations were found between different dimensions of SCA and various eye-movement features. A group of FER gazing patterns was found to be highly sensitive to the possibility of children's SCD. The SCD prediction model reached an accuracy as high as 88.9%, which offers a possible technique to fast screen SCD for children.