Co-attentive multi-task convolutional neural network for facial expression recognition

•Unlike previous hard parameter sharing methods, we introduce FLD as the auxiliary task of FER based on soft parameter sharing methods.•Based on the cross-stitch network, we propose an end-to-end co-attentive convolutional neural network.•We conduct detailed experiments to analyze all aspects of our method, which validate the effectiveness and generalizability of our approach.