Structure-aware deep learning for chronic middle ear disease

•A automatic diagnosis schema for middle ear diseases.•A criterion for choosing 5 CT feature maps to represent the middle ear.•Based on the "one vote veto", our study is biased towards the purpose.•Data augmentation based on the similarity of the left and right middle ears.•The proposed approach achieves the state-of-the-art results.