Deep metric learning for otitis media classification

•Deep metric learning can be used to classify otitis media in otoscopy images.•Manual classification is observer dependent and suffers from variable accuracy.•Triplet loss captures the variation of an unbalanced data very well.•Using triplet loss, a high accuracy of 85% was achieved.•Presence of ear wax and blurry images pose classification challenges.