Constrained mutual convex cone method for image set based recognition

•Propose novel image-set classification frameworks based on convex cone representation.•Define the similarity between two convex cones.•Introduce discriminative feature extraction method based on the gaps among convex cones.•Demonstrate the effectiveness of the proposed methods through visualizations and classification experiments.