Histogram of 3D Facets: A depth descriptor for human action and hand gesture recognition

•A new 3D local shape descriptor for hand gesture and human action recognition from depth sensors.•Extensive results demonstrate the outstanding discriminative power of the proposed descriptor.•The proposed descriptor is compact in dimension, which is thus economic to compute.•A Dynamic Programming based Temporal Segmentation framework to represent dynamic depth videos.