Learning inter- and intraframe representations for non-Lambertian photometric stereo

•A two-stage CNN architecture are designed to construct inter- and intraframe representations for photometric stereo.•The easily obtained object mask is utilized to adverse interference from invalid background regions.•The proposed method is capable of predicting accurate surface normal details for non-Lambertian objects and performs well with sparse input frames.