Learning interlaced sparse Sinkhorn matching network for video super-resolution

•An efficient and effective ISSM module has been designed for feature alignment. To the best of our knowledge, this is the first work to learn optimal matching for VSR.•A Bi-TF model has been developed for temporal fusion, which demonstrates much better performance than the commonly-used fusion techniques in VSR.•Extensive evaluations on three benchmark datasets have demonstrated competing performance of the proposed method against the state-of-the-art methods.