Atlas-ISTN: Joint segmentation, registration and atlas construction with image-and-spatial transformer networks

•A deep learning framework for atlas construction, registration and segmentation.•Generates a population-derived atlas within a deep learning framework.•A robust segmentation system which preserves topology of test time predictions.•Inter-subject correspondence is provided by mapping subjects to atlas space.