Weakly supervised object detection with 2D and 3D regression neural networks

•A novel weakly supervised detection method based on convolution neural networks.•Encoder-decoder architecture to compute high resolution attention maps.•Networks optimized to estimate the number of lesions in a brain MRI scan.•Gradient methods can perform poorly when saliency alone is not discriminative.•Results close to expert intrarater agreement in the four brain regions studied.