Active, continual fine tuning of convolutional neural networks for reducing annotation efforts

•ACFT dramatically reduces annotation efforts compared with random selection.•ACFT selects the most informative and representative samples for annotation.•ACFT automatically handles noise labels by computing entropy and diversity locally•ACFT strikes a balance between exploration and exploitation by injecting randomization.•ACFT offers a general solution in both medical and natural imaging.