Content-based image retrieval for the diagnosis of myocardial perfusion imaging using a deep convolutional autoencoder

Background Single-photon emission computed tomography (SPECT) myocardial perfusion imaging (MPI) plays a crucial role in the optimal treatment strategy for patients with coronary heart disease. We tested the feasibility of feature extraction from MPI using a deep convolutional autoencoder (CAE) model. Methods Eight hundred and forty-three pairs of stress and rest myocardial perfusion images were collected from consecutive patients who underwent cardiac scintigraphy in our hospital between December 2019 and February 2022. We trained a CAE model to reproduce the input paired image data, so as the encoder to output a 256-dimensional feature vector. The extracted feature vectors were further dimensionally reduced via principal component analysis (PCA) for data visualization. Content-based image retrieval (CBIR) was performed based on the cosine similarity of the feature vectors between the query and reference images. The agreement of the radiologist’s finding between the query and retrieved MPI was evaluated using binary accuracy, precision, recall, and F1-score. Results A three-dimensional scatter plot with PCA revealed that feature vectors retained clinical information such as percent summed difference score, presence of ischemia, and the location of scar reported by radiologists. When CBIR was used as a similarity-based diagnostic tool, the binary accuracy was 81.0%. Conclusion The results indicated the utility of unsupervised feature learning for CBIR in MPI. Graphical abstract