Let Real Images be as a Judger, Spotting Fake Images Synthesized with Generative Models
arxiv(2024)
摘要
In the last few years, generative models have shown their powerful
capabilities in synthesizing realistic images in both quality and diversity
(i.e., facial images, and natural subjects). Unfortunately, the artifact
patterns in fake images synthesized by different generative models are
inconsistent, leading to the failure of previous research that relied on
spotting subtle differences between real and fake. In our preliminary
experiments, we find that the artifacts in fake images always change with the
development of the generative model, while natural images exhibit stable
statistical properties. In this paper, we employ natural traces shared only by
real images as an additional predictive target in the detector. Specifically,
the natural traces are learned from the wild real images and we introduce
extended supervised contrastive learning to bring them closer to real images
and further away from fake ones. This motivates the detector to make decisions
based on the proximity of images to the natural traces. To conduct a
comprehensive experiment, we built a high-quality and diverse dataset that
includes generative models comprising 6 GAN and 6 diffusion models, to evaluate
the effectiveness in generalizing unknown forgery techniques and robustness in
surviving different transformations. Experimental results show that our
proposed method gives 96.1
Extensive experiments conducted on the widely recognized platform Midjourney
reveal that our proposed method achieves an accuracy exceeding 78.4
underscoring its practicality for real-world application deployment. The source
code and partial self-built dataset are available in supplementary material.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要