Forensic Symmetry for DeepFakes
IEEE Transactions on Information Forensics and Security(2023)
摘要
In this paper, we propose a new DeepFakes forensics approach called forensic symmetry, which determines whether two symmetrical face patches contain the same or different natural features. To do this, we propose a multi-stream learning structure composed of two feature extractors. The first feature extractor obtains symmetry feature from the front face images. The second feature extractor obtains similarity feature from the side face images. Symmetry feature and similarity feature are collectively called natural feature. Forensic symmetry system maps the pair of symmetrical face patches into the angular hyperspace to quantify the difference of their natural features. The greater the difference of natural features, the higher the tamper probability of face images. The heuristic prediction algorithm is designed to compute the tamper probability of DeepFakes at video level. A series of experiments are carried out to evaluate the effectiveness of our proposed forensic symmetry system. Experimental results show that our approach is effective for DeepFakes detection under the scenarios of homologous detection, heterogeneous detection, and re- compression detection.
更多查看译文
关键词
Faces,Deepfakes,Feature extraction,Forensics,Prediction algorithms,Visualization,Computational modeling,DeepFakes forensics,face symmetry detection,multi-stream learning,multi-margin loss,heuristic prediction
AI 理解论文
溯源树
样例
![](https://originalfileserver.aminer.cn/sys/aminer/pubs/mrt_preview.jpeg)
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要