Generalized Fake Image Detection Method Based on Gated Hierarchical Multi-Task Learning
IEEE SIGNAL PROCESSING LETTERS(2023)
Abstract
Recently, the abuse of image generation techniques based on artificial intelligence has posed a great threat to the integrity of digital images. However, existing detection methods are hard to provide generalized detection capability of fake images generated by unseen models. To address this issue, we propose a generalized fake image detection framework based on gated hierarchical multi-task learning, which is supervised by well-designed forensics sub-tasks. Firstly, a global artifact learning task is constructed as binary classification with region masking augmentation. Besides, a block-wise spatial correlation learning task is designed by solving jigsaw puzzle cooperated with color jitter operations, which aims to explore common artifacts of various generators. Finally, a hierarchical multi-task learning paradigm is developed with multi-gate structures, which can adjust the importance of different forensics clues and jointly enhance detection performance. Extensive experiments have been conducted to evaluate the superiority of the proposed method on the open-set scenario with unseen generators.
MoreTranslated text
Key words
Image forensics,fake image detection,hierarchical multi-task learning,multi-gate structure
AI Read Science
Must-Reading Tree
Example
![](https://originalfileserver.aminer.cn/sys/aminer/pubs/mrt_preview.jpeg)
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined