on the generalization of GAN image forensics

on the generalization of GAN image forensics


Recently the GAN generated face images are more and more realistic with high-quality, even hard for human eyes to detect. On the other hand, the forensics community keeps on developing methods to detect these generated fake images and try to guarantee the credibility of visual contents. Although researchers have developed some methods to detect generated images, few of them explore the important problem of generalization ability of forensics model. As new types of GANs are emerging fast, the generalization ability of forensics models to detect new types of GAN images is absolutely an essential research topic. In this paper, we explore this problem and propose to use preprocessed images to train a forensic CNN model. By applying similar image level preprocessing to both real and fake training images, the forensics model is forced to learn more intrinsic features to classify the generated and real face images. Our experimental results also prove the effectiveness of the proposed method.

on the generalization of GAN image forensics

Xinsheng Xuan, Bo Peng, Jing Dong*thanks: * Corresponding author. and Wei Wang thanks: This work is funded by the National Natural Science Foundation of China (Grant No. 61502496, No. 61303262 and No. U1536120) and Beijing Natural Science Foundation (Grant No. 4164102).
National Laboratory of Pattern Recognition, Institute of Automation,
Chinese Academy of Sciences, Beijing 100190
E-mail: xinsheng.xuan@cripac.ia.ac.cn, { bo.peng, jdong, wwang }@nlpr.ia.ac.cn

Index Terms—  GAN, face image forensics, fake image detection, image preprocessing

1 Introduction

Generative Adversarial Networks (GANs) [1] are generative models that learn the distribution of the data without any supervision. Currently, GANs are the most popular and effective generative models for image generation and the generated images could reach very high quality, even human eyes could not tell them apart from real images. Some examples are shown in Fig.1. Owing to the advancement image synthesis of GAN, it also brings a serious forensics problem if we could not distinguish fake image from real ones. For example, DeepFake is a GAN-based technology that can replace a person’s face with another person’s or animal’s face [2]. Criminals can use the generated images to make fake news, and the rumors brought by fake news can have a serious negative impact on our community. In addition, if the generated face can be used to deceive the face recognition system, it will challenge the system security and may cause the collapse of the entire recognition system.

Fig. 1: Generated face image examples with PG-GAN [3].

Although there have been some methods proposed in the literature for detecting AI generated images, existing methods are almost exclusively for the detection of one type of generated images, but the detection performance of other unseen types of generated images is not addressed. As new types of GAN models are emerging quickly, the generalization ability of forensics method to other unseen types of generated fake images is becoming more important for the forensic analysis.

To improve the generalization ability of image forensics model, some primary studies are done in this paper. We adopt a method of image preprocessing, e.g. Gaussian Blur and Gaussian Noise, in the training phase to enhance the generalization ability of our forensics Convolutional Neural Network (CNN) model. The motivation behind using image preprocessing is to improve pixel level statistical similarity between real images and fake images, so that the forensic classifier is forced to learn more intrinsic and meaningful features, rather than the style of the generation model. Hence the classifier will have better generalization ability for the aim of forensic. The experimental results we conduct in this paper also validate the idea of the proposed method.

Fig. 2: The overall framework of the proposed method.

2 Related Work

There are some related work proposed to detect AI generated fake images or videos using deep networks. To detect DeepFake video, different detection methods have been proposed [4, 5, 6, 7, 8]. In [4], the authors propose a temporal-aware CNN-RNN network pipeline to automatically detect DeepFake videos. Li and Lyu [5] found face swap transforms leave distinctive artifacts in the resulting DeepFake videos, and they can be effectively captured by convolutional neural networks. The method in [6] is based on detection of eye blinking in videos, which is a physiological signal that is not well presented in synthesized fake videos. In [7], the authors propose that errors can be revealed when 3D head poses are estimated from the face images, and they further develop a classification method based on this cue. Two network architecture are proposed in [8], which are used to detect fake video generated by Deepfake [2] and Face2Face [9, 10].

Apart from the forensics of DeepFake, some work focus on the detection of GAN generated images [11, 12, 13, 14]. In [11], the authors present a study on the detection of images translation from GANs. But some of them show dramatic impairments on Twitter-like compressed images. Shahroz Tariq et al.[12] use ensemble classifiers to detect fake face images created by GANs. A method based on color statistical features is proposed in [13], and several detection schemes are designed according to the practicability. Nhu-Tai Do et al.[14] proposed another model based on convolutional neural network to detect gernerated face images, which is based on transfer learning from a deep face recognition network. These image forensics methods can perform well on test dataset that is homologous to the training dataset.

However, most of the above work do not pay attention to the generalization ability of their forensics models. They only train and test their methods on the same type of generated image, but the generalization ability to other fake images generated by new GANs models are unknown. An exception is the ForensicTransfer work proposed by Davide Cozzolino et al [15]. The authors use a new autoencoder-based architecture which enforces activations in different parts of a latent vector for the real and fake classes. They devise a learning based forensic detector which adapts well to new domains, and they handle scenarios where only a handful of target domain fake examples are available during training. However, in a real application, we may not have an example images from an unknown generation model. Thus, in this work we propose to improve the generalization ability without using any target domain fake images.

3 Proposed Method

From a machine learning perspective, training and testing are two different phases. In the training stage, the training workflow is as shown in Fig.2. We add an image preprocessing operation in front of the entire network architecture, where image preprocessing operation can be smoothing filtering or adding noise. In the testing stage, we used the network architecture shown in Fig.2. At this stage, we abandon the preprocessing operation, and directly use original images as input.

A key difference of our proposed method from other GAN forensics work is that we use an image preprocessing step in the training stage to destroy low level unstable artifact of GAN images and force the forensics discriminator to focus on more intrinsic forensic clues. In this way, our method is a quite different exploration to existing image forensics or image steganalysis networks [16, 17, 18], where the network is designed to enhance high frequency pixel noise and to focus on the clues in low level pixel statistics. Whereas we intentionally destroy or depress these low level high frequency clues by introducing a preprocessing step using smoothing filtering or noise. By doing this we can improve the low level similarity between real images and fake images, so that the forensic classifier is forced to learn more intrinsic features that have better generalization ability.

In this work, Gaussian blur and Gaussian noise are used as our image preprocessing methods. Adding Gaussian blur and Gaussian noise can both change low level pixel statistics, which serve well for our purpose of depressing low level unstable clues. In order to increase the diversity of training samples, we apply random extent of these preprocessings. The kernel size of Gaussian blur is randomly chosen from 1, 3, 5 and 7 for each training batch. Similarly, the standard deviation of Gaussian noise is randomly set between 0 and 5 for each batch. Note that Gaussian blur of kernel 1 and Gaussian noise of 0 deviation result in no change to the original images.

As our main focus is to verify the effectiveness of proposed preprocessing operation on improving generalization ability, we do not design a complex CNN network architecture. The network architecture of our approach uses a simple DCGAN [19] network’s discriminator network. The whole CNN network architecture is shown in Fig.2. The input of the network are real and fake images, with image size of 128x128. The network is a binary classifier, with four convolutional layers, and all convolutions have stride 2 and padding 1, and all convolution kernel size is 4x4. For the four convolutional layers, we use the Batch Normalization except the first layer, and use Leaky Rectified Linear Unit activation functions that introduce non-linearities. The loss function and optimization algorithm are Binary Cross Entropy Loss and Adaptive Moment Estimation respectively.

At test stage, we use the trained CNN model to make forensic decisions on testing images. A difference from the training stage is that we do not preprocess the testing images. This is because the training images also inclue cases of non-preprocessed images from Gaussian blur of kernel 1 and Gaussian noise of deviation 0.

4 Experiments

4.1 Experimental Setups

For the real face image dataset, we use the CelebA-HQ [3], which contains high quality face images of 1024x1024 resolution. We denote the real images in CelebA-HQ as . As for fake datasets, we use images generated by DCGAN [19], WGAN-GP [21] and PGGAN [3], and they are respectively denoted as , and . For DCGAN and WGAN-GP, we first train the generative models using CelebA [20] dataset, and then use these trained GAN models to generate fake face images. The PGGAN model is a high quality image generation model based on progressive growing. Due to the long training time of the PGGAN model, we directly download fake image dataset provided by authors [3]. The size of images generated by DCGAN and WGAN-GP models is 128x128, and this is the input image size that our CNN model requires. However, the size of both real images and PG-GAN generated images is of high resolution 1024x1024, so we resize them to 128x128.

In our experiments, we train our CNN forensics model on only and datasets, and the rest two generated datasets and are just used for testing the generalization ability of trained model. Here images in and are treated as unseen generated images from new GANs that are different from the training data. The and datasets each has 20K images, where the first 10K images are used for model training and the last 10K for testing. The and datasets each contains 10K images for testing generalization ability.

No. Detector model Testing set ACC(%) TPR(%) TNR(%)
+ 95.45 95.12 95.77
+ 94.28 93.08 95.47
+ 95.02 94.65 95.38
+ 64.62 95.12 34.12
+ 68.07 93.08 43.06
+ 68.28 94.65 41.91
+ 60.55 95.12 25.98
+ 64.05 93.08 35.02
+ 66.38 94.65 38.11

Table 1: Detection results of models in different preprocessing operations

The model trained on and without any image preprocessing is denoted as . For the other two models, the training dataset is processed by Gaussian blur or Gaussian noise, which respectively are denoted as and . Then, we use testing images in , , and to test , and separately. The performance is measured by overall accuracy (ACC), true positive rate (TPR) and true negative rate (TNR), where positive means real images and negative means fake images.

4.2 Improvement of Model Generalization

The experimental results are shown in Table.1. The experiment is divided into three parts by different test datasets. The test datasets of the first row to the third row are and , the test datasets of the fourth row to the sixth row are and , and the test datasets of the seventh row to the ninth row are and . Compare the model without image preprocessing operation on row 1 and the and models with image preprocessing operations on row 2 and row 3, ACC, TPR and TNR are almost constant after adding preprocessing. And this means that the proposed method does not damage the model and is relatively stable. From the first three row, it can also be seen that testing on the data which is from the same domain as training data can achieve very high classification performance.

From the data of row 1 we can observe that the detection ACC, TPR and TNR are all higher than 95% on testing dataset of the same type as training dataset, but the ACC and TNR on rows 4 and 7 are both significantly lower than those in row 1. This result means that the generalization ability of the model on unseen types of fake images is bad.

Compare row 4 and rows 5, 6 in Table.1, with the test dataset is and , we can see that our trained model can improve the TNR by around 10 percents and the overall ACC is also improved. And this can show that the method of preprocessing operation is effective for improving generalization ability on unseen generated images. Similarly, comparing row 7 and rows 8, 9, TNR also has an improvement of about 10 percents. Although the performance increment is not all that large due to the inherent difficulty of this problem, it is sufficient to show that our methods can improve generalization ability on unseen types of fake image datasets.

From the experimental results, it can be seen that the proposed image preprocessing method can actually lead to a certain improvement of generalization, although the increment is not quite large. After our analysis, we believe that the reason for the difficulty in forensics generalization may be as shown in Fig.3. There are many types of generator models, and likely to be more in the future, and the distribution of images generated by each model may vary greatly. As shown in Fig.3, Fake1, Fake2 and Fake3 belong to differently distributed fake images. Although they are all fake images, the distribution difference between them is quite large. Therefore, to train a forensics model which can generalize to future unknown generated fake images is a very challenging task. We hope researchers can carry on in this line of research in the future to develop more and more effective solutions.

Fig. 3: Possible distribution of real and fake images simplified on a two-dimensional feature space.

5 Conclusion

In this paper, we have investigated the issue of generalization ability of detection model for generated images. We found that most of the existing detection models did not pay attention to the improvement of generalization capabilities. Based on the observations, we propose to improve the generalization ability of a CNN forensics model by adding an image preprocessing step before training to force the discriminator to learn more intrinsic and generalizable features. To evaluate the performance of the proposed method, extensive experiments have been conducted. The experimental results show that our approach is effective in improving generalization, although the performance increment is not all that large due to the inherent difficulty of this problem. Observed from the experiments, the distribution of fake images generated by different models may be quite different. In the future, we will continue to optimize the generalization of the detection model in other ways.


  • [1] Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio, “Generative adversarial nets,” in Advances in neural information processing systems, 2014, pp. 2672–2680.
  • [2] “Deepfake,” https://github.com/deepfakes/faceswap.
  • [3] Tero Karras, Timo Aila, Samuli Laine, and Jaakko Lehtinen, “Progressive growing of gans for improved quality, stability, and variation,” arXiv preprint arXiv:1710.10196, 2017.
  • [4] David Güera and Edward J Delp, “Deepfake video detection using recurrent neural networks,” in IEEE International Conference on Advanced Video and Signal-based Surveillance (to appear), 2018.
  • [5] Yuezun Li and Siwei Lyu, “Exposing deepfake videos by detecting face warping artifacts,” arXiv preprint arXiv:1811.00656, 2018.
  • [6] Yuezun Li, Ming-Ching Chang, Hany Farid, and Siwei Lyu, “In ictu oculi: Exposing ai generated fake face videos by detecting eye blinking,” arXiv preprint arXiv:1806.02877, 2018.
  • [7] Xin Yang, Yuezun Li, and Siwei Lyu, “Exposing deep fakes using inconsistent head poses,” arXiv preprint arXiv:1811.00661, 2018.
  • [8] Darius Afchar, Vincent Nozick, Junichi Yamagishi, and Isao Echizen, “Mesonet: a compact facial video forgery detection network,” arXiv preprint arXiv:1809.00888, 2018.
  • [9] Justus Thies, Michael Zollhofer, Marc Stamminger, Christian Theobalt, and Matthias Nießner, “Face2face: Real-time face capture and reenactment of rgb videos,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016, pp. 2387–2395.
  • [10] Andreas Rössler, Davide Cozzolino, Luisa Verdoliva, Christian Riess, Justus Thies, and Matthias Nießner, “Faceforensics: A large-scale video dataset for forgery detection in human faces,” arXiv preprint arXiv:1803.09179, 2018.
  • [11] Francesco Marra, Diego Gragnaniello, Davide Cozzolino, and Luisa Verdoliva, “Detection of gan-generated fake images over social networks,” in 2018 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR). IEEE, 2018, pp. 384–389.
  • [12] Shahroz Tariq, Sangyup Lee, Hoyoung Kim, Youjin Shin, and Simon S Woo, “Detecting both machine and human created fake face images in the wild,” in Proceedings of the 2nd International Workshop on Multimedia Privacy and Security. ACM, 2018, pp. 81–87.
  • [13] Haodong Li, Bin Li, Shunquan Tan, and Jiwu Huang, “Detection of deep network generated images using disparities in color components,” arXiv preprint arXiv:1808.07276, 2018.
  • [14] Tai Do Nhu, In Na, and S.H. Kim, “Forensics face detection from gans using convolutional neural network,” 10 2018.
  • [15] Davide Cozzolino, Justus Thies, Andreas Rössler, Christian Riess, Matthias Nießner, and Luisa Verdoliva, “Forensictransfer: Weakly-supervised domain adaptation for forgery detection,” arXiv preprint arXiv:1812.02510, 2018.
  • [16] Yinlong Qian, Jing Dong, Wei Wang, and Tieniu Tan, “Deep learning for steganalysis via convolutional neural networks,” in Media Watermarking, Security, and Forensics 2015. International Society for Optics and Photonics, 2015, vol. 9409, p. 94090J.
  • [17] Belhassen Bayar and Matthew C Stamm, “A deep learning approach to universal image manipulation detection using a new convolutional layer,” in Proceedings of the 4th ACM Workshop on Information Hiding and Multimedia Security. ACM, 2016, pp. 5–10.
  • [18] Pengpeng Yang, Rongrong Ni, and Yao Zhao, “Recapture image forensics based on laplacian convolutional neural networks,” in International Workshop on Digital Watermarking. Springer, 2016, pp. 119–128.
  • [19] Alec Radford, Luke Metz, and Soumith Chintala, “Unsupervised representation learning with deep convolutional generative adversarial networks,” arXiv preprint arXiv:1511.06434, 2015.
  • [20] Ziwei Liu, Ping Luo, Xiaogang Wang, and Xiaoou Tang, “Deep learning face attributes in the wild,” in Proceedings of the IEEE International Conference on Computer Vision, 2015, pp. 3730–3738.
  • [21] Ishaan Gulrajani, Faruk Ahmed, Martin Arjovsky, Vincent Dumoulin, and Aaron C Courville, “Improved training of wasserstein gans,” in Advances in Neural Information Processing Systems, 2017, pp. 5767–5777.
Comments 2
Request Comment
The feedback must be of minimum 40 characters and the title a minimum of 5 characters
Add comment
Loading ...
This is a comment super asjknd jkasnjk adsnkj
The feedback must be of minumum 40 characters
The feedback must be of minumum 40 characters

You are asking your first question!
How to quickly get a good answer:
  • Keep your question short and to the point
  • Check for grammar or spelling errors.
  • Phrase it like a question
Test description