Detection of Deepfake Video Using Residual Neural Network and Long Short-Term Memory
##plugins.themes.academic_pro.article.sidebar##
##plugins.themes.academic_pro.article.main##
Abstract
The appearance of web-based media has implied genuine and anecdotal stories introduced in such a comparative manner that it can now and then be hard to differentiate the two. Similarly, manipulation of real photos, audios or videos with the help of Artificial Intelligence techniques is done such that it is difficult to distinguish between the real and fake thus called Deepfake. It can happen to big celebrities, politicians, and to layman as well for some malicious purpose. Consequently, this procedure can end up being very threat to human culture subsequently expected to identify it appropriately. This paper intends to tackle this issue by proposing a model that uses Residual Neural Network (ResNet50) and Long Short-term Memory (LSTM) to detect video as fake or real. This approach tries to find flaws in the fake data left behind while its creation using neural based techniques like generative adversarial networks (GAN).
##plugins.themes.academic_pro.article.details##
This work is licensed under a Creative Commons Attribution 4.0 International License.
References
- Agarwal, S., Farid, H., Fried, O., and Agrawala, M. 2020. Detecting deep-fake videos from phoneme-viseme mismatches. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops. DOI: https://doi.org/10.1109/CVPRW50498.2020.00338
- Goyani, M. M. and Patel, N. M. 2017. Judgmental feature based facial expression recognition and fer datasets-a comprehensive study. International Journal of Next-Generation
- Computing, 62–81.
- He, K., Zhang, X., Ren, S., and Sun, J. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition. 770–778. DOI: https://doi.org/10.1109/CVPR.2016.90
- Karandikar, A., Deshpande, V., Singh, S., Nagbhidkar, S., and Agrawal, S. 2020.Deepfake video detection using convolutional neural network. International Journal of Advanced Trends in Computer Science and Engineering 9, 2, 1311–1315. DOI: https://doi.org/10.30534/ijatcse/2020/62922020
- Li, Y., Chang, M.-C., and Lyu, S. 2018. In ictu oculi: Exposing ai created fake videos by detecting eye blinking. In 2018 IEEE International workshop on information forensics and security (WIFS). IEEE, 1–7. DOI: https://doi.org/10.1109/WIFS.2018.8630787
- Li, Y., Yang, X., Sun, P., Qi, H., and Lyu, S. 2020. Celeb-df: A large-scale challenging dataset for deepfake forensics. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 3207–3216. DOI: https://doi.org/10.1109/CVPR42600.2020.00327
- Nguyen, H. H., Yamagishi, J., and Echizen, I. 2019. Capsule-forensics: Using capsule networks to detect forged images and videos. In ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2307–2311. DOI: https://doi.org/10.1109/ICASSP.2019.8682602
- Pan, D., Sun, L., Wang, R., Zhang, X., and Sinnott, R. O. 2020. Deepfake detection through deep learning. In 2020 IEEE/ACM International Conference on Big Data Computing, Applications and Technologies (BDCAT). IEEE, 134–143. DOI: https://doi.org/10.1109/BDCAT50828.2020.00001
- Pulver, A. and Lyu, S. 2017. Lstm with working memory. In 2017 International Joint Conference on neural Networks (IJCNN). IEEE, 845–851. DOI: https://doi.org/10.1109/IJCNN.2017.7965940
- Salmon, B. P., Kleynhans, W., Schwegmann, C. P., and Olivier, J. C. 2015. Proper comparison among methods using a confusion matrix. In 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS). IEEE, 3057–3060. DOI: https://doi.org/10.1109/IGARSS.2015.7326461