A Bibliometric Analysis of Deepfakes : Trends, Applications and Challenges

Diya Garg; Rupali Gill

doi:10.4108/eetsis.4883

Authors

Diya Garg Chitkara University
Rupali Gill Chitkara University

DOI:

https://doi.org/10.4108/eetsis.4883

Keywords:

Deep Learning, deepfakes, Artificial Intelligence, Bibliometric analysis, Deepfake Application, Deepfake challenges

Abstract

INTRODUCTION: The rapid progress in artificial intelligence (AI) over the past decade has ushered in a new era of transformative technologies. Deep learning has emerged as a potential tool, demonstrating remarkable capabilities in various applications. This paper focuses on one of the controversial applications of deep learning commonly known as deepfakes.
OBJECTIVES: The main objective of this comprehensive bibliometric survey is to explore the trends, applications and challenges of deepfakes over the course of last 4.5 years.
METHODS: In this research, a total of 794 documents published from 2019 to July 2023 were acquired from Scopus database. To conduct this bibliometric analysis, RStudio and VOSviewer tools have been used. In this current analysis, deepfake challenges, countries, sources, top 20 cited documents, and research trends in the field of deepfake have been included.
RESULTS: The analysis highlights a substantial increase in deepfake publications from January 2019 to July 2023. Out of the 8 document types identified 38% are article publications. In addition, from the journal articles it has been depicted that the journal source entitled "Advances in Computer Vision and Pattern Recognition" holds Q1 status with 8.3% publications in the deepfakes domain during the targeted year range. Moreover, the data visualizations reveal the growing international collaboration, with the USA as the most prolific country in deepfake research.
CONCLUSION: Despite numerous reviews on deepfakes, there has been a notable absence of comprehensive scientometric analyses. This paper fills this gap through a bibliometric study using the Scopus database as urderlying source. The analysis includes keyword analysis, leading research-contributing institutes, co-country collaboration, and co-keyword occurrence. The findings offer valuable insights for scholars, providing a foundational understanding including document types, prominent journals, international collaboration trends, and influential institutions and offering valuable guidance for future scholarly pursuits in this evolving field.

References

Leandro A Passos, Danilo Jodas, Kelton AP da Costa, Luis A Souza Júnior, Douglas Rodrigues, Javier Del Ser, David Camacho, and João Paulo Papa. A review of deep learning-based approaches for deepfake content detection. arXiv preprint arXiv:2202.06095, 2022.

Abdulqader M Almars. Deepfakes detection techniques using deep learning: a survey. Journal of Computer and Communications, 9(05):20–35, 2021.

P Marcel. Deepfakes: a new threat to face recognition. Assessment and detection, 2018.

Ai-powered deepfakes bare fangs in 2023, raise concern about impact on privacy, electoral politics — thehindubusinessline.com. https://www.thehindubusinessline.com/info-tech/ai-powered-deepfakes-bare-fangs-in-2023-raise-concern-about-impact-on-privacy-electoral-politics/article67692281.ece, 2023. [online; accessed 01-january-2024].

Neha Sandotra and Bhavna Arora. A comprehensive evaluation of feature-based ai techniques for deepfake detection. Neural Computing and Applications, pages 1– 29, 2023.

What is deepfake AI? A definition from WhatIs.com. https://www.techtarget.com/whatis/definition/deepfake, 2022. [Online; accessed 16-December-2023].

Behind the scenes of TV’s first deep fake comedy: “None of it is illegal. Everything is silly.” The Guardian . https://www.theguardian.com/tv-and-radio/2023/jan/09/deep-fake-neighbour-wars-interview-itvx-comedy, 2022. [Online; accessed 16-December-2023].

Rashmika Mandanna deepfake case: Four suspects tracked by Delhi Police, search on to nab key conspirator . https://www.businesstoday.in/latest/trends/story/rashmika-mandanna-deepfake-case-four-suspects-tracked-by-delhi-police-search-on-to-nab-key-conspirator, 2023. [Online; accessed 15-December-2023].

Don’t believe your eyes: Exploring the positives and negatives of deepfakes. AI News . https://www.artificialintelligence-news.com/2019/08/05/dont-believe-your-eyes-exploring-the-positives-and-negatives-of-deepfakes/, 2019. [Online; accessed 19-November-2023].

Christian Rathgeb, Daniel Fischer, Pawel Drozdowski, and Christoph Busch. Reliable detection of doppelgängers based on deep face representations. IET Biometrics, 11(3):215–224, 2022.

Huy H Nguyen, Junichi Yamagishi, and Isao Echizen. Capsule-forensics networks for deepfake detection. In Handbook of Digital Face Manipulation and Detection: From DeepFakes to Morphing Attacks, pages 275–301. Springer International Publishing Cham, 2022.

Ruben Tolosana, Christian Rathgeb, Ruben Vera- Rodriguez, Christoph Busch, Luisa Verdoliva, Siwei Lyu, Huy H Nguyen, Junichi Yamagishi, Isao Echizen, Peter Rot, et al. Future trends in digital face manipulation and detection. In Handbook of Digital Face Manipulation and Detection: From DeepFakes to Morphing Attacks, pages 463–482. Springer, 2022.

Davide Cozzolino, Giovanni Poggi, and Luisa Verdoliva. Data-driven digital integrity verification. In Multimedia Forensics, pages 281–311. Springer Singapore Singapore, 2022.

Sumaiya Thaseen Ikram, Shourya Chambial, Dhruv Sood, et al. A performance enhancement of deepfake video detection through the use of a hybrid cnn deep learning model. International journal of electrical and computer engineering systems, 14(2):169–178, 2023.

Siva Ramakrishna Nallapati, Dhiren Dommeti, Saket Medhalavalasa, Kranthi Kiran Bonku, PVVS Srinivas, and Debnath Bhattacharyya. Identification of deepfakes using strategic models and architectures. In 2023 International Conference on Sustainable Computing and Data Communication Systems (ICSCDS), pages 75–82. IEEE, 2023.

Davide Salvi, Honggu Liu, Sara Mandelli, Paolo Bestagini, Wenbo Zhou, Weiming Zhang, and Stefano Tubaro. A robust approach to multimodal deepfake detection. Journal of Imaging, 9(6):122, 2023.

Lulu Tian, Hongxun Yao, and Ming Li. Fakepoi: A largescale fake person of interest video detection benchmark and a strong baseline. IEEE Transactions on Circuits and Systems for Video Technology, 2023.

Irene Amerini and Roberto Caldelli. Exploiting prediction error inconsistencies through lstm-based classifiers to detect deepfake videos. In Proceedings of the 2020 ACM workshop on information hiding and multimedia security, pages 97–102, 2020.

Shahroz Tariq, Sangyup Lee, and Simon Woo. One detector to rule them all: Towards a general deepfake attack detection framework. In Proceedings of the web conference 2021, pages 3625–3637, 2021.

Yuval Nirkin, Lior Wolf, Yosi Keller, and Tal Hassner. Deepfake detection based on discrepancies between faces and their context. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(10):6111–6121, 2021.

Yuezun Li and Siwei Lyu. Exposing deepfake videos by detecting face warping artifacts. arXiv preprint arXiv:1811.00656, 2018.

Manoj Kumar, Hitesh Kumar Sharma, et al. A gan-based model of deepfake detection in social media. Procedia Computer Science, 218:2153–2162, 2023.

Jacob Mallet, Laura Pryor, Rushit Dave, and Mounika Vanamala. Deepfake detection analyzing hybrid dataset utilizing cnn and svm. In Proceedings of the 2023 7th International Conference on Intelligent Systems, Metaheuristics & Swarm Intelligence, pages 7–11, 2023.

Fatima Khalid, Ali Javed, Aun Irtaza, and Khalid Mahmood Malik. Deepfakes catcher: a novel fused truncated densenet model for deepfakes detection. In Proceedings of International Conference on Information Technology and Applications: ICITA 2022, pages 239–250. Springer, 2023.

Ameni Jellali, Ines Ben Fredj, and Kaïs Ouni. An approach of fake videos detection based on haar cascades and convolutional neural network. In 2023 IEEE International Conference on Advanced Systems and Emergent Technologies (IC_ASET), pages 01–06. IEEE, 2023.

Umar Masud, Mohd Sadiq, Sarfaraz Masood, Musheer Ahmad, and Ahmed A Abd El-Latif. Lw-deepfakenet: a lightweight time distributed cnn-lstm network for realtime deepfake video detection. Signal, Image and Video Processing, 17(8):4029–4037, 2023.

Pallabi Saikia, Dhwani Dholaria, Priyanka Yadav, Vaidehi Patel, and Mohendra Roy. A hybrid cnn-lstm model for video deepfake detection by leveraging optical flow features. In 2022 international joint conference on neural networks (IJCNN), pages 1–7. IEEE, 2022.

Shu Hu, Yuezun Li, and Siwei Lyu. Exposing gangenerated faces using inconsistent corneal specular highlights. In ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 2500–2504. IEEE, 2021.

Zhengzhe Liu, Xiaojuan Qi, and Philip HS Torr. Global texture enhancement for fake face detection in the wild. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 8060–8069, 2020.

Run Wang, Felix Juefei-Xu, Lei Ma, Xiaofei Xie, Yihao Huang, Jian Wang, and Yang Liu. Fakespotter: A simple yet robust baseline for spotting ai-synthesized fake faces. arXiv preprint arXiv:1909.06122, 2019.

Shruti Agarwal, Hany Farid, Tarek El-Gaaly, and Ser- Nam Lim. Detecting deep-fake videos from appearance and behavior. In 2020 IEEE international workshop on information forensics and security (WIFS), pages 1–6. IEEE, 2020.

Simranjeet Singh, Rajneesh Sharma, and Alan F Smeaton. Using gans to synthesise minimum training data for deepfake generation. arXiv preprint arXiv:2011.05421, 2020.

Yunjey Choi, Youngjung Uh, Jaejun Yoo, and Jung-Woo Ha. Stargan v2: Diverse image synthesis for multiple domains. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 8188–8197, 2020.

Jiangning Zhang, Xianfang Zeng, Mengmeng Wang, Yusu Pan, Liang Liu, Yong Liu, Yu Ding, and Changjie Fan. Freenet: Multi-identity face reenactment. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 5326–5335, 2020.

Yuval Nirkin, Yosi Keller, and Tal Hassner. Fsgan: Subject agnostic face swapping and reenactment. In Proceedings of the IEEE/CVF international conference on computer vision, pages 7184–7193, 2019.

Ming Liu, Yukang Ding, Min Xia, Xiao Liu, Errui Ding, Wangmeng Zuo, and Shilei Wen. Stgan: A unified selective transfer network for arbitrary image attribute editing. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 3673–3682, 2019.

Nicolo Bonettini, Edoardo Daniele Cannas, Sara Mandelli, Luca Bondi, Paolo Bestagini, and Stefano Tubaro. Video face manipulation detection through ensemble of cnns. In 2020 25th international conference on pattern recognition (ICPR), pages 5012–5019. IEEE, 2021.

Isnaini Imroatus Solichah, Faizin Sulistio, and Milda Istiqomah. Protection of victims of deep fake pornography in a legal perspective in indonesia. International Journal of Multicultural and Multireligious Understanding, 10(1):383–390, 2023.

New deepfake AI tech creates videos using one image.https://blooloop.com/technology/news/samsung-ai-deepfake-video-museum-technology/, 2021. [Online; accessed 16-November-2023].

Anna Broinowski. Deepfake nightmares, synthetic dreams: A review of dystopian and utopian discourses around deepfakes, and why the collapse of reality may not be imminent—yet. Journal of Asia-Pacific Pop Culture, 7(1):109–139, 2022.

Ravneet Kaur, Ramkumar Ketti Ramachandran, Robin Doss, and Lei Pan. A multi-domain perspective of future directions for vanets for emergency message dissemination. IoT-Enabled Smart Healthcare Systems, Services and Applications, pages 199–218, 2022.

Chaitanya Singla and Sukhdev Singh. Pemo: A new validated dataset for punjabi speech emotion detection.

Catherine Stupp. Fraudsters used ai to mimic ceo’s voice in unusual cybercrime case. The Wall Street Journal, 30 (08), 2019.

Hanxiang Hao, Emily R Bartusiak, David Güera, Daniel Mas Montserrat, Sriram Baireddy, Ziyue Xiang, Sri Kalyan Yarlagadda, Ruiting Shao, János Horváth, Justin Yang, et al. Deepfake detection using multiple data modalities. In Handbook of Digital Face Manipulation and Detection: From DeepFakes to Morphing Attacks, pages 235–254. Springer International Publishing Cham, 2022.

Chaitanya Singla and Sukhdev Singh. Punjabi speech emotion recognition using prosodic, spectral and wavelet features. In 2022 10th International Conference on Emerging Trends in Engineering and Technology-Signal and Information Processing (ICETET-SIP-22), pages 1–6. IEEE, 2022.

Why the Manoj Tiwari deepfakes should have India deeply worried . https://theprint.in/tech/why-the-manoj-tiwari-deepfakes-should-have-india-deeply-worried/372389/, 2020. [Online; accessed 19-September-2023].

Shilpi Harnal, Gaurav Sharma, Anupriya, Anand Muni Mishra, Deepak Bagga, Nikhil Saini, Pankaj Kumar Goley, and Kumar Anupam. Bibliometric mapping of theme and trends of augmented reality in the field of education. Journal of Computer Assisted Learning, 2023.

Gartner Identifies Four Emerging Technologies Expected to Have Transformational Impact on Digital Advertising . https://www.gartner.com/en/newsroom/press-releases/2022-08-03-gartner-identifies-four-emerging-technologies-expected-to-have-transformational-impact-on-digital-advertising, 2022. [Online; accessed 19-November-2023].

Yuezun Li, Pu Sun, Honggang Qi, and Siwei Lyu. Toward the creation and obstruction of deepfakes. In Handbook of Digital Face Manipulation and Detection: From DeepFakes to Morphing Attacks, pages 71–96. Springer International Publishing Cham, 2022.

Rosa Gil, Jordi Virgili-Gomà, Juan-Miguel López-Gil, and Roberto García. Deepfakes: evolution and trends. Soft Computing, pages 1–24, 2023.

Ruben Tolosana, Ruben Vera-Rodriguez, Julian Fierrez, Aythami Morales, and Javier Ortega-Garcia. An introduction to digital face manipulation. In Handbook of Digital Face Manipulation and Detection: From DeepFakes to Morphing Attacks, pages 3–26. Springer International Publishing Cham, 2022.

Lucas Whittaker, Rory Mulcahy, Kate Letheren, Jan Kietzmann, and Rebekah Russell-Bennett. Mapping the deepfake landscape for innovation: A multidisciplinary systematic review and future research agenda. Technovation, 125:102784, 2023.

Xueqian Yu, Yanning Chen, Yueyang Li, Jialan Hong, and Fang Hua. A bibliometric mapping study of the literature on oral health-related quality of life. Journal of Evidence-Based Dental Practice, 23(1):101780, 2023.

Waqas Liaqat, Muhammad Tanveer Altaf, Celaleddin Barutçular, Ehab M Zayed, and Touseef Hussain. Drought and sorghum: a bibliometric analysis using vos viewer. Journal of Biomolecular Structure and Dynamics, pages 1–13, 2023.

Yuezun Li, Xin Yang, Pu Sun, Honggang Qi, and Siwei Lyu. Celeb-df: A large-scale challenging dataset for deepfake forensics. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 3207–3216, 2020.

Falko Matern, Christian Riess, and Marc Stamminger. Exploiting visual artifacts to expose deepfakes and face manipulations. In 2019 IEEE Winter Applications of Computer Vision Workshops (WACVW), pages 83–92. IEEE, 2019.

Sheng-Yu Wang, Oliver Wang, Richard Zhang, Andrew Owens, and Alexei A Efros. Cnn-generated images are surprisingly easy to spot... for now. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 8695–8704, 2020.

Renu Popli, Isha Kansal, Chaitanya Singla, and Devendra Prasad. A systematic review on techniques of facemask detection using digital images. In 2021 9th International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions)(ICRITO), pages 1–6. IEEE, 2021.

Ruben Tolosana, Ruben Vera-Rodriguez, Julian Fierrez, Aythami Morales, and Javier Ortega-Garcia. Deepfakes and beyond: A survey of face manipulation and fake detection. Information Fusion, 64:131–148, 2020.

Luisa Verdoliva. Media forensics and deepfakes: an overview. IEEE Journal of Selected Topics in Signal Processing, 14(5):910–932, 2020.

Mika Westerlund. The emergence of deepfake technology: A review. Technology innovation management review, 9(11), 2019.

Cristian Vaccari and Andrew Chadwick. Deepfakes and disinformation: Exploring the impact of synthetic political video on deception, uncertainty, and trust in news. Social Media+ Society, 6(1):2056305120903408, 2020.

Haya R Hasan and Khaled Salah. Combating deepfake videos using blockchain and smart contracts. Ieee Access, 7:41596–41606, 2019.

Jan Kietzmann, LindaWLee, Ian P McCarthy, and Tim C Kietzmann. Deepfakes: Trick or treat? Business Horizons, 63(2):135–146, 2020.

Ricard Durall, Margret Keuper, and Janis Keuper. Watch your up-convolution: Cnn based generative deep neural networks are failing to reproduce spectral distributions. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 7890–7899, 2020.

Iacopo Masi, Aditya Killekar, Royston Marian Mascarenhas, Shenoy Pratik Gurudatt, and Wael AbdAlmageed. Two-branch recurrent network for isolating deepfakes in videos. In Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part VII 16, pages 667–684. Springer, 2020.

Lakshmanan Nataraj, Tajuddin Manhar Mohammed, Shivkumar Chandrasekaran, Arjuna Flenner, Jawadul H Bappy, Amit K Roy-Chowdhury, and BS Manjunath. Detecting gan generated fake images using cooccurrence matrices. arXiv preprint arXiv:1903.06836,

Luca Guarnera, Oliver Giudice, and Sebastiano Battiato. Deepfake detection by analyzing convolutional traces. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops, pages 666–667, 2020.

Tackhyun Jung, Sangwon Kim, and Keecheon Kim. Deepvision: Deepfakes detection using human eye blinking pattern. IEEE Access, 8:83144–83154, 2020.

Trisha Mittal, Uttaran Bhattacharya, Rohan Chandra, Aniket Bera, and Dinesh Manocha. Emotions don’t lie: An audio-visual deepfake detection method using affective cues. In Proceedings of the 28th ACM international conference on multimedia, pages 2823–2832, 2020.

Bojia Zi, Minghao Chang, Jingjing Chen, Xingjun Ma, and Yu-Gang Jiang. Wilddeepfake: A challenging realworld dataset for deepfake detection. In Proceedings of the 28th ACM international conference on multimedia, pages 2382–2390, 2020.

Hasam Khalid and Simon S Woo. Oc-fakedect: Classifying deepfakes using one-class variational autoencoder. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops, pages 656–657, 2020.

Pavel Korshunov and Sébastien Marcel. Vulnerability assessment and detection of deepfake videos. In 2019 International Conference on Biometrics (ICB), pages 1–6. IEEE, 2019.

Luciano Floridi. Artificial intelligence, deepfakes and a future of ectypes. Ethics, Governance, and Policies in Artificial Intelligence, pages 307–312, 2021.

J Scott Brennen, Felix M Simon, and Rasmus Kleis Nielsen. Beyond (mis) representation: Visuals in covid-19 misinformation. The International Journal of Press/Politics, 26(1):277–299, 2021.

Rohit Kumar Kaliyar, Anurag Goswami, and Pratik Narang. Deepfake: improving fake news detection using tensor decomposition-based deep neural network. The Journal of Supercomputing, 77:1015–1037, 2021.

Ivo Svoboda, Mykhailo Shevchuk, Oleksandr Shamsutdinov, Pavlo Lysianskyi, and Oleksii Voluiko. Identification of new threats to the national security of the state. Cuestiones Políticas, 41(78), 2023.

Pavel Korshunov and Sébastien Marcel. The threat of deepfakes to computer and human visions. In Handbook of Digital Face Manipulation and Detection: From DeepFakes to Morphing Attacks, pages 97–115. Springer International Publishing Cham, 2022.

Jennifer A Fehring and Tamara Bonaci. It looks like me, but it isn’t me: On the societal implications of deepfakes. IEEE Potentials, 42(5):33–38, 2023.

Soubhik Barari, Christopher Lucas, Kevin Munger, et al. Political deepfake videos misinform the public, but no more than other fake media. OSF Preprints, 13, 2021.

KN Sudhakar and MB Shanthi. Deepfake: An endanger to cyber security. In 2023 International Conference on Sustainable Computing and Smart Systems (ICSCSS), pages 1542–1548. IEEE, 2023.

Rayees Farooq. Knowledge management and performance: a bibliometric analysis based on scopus and wos data (1988–2021). Journal of Knowledge Management, 27 (7):1948–1991, 2023.

Irena Mitrović, Marko Mišić, and Jelica Protić. Exploring high scientific productivity in international coauthorship of a small developing country based on collaboration patterns. Journal of big Data, 10(1):64, 2023.

Yuezun Li and Siwei Lyu. Obstructing deepfakes by disrupting face detection and facial landmarks extraction. Deep Learning-Based Face Analytics, pages 247–267, 2021.

Pummy Dhiman, Amandeep Kaur, Celestine Iwendi, and Senthil Kumar Mohan. A scientometric analysis of deep learning approaches for detecting fake news. Electronics, 12(4):948, 2023.