Advanced Attention-Enhanced BiLSTM-GRU Model for Real vs. Fake News Detection

Authors

DOI:

https://doi.org/10.4108/eetiot.7829

Keywords:

Fake text, DL, Deep Learning, BiLSTM, Bi-directional Long Short Term Memory, BiLSTM-AM, BiLSTM with Attention Mechanism, GRU, Gated Recurrent Unit, GRU-AM, BiLSTM-GRU

Abstract

INTRODUCTION: Social media has become one of the primary platforms for the rapid dissemination of both real and fake information. In today's digital society, individuals are often easily influenced by misleading content, making fake news a powerful tool for manipulation. A common strategy employed on social media is the intentional spread of false information with the aim of deceiving and misleading the public.

OBJECTIVES: In some cases, this misinformation is so convincing that it significantly influences public opinion and behaviour, with long-term consequences. According to research, only 54% of people are capable of detecting deception without external assistance. To address this growing concern, the proposed model leverages Deep Learning techniques to identify fake news content in both Tamil and English languages.

METHODS: The dataset for this study was sourced from an open-access repository on GitHub. After thorough pre-processing, the dataset was divided into training (80%) and testing (20%) subsets. Additionally, the proposed modified attention-based revamping weighted BiLSTM-GRU model is introduced and evaluated.

RESULTS: The effectiveness of each model is measured using various performance metrics, including accuracy, precision, recall, F1-score, Bilingual Evaluation Understudy, Area under the ROC Curve, and the Receiver Operating Characteristic curve. Comparative analysis shows that the proposed model outperforms the existing methods across all evaluation parameters.

CONCLUSION: A key advantage of the proposed approach is its capability to accurately detect fake text in both Tamil and English. Furthermore, the model demonstrates strong performance when tested on datasets generated using AI tools like ChatGPT, effectively identifying real and fake content with high precision.

Downloads

<br data-mce-bogus="1"> <br data-mce-bogus="1">

References

[1] Hu B, Mao Z, Zhang Y. An overview of fake news detection: From a new perspective. Fundamental Research. 2025;5(1):332-46.

[2] Singh R, Ram A, Rajput A, Sachan M, Kumar A, Srivastava A, et al. Social Media Fake News Detection Challenge and Impact for Society. Library of Progress-Library Science, Information Technology & Computer. 2024;44(3).

[3] Kuntur S, WrĂłblewska A, Paprzycki M, Ganzha M. Fake News Detection: It's All in the Data! arXiv preprint arXiv:240702122. 2024.

[4] Olan F, Jayawickrama U, Arakpogun EO, Suklan J, Liu S. Fake news on social media: the impact on society. Information Systems Frontiers. 2024;26(2):443-58.

[5] Oladokun BD, Aruwa JE, Ottah GA, Ajani YA. Misinformation and disinformation in the era of social media: The need for fact-checking skills. Journal of Information and Knowledge. 2024:1-7.

[6] Arslan RS. FAKE NEWS DETECTION FRAMEWORK USING BERT AND DOC2VEC WITH MACHINE LEARNING.

[7] Al Ghamdi MA, Bhatti MS, Saeed A, Gillani Z, Almotiri SH. A fusion of BERT, machine learning and manual approach for fake news detection. Multimedia Tools and Applications. 2024;83(10):30095-112.

[8] Lee DY, Liu Y-Y. Application of Supervised Machine Learning Algorithms for Detection of Fake News using Support Vector Machine Classifier.

[9] Abdullah NAS, Rusli NIA, Yuslee NS. Development of a machine learning algorithm for fake news detection. Indonesian Journal of Electrical Engineering and Computer Science. 2024;35(3):1732-43.

[10] Assenza T, Collard F, Fève P, Huber SJ. From buzz to bust: How fake news shapes the business cycle. ECONtribute Discussion Paper, 2024.

[11] Padalko H, Chomko V, Chumachenko D. A novel approach to fake news classification using LSTM-based deep learning models. Frontiers in big Data. 2024;6:1320800.

[12] Dev DG, Bhatnagar V, Bhati BS, Gupta M, Nanthaamornphong A. LSTMCNN: A hybrid machine learning model to unmask fake news. Heliyon. 2024;10(3).

[13] Ahmad I, Yousaf M, Yousaf S, Ahmad MOJC. Fake news detection using machine learning ensemble methods. Complexity 2020;2020(1):8885861.

[14] Aslam N, Ullah Khan I, Alotaibi FS, Aldaej LA, Aldubaikil AKJc. Fake detect: A deep learning ensemble model for fake news detection. Complexity 2021;2021(1):5557784.

[15] Singh VK, Ghosh I, Sonagara DJJotAfIS, Technology. Detecting fake news stories via multimodal analysis. Journal of the Association for Information Science Technology 2021;72(1):3-17.

[16] Kaliyar RK, Goswami A, Narang P, Sinha SJCSR. FNDNet–a deep convolutional neural network for fake news detection. Cognitive Systems Research 2020;61:32-44.

[17] Zhou X, Zafarani RJASen. Network-based fake news detection: A pattern-driven approach. ACM SIGKDD explorations newsletter 2019;21(2):48-60.

[18] Raza S, Ding CJIJoDS, Analytics. Fake news detection based on news content and social contexts: a transformer-based approach. International Journal of Data Science Analytics 2022;13(4):335-62.

[19] Hakak S, Alazab M, Khan S, Gadekallu TR, Maddikunta PKR, Khan WZJFGCS. An ensemble machine learning approach through effective feature extraction to classify fake news. Future Generation Computer Systems 2021;117:47-58.

[20] Sharma U, Saran S, Patil SMJIJocrt. Fake news detection using machine learning algorithms. International Journal of creative research thoughts 2020;8(6):509-18.

[21] Baarir NF, Djeffal A, editors. Fake news detection using machine learning. 2020 2nd International workshop on human-centric smart environments for health and well-being (IHSH); 2021: IEEE.

[22] Hakak S, Alazab M, Khan S, Gadekallu TR, Maddikunta PKR, Khan WZJFGCS. An ensemble machine learning approach through effective feature extraction to classify fake news. Future Generation Computer Systems. 2021;117:47-58.

[23] Ozbay FA, Alatas BJPAsm, applications i. Fake news detection within online social media using supervised artificial intelligence algorithms. Physica A: statistical mechanics its applications 2020;540:123174.

[24] Khan S, Hakak S, Deepa N, Prabadevi B, Dev K, Trelova SJFiPH. Detecting COVID-19-related fake news using feature extraction. Frontiers in Public Health 2022;9:788074.

[25] Saleh H, Alharbi A, Alsamhi SHJIA. OPCNN-FAKE: Optimized convolutional neural network for fake news detection. IEEE Access 2021;9:129471-89.

[26] Umer M, Imtiaz Z, Ullah S, Mehmood A, Choi GS, On B-WJIA. Fake news stance detection using deep learning architecture (CNN-LSTM). IEEE Access. 2020;8:156695-706.

[27] Monti F, Frasca F, Eynard D, Mannion D, Bronstein MMJapa. Fake news detection on social media using geometric deep learning. arXiv preprint arXiv:06673 2019.

[28] Nasir JA, Khan OS, Varlamis IJIjoimdi. Fake news detection: A hybrid CNN-RNN based deep learning approach. International journal of information management data insights. 2021;1(1):100007.

[29] Kaliyar RK, Goswami A, Narang PJMt, applications. FakeBERT: Fake news detection in social media with a BERT-based deep learning approach. Multimedia tools applications 2021;80(8):11765-88.

[30] Kaur S, Kumar P, Kumaraguru PJSC. Automating fake news detection system using multi-level voting model. Soft Computing 2020;24(12):9049-69.

[31] Mahabub AJSAS. A robust technique of fake news detection using Ensemble Voting Classifier and comparison with other classifiers. SN Applied Sciences 2020;2(4):525.

[32] Reddy H, Raj N, Gala M, Basava AJIjoa, computing. Text-mining-based fake news detection using ensemble methods. International journal of automation computing 2020;17(2):210-21.

[33] Goldani MH, Momtazi S, Safabakhsh RJASC. Detecting fake news with capsule neural networks. Applied Soft Computing 2021;101:106991.

[34] Kaliyar RK, Goswami A, Narang PJTJoS. DeepFakE: improving fake news detection using tensor decomposition-based deep neural network. The Journal of Supercomputing 2021;77(2):1015-37.

[35] Meel P, Vishwakarma DKJESwA. A temporal ensembling based semi-supervised ConvNet for the detection of fake news articles. Expert Systems with Applications 2021;177:115002.

[36] Jadhav SS, Thepade SDJAAI. Fake news identification and classification using DSSM and improved recurrent neural network classifier. Applied Artificial Intelligence 2019;33(12):1058-68.

[37] Liu Y, Wu Y-FBJAToIS. Fned: a deep network for fake news early detection on social media. ACM Transactions on Information Systems 2020;38(3):1-33.

[38] Gundapu S, Mamidi RJapa. Transformer based automatic COVID-19 fake news detection system. arXiv preprint arXiv:00180 2021.

[39] Goldani MH, Safabakhsh R, Momtazi SJIP, Management. Convolutional neural network with margin loss for fake news detection. Information Processing Management 2021;58(1):102418.

[40] Liao Q, Chai H, Han H, Zhang X, Wang X, Xia W, et al. An integrated multi-task model for fake news detection. IEEE Transactions on Knowledge Data Engineering 2021;34(11):5154-65.

[41] Huang Y-F, Chen P-HJESwA. Fake news detection using an ensemble learning model based on self-adaptive harmony search algorithms. Expert Systems with Applications 2020;159:113584.

[42] Deokate SBJIJRASET. Fake news detection using support vector machine learning algorithm. Int J Res Appl Sci Eng Technol 2019.

[43] Vijjali R, Potluri P, Kumar S, Teki SJapa. Two stage transformer model for COVID-19 fake news detection and fact checking. arXiv preprint arXiv:13253 2020.

[44] Yang K-C, Niven T, Kao H-YJapa. Fake news detection as natural language inference. arXiv preprint arXiv:07347 2019.

[45] Choudhary A, Arora AJJoR, Services C. Assessment of bidirectional transformer encoder model and attention based bidirectional LSTM language models for fake news detection. Journal of Retailing Consumer Services 2024;76:103545.

[46] Dhiman P, Kaur A, Gupta D, Juneja S, Nauman A, Muhammad GJH. GBERT: A hybrid deep learning model based on GPT-BERT for fake news detection. Heliyon 2024;10(16).

[47] Bazmi P, Asadpour M, Shakery A, Maazallahi AJIP, Management. Entity-centric multi-domain transformer for improving generalization in fake news detection. Information Processing Management 2024;61(5):103807.

[48] Al-Alshaqi M, Rawat DB, Liu CJS. Ensemble Techniques for Robust Fake News Detection: Integrating Transformers, Natural Language Processing, and Machine Learning. Sensors 2024;24(18):6062.

[49] Bharadwaj P, Shao Z. Fake news detection with semantic features and text mining. 2019.

[50] Ni S, Li J, Kao H-YJIA. MVAN: Multi-view attention networks for fake news detection on social media. IEEe Access 2021;9:106907-17.

[51] Trueman TE, Kumar A, Narayanasamy P, Vidya JJASC. Attention-based C-BiLSTM for fake news detection. Applied Soft Computing 2021;110:107600.

Downloads

Published

20-05-2025

How to Cite

[1]
M. Arunkrishna and B. Senthilkumaran, “Advanced Attention-Enhanced BiLSTM-GRU Model for Real vs. Fake News Detection”, EAI Endorsed Trans IoT, vol. 11, May 2025.

Issue

Vol. 11 (2025): EAI Endorsed Transactions on Internet of Things

Section

Research article

License

Copyright (c) 2025 M. Arunkrishna, B. Senthilkumaran

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

This is an open-access article distributed under the terms of the Creative Commons Attribution CC BY 3.0 license, which permits unlimited use, distribution, and reproduction in any medium so long as the original work is properly cited.