Enhancing conversational sentimental analysis for psychological depression prediction with Bi-LSTM
Abstract
Human mental health (HMH) is a pervasive and impactful condition that profoundly affects an individual’s cognitive, emotional, and behavioural aspects in a negative manner. Among various mental health disorders, depression is particularly prevalent, with approximately 20% of women experiencing at least one depressive episode during their lifetime. Identifying depression early on is crucial for timely intervention and support. This study examines user-generated content from major social platforms like Twitter, Facebook, and Instagram, aiming to detect potential signs of depression through behavioural symptoms such as mood changes, loss of interest, altered sleep patterns, focus difficulties, and impaired decision-making. Leveraging natural language processing and machine learning, sentiment analysis deciphers emotional context in posts and comments. A new efficient methodology utilizing Bidirectional Encoder Representations from Transformers (BERT) is proposed for efficient analysis of the posts and comments. Knowledge distillation transfers insights from a large BERT model to a smaller one, enhancing accuracy. Integrating word2vec and BERT with bidirectional long short-term memory (Bi-LSTM), the approach effectively analyses depression and anxiety indicators in social media data. Comparative assessments highlight the system’s excellence, achieving a remarkable 98.5% accuracy through knowledge distillation. The proposed methodology marks a substantial stride in identifying mental health signals from social media, facilitating better early intervention and support for those facing depression and anxiety-related challenges.
Keywords
Full Text:
PDFReferences
1. Shrestha K. Machine learning for depression diagnosis using Twitter data. International Journal of Computer Engineering in Research Trends 2018; 5(2): 56–61. doi: 10.22362/ijcert/2018/v5/i2/v5i208
2. Tadesse MM, Lin H, Xu B, Yang L. Detection of suicide ideation in social media forums using deep learning. Algorithms 2020; 13(1). doi: 10.3390/a13010007
3. Seppälä J, De Vita I, Jämsä T, et al. Smartphone and wearable sensors-based m-health approach for psychiatric disorders and symptoms—A systematic review and link to m-RESIST project. JMIR Mental Health 2018; 6(2): 1–21. doi: 10.2196/mental.9819
4. Drissi N, Ouhbi S, Idrissi MAJ, et al. On the use of sensors in mental healthcare. Intelligent Environments 2019; 26: 307–316. doi: 10.3233/AISE190058
5. Dang NC, Moreno-García MN, De la Prieta F. Sentiment analysis based on deep learning: A comparative study. Electronics 2020; 9(3): 483. doi: 10.3390/electronics9030483
6. Fiallos A, Jimenes K. Using reddit data for multi-label text classification of twitter users interests. In: Proceedings of the 2019 Sixth International Conference on eDemocracy & eGovernment (ICEDEG); 24–26 April 2019; Quito, Ecuador. pp. 324–327.
7. Go A, Bhayani R, Huang L. Twitter sentiment classification using distant supervision. Available online: https://www-cs.stanford.edu/people/alecmgo/papers/TwitterDistantSupervision09.pdf (accessed on 28 September 2023).
8. Mary GS, Blesswin AJ, Kumar SM. Self-authentication model to prevent cheating issues in grayscale visual secret sharing schemes. Wireless Personal Communications 2022; 125: 1695–1714. doi: 10.1007/s11277-022-09628-8
9. Sau A, Bhakta I. Screening of anxiety and depression among seafarers using machine learning technology. Informatics in Medicine Unlocked 2019; 16: 100149. doi: 10.1016/j.imu.2018.12.004
10. Neha S, Nivya, Shekar PHC, et al. Emotion recognition and depression detection using deep learning. International Research Journal of Engineering and Technology (IRJET) 2020; 7(8): 3031–3036.
11. Ali F, El-Sappagh S, Islam SMR, et al. An intelligent healthcare monitoring framework using wearable sensors and social networking data. Future Generation Computer Systems 2021; 114: 23–43. doi: 10.1016/j.future.2020.07.047
12. Yadav A, Vishwakarma DK. Sentiment analysis using deep learning architectures: A review. Artificial Intelligence Review 2020; 53(6): 4335–4385. doi: 10.1007/s10462-019-09794-5
13. Devlin J, Chang MW, Lee K, Toutanova K. BERT: Pre-training of deep bidirectional transformers for language understanding. In: Proceedings of the 17th Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT 2019); 2–7 June 2019; Minneapolis, Minnesota, America. pp. 4171–4186.
14. Kowsari K, Meimandi KJ, Heidarysafa M, et al. Text classification algorithms: A survey. Information 2019; 10(4): 150. doi: 10.3390/info10040150
15. Garcia-Ceja E, Riegler M, Nordgreen T, et al. Mental health monitoring with multimodal sensing and machine learning: A survey. Pervasive and Mobile Computing 2018; 51: 1–26. doi: 10.1016/j.pmcj.2018.09.003
16. Garcia-Ceja E, Galván-Tejada CE, Brena R. Multi-view stacking for activity recognition with sound and accelerometer data. Information Fusion 2018; 40: 45–56. doi: 10.1016/j.inffus.2017.06.004
17. Zogan H, Razzak I, Wang X, et al. Explainable depression detection with multi-modalities using a hybrid deep learning model on social media. World Wide Web 2022; 25(1): 281–304. doi: 10.1007/s11280-021-00992-2
18. Kumar A, Sharma A, Arora A. Anxious depression prediction in real-time social data. In: Proceedings of the International Conference on Advances in Engineering Science Management & Technology (ICAESMT)-2019; 4 March 2019; Uttarakhand, India. pp. 1–7.
19. Kim J, Lee J, Park E, Han J. A deep learning model for detecting mental illness from user content on social media. Scientific Reports 2020; 10(1): 11846. doi: 10.1038/s41598-020-68764-y
20. Dansana D, Adhikari JD, Mohapatra M, Sahoo S. An approach to analyse and forecast social media data using machine learning and data analysis. In: Proceedings of the 2020 International Conference on Computer Science, Engineering and Applications (ICCSEA); 13–14 March 2020; Gunupur, India. pp. 1–5.
21. Wang B, Wang A, Chen H, et al. Evaluating word embedding models: Methods and experimental results. APSIPA Transactions on Signal and Information Processing 2019; 8(E19). doi: 10.1017/ATSIP.2019.12
22. Qiu XP, Sun TX, Xu YG, et al. Pre-trained models for natural language processing: A survey. Science China Technological Sciences 2020; 63(10): 1872–1897. doi: 10.1007/s11431-020-1647-3
23. Young T, Hazarika D, Poria S, Cambria E. Recent trends in deep learning based natural language processing. IEEE Computational Intelligence Magazine 2018; 13(3): 55–75. doi: 10.1109/MCI.2018.2840738
24. Vaswani A, Shazeer S, Parmar N, et al. Attention is all you need. In: Proceedings of the 31st Conference on Neural Information Processing Systems (NIPS 2017); 4–9 December 2017; Long Beach, CA, USA. pp. 1–11.
25. Hochreiter S, Schmidhuber J. Long short-term memory. Neural Computation 1997; 9(8): 1735–1780. doi: 10.1162/neco.1997.9.8.1735
26. Tadesse MM, Lin H, Xu B, Yang L. Detection of depression-related posts in reddit social media forum. IEEE Access 2019; 7: 44883–44893. doi: 10.1109/ACCESS.2019.2909180
27. Burdisso SG, Errecalde M, Montes-y-Gómez M. A text classification framework for simple and effective early depression detection over social media streams. Expert Systems with Applications 2019; 133: 182–197. doi: 10.1016/j.eswa.2019.05.023
28. Moraes R, Valiati JF, Neto WPG. Document-level sentiment classification: An empirical comparison between SVM and ANN. Expert Systems with Applications 2013; 40(2): 621–633. doi: 10.1016/j.eswa.2012.07.059
29. Munikar M, Shakya S, Shrestha A. Fine-grained sentiment classification using BERT. In: Proceedings of the 2019 International Conference on Artificial Intelligence for Transforming Business and Society (AITB); 5 November 2019; Kathmandu, Nepal. pp. 2–5.
30. Jang B, Kim M, Harerimana G, et al. Bi-LSTM model to increase accuracy in text classification: Combining word2vec CNN and attention mechanism. Applied Sciences 2020; 10(17): 5841. doi: 10.3390/app10175841
31. Blesswin AJ, Mary GS, Kumar SM. Multiple secret image communication using visual cryptography. Wireless Personal Commns 2022; 122(4): 3085–3103. doi: 10.1007/s11277-021-09041-7
32. Zeberga K, Attique M, Shah B, et al. A Novel text mining approach for mental health prediction using Bi-LSTM and BERT model. Computational Intelligence and Neuroscience 2022; 2022: 7893775. doi: 10.1155/2022/7893775
DOI: https://doi.org/10.32629/jai.v7i1.1116
Refbacks
- There are currently no refbacks.
Copyright (c) 2023 Selva Mary G., John Blesswin A., Mithra Venkatesan, Shubhangi Vairagar, Sushadevi Adagale, Chetana Shravage, Jyotsna Barpute
License URL: https://creativecommons.org/licenses/by-nc/4.0/