Deteksi Dini Gangguan Kesehatan Mental dengan Model Bert dan Algoritma Xgboost
Abstract views: 0
,
Abstract
Mental health disorders are severe conditions that affect a person's thoughts, feelings, behavior, and well-being. Data from the World Health Organization (WHO) shows that more than 264 million people worldwide experience depression, one of the most common forms of mental health disorders. However, limited access to psychological services, such as lack of professionals and high costs, are major challenges in providing adequate support. Therefore, innovative technology-based solutions are needed for efficient and affordable psychological support. Efforts to improve research results to develop a mental health chatbot model by combining BERT (Bidirectional Encoder Representations from Transformers) and XGBoost (Extreme Gradient Boosting) models. The BERT model is used to understand the context of the conversation, while the XGBoost algorithm is used for text classification. The dataset used comes from Kaggle, which consists of 312 question patterns with several patterns or classes, namely 79 classes. The results of the program implementation test produced a percentage of 93.05% and output in the form of a program in the execution of the model on Google Colab..
References
E. M. Boucher et al., “Artificially intelligent chatbots in digital mental health interventions: a review,” Expert Rev Med Devices, vol. 18, no. sup1, pp. 37–49, Dec. 2021, doi: 10.1080/17434440.2021.2013200.
J. De Freitas, A. K. Uğuralp, Z. Oğuz‐Uğuralp, and S. Puntoni, “Chatbots and mental health: Insights into the safety of generative AI,” Journal of Consumer Psychology, vol. 34, no. 3, pp. 481–491, Jul. 2024, doi: 10.1002/jcpy.1393.
World Health Organization, “ World Mental Health Report: Transforming Mental Health for All.” Accessed: Nov. 19, 2024. [Online]. Available: https://www.who.int/publications/i/item/9789240049338
J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, “BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding.,” in Proceedings of the 2019 Conference of the North, Stroudsburg, PA, USA: Association for Computational Linguistics, 2019, pp. 4171–4186. doi: 10.18653/v1/N19-1423.
K. Mishra, H. Bodkhe, R. Naik, N. Bangalkar, and P. Dubey, “Advancements in Conversational AI: Building Mental Health Chatbot with BERT Model,” in 2023 International Conference on Artificial Intelligence for Innovations in Healthcare Industries (ICAIIHI), IEEE, Dec. 2023, pp. 1–6. doi: 10.1109/ICAIIHI57871.2023.10489148.
J. J. Bird and A. Lotfi, “Generative Transformer Chatbots for Mental Health Support: A Study on Depression and Anxiety,” in Proceedings of the 16th International Conference on PErvasive Technologies Related to Assistive Environments, New York, NY, USA: ACM, Jul. 2023, pp. 475–479. doi: 10.1145/3594806.3596520.
R. Martínez-Castaño, A. Htait, L. Azzopardi, and Y. Moshfeghi, “BERT-Based Transformers for Early Detection of Mental Health Illnesses,” 2021, pp. 189–200. doi: 10.1007/978-3-030-85251-1_15.
K. Zeberga, M. Attique, B. Shah, F. Ali, Y. Z. Jembre, and T.-S. Chung, “A Novel Text Mining Approach for Mental Health Prediction Using Bi-LSTM and BERT Model,” Comput Intell Neurosci, vol. 2022, pp. 1–18, Mar. 2022, doi: 10.1155/2022/7893775.
P. Fusar-Poli et al., “What is good mental health? A scoping review,” European Neuropsychopharmacology, vol. 31, pp. 33–46, Feb. 2020, doi: 10.1016/j.euroneuro.2019.12.105.
A. Singla, “Roberta and BERT: Revolutionizing Mental Healthcare through Natural Language,” Shodh Sagar Journal of Artificial Intelligence and Machine Learning, vol. 1, no. 1, pp. 10–27, 2024, doi: 10.36676/ssjaiml.v1.i1.02.
A. Subakti, H. Murfi, and N. Hariadi, “The performance of BERT as data representation of text clustering,” J Big Data, vol. 9, no. 1, p. 15, Dec. 2022, doi: 10.1186/s40537-022-00564-9.
H. Yang et al., “Enhancing psychiatric rehabilitation outcomes through a multimodal multitask learning model based on BERT and TabNet: An approach for personalized treatment and improved decision-making,” Psychiatry Res, vol. 336, p. 115896, Jun. 2024, doi: 10.1016/j.psychres.2024.115896.
S. Ji, T. Zhang, L. Ansari, J. Fu, P. Tiwari, and E. Cambria, “MentalBERT: Publicly Available Pretrained Language Models for Mental Healthcare,” Oct. 2021.
L. Balcombe, “AI Chatbots in Digital Mental Health,” Informatics, vol. 10, no. 4, p. 82, Oct. 2023, doi: 10.3390/informatics10040082.
Ibrahim Ahmad Assegaf et al., “PENGEMBANGAN CHATBOT KONSULTASI KESEHATAN MENTAL KESEHATAN MENTAL BERBASIS OPEN AI MODEL GPT-3.5 TURBO MENGGUNAKAN MEDIA WHATSAPP,” Jurnal Informatika Teknologi dan Sains (Jinteks), vol. 6, no. 4, pp. 785–793, Nov. 2024, doi: 10.51401/jinteks.v6i4.4749.
J. M. Liu, D. Li, H. Cao, T. Ren, Z. Liao, and J. Wu, “ChatCounselor: A Large Language Models for Mental Health Support,” Sep. 2023.
A. Bhagchandani and A. Nayak, “Deep Learning Based Chatbot Framework for Mental Health Therapy,” 2022, pp. 271–281. doi: 10.1007/978-981-16-5689-7_24.
M. Casu, S. Triscari, S. Battiato, L. Guarnera, and P. Caponnetto, “AI Chatbots for Mental Health: A Scoping Review of Effectiveness, Feasibility, and Applications,” Applied Sciences, vol. 14, no. 13, p. 5889, Jul. 2024, doi: 10.3390/app14135889.
A. Montejo-Ráez, M. D. Molina-González, S. M. Jiménez-Zafra, M. Á. García-Cumbreras, and L. J. García-López, “A survey on detecting mental disorders with natural language processing: Literature review, trends and challenges,” Comput Sci Rev, vol. 53, p. 100654, Aug. 2024, doi: 10.1016/j.cosrev.2024.100654.
S. Hornstein, K. Zantvoort, U. Lueken, B. Funk, and K. Hilbert, “Personalization strategies in digital mental health interventions: a systematic review and conceptual framework for depressive symptoms,” Front Digit Health, vol. 5, May 2023, doi: 10.3389/fdgth.2023.1170002.
M. Erkamim, S. Suswadi, M. Z. Subarkah, and E. Widarti, “Komparasi Algoritme Random Forest dan XGBoosting dalam Klasifikasi Performa UMKM,” Jurnal Sistem Informasi Bisnis, vol. 13, no. 2, pp. 127–134, Oct. 2023, doi: 10.21456/vol13iss2pp127-134.
C. Bentéjac, A. Csörgő, and G. Martínez-Muñoz, “A Comparative Analysis of XGBoost,” Nov. 2019, doi: 10.1007/s10462-020-09896-5.
I. D. R. Nugroho, M. D. Trisna, and S. Saroji, “An Implementation of XGBoost and Random Forest Algorithm to Estimate Effective Porosity and Permeability on Well log data at Fajar Field, South Sumatera Basin, Indonesia,” INDONESIAN JOURNAL OF APPLIED PHYSICS, vol. 14, no. 2, p. 271, Nov. 2024, doi: 10.13057/ijap.v14i2.82901.
Copyright (c) 2025 Rahmadika Putri Tresyani, Danang Wahyu Utomo, Naufal Maldini
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
