International Journal of Leading Research Publication
E-ISSN: 2582-8010
•
Impact Factor: 9.56
A Widely Indexed Open Access Peer Reviewed Multidisciplinary Monthly Scholarly International Journal
Plagiarism is checked by the leading plagiarism checker
Call for Paper
Volume 7 Issue 6
June 2026
Indexing Partners
Multimodal Depression Detection An Integrated Multimodal Framework for Automated Depression Severity Assessment
| Author(s) | Anuj Sahu, Chandra Prakash Singar, Puja Gupta, Divyansh Ganote, Sanjay Patil |
|---|---|
| Country | India |
| Abstract | Depression remains one of the most prevalent mental health disorders globally, yet early detection remains challenging due to its multifaceted and heterogeneous clinical presentation [1]. This study presents a novel multimodal depression detection system that integrates five distinct analytical modalities: facial expression analysis, vocal tone assessment, video-based emotion recognition, text sentiment analysis, and clinical questionnaire evaluation. Using a probability-weighted scoring mechanism combined with an unequal weighting scheme that prioritizes explicit user input, the system generates a comprehensive depression severity score on a 0–100 scale with clinically relevant classification thresholds. The architecture leverages convolutional neural networks (CNNs) [4] for image and video processing, long short-term memory (LSTM) networks [5] for audio analysis, a trained sequence model for text classification, and large language model (LLM) integration via the Groq API for open-ended questionnaire assessment. By combining noisy ambient snapshots with explicit clinical input, the system achieves a holistic psychological profile that extends beyond single-modality approaches [8]. This paper describes the technical implementation, mathematical framework, and clinical classification methodology underlying this integrated system. |
| Keywords | depression detection, multimodal analysis, machine learning, emotion recognition, clinical assessment, CNN, LSTM, NLP, LLM |
| Field | Engineering |
| Published In | Volume 7, Issue 5, May 2026 |
| Published On | 2026-05-14 |
| DOI | https://doi.org/10.70528/IJLRP.v7.i5.2191 |
| Short DOI | https://doi.org/hb379t |
Share this

CrossRef DOI is assigned to each research paper published in our journal.
IJLRP DOI prefix is
10.70528/IJLRP
Downloads
All research papers published on this website are licensed under Creative Commons Attribution-ShareAlike 4.0 International License, and all rights belong to their respective authors/researchers.