MentalMARBERT: Domain-Adaptive Pre-training and Two-Stage Fine-Tuning for Arabic Mental Health Disorders Detection

In three linesStudy proposes MentalMARBERT, a domain-adapted BERT model for detecting mental health disorders in Arabic text. Two-phase framework: domain adaptation (DAPT/TAPT) on 50,670 annotated tweets, then hierarchical fine-tuning with LoRA. Macro-F1 0.861, accuracy 0.877.

Summary generated by Claude — human-verified