Validity and Reliability of the Self-administered Psycho-TherApy-SystemS (SELFPASS) Item Pool for the Daily Mood Tracking of Depressive Symptoms: Cross-sectional Web-Based Survey

Background: e-Mental health apps targeting depression have gained increased attention in mental health care. Daily self-assessment is an essential part of e-mental health apps. The Self-administered Psycho-TherApy-SystemS (SELFPASS) app is a self-management app to manage depressive and comorbid anxiety symptoms of patients with a depression diagnosis. A self-developed item pool with 40 depression items and 12 anxiety items is included to provide symptom-specific suggestions for interventions. However, the psychometric properties of the item pool have not yet been evaluated. Objective: The aim of this study is to investigate the validity and reliability of the SELFPASS item pool. Methods: A weblink with the SELFPASS item pool and validated mood assessment scales was distributed to healthy subjects and patients who had received a diagnosis of a depressive disorder within the last year. Two scores were derived from the SELFPASS item pool: SELFPASS depression (SP-D) and SELFPASS anxiety (SP-A). Reliability was examined using Cronbach alpha. Construct validity was assessed through Pearson correlations with the Patient Health Questionnaire-9 (PHQ-9), the General Anxiety Disorder Scale-7 (GAD-7), and the WHO-5-Wellbeing-Scale (WHO-5). Logistic regression analysis was performed as an indicator for concurrent criterion validity of SP-D and SP-A. Factor analysis was performed to provide information about the underlying factor structure of the item pool. Item-scale correlations were calculated in order to determine item quality. Results: A total of 284 participants were included, with 192 (67.6%) healthy subjects and 92 (32.4%) patients. Cronbach alpha was set to .94 for SP-D and alpha=.88 for SP-A. We found significant positive correlations between SP-D and PHQ-9 scores (r=0.87; P<.001) and between SP-A and GAD-7 scores (r=0.80; P<.001), and negative correlations between SP-D and WHO-5 scores (r=-0.80; P<.001) and between SP-A and WHO-5 scores (r=-0.69; P<.001). Increasing scores of SP-D and SP-A led to increased odds of belonging to the patient group (SP-D: odds ratio 1.03, 95% CI 1.01-1.05; P<.001; SP-A: 1.05, 1.05-1.01; P=.01). The item pool yielded 2 factors: one that consisted of mood-related items and another with somatic-related items. Conclusions: The SELFPASS item pool showed good psychometric properties in terms of reliability, construct, and criterion validity. The item pool is an appropriate source for daily mood tracking in future e-mental health apps among patients with depression. Our study provides general recommendations for future developments as well as recommendations within the item pool.