This paper is in the following e-collection/theme issue:

Digital Biomarkers and Digital Phenotyping (172) Mobile Health (mhealth) (2713) mHealth for Data Collection and Research (891) Depression and Mood Disorders; Suicide Prevention (1258) Mobile Health in Psychiatry (395) Wearable Devices and Sensors (799) Methods and New Tools in Mental Health Research (421) New Methods (890)

Published on in Vol 9, No 7 (2021): July

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/29840, first published .
Predicting Depressive Symptom Severity Through Individuals’ Nearby Bluetooth Device Count Data Collected by Mobile Phones: Preliminary Longitudinal Study

Predicting Depressive Symptom Severity Through Individuals’ Nearby Bluetooth Device Count Data Collected by Mobile Phones: Preliminary Longitudinal Study

Predicting Depressive Symptom Severity Through Individuals’ Nearby Bluetooth Device Count Data Collected by Mobile Phones: Preliminary Longitudinal Study

Authors of this article:

Yuezhou Zhang1 Author Orcid Image ;   Amos A Folarin1, 2, 3, 4, 5 Author Orcid Image ;   Shaoxiong Sun1 Author Orcid Image ;   Nicholas Cummins1 Author Orcid Image ;   Yatharth Ranjan1 Author Orcid Image ;   Zulqarnain Rashid1 Author Orcid Image ;   Pauline Conde1 Author Orcid Image ;   Callum Stewart1 Author Orcid Image ;   Petroula Laiou1 Author Orcid Image ;   Faith Matcham6 Author Orcid Image ;   Carolin Oetzmann6 Author Orcid Image ;   Femke Lamers7 Author Orcid Image ;   Sara Siddi8, 9, 10 Author Orcid Image ;   Sara Simblett11 Author Orcid Image ;   Aki Rintala12, 13 Author Orcid Image ;   David C Mohr14 Author Orcid Image ;   Inez Myin-Germeys12 Author Orcid Image ;   Til Wykes3, 11 Author Orcid Image ;   Josep Maria Haro8, 9, 10 Author Orcid Image ;   Brenda W J H Penninx7 Author Orcid Image ;   Vaibhav A Narayan15 Author Orcid Image ;   Peter Annas16 Author Orcid Image ;   Matthew Hotopf3, 6 Author Orcid Image ;   Richard J B Dobson1, 2, 3, 4, 5 Author Orcid Image ;   RADAR-CNS Consortium17
Article Authors Cited by (20) Tweetations (35) Metrics

    Original Paper

    1Department of Biostatistics & Health Informatics, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom

    2Institute of Health Informatics, University College London, London, United Kingdom

    3NIHR Biomedical Research Centre at South London and Maudsley NHS Foundation Trust and King’s College London, London, United Kingdom

    4Health Data Research UK London, University College London, London, United Kingdom

    5NIHR Biomedical Research Centre at University College London Hospitals NHS Foundation Trust, London, United Kingdom

    6Department of Psychological Medicine, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom

    7Department of Psychiatry, Amsterdam Public Health Research Institute and Amsterdam Neuroscience, Amsterdam University Medical Centre, Vrije Universiteit and GGZ InGeest, Amsterdam, Netherlands

    8Teaching Research and Innovation Unit, Parc Sanitari Sant Joan de Déu, Fundació Sant Joan de Déu, Barcelona, Spain

    9Centro de Investigación Biomédica en Red de Salud Mental, Madrid, Spain

    10Faculty of Medicine and Health Sciences, Universitat de Barcelona, Barcelona, Spain

    11Department of Psychology, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom

    12Center for Contextual Psychiatry, Department of Neurosciences, Katholieke Universiteit Leuven, Leuven, Belgium

    13Faculty of Social Services and Health Care, LAB University of Applied Sciences, Lahti, Finland

    14Center for Behavioral Intervention Technologies, Department of Preventive Medicine, Northwestern University, Evanston, IL, United States

    15Janssen Research and Development LLC, Titusville, NJ, United States

    16H Lundbeck A/S, Copenhagen, Denmark

    Corresponding Author:

    Richard J B Dobson, PhD

    Department of Biostatistics & Health Informatics

    Institute of Psychiatry, Psychology and Neuroscience

    King's College London

    SGDP Centre, IoPPN, Box PO 80

    De Crespigny Park, Denmark Hill

    London, SE5 8AF

    United Kingdom

    Phone: 44 20 7848 0473

    Email: richard.j.dobson@kcl.ac.uk


    Background: Research in mental health has found associations between depression and individuals’ behaviors and statuses, such as social connections and interactions, working status, mobility, and social isolation and loneliness. These behaviors and statuses can be approximated by the nearby Bluetooth device count (NBDC) detected by Bluetooth sensors in mobile phones.

    Objective: This study aimed to explore the value of the NBDC data in predicting depressive symptom severity as measured via the 8-item Patient Health Questionnaire (PHQ-8).

    Methods: The data used in this paper included 2886 biweekly PHQ-8 records collected from 316 participants recruited from three study sites in the Netherlands, Spain, and the United Kingdom as part of the EU Remote Assessment of Disease and Relapse-Central Nervous System (RADAR-CNS) study. From the NBDC data 2 weeks prior to each PHQ-8 score, we extracted 49 Bluetooth features, including statistical features and nonlinear features for measuring the periodicity and regularity of individuals’ life rhythms. Linear mixed-effect models were used to explore associations between Bluetooth features and the PHQ-8 score. We then applied hierarchical Bayesian linear regression models to predict the PHQ-8 score from the extracted Bluetooth features.

    Results: A number of significant associations were found between Bluetooth features and depressive symptom severity. Generally speaking, along with depressive symptom worsening, one or more of the following changes were found in the preceding 2 weeks of the NBDC data: (1) the amount decreased, (2) the variance decreased, (3) the periodicity (especially the circadian rhythm) decreased, and (4) the NBDC sequence became more irregular. Compared with commonly used machine learning models, the proposed hierarchical Bayesian linear regression model achieved the best prediction metrics (R2=0.526) and a root mean squared error (RMSE) of 3.891. Bluetooth features can explain an extra 18.8% of the variance in the PHQ-8 score relative to the baseline model without Bluetooth features (R2=0.338, RMSE=4.547).

    Conclusions: Our statistical results indicate that the NBDC data have the potential to reflect changes in individuals’ behaviors and statuses concurrent with the changes in the depressive state. The prediction results demonstrate that the NBDC data have a significant value in predicting depressive symptom severity. These findings may have utility for the mental health monitoring practice in real-world settings.

    JMIR Mhealth Uhealth 2021;9(7):e29840

    doi:10.2196/29840

    Keywords

    mental health; depression; digital biomarkers; digital phenotyping; digital health; Bluetooth; hierarchical Bayesian model; mobile health; mHealth; monitoring 


    Existing studies have demonstrated that depression is significantly associated with individuals’ behaviors and statuses, such as social connections and interactions, working status, mobility, and social isolation and loneliness [1-4]. For example, individuals reporting fewer social network connections or less social support tend to have higher depressive symptomatology [1]. As the depressive mood and medical comorbidity can make people unable to work, the unemployment rate in depression is high [2]. Reduced mobility and physical activity are associated with depressive symptoms [3]. Loneliness is a specific risk factor for depression, and a significant proportion of suicides have a history of social isolation [1,4]. Although these findings have been replicated in different populations, these studies relied on participant self-report, which is susceptible to recall bias and typically does not capture dynamic information [5].

    Mobile phone technology provides an unobtrusive, continuous, and cost-efficient means to capture individuals’ daily behaviors and statuses using a number of embedded sensors, such as accelerometers, GPS sensors, and Bluetooth sensors [6]. The embedded Bluetooth sensor can be used to record individuals’ local proximity information, such as the nearby Bluetooth device count (NBDC) that includes the Bluetooth signal of other phone users [7]. The continuously recorded NBDC data represents a mixed signal that has been used to estimate individuals’ behaviors and statuses, including face-to-face social interactions [8-10], working status [11], mobility [12], and isolation and loneliness [13,14]. Therefore, the NBDC data have the potential to reflect changes in people’s behaviors and statuses during the depressive state.

    There have been a few studies exploring the relationship between the NBDC data and depression directly. Wang et al found a negative association (r=−0.362, P=.03) between the NBDC and self-reported depressive symptoms on the StudentLife data set, which contained mobile phone data from 48 students across a 10-week term at Dartmouth College [15]. Boonstra et al illustrated the feasibility of collecting nearby Bluetooth device information for the depression recognition task, but they did not provide further findings [5].

    Several recent studies have investigated the relationships between Bluetooth proximity data and mental health [16-18]. Moturu et al found that individuals with lower sociability (estimated by the NBDC) tend to report lower mood more often [16]. Bogomolov et al established machine learning models to recognize happiness and stress with features of Bluetooth records, calls, and text messages, which obtained accuracy rates of 80.81% and 72.28%, respectively [17,18]. The above three studies were all performed on the “Friends and Family” data set, including 8 weeks of mobile phone data from 117 participants living in a major US university’s married graduate student residency.

    Previous studies [15-18] have been performed on relatively small (approximately 100 participants) homogeneous (eg, university students) cohorts of participants over relatively short periods (8-10 weeks), which may limit their generalizability. Besides, Bluetooth features used in these studies [15-18] have been limited to basic statistical features (eg, sum, mean, and standard deviation), which are unable to characterize some nonlinear aspects (such as complexity, regularity, and periodicity) of the Bluetooth data. These nonlinear characteristics can reflect individuals’ life rhythms, such as circadian and social rhythms, which are affected by depressive symptoms [19]. Therefore, the associations between the NBDC data and depression are yet to be fully explored.

    In this paper, we aimed to explore the value of the NBDC data in predicting self-reported depressive symptom severity in a relatively large cohort of individuals with a history of recurrent major depressive disorder. Our first objective was to explore the associations between statistical Bluetooth features and depressive symptom severity. Our second objective was to extract nonlinear features for quantifying complexity, regularity, and periodicity from the NBDC data and test their associations with depression. The third objective was to leverage appropriate machine learning models to predict the severity of depressive symptoms using extracted Bluetooth features.


    Data Set

    Study Participants and Settings

    The data used in this study were collected from a major EU Innovative Medicines Initiative (IMI) research program Remote Assessment of Disease and Relapse-Central Nervous System (RADAR-CNS) [20]. The project aimed to investigate the use of remote measurement technologies (RMTs) to monitor people with depression, epilepsy, and multiple sclerosis in real-world settings. The study protocol for the depression component (Remote Assessment of Disease and Relapse-Major Depressive Disorder; RADAR-MDD) has been described in detail by Matcham et al [21]. The RADAR-MDD project aimed to recruit 600 participants with a recent history of depression from three study sites in Spain (Centro de Investigación Biomédican en Red [CIBER], Barcelona), the Netherlands (Vrije Universiteit Medisch Centrum [VUmc], Amsterdam]), and the United Kingdom (King’s College London [KCL]). Recruitment procedures varied slightly across sites with eligible participants identified through existing research infrastructures (in KCL and VUmc) where consent to be contacted for research purposes exists; advertisements in general practices, psychologist practices, and newspapers; Hersenonderzoek.nl [22], a Dutch online registry (VUmc); and mental health services (in KCL and CIBER) [21].

    Participants were asked to install passive and active remote monitoring technology (pRMT and aRMT, respectively) apps and use an activity tracker for up to 2 years of follow-up. Many categories of passive and active data were collected and uploaded to an open-source platform, RADAR-base [23].

    As the purpose of this paper was to explore the value of the NBDC data in predicting self-reported depressive symptom severity, we focused on the NBDC data, 8-item Patient Health Questionnaire (PHQ-8) data [24], and baseline demographics. However, according to our previous research, the COVID-19 pandemic and related lockdown policies greatly impacted the behaviors (particularly mobility, social interactions, and working environment [working from home]) of European people [25]. To exclude the impact of the COVID-19 pandemic, we performed a preliminary analysis with the data before February 2020.

    PHQ-8 Data

    The variability of each participant’s depressive symptom severity was measured via the PHQ-8, conducted by mobile phones every 2 weeks. The PHQ-8 score ranges from 0 to 24 (increasing severity) [24]. According to the PHQ-8 score, the severity of depression can usually be divided into the following five levels: asymptomatic (PHQ-8 <5), mild (5 ≤ PHQ-8 < 10), moderate (10 ≤ PHQ-8 < 15), moderately severe (15 ≤ PHQ-8 < 20), and severe (PHQ-8 ≥20) [24].

    NBDC Data

    The RADAR-base pRMT app scanned other Bluetooth devices in the participant’s physical proximity once every hour. To avoid privacy leaks from participants and passers, the Media Access Control (MAC) address and types of Bluetooth devices were not recorded in this study. The NBDC was uploaded to the RADAR-base platform for further analyses.

    Figure 1 is a schematic diagram showing an individual’s NBDC in different scenarios in daily activities and life. At home, the NBDC is related to the number of family members and Bluetooth devices in the house, reflecting the participant’s connections with family (whether living alone) and the number of other Bluetooth devices. In public transportation (such as the train, subway, and bus), the NBDC is affected by the number of surrounding passengers’ Bluetooth devices, reflecting the participant’s social connections with strangers. Studies have shown that whether feeling comfortable in the presence of strangers is related to the intensity of social connections [26]. In the company, the NBDC can reflect the participant’s social connections and interactions with co-workers. After work, the NBDC can reflect whether the participant joins other social activities, such as going to the park or bar. Therefore, the NBDC data contain information about participants’ social connections and interactions with family, friends, co-workers, and strangers, and the data can also reflect participants’ time at home, mobility, social isolation, and working status, as well as the number of other Bluetooth devices in the house and working environment.

    Figure 2 shows an example of two NBDC sequences collected over 14 days (336 hours) before two PHQ-8 records from one participant at two different depression severity levels (mild vs moderately severe).

    ‎
    Figure 1. A schematic diagram showing an individual’s nearby Bluetooth devices count (NBDC) in different scenarios in daily activities and life.
    View this figure
    ‎
    Figure 2. An example of two 14-day nearby Bluetooth devices count (NBDC) sequences from the same participant at the mild depression level (A) and moderately severe level (B). PHQ-8: 8-item Patient Health Questionnaire.
    View this figure
    Demographics

    Participants’ demographics were recorded during the enrollment session. According to previous studies [27,28], baseline age, gender, and education level were considered as covariates in our analyses. Due to the different educational systems in the three countries in our data set, we used the number of years in education to represent education level.

    Data Inclusion Criteria and Data Preprocessing

    For each PHQ-8 record, we considered a “PHQ-8 interval” of 14 days before the day when the participant fills in the PHQ-8 questionnaire, as the PHQ-8 score is used to represent the depressive symptom severity of the participant for the past 2 weeks. To reduce the impact of the COVID-19 pandemic and missing data on our analysis, we specified the following two data inclusion criteria:

    1. As mentioned in the data set section, to exclude the impact of the COVID-19 pandemic, we restricted our analysis to PHQ-8 records prior to February 2020.
    2. Saeb et al [29] and Farhan et al [30] used 50% as each day’s completeness threshold for passive data. In our data set, 89.62% of days have 50% (12 hours) or more of the NBDC data. We considered one day as a “valid day” if it contained at least 12 hours of the NBDC data. Then, we empirically selected PHQ-8 intervals with at least 10 valid days as valid PHQ-8 intervals to retain the majority (81.78%) of PHQ-8 intervals.

    For the NBDC sequence in each selected PHQ-8 interval, we used linear interpolation to impute the missing hours in all valid days and discarded the NBDC data that did not belong to a valid day. The “NBDC sequence” in the rest of this paper refers to the preprocessed NBDC data in the 14-day PHQ-8 interval.

    Feature Extraction

    According to past Bluetooth-related research [15-18] and research on nonlinear features of signal processing [31,32], we extracted 49 Bluetooth features from the NBDC sequence in the PHQ-8 interval in the following three categories: second-order statistics, multiscale entropy (MSE), and frequency domain (FD). Table 1 summarizes all Bluetooth features extracted in this paper.

    Table 1. Summary of 49 Bluetooth features used in this paper and their short descriptions.
    CategoryAbbreviationDescriptionNumber of features (N=49)
    Statistical features[Second-order feature]_[Daily feature], eg, Max_MeanSecond-order features (max, min, mean, and standard deviation) calculated in the PHQ-8a interval based on daily statistical Bluetooth features (max, min, mean, and standard deviation).16
    Multiscale entropy (MSE)MSE_1, MSE_2, …, MSE_24Multiscale entropy of the NBDCb sequences from scale 1 to scale 24.24
    Frequency domaincLF_sum, MF_sum, HF_sumThe sums of spectrum power in LF, MF, and HF.3
    Frequency domainLF_pct, MF_pct, HF_pctThe percentages of spectrum power in LF, MF, and HF to the total spectrum power.3
    Frequency domainLF_se, MF_se, HF_seSpectral entropy in LF, MF, and HF.3

    aPHQ-8: 8-item Patient Health Questionnaire.

    bNBDC: nearby Bluetooth device count.

    cLF: low frequency (0-0.75 cycles/day); MF: middle frequency (0.75-1.25 cycles/day); HF: high frequency (>1.25 cycles/day).

    Second-Order Statistical Features

    We first calculated four daily features (max, min, mean, and standard deviation) of daily NBDC data from all valid days in the PHQ-8 interval. For each daily feature, we calculated four second-order features (max, min, mean, and standard deviation) to reflect the amount and variance of the NBDC in the PHQ-8 interval. These features were denoted in the following format: [Second-order feature]_[Daily feature]. For example, the average value of the daily maximum number of the NBDC in the PHQ-8 interval was denoted as Mean_Max. A total of 16 second-order statistical features were extracted.

    Nonlinear Bluetooth Features

    The second-order statistical features can only reflect the amount (max, min, and mean) and variance (standard deviation) of the NBDC data. To exploit more information embedded in the NBDC data, we proposed MSE and FD features to measure the nonlinear characteristics, such as regularity, complexity, and periodicity, of the NBDC sequence.

    Multiscale Entropy Features

    MSE analysis has been used to provide insights into the complexity and periodicity of signals over a range of timescales since the method was proposed by Costa et at [31]. It has been widely used in the field of signal analysis, such as heart rate variability analysis [33], electroencephalogram analysis [34], and gait dynamics analysis [35]. Compared with other entropy techniques (eg, sample entropy and approximate entropy), the advantage of MSE analysis is that the assessments of complexity at shorter and longer timescales can be analyzed separately [36]. The MSE at short timescales reflects the complexity of the sequence. The larger the MSE at short timescales, the more chaotic and irregular the signal. The MSE at relatively long timescales assesses fluctuations occurring at a certain period, reflecting the periodicity of the signal.

    To explore the complexity and periodicity of the NBDC sequence on different timescales (from 1 hour to 24 hours), we calculated MSE features of the NBDC sequences from scale 1 to scale 24, denoted as MSE_1, MSE_2, …, MSE_24. Figure 3 shows an example of MSE features calculated on two NBDC sequences at different depression severity levels from the same participant shown in Figure 2. In this example, the NBDC sequence at the mild depression level (PHQ-8=7) has lower MSE at relatively short timescales (scale 1-3) and higher MSE at relatively long timescales than the sequence at the moderately severe depression level (PHQ-8=15). This indicated that this participant’s NBDC sequence at the mild depression level was more regular and periodic than the NBDC sequence at the moderately severe depression level.

    ‎
    Figure 3. An example of multiscale entropy (scale 1-24) of two 14-day nearby Bluetooth device count (NBDC) sequences at the mild depression level (blue) and the moderately severe level (orange) from the same participant as in Figure 2. PHQ-8: 8-item Patient Health Questionnaire.
    View this figure
    FD Features

    FD analysis has been widely used in the signal processing field, especially for signals with periodic characteristics [32]. People’s behaviors follow a quasiperiodic routine, such as sleeping at night, working on weekdays, and gathering with friends on weekends [19,37]. We therefore leveraged FD analysis to explore the periodic patterns in the NBDC data. Fast Fourier transformation (FFT) was performed to transform the NBDC sequence from the time domain to the FD. We set the sample rate to 24 hours, and then, the spectrum generated by FFT had the frequency axis scaled to reflect cycles per day.

    Figure 4 is an example of a NBDC sequence in the time domain and its spectrum in the FD. According to the spectrum’s definition, spectrum power around 1 cycle per day reflects the participant’s circadian rhythm (approximately 24-hour rhythm) [19]. To explore the periodic rhythms of different period lengths, we empirically defined the following three frequency intervals: low frequency (LF) (0-0.75 cycles/day), middle frequency (MF) (0.75-1.25 cycles/day), and high frequency (HF) (>1.25 cycles/day). The power in MF represents the circadian rhythm. Similarly, the power in LF represents the long-term (>1 day) rhythm, while the power in HF represents the short-term (<1 day) rhythm.

    The sums of spectrum power in these three frequency intervals were calculated and denoted as LF_sum, MF_sum, and HF_sum, respectively. The percentages of spectrum powers in these three frequency intervals to the total spectrum power were extracted and denoted as LF_pct, MF_pct, and HF_pct, respectively. To estimate the complexity and regularity of the spectrum, we calculated spectral entropy (SE) [38] in these three intervals, denoted as LF_se, MF_se, and HF_se, respectively.

    ‎
    Figure 4. An example of a 14-day nearby Bluetooth devices count (NBDC) sequence in the time domain (A) and its spectrum in the frequency domain (B).
    View this figure

    Statistical Methods

    The linear mixed-effect model contains both fixed and random effects, allowing for both within-participant and between-participants variations over repeated measurements [39]. Therefore, we used linear mixed-effect models in our statistical analyses.

    Pairwise Association Analyses

    To explore the association between each Bluetooth feature and depression severity, a series of pairwise linear mixed-effect models with random participant intercepts were performed to regress the PHQ-8 score with each of the Bluetooth features. All mixed-effect models, baseline age, gender, and years in education were considered as covariates. The z-test was used to evaluate the statistical significance of the coefficient of each model. The Benjamini-Hochberg method [40] was used for correction of multiple comparisons, and the significant level for the adjusted P value was set to .05. All linear mixed-effect models were implemented by using the R package “lmerTest,” and the Benjamini-Hochberg method was performed by using the command “p.adjust” in R software (R Foundation for Statistical Computing).

    Likelihood Ratio Test

    One objective of this paper was to assess what value these Bluetooth features provide beyond other information that might be readily available, such as baseline demographics. The likelihood ratio test is a statistical test of goodness of fit between two nested models [41]. If the model with more parameters fits the data significantly better, it indicates that additional parameters provide more information and improve the model’s fitness [41]. Therefore, we built three nested linear mixed-effect models with random participant intercepts (model A, model B, and model C). The predictors of model A were only demographics. The predictors of model B were demographics and 16 second-order statistical features. The predictors of model C were demographics and all 49 Bluetooth features. The likelihood ratio tests were performed to test whether these Bluetooth features have a significant value in fitting the PHQ-8 score regression model.

    Prediction Models

    Another objective of this paper was to examine whether it is possible to predict participants’ depressive symptom severity using Bluetooth features combined with some known information (demographics and previous PHQ-8 scores). A subset of PHQ-8 intervals was selected for the prediction task based on the following two additional criteria:

    1. To ensure that each participant had sufficient PHQ-8 intervals for the time-series cross-validation (described in the following model evaluation section), the number of valid PHQ-8 intervals for each participant should be at least 3.
    2. To test whether the model can predict variability of depression severity, the difference of one participant’s PHQ-8 scores should be more than or equal to 5 (clinically meaningful change) [42].
    Hierarchical Bayesian Linear Regression Model

    The hierarchical Bayesian approach is an intermediate method compared to the completely pooled model and individualized model, capturing the whole population’s characteristics while allowing individual differences [43]. We leveraged the hierarchical Bayesian linear regression model to predict participants’ PHQ-8 scores using Bluetooth features, demographics (age, gender, and years in education), and the last observed PHQ-8 score. In this study, we implemented the hierarchical Bayesian linear regression using the “PyMC3” package [44] in Python. To compare the results with other commonly used machine learning models, we also implemented the LASSO regression model [45] and XGBoost regression model [46] using the Scikit-learn machine learning library [47] in Python. As depressive mood has a strong autocorrelation [48], we considered a baseline hierarchical Bayesian linear regression model with the last observed PHQ-8 score and demographics as predictors.

    Model Evaluation

    We selected root mean squared error (RMSE) and the predicted coefficient of determination (R2) as two metrics for model discrimination evaluation. As we used the temporal data, “future data” should not predict “past data.” Therefore, only the data observed before test data can be included in the training set. We applied leave-all-out (LAO) and leave-one-out (LOO) time-series cross-validation [48]. As the number of PHQ-8 intervals of each participant in our data was different, we made some minor modifications to these two schemes (Figure 5).

    ‎
    Figure 5. Two schematic diagrams of leave-all-out time-series cross-validation (A) and leave-one-out time-series cross-validation (B), where T is the maximum number of PHQ-8 intervals of one participant, J is the number of participants, the training set is indicated by blue, the test set is indicated by orange, and unused data are indicated by green. PHQ-8: 8-item Patient Health Questionnaire.
    View this figure
    LAO Time-Series Cross-Validation

    Each participant’s data were divided into a sequence of t consecutive same-sized test sets, where the size of each test set is the length of one PHQ-8 interval (14 days) and t is the number of PHQ-8 intervals of this participant. The corresponding training set included all PHQ-8 intervals before each test set. Then, test sets and training sets were pooled across all participants. This process generated T-1 test and training set pairs (no prior data to predict the first PHQ-8 score), where T is the maximum number of PHQ-8 intervals of one participant in our data set (t≤T).

    LOO Time-Series Cross-Validation

    Each participant’s data were divided into a training set and a test set. The training set was constructed using the first two PHQ-8 intervals of a participant, with the test set containing the rest of the participant’s PHQ-8 intervals. Then, the training set was pooled with all data from all other participants. This scheme generated J training and test set pairs, where J is the number of participants in our data set.


    Data Summary

    According to our date inclusion criteria, from June 2018 to February 2020, 2886 PHQ-8 intervals from 316 participants collected from three study sites were selected for our analysis. Table 2 shows the descriptive statistics for all 49 Bluetooth features, and Figure 6 presents pairwise Spearman correlation coefficients between all features. Table 3 presents a summary of the demographics and distribution of PHQ-8 records of all selected participants. Figure 7 presents boxplots of the NBDC for every hour in the whole population.

    Table 2. Descriptive statistics for all 49 Bluetooth features.
    FeatureaMeanSDMinQ1MedianQ3Max
    Second-order statistics







    		Max_Max49.7948.481.0025.0040.0060.00621.00

    		Min_Max5.096.220.002.004.006.0090.00

    		Mean_Max18.5618.940.759.2314.0721.62268.29

    		Std_Max13.1414.050.006.1410.4516.22195.19

    		Max_Min1.592.080.000.001.002.0043.00

    		Min_Min0.060.270.000.000.000.003.00

    		Mean_Min0.580.880.000.000.210.7913.71

    		Std_Min0.500.620.000.000.420.7011.94

    		Max_Std12.3112.760.345.609.5115.39185.98

    		Min_Std1.201.450.000.560.871.3221.61

    		Mean_Std4.554.870.162.173.255.2470.65

    		Std_Std3.243.710.091.342.434.0462.52

    		Max_Mean9.329.340.174.386.8811.04136.10

    		Min_Mean1.882.140.000.501.422.5032.00

    		Mean_Mean4.424.190.072.193.405.2849.55

    		Std_Mean2.132.590.050.841.452.5449.37
    Multiscale entropy (MSE)







    		MSE_10.800.460.050.420.711.132.44

    		MSE_20.970.540.040.560.851.313.58

    		MSE_31.120.660.090.701.011.429.41

    		MSE_41.230.690.050.821.151.518.83

    		MSE_51.350.820.100.931.271.628.51

    		MSE_61.380.840.080.971.281.638.00

    		MSE_71.470.970.101.011.331.707.72

    		MSE_81.501.070.101.001.301.677.40

    		MSE_91.581.220.100.991.321.727.30

    		MSE_101.581.230.080.971.301.727.08

    		MSE_111.581.290.090.951.251.677.02

    		MSE_121.591.330.100.921.231.666.70

    		MSE_131.741.460.110.981.301.796.55

    		MSE_141.851.530.111.011.361.876.70

    		MSE_151.961.620.131.031.391.956.55

    		MSE_161.981.620.131.031.391.956.40

    		MSE_172.041.670.141.021.392.086.14

    		MSE_182.031.650.151.011.392.086.04

    		MSE_192.091.690.171.011.392.086.04

    		MSE_202.091.670.170.981.392.085.94

    		MSE_212.101.660.180.981.392.205.83

    		MSE_222.131.680.180.981.392.305.83

    		MSE_232.171.690.180.981.394.285.61

    		MSE_242.271.700.200.981.394.285.35
    Frequency domain (FD)







    		LFb_sum330.662469.740.0517.4153.87184.8085956.16

    		MFc_sum157.241166.320.028.1625.7783.0534970.35

    		HFd_sum602.223272.440.4755.72151.74403.3864127.16

    		LF_pcte0.250.100.030.170.230.310.63

    		MF_pct0.130.100.010.070.110.170.74

    		HF_pct0.620.150.120.530.640.720.92

    		LF_sef0.830.100.380.780.850.901.00

    		MF_se0.820.090.400.770.830.880.99

    		HF_se0.900.040.720.880.900.920.99

    aDefinitions of Bluetooth features in this table are shown in Table 1.

    bLF: low frequency (0-0.75 cycles/day).

    cMF: middle frequency (0.75-1.25 cycles/day).

    dHF: high frequency (>1.25 cycles/day).

    epct: percentage of spectrum power.

    fse: spectral entropy.

    ‎
    Figure 6. A correlation plot of pairwise Spearman correlations between all 49 Bluetooth features. Definitions of Bluetooth features in this figure are shown in Table 1.
    View this figure
    Table 3. Summary of the demographics and 8-item Patient Health Questionnaire (PHQ-8) record distribution of all selected participants.
    CharacteristicValue
    Number of participants316
    Demographics

    		Age at baseline, median (Q1, Q3)51.0 (35.0, 59.0)

    		Female sex, n (%)234 (74.1%)

    		Number of years in education, median (Q1, Q3)16.0 (14.0, 19.0)
    PHQ-8 record distribution

    		Number of PHQ-8 intervals2886

    		Number of PHQ-8 intervals for each participant, median (Q1, Q3)8.0 (3.0, 14.0)

    		PHQ-8 score, median (Q1, Q3)9.0 (5.0, 15.0)
    ‎
    Figure 7. Boxplots of the nearby Bluetooth devices count (NBDC) for every hour in the whole population. Boxes extend between the 25th and 75th percentiles, and green solid lines inside the boxes are medians. Note the relative stationary NBDC during the night-time hours.
    View this figure

    Association Analysis Results

    The significant associations between depression severity (the PHQ-8 score) and Bluetooth features are presented in Table 4.

    Associations Between the PHQ-8 Score and Second-Order Statistical Features

    There were 10 second-order statistical features significantly associated with the PHQ-8 score. All these significant associations were negative, that is, the larger the value of these features, the lower the PHQ-8 score. Notably, Min_Max (the minimum value of daily maximum NBDC in the past 14 days) had the strongest association (z=−4.431, P<.001), which indicated that participants with a lower PHQ-8 score tended to have more daily social activities (such as social interactions and traveling) in the past 2 weeks. In addition, four features related to daily variance (Max_Std, Min_Std, Mean_Std, and Std_Std) of the NBDC were all significantly and negatively associated with depression.

    Associations Between the PHQ-8 Score and Multiscale Entropy Features

    MSE at scale 1, scale 2, and scale 3 (MSE_1, MSE_2, and MSE_3) were significantly and positively associated with the PHQ-8 score, while MSE at scale 16 and scale 22 (MSE_16 and MSE_22) were significantly and negatively associated with depressive symptom severity. According to the explanations of MSE we mentioned in the Methods section, these associations indicated that participants with more irregular and chaotic NBDC sequences were likely to have more severe depressive symptoms, while those with periodic and regular NBDC sequences may have lower PHQ-8 scores.

    Associations Between the PHQ-8 Score and FD Features

    There were five FD features significantly associated with the PHQ-8 score. The spectrum power was related to both the amount and frequency components of the NBDC sequence, so it had relatively strong correlations with second-order statistical features (Figure 6). Therefore, the spectrum power of three frequency intervals (LF_sum, MF_sum, and HF_sum) were all significantly and negatively associated with the PHQ-8 score. Among them, the MF_sum had the strongest association (z=−4.766, P<.001) with depression, which indicated that the circadian rhythm of the NBDC sequence is important to reflect the severity of depression. Likewise, the percentage of middle-frequency power (MF_pct) was significantly and negatively associated with depressive symptom severity. The spectral entropy of HF (HF_se) was significantly and positively associated with depression. This indicated that participants with irregular short-term (<1 day) rhythms were likely to have more severe depressive symptoms.

    Table 4. Coefficient estimates, standard error, z-test statistics, and P values from pairwise linear mixed-effect models for exploring associations between Bluetooth features and the depressive symptom severity (8-item Patient Health Questionnaire).
    FeatureaEstimateSEz scoreAdjusted P valueb,c
    Second-order statistics




    		Min_Max−0.0520.012−4.431<.001

    		Mean_max−0.0160.006−2.809.005

    		Max_Std−0.0150.006−2.657.008

    		Min_Std−0.2150.056−3.838<.001

    		Mean_Std−0.0650.023−2.802.005

    		Std_Std−0.0480.020−2.385.02

    		Max_Mean−0.0300.008−3.498<.001

    		Min_Mean−0.0930.046−2.036.04

    		Mean_Mean−0.0830.026−3.225.001

    		Std_Mean−0.0950.027−3.464.001
    Multiscale entropy (MSE)

    		MSE_10.6420.2252.853.005

    		MSE_20.4330.1922.255.02

    		MSE_30.4010.2021.985.04

    		MSE_16−0.1020.042−2.429.01

    		MSE_22−0.1230.043−2.860.005
    Frequency domain (FD)

    		LFd_sum−0.0210.005−3.865<.001
    MFe_sum−0.0670.014−4.766<.001

    		HFf_sum−0.0270.010−2.606.009

    		MF_pctg−1.8340.812−2.259.02

    		HF_seh3.8211.8202.099.04

    aDefinitions of Bluetooth features in this table are shown in Table 1.

    bOnly significant associations (adjusted P value <.05) are reported.

    cP values were adjusted by the Benjamini-Hochberg method for correction of multiple comparisons.

    dLF: low frequency (0-0.75 cycles/day).

    eMF: middle frequency (0.75-1.25 cycles/day).

    fHF: high frequency (>1.25 cycles/day).

    gpct: percentage of spectrum power.

    hse: spectral entropy.

    Results of Likelihood Ratio Tests

    The results of the likelihood ratio tests are presented in Table 5. Model B (with second-order statistical Bluetooth features) and model C (with all Bluetooth features) fitted data significantly better than model A (without Bluetooth features), indicating that Bluetooth features could improve the statistical model significantly. The goodness of fit of model C was significantly better than that of model B, indicating that nonlinear Bluetooth features (MSE and FD features) provided additional information to the statistical model.

    Table 5. Results of the likelihood ratio tests of the three nested linear mixed-effect models.
    ModelDifference of parametersChi-squareaP value
    Model Bb vs model Ac1631.04.01
    Model Cd vs model A49135.19<.001
    Model C vs model B33104.15<.001

    aThe critical values of the likelihood ratio statistic are as follows: χ20.05(16)=26.296, χ20.05(33)=47.400, and χ20.05(49)=66.339.

    bPredictors of model B: demographics + 16 second-order statistical features.

    cPredictors of model A: demographics.

    dPredictors of model C: demographics + 16 second-order statistical features + 24 multiscale entropy features + nine frequency domain features.

    Performance of Prediction Models

    A subset of 183 participants was selected for the prediction models. The results of the LAO and LOO time-series cross-validation are presented in Table 6. The R2 score of the baseline model was 0.338 in LAO time-series cross-validation, which showed that more than 30% variance could be explained by the last observed PHQ-8 score and baseline demographics. In LOO time-series cross-validation, the R2 score of the baseline model was negative, which indicated that the baseline model did not explain any variance in the LOO time-series cross-validation. To assess the improvement from nonlinear Bluetooth features, we tested the hierarchical Bayesian model with and without nonlinear Bluetooth features separately.

    Table 6. Results of the leave-all-out time-series cross-validation and leave-one-out time-series cross-validation of the hierarchical Bayesian linear regression model, commonly used machine learning models, and the baseline model.
    ModelLeave-all-outLeave-one-out
    R2RMSEaR2RMSE
    Baseline modelb0.3384.547−0.0745.802
    LASSO regression0.4584.1140.1445.178
    XGBoost regression0.4644.0920.3464.523
    Hierarchical Bayesian linear (second-order statistical features)0.4814.0260.3534.501
    Hierarchical Bayesian linear (all Bluetooth features)0.5263.8910.3874.426

    aRMSE: root mean squared error.

    bThe baseline model is the hierarchical Bayesian linear regression model with only the last observed 8-item Patient Health Questionnaire score and demographics as predictors.

    In the subset, the maximum number of PHQ-8 intervals of one participant was 27, so the LAO time-series cross-validation went through T-1=26 iterations. The hierarchical Bayesian linear regression model with all Bluetooth features achieved the best result (R2=0.526, RMSE=3.891), beating the LASSO and XGBoost regression models. Compared with the result of the baseline model (R2=0.338), the improvement in the R2 score was 0.188, which means the Bluetooth features explained an additional 18.8% of data variance. The nonlinear Bluetooth features explained an additional 4.5% of data variance in the hierarchical Bayesian model.

    The number of subset participants was 183, so J=183 iterations of the LOO time-series cross-validation were performed. The hierarchical Bayesian linear model with all Bluetooth features had the best performance (R2=0.387, RMSE=4.426), but the result was close to that of the XGBoost regression model (R2=0.346, RMSE=4.523).

    The performance of the hierarchical Bayesian linear regression model evaluated by the LAO cross-validation was better than the LOO cross-validation performance. One potential reason is that only the first two PHQ-8 intervals of one participant were used for training in the LOO cross-validation, which may have caused the model to underfit the patterns at the participant level.


    Principal Findings

    This paper explored the value of the NBDC data in predicting depression severity. Compared with previous Bluetooth-related studies [15-18], our study was performed on a larger (N=316) multicenter data set with a longer follow-up (median 4 months). We extracted 49 features from the NBDC sequences in the following three categories: second-order statistical features, MSE features, and FD features. To the best of our knowledge, this is the first time that MSE and FD features have been used in NBDC and depression data analyses. According to the results of association analyses (Table 4), when depression symptoms worsened (increase in the PHQ-8 score), one or more of the following changes were seen in the preceding 14 days of the NBDC sequence: (1) the amount decreased, which is consistent with the finding by Wang et al [15], (2) the variance decreased, (3) the periodicity (especially the circadian rhythm) decreased, and (4) the NBDC sequence became more irregular and chaotic.

    These changes in the NBDC data can be explained by depression symptoms. The main manifestations of depression include negative feelings (such as sadness, guilt, stress, and tiredness) and loss of interest or pleasure [49]. This may lead to changes in behaviors, such as increased time at home [29,50], decreased mobility [3,29], loss of the ability to work or study [2,49], reduced intensity of social interactions [1], unstable and irregular sleep [51], and decreased engagement in activities [52]. The increased time at home, inability to work or study, and diminished social interactions are reflected in the reduced amount of the NBDC sequence. The decreased mobility and engagement in activities may be possible reasons why participants with higher PHQ-8 scores have lower variance-related features (Max_Std, Min_Std, Mean_Std, and Std_Std). Depression also may lead to misalignment of the circadian rhythm and make people’s life rhythms (such as sleep rhythms and social rhythms) more irregular [19]. This can be reflected in reduced periodicity and increased irregularity of the NBDC sequence. Saeb et al [29] and Farhan et al [30] found similar findings in GPS data, and showed that the circadian rhythm of the GPS signal was significantly and negatively correlated with depression.

    From the perspective of the statistical model, Bluetooth features extracted in this paper significantly improved the goodness of fit for the PHQ-8 score, and nonlinear Bluetooth features (MSE and FD features) can provide additional information to second-order statistical features (Table 5). From the perspective of the prediction model, these 49 Bluetooth features explained an extra 18.8% of the variance in the PHQ-8 score relative to the baseline model, containing only the last PHQ-8 score and demographics, and MSE and FD features explained an extra 4.5% of data variance in the hierarchical Bayesian model (Table 6). From the perspective of the correlations between Bluetooth features (Figure 6), we can observe that, except for three FD features related to the spectrum power that had relatively strong correlations with second-order statistical features, the correlations between other nonlinear Bluetooth features and second-order statistical features were not obvious. This indicated that the MSE and FD features captured dimensions of information to second-order statistical features.

    In our prediction model, the hierarchical Bayesian linear regression model achieved the best results in both the LAO and LOO time-series cross-validation. Compared with other models, one of the advantages of the hierarchical Bayesian model is that it performs individual predictions while considering the population’s common characteristics [43]. Therefore, the hierarchical Bayesian model can be considered a suitable prediction modelling method for longitudinal data. The LOO time-series cross-validation results illustrated that the hierarchical Bayesian model could predict depression for participants with few observations (only two PHQ intervals in the training set) that overcomes the cold start problem. The hierarchical Bayesian linear model achieved a better result in the LAO time-series cross-validation, which indicated that the prediction results gradually became more accurate and individualized when each participant had more data available in the training set.

    Limitations

    The RADAR-MDD project was designed for long-term monitoring (up to 2 years) and collecting many other passive data, such as GPS data, acceleration data, app usage, and screen lightness, which need to be collected simultaneously through the mobile phone. Therefore, to avoid excessive battery consumption, nearby Bluetooth devices were scanned hourly in this study. However, some past studies suggested scanning nearby Bluetooth devices every 5 minutes to achieve high enough temporal resolution [9,18]. Although hourly NBDC data can also reflect individuals’ behaviors and statuses, our lower data resolution may cause the loss of some dynamic information. On the other hand, using the relatively low resolution enabled us to collect multimodal data without excessive battery consumption. As the NBDC data are related to individuals’ movement and location information, we will combine the NBDC data with GPS and acceleration data for future analysis to understand the context of the Bluetooth data.

    As we mentioned in the Methods section, the MAC addresses and types of Bluetooth devices were not recorded for private issues. This made it impossible to distinguish between mobile phones and other Bluetooth devices (such as headphones, printers, and laptops), and between strangers’ and acquaintances’ devices. The advantage of the NBDC data is that the data contain mixed and rich information. The disadvantage is that it is difficult to explain the specific reasons for changes in the NBDC, that is, we cannot know whether the changes in the NBDC are caused by social interactions, working status, traveling, or isolation. Therefore, this paper did not explain in depth the actual meaning behind the Bluetooth features. For this limitation, we plan to use hashed MAC addresses in future research.

    For the FD features, the division of the frequency intervals of the spectrum of the NBDC sequence in this paper was manually specified by our experience. The purpose of extracting these FD features was to prove that the NBDC sequence’s FD has the potential to provide more information about individuals’ behaviors and life rhythms. It is necessary to discuss the optimal boundaries of frequency intervals of the NBDC data in future research.

    This paper applied the hierarchical Bayesian linear regression model to explore the linear relationships between Bluetooth features and depression. However, there may be nonlinear relationships between social connections and depressive symptom severity. The Gaussian process [53], using the kernel method to find nonlinear relationships, will be considered in future research.

    Conclusion

    Our statistical results indicated that the NBDC data have the potential to reflect changes in individuals’ behaviors and statuses during a depressive state. The prediction results demonstrated that the NBDC data have significant value in predicting depressive symptom severity. The nonlinear Bluetooth features proposed in this paper provide additional information to statistical and prediction models. The hierarchical Bayesian model is an appropriate prediction model for predicting depression with longitudinal data, as both participant-level and population-level characteristics are considered in the model. These findings may support the mental health monitoring practice in real-world settings.

    Acknowledgments

    The Remote Assessment of Disease and Relapse-Central Nervous System (RADAR-CNS) project has received funding from the Innovative Medicines Initiative (IMI) 2 Joint Undertaking under grant agreement number 115902. This Joint Undertaking receives support from the European Union’s Horizon 2020 research and innovation program and European Federation of Pharmaceutical Industries and Associations (EFPIA) (www.imi.europa.eu). This communication reflects the views of the RADAR-CNS consortium, and neither IMI nor the European Union and EFPIA are liable for any use that may be made of the information contained herein. The funding body was not involved in the design of the study, the collection or analysis of the data, or the interpretation of the data. Participants in the CIBER site came from the following four clinical communities in Spain: Parc Sanitari Sant Joan de Déu Network services, Institut Català de la Salut, Institut Pere Mata, and Hospital Clínico San Carlos. Participant recruitment in Amsterdam was partially accomplished through Hersenonderzoek.nl, a Dutch online registry that facilitates participant recruitment for neuroscience studies. Hersenonderzoek.nl is funded by ZonMw-Memorabel (project number 73305095003), a project in the context of the Dutch Deltaplan Dementie, Gieskes-Strijbis Foundation, the Alzheimer's Society in the Netherlands, and Brain Foundation Netherlands. This paper represents independent research partly funded by the National Institute for Health Research (NIHR) Maudsley Biomedical Research Centre at South London and Maudsley NHS Foundation Trust and King’s College London. The views expressed are those of the authors and not necessarily those of the NHS, NIHR, or Department of Health and Social Care. We thank all the members of the RADAR-CNS patient advisory board for their contribution to the device selection procedures and for their invaluable advice throughout the study protocol design. This research was reviewed by a team with experience in mental health problems and their careers who have been specially trained to advise on research proposals and documentation through the Feasibility and Acceptability Support Team for Researchers (FAST-R), a free confidential service in England provided by the National Institute for Health Research Maudsley Biomedical Research Centre via King’s College London and South London and Maudsley NHS Foundation Trust. Remote Assessment of Disease and Relapse-Major Depressive Disorder (RADAR-MDD) will be conducted according to the Declaration of Helsinki and Good Clinical Practice, adhering to principles outlined in the NHS Research Governance Framework for Health and Social Care (2nd edition). Ethical approval has been obtained in London from the Camberwell St Giles Research Ethics Committee (REC reference: 17/LO/1154), in London from the CEIC Fundacio Sant Joan de Deu (CI: PIC-128-17), and in the Netherlands from the Medische Ethische Toetsingscommissie VUms (METc VUmc registratienummer: 2018.012 – NL63557.029.17). RJBD is supported by the following: (1) NIHR Biomedical Research Centre at South London and Maudsley NHS Foundation Trust and King’s College London, London, UK; (2) Health Data Research UK, which is funded by the UK Medical Research Council, Engineering and Physical Sciences Research Council, Economic and Social Research Council, Department of Health and Social Care (England), Chief Scientist Office of the Scottish Government Health and Social Care Directorates, Health and Social Care Research and Development Division (Welsh Government), Public Health Agency (Northern Ireland), British Heart Foundation, and Wellcome Trust; (3) The BigData@Heart Consortium, funded by the Innovative Medicines Initiative-2 Joint Undertaking under grant agreement number 116074. This Joint Undertaking receives support from the European Union’s Horizon 2020 research and innovation program and EFPIA; it is chaired by DE Grobbee and SD Anker, partnering with 20 academic and industry partners and the European Society of Cardiology; (4) The National Institute for Health Research University College London Hospitals Biomedical Research Centre; (5) The NIHR Biomedical Research Centre at South London and Maudsley NHS Foundation Trust and King’s College London; (6) The UK Research and Innovation London Medical Imaging & Artificial Intelligence Centre for Value Based Healthcare; (7) The NIHR Applied Research Collaboration South London (NIHR ARC South London) at King’s College Hospital NHS Foundation Trust. This paper represents independent research partly funded by the NIHR Biomedical Research Centre at South London and Maudsley NHS Foundation Trust and King’s College London. The views expressed are those of the authors and not necessarily those of the NHS, the NIHR, or the Department of Health and Social Care. MH and TW have been supported by NIHR Senior Investigator Awards.

    Conflicts of Interest

    VAN is an employee of Janssen Research and Development LLC. PA is employed by the pharmaceutical company H. Lundbeck A/S. DCM has accepted honoraria and consulting fees from Apple, Inc, Otsuka Pharmaceuticals, Pear Therapeutics, and the One Mind Foundation; has received royalties from Oxford Press; and has an ownership interest in Adaptive Health, Inc.

    1. Cacioppo JT, Hughes ME, Waite LJ, Hawkley LC, Thisted RA. Loneliness as a specific risk factor for depressive symptoms: cross-sectional and longitudinal analyses. Psychol Aging 2006 Mar;21(1):140-151. [CrossRef] [Medline]
    2. Rizvi SJ, Cyriac A, Grima E, Tan M, Lin P, Gallaugher LA, et al. Depression and employment status in primary and tertiary care settings. Can J Psychiatry 2015 Jan;60(1):14-22 [FREE Full text] [CrossRef] [Medline]
    3. Lampinen P, Heikkinen E. Reduced mobility and physical activity as predictors of depressive symptoms among community-dwelling older adults: an eight-year follow-up study. Aging Clin Exp Res 2003 Jun;15(3):205-211. [CrossRef] [Medline]
    4. Burgess P, Pirkis J, Morton J, Croke E. Lessons from a comprehensive clinical audit of users of psychiatric services who committed suicide. Psychiatr Serv 2000 Dec;51(12):1555-1560. [CrossRef] [Medline]
    5. Boonstra T, Werner-Seidler A, O'Dea B, Larsen M, Christensen H. Smartphone app to investigate the relationship between social connectivity and mental health. 2017 Presented at: 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC); July 11-15, 2017; Jeju, Korea (South) p. 287-290. [CrossRef]
    6. Rohani DA, Faurholt-Jepsen M, Kessing LV, Bardram JE. Correlations Between Objective Behavioral Features Collected From Mobile and Wearable Devices and Depressive Mood Symptoms in Patients With Affective Disorders: Systematic Review. JMIR Mhealth Uhealth 2018 Aug 13;6(8):e165 [FREE Full text] [CrossRef] [Medline]
    7. Yan Z, Yang J, Tapia EM. Smartphone bluetooth based social sensing. In: UbiComp '13 Adjunct: Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publication. 2013 Presented at: ACM conference on Pervasive and ubiquitous computing adjunct publication; September 8-12, 2013; Zurich, Switzerland p. 95-98. [CrossRef]
    8. Eagle N, Pentland A, Lazer D. Inferring friendship network structure by using mobile phone data. Proc Natl Acad Sci U S A 2009 Sep 08;106(36):15274-15278 [FREE Full text] [CrossRef] [Medline]
    9. Eagle N, (Sandy) Pentland A. Reality mining: sensing complex social systems. Pers Ubiquit Comput 2005 Nov 3;10(4):255-268. [CrossRef]
    10. Dissing AS, Jørgensen TB, Gerds TA, Rod NH, Lund R. High perceived stress and social interaction behaviour among young adults. A study based on objective measures of face-to-face and smartphone interactions. PLoS One 2019 Jul 26;14(7):e0218429 [FREE Full text] [CrossRef] [Medline]
    11. Clark BK, Winkler EA, Brakenridge CL, Trost SG, Healy GN. Using Bluetooth proximity sensing to determine where office workers spend time at work. PLoS One 2018 Mar 7;13(3):e0193971 [FREE Full text] [CrossRef] [Medline]
    12. Nordström E, Diot C, Gass R, Gunningberg P. Experiences from measuring human mobility using Bluetooth inquiring devices. In: MobiEval '07: Proceedings of the 1st international workshop on System evaluation for mobile platforms. 2007 Presented at: 1st international workshop on System evaluation for mobile platforms; June 11, 2007; San Juan, Puerto Rico p. 15-20. [CrossRef]
    13. Doryab A, Villalba DK, Chikersal P, Dutcher JM, Tumminia M, Liu X, et al. Identifying Behavioral Phenotypes of Loneliness and Social Isolation with Passive Sensing: Statistical Analysis, Data Mining and Machine Learning of Smartphone and Fitbit Data. JMIR Mhealth Uhealth 2019 Jul 24;7(7):e13209 [FREE Full text] [CrossRef] [Medline]
    14. Wu C, Barczyk AN, Craddock RC, Harari GM, Thomaz E, Shumake JD, et al. Improving prediction of real-time loneliness and companionship type using geosocial features of personal smartphone data. Smart Health 2021 Apr;20:100180. [CrossRef]
    15. Wang R, Chen F, Chen Z, Li T, Harari G, Tignor S, et al. StudentLife: assessing mental health, academic performance and behavioral trends of college students using smartphones. In: UbiComp '14: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing. 2014 Presented at: ACM International Joint Conference on Pervasive and Ubiquitous Computing; September 13-17, 2014; Seattle, Washington p. 3-14. [CrossRef]
    16. Moturu S, Khayal I, Aharony N, Wei P, Pentland A. Sleep, mood and sociability in a healthy population. 2011 Presented at: Annual International Conference of the IEEE Engineering in Medicine and Biology Society; August 30-September 3, 2011; Boston, MA, USA p. 5267-5270. [CrossRef]
    17. Bogomolov A, Lepri B, Pianesi F. Happiness Recognition from Mobile Phone Data. 2013 Presented at: 2013 International Conference on Social Computing; September 8-14, 2013; Alexandria, VA, USA p. 790-795. [CrossRef]
    18. Bogomolov A, Lepri B, Ferron M, Pianesi F. Daily Stress Recognition from Mobile Phone Data, Weather Conditions and Individual Traits. 2014 Presented at: MM '14: Proceedings of the 22nd ACM international conference on Multimedia; November 3-7, 2014; Orlando, FL, USA p. 477-486. [CrossRef]
    19. Walker WH, Walton JC, DeVries AC, Nelson RJ. Circadian rhythm disruption and mental health. Transl Psychiatry 2020 Jan 23;10(1):28 [FREE Full text] [CrossRef] [Medline]
    20. Khoulji S, Garzón-Rey J, Aguilo J. Remote Assessment of Disease and Relapse – Central Nervous System- RADAR-CNS. TMLAI 2017 Aug 31;5(4):1 [FREE Full text] [CrossRef]
    21. Matcham F, Barattieri di San Pietro C, Bulgari V, de Girolamo G, Dobson R, Eriksson H, RADAR-CNS consortium. Remote assessment of disease and relapse in major depressive disorder (RADAR-MDD): a multi-centre prospective cohort study protocol. BMC Psychiatry 2019 Feb 18;19(1):72 [FREE Full text] [CrossRef] [Medline]
    22. Hersenonderzoek.nl.   URL: https://hersenonderzoek.nl [accessed 2020-07-20]
    23. Ranjan Y, Rashid Z, Stewart C, Conde P, Begale M, Verbeeck D, Hyve, RADAR-CNS Consortium. RADAR-Base: Open Source Mobile Health Platform for Collecting, Monitoring, and Analyzing Data Using Sensors, Wearables, and Mobile Devices. JMIR Mhealth Uhealth 2019 Aug 01;7(8):e11734 [FREE Full text] [CrossRef] [Medline]
    24. Kroenke K, Strine TW, Spitzer RL, Williams JBW, Berry JT, Mokdad AH. The PHQ-8 as a measure of current depression in the general population. J Affect Disord 2009 Apr;114(1-3):163-173. [CrossRef] [Medline]
    25. Sun S, Folarin AA, Ranjan Y, Rashid Z, Conde P, Stewart C, RADAR-CNS Consortium. Using Smartphones and Wearable Devices to Monitor Behavioral Changes During COVID-19. J Med Internet Res 2020 Sep 25;22(9):e19992 [FREE Full text] [CrossRef] [Medline]
    26. Lee RM, Draper M, Lee S. Social connectedness, dysfunctional interpersonal behaviors, and psychological distress: Testing a mediator model. Journal of Counseling Psychology 2001;48(3):310-318. [CrossRef]
    27. Aluoja A, Leinsalu M, Shlik J, Vasar V, Luuk K. Symptoms of depression in the Estonian population: prevalence, sociodemographic correlates and social adjustment. Journal of Affective Disorders 2004 Jan;78(1):27-35. [CrossRef]
    28. Akhtar-Danesh N, Landeen J. Relation between depression and sociodemographic factors. Int J Ment Health Syst 2007 Sep 04;1(1):4 [FREE Full text] [CrossRef] [Medline]
    29. Saeb S, Zhang M, Karr CJ, Schueller SM, Corden ME, Kording KP, et al. Mobile Phone Sensor Correlates of Depressive Symptom Severity in Daily-Life Behavior: An Exploratory Study. J Med Internet Res 2015 Jul 15;17(7):e175 [FREE Full text] [CrossRef] [Medline]
    30. Farhan AA, Yue C, Morillo R, Ware S, Lu J, Bi J, et al. Behavior vs. introspection: refining prediction of clinical depression via smartphone sensing data. 2016 Presented at: 2016 IEEE Wireless Health (WH); October 25-27, 2016; Bethesda, MD, USA. [CrossRef]
    31. Costa M, Goldberger AL, Peng C. Multiscale entropy analysis of biological signals. Phys Rev E Stat Nonlin Soft Matter Phys 2005 Feb 18;71(2 Pt 1):021906. [CrossRef] [Medline]
    32. Broughton S, Bryan K. Discrete Fourier Analysis and Wavelets: Applications to Signal and Image Processing. Hoboken, NJ, USA: Wiley; 2008.
    33. Silva LEV, Cabella BCT, Neves UPDC, Murta Junior LO. Multiscale entropy-based methods for heart rate variability complexity analysis. Physica A: Statistical Mechanics and its Applications 2015 Mar;422:143-152. [CrossRef]
    34. Mizuno T, Takahashi T, Cho RY, Kikuchi M, Murata T, Takahashi K, et al. Assessment of EEG dynamical complexity in Alzheimer's disease using multiscale entropy. Clin Neurophysiol 2010 Sep;121(9):1438-1446 [FREE Full text] [CrossRef] [Medline]
    35. Costa M, Peng C, L. Goldberger A, Hausdorff JM. Multiscale entropy analysis of human gait dynamics. Physica A: Statistical Mechanics and its Applications 2003 Dec;330(1-2):53-60. [CrossRef]
    36. Busa MA, van Emmerik RE. Multiscale entropy: A tool for understanding the complexity of postural control. J Sport Health Sci 2016 Mar;5(1):44-51 [FREE Full text] [CrossRef] [Medline]
    37. Mizuno K. Human circadian rhythms and exercise: Significance and application in real-life situations. JPFSM 2014;3(3):307-315. [CrossRef]
    38. Shannon CE. A Mathematical Theory of Communication. The Bell System Technical Journal 1948;27(3):379-423. [CrossRef]
    39. Laird NM, Ware JH. Random-effects models for longitudinal data. Biometrics 1982 Dec;38(4):963-974. [Medline]
    40. Benjamini Y, Hochberg Y. Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing. Journal of the Royal Statistical Society: Series B (Methodological) 2018 Dec 05;57(1):289-300. [CrossRef]
    41. Glover S, Dixon P. Likelihood ratios: a simple and flexible statistic for empirical psychologists. Psychon Bull Rev 2004 Oct;11(5):791-806. [CrossRef] [Medline]
    42. Saeb S, Lattie EG, Schueller SM, Kording KP, Mohr DC. The relationship between mobile phone location sensor data and depressive symptom severity. PeerJ 2016;4:e2537 [FREE Full text] [CrossRef] [Medline]
    43. Gelman A, Carlin J, Stern H, Dunson D, Vehtari A, Rubin D. Bayesian Data Analysis. New York, NY: Chapman and Hall/CRC; 2013.
    44. Salvatier J, Wiecki T, Fonnesbeck C. Probabilistic programming in Python using PyMC3. PeerJ Computer Science 2016;2:e55 [FREE Full text] [CrossRef]
    45. Tibshirani R. Regression Shrinkage and Selection Via the Lasso. Journal of the Royal Statistical Society: Series B (Methodological) 2018 Dec 05;58(1):267-288. [CrossRef]
    46. Chen T, Guestrin C. XGBoost: A Scalable Tree Boosting System. 2016 Presented at: KDD '16: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining; August 13-17, 2016; San Francisco, CA, USA p. 785-794. [CrossRef]
    47. Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, et al. Scikit-learn: Machine learning in Python. The Journal of Machine Learning Research 2011;12:2825-2830 [FREE Full text]
    48. Busk J, Faurholt-Jepsen M, Frost M, Bardram JE, Vedel Kessing L, Winther O. Forecasting Mood in Bipolar Disorder From Smartphone Self-assessments: Hierarchical Bayesian Approach. JMIR Mhealth Uhealth 2020 Apr 01;8(4):e15028 [FREE Full text] [CrossRef] [Medline]
    49. Depression and Other Common Mental Disorders: Global Health Estimates. World Health Organization.   URL: https://apps.who.int/iris/bitstream/handle/10665/254610/WHO-MSD-MER-2017.2-eng.pdf [accessed 2021-07-20]
    50. Chow PI, Fua K, Huang Y, Bonelli W, Xiong H, Barnes LE, et al. Using Mobile Sensing to Test Clinical Models of Depression, Social Anxiety, State Affect, and Social Isolation Among College Students. J Med Internet Res 2017 Mar 03;19(3):e62 [FREE Full text] [CrossRef] [Medline]
    51. Zhang Y, Folarin AA, Sun S, Cummins N, Bendayan R, Ranjan Y, RADAR-CNS Consortium. Relationship Between Major Depression Symptom Severity and Sleep Collected Using a Wristband Wearable Device: Multicenter Longitudinal Observational Study. JMIR Mhealth Uhealth 2021 Apr 12;9(4):e24604 [FREE Full text] [CrossRef] [Medline]
    52. Goldberg B, Brintnell ES, Goldberg J. The Relationship Between Engagement in Meaningful Activities and Quality of Life in Persons Disabled by Mental Illness. Occupational Therapy in Mental Health 2002 Mar;18(2):17-44. [CrossRef]
    53. Dearmon J, Smith TE. Gaussian Process Regression and Bayesian Model Averaging: An Alternative Approach to Modeling Spatial Phenomena. Geogr Anal 2015 Aug 21;48(1):82-111. [CrossRef]

    ‎
    CIBER: Centro de Investigación Biomédican en Red
    FD: frequency domain
    HF: high frequency
    KCL: King’s College London
    LAO: leave-all-out
    LF: low frequency
    LOO: leave-one-out
    MAC: Media Access Control
    MF: middle frequency
    MSE: multiscale entropy
    NBDC: nearby Bluetooth device count
    PHQ-8: 8-item Patient Health Questionnaire
    RADAR-CNS: Remote Assessment of Disease and Relapse - Central Nervous System
    RADAR-MDD: Remote Assessment of Disease and Relapse - Major Depressive Disorder
    RMSE: root mean squared error
    RMT: remote measurement technology
    VUmc: Vrije Universiteit Medisch Centrum

    Edited by G Eysenbach; submitted 23.04.21; peer-reviewed by A Lamer; comments to author 14.05.21; revised version received 18.05.21; accepted 31.05.21; published 30.07.21

    Copyright

    ©Yuezhou Zhang, Amos A Folarin, Shaoxiong Sun, Nicholas Cummins, Yatharth Ranjan, Zulqarnain Rashid, Pauline Conde, Callum Stewart, Petroula Laiou, Faith Matcham, Carolin Oetzmann, Femke Lamers, Sara Siddi, Sara Simblett, Aki Rintala, David C Mohr, Inez Myin-Germeys, Til Wykes, Josep Maria Haro, Brenda W J H Penninx, Vaibhav A Narayan, Peter Annas, Matthew Hotopf, Richard J B Dobson, RADAR-CNS Consortium. Originally published in JMIR mHealth and uHealth (https://mhealth.jmir.org), 30.07.2021.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mHealth and uHealth, is properly cited. The complete bibliographic information, a link to the original publication on https://mhealth.jmir.org/, as well as this copyright and license information must be included.