Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Improving emotion recognition in schizophrenia with “VOICES”: An on-line prosodic self-training

  • María Lado-Codesido,

    Roles Conceptualization, Investigation, Methodology, Project administration, Validation, Writing – original draft, Writing – review & editing

    Affiliation University of Santiago de Compostela, Santiago de Compostela, Spain, Donostia University Hospital, San Sebastián, Spain

  • Cristina Méndez Pérez,

    Roles Data curation, Investigation, Project administration

    Affiliation University Hospital Complex of Vigo, Vigo, Spain

  • Raimundo Mateos,

    Roles Resources, Supervision

    Affiliation Department of Psychiatry, School of Medicine, University of Santiago de Compostela, Santiago de Compostela, Spain

  • José Manuel Olivares,

    Roles Resources, Supervision

    Affiliation Department of Psychiatry, Biomedical Institute of Galicia Sur, Biomedical Research Center in Mental Health Network (CIBERSAM), University Hospital Complex of Vigo, Pontevedra, Spain

  • Alejandro García Caballero

    Roles Conceptualization, Formal analysis, Investigation, Supervision, Writing – review & editing

    alejandro.alberto.garcia.caballero@sergas.es

    Affiliations Department of Psychiatry, Biomedical Institute of Galicia Sur, Biomedical Research Center in Mental Health Network (CIBERSAM), University Hospital Complex of Ourense, Ourense, Spain, Department of Psychiatry, School of Medicine, University of Santiago de Compostela, Santiago de Compostela, Spain

Abstract

Introduction

Emotion recognition (ER) deficits have been extensively demonstrated in schizophrenia. These deficiencies are not only restricted to facial emotion recognition but also include emotional prosody (tone of the voice) recognition deficits. They have been significantly associated with symptom severity and poor social functioning. The aim of this study was to test the efficacy, in real clinical conditions, of an online self-training prosodic game included in the Social Cognition rehabilitation program e-Motional Training.

Method

A randomized, single-blind multicenter clinical trial was conducted with 50 outpatients with schizophrenia or schizoaffective disorder. The control group was treated with Treatment-as-usual (TAU), based on drug therapy, case management and individual and group psychotherapy (not focused on Social Cognition). The intervention group was treated with TAU plus the employment of Voices, an online self-training program devised for prosodic rehabilitation.

Statistical analysis

Linear regression was used to evaluate the effectiveness of the intervention in emotion recognition measured with the Reading the Mind in the Voice–Spanish Version (RMV-SV).

Results

There were statistically significant differences between the intervention and control group measured with RMV-SV (β = 3,6[IC 95%], p<0.001), with a response variable in RMV post R2 = 0,617.

Discussion

Voices, a prosodic rehabilitation game included in e-Motional Training, seems to be a promising tool for improving emotional voice recognition deficits in schizophrenia, filling the need for such interventions.

1. Introduction

Social cognition (SC) is defined as the set of mental operations that underlie social interactions and includes the processes involved in the perception, interpretation and generation of responses when faced with the intentions, dispositions and behaviors of others [1, 2]. As with other mental disorders, SC disorders occurring in schizophrenia entail a reduced ability to adapt to social situations, considering the individuals involved and the context in which these situations occur. This reduced ability entails poor functioning and deficient social integration [3] and is a determinant in the quality of life of individuals with schizophrenia [4].

SC includes the following subdomains: theory of mind, social perception, social knowledge or social scheme, attributional bias and emotion recognition [5]. Although all of these subdomains are affected in schizophrenia [5, 6], emotion recognition is considered a potential key factor of social dysfunction in schizophrenia [7]. Research in this field has been largely based on studies on the recognition of the facial expressions of emotions, relegating to second place other perceptive channels, such as the auditory channel [8]. However, auditory recognition could present a greater disorder in schizophrenia than its visual analog [913]. According to some authors, however, this disorder depends on the type of emotion expressed [14].

Within auditory perception, we can differentiate the transmission of verbal communication, referring to the content of speech (what is being said), from nonverbal communication or prosody (how it is being said), which includes nonlexical signals within the spoken language, such as accentuation and tone. Prosody fulfills a key function within the organization and interpretation of speech and is of considerable importance for perceiving the emotional state and intentions of others [15].

Prosodic disorders in schizophrenia have been the subject of various studies [12, 1624] and occur in early stages of the disease and are a stable deficit [2528]. Although these disorders are greater in patients with chronic disorders[19, 29, 30], they are found in groups with a high risk of psychosis [31] and in first-degree relatives of patients with schizophrenia [32]. The underlying mechanisms and the correlation with neural substrates of these deficits have also been reported [3335]. These disorders occur at both the expressive [36] and receptive prosody level [11, 12, 18, 37, 38], with a greater difficulty in perceiving emotions with negative content (sadness, fear, anger) [26, 39, 40].

The study of these deficiencies and the search for strategies to improve them are important because SC appears to have a greater repercussion on social functionality than neurocognition by itself [4143]. Moreover, auditory cognitive training can generate and maintain generalized cognitive improvements [44, 45], causing changes at the cortical level [46, 47].

Even though there is a growing interest in prosodic training, the newly developed rehabilitation programs such as Social Cognition and Interaction Training [48] or Cognitive Enhancement Therapy [49, 50] that included prosodic rehabilitation modules, did not specifically assess the efficacy of the prosodic intervention.

More recently, a description of the Socialville program was published [51, 52], which includes exercises for identifying vocal emotions, using phrases with neutral content expressed with a certain emotional tone. After the phrase has been spoken, between 2 and 5 emotional labels are presented: the objective emotion and distractors, where the patient selects the correct emotion. The game works with basic emotions (neutral, happiness, sadness, anger and fear). The difficulty increases based on the user’s success.

We also found a number of studies that have developed an auditory training program [44, 53] based on the discrimination of stimuli at different frequencies, varying the speed of emission and the interstimulus interval in various exercises ranging from lesser to greater complexity, until a maximum is reached that requires memorizing conversations with a considerable number of details. However, these works [44, 53] are focused on cognitive remediation and not in emotion recognition or prosodic rehabilitation. The study by Sacks et al. [44] showed improvements in SC measures, but these can be attributed to a computerized social cognition module added to the original auditory training.

For the development of these prosodic tools, the use of computerized methods is considered relevant, due to their ease and flexibility of use, reduced costs and easy accessibility [54]. Also relevant are the use of repetitive practices with a high level of dosing, a focus on sensory processing and carefully restricted and individual adapted learning trials [46].

In this article, we present a simple, blind, randomized clinical trial conducted with patients with schizophrenia, using the Voices program. The study goals were 1) to assess the efficacy of the program when improving prosodic recognition measured with the RMV–SV and 2) to assess the ease of use and user satisfaction with the program.

2. Material and methods

We conducted a randomized single-blind multicenter clinical trial that selected 53 patients with schizophrenia or schizoaffective disorder. Fifty-three patients were approached and none of them declined to participate in this study. The patients were recruited from the following 5 centers: University Hospital of Ourense, University Hospital Complex of Ferrol, University Hospital Complex of Vigo, the Ceboliño residence (Ourense) and the Professional Association of Patients with Mental Illnesses of Carballo (A Coruña). After recruitment, the sample was randomized in each center into two balanced groups (Fig 1). Three of the recruited patients were lost to follow-up, 2 in the control group and 1 in the intervention group (control n = 24, intervention n = 26). Therefore, the final sample was composed by 50 patients.

2.1 Inclusion and exclusion criteria

We included patients who voluntarily agreed to participate in the study, were 18–60 years of age, had a diagnosis of schizophrenia or schizoaffective disorder (Diagnostic and Statistical Manual of Mental Disorders, 5th Edition), were clinically stable (followed-up by the Department of Psychiatry and undergoing drug treatment), presented an IQ within normal ranges, had no comorbidity with other psychiatric, neurological or severe auditive diseases and who had no current substance abuse (except nicotine). We excluded patients with legal disability. All participants were clinically stable, during the informed consent process, the researchers confirmed that they understood the voluntariness of their participation and the randomization strategy. Written informed consent was therefore obtained by researchers not pertaining to the clinical staff in order to minimize social desirability biases. The recruitment began in January 2017 and ended in April 2017.

2.2 Initial database characterization

The mean age was 40.9 (SD = 12.1 years). Fifty-two percent of the participants were men, and 48% were women. Ninety-percent of the participants had been diagnosed with schizophrenia, while 10% had been diagnosed with schizoaffective disorder. Seventy-six percent of the participants presented no associated comorbidity.

2.2.1 Intervention description with Voices.

The control and intervention groups underwent TAU including drug therapy, case management and individual and group psychotherapy not focused on social cognitive rehabilitation. The control and intervention groups were distributed according to a computer-generated randomization list. The allocation sequence was randomly assigned and concealed from the researcher.

The intervention group underwent 8 sessions of the Voices program, divided into 2 weekly sessions lasting approximately 30 minutes for a month. The participants attended their reference center to undergo the training, generally on nonconsecutive weekdays. A common data collection protocol was established for all centers involved in the study. The training was conducted with a personal computer and headphones for every participant, in a peaceful, quiet room, with the support of trained personnel to show the participant how to use the application.

Voices (Fig 2) is a computer program consisting of 8 sessions. At the start of each session, the program automatically plays a phrase and after hearing it the participant has to choose the response that corresponds with the emotion conveyed (Fig 3). After that, the program reports whether the choice was correct or incorrect and automatically presents the next fragment for listening. Once the fragments for each session have been completed, the score is displayed. The sessions increase in difficulty gradually (Table 1). The fragments can be listened to as many times as desired. There is no time limit to answer, although once the user has answered, they cannot go backwards.

thumbnail
Fig 2. Sessions for Voices.

Reprinted from www.e-motionaltraining.com under a CC BY license, with permission from Fundación Biomédica Galicia Sur, original copyright 2018.

https://doi.org/10.1371/journal.pone.0210816.g002

thumbnail
Fig 3. Voices program.

Reprinted from www.e-motionaltraining.com under a CC BY license, with permission from Fundación Biomédica Galicia Sur, original copyright 2018.

https://doi.org/10.1371/journal.pone.0210816.g003

Supervision of intervention group was conducted by the center’s staff as a routine activity, and researchers were blind to the assignment.

In order to build the program up, we selected 100 simple and ambiguous phrases (e.g. “I have brought what you asked me”, “It was there, behind the cupboard”) that were recorded by professional actors according to the requested emotion. These audio recordings and the response options were tested with 20 independent examiners. The phrases that had an inter-examiner concordance greater than 70% were selected for the new version, which was then applied to a sample of 164 healthy students recruited from the Faculty of Medicine of the University of Santiago of Compostela, Spain. Subsequently, the phrases that obtained a concordance equal or greater than 80% were selected. These phrases (N = 63) were therefore used to configure the Voices program, included in the rehabilitation platform www.e-motionaltraining.com

2.3 Evaluation tools

Several tools were employed to assess the benefits of performing prosodic training for patients with schizophrenia and employing Voices for this task.

2.3.1 Patients evaluation.

All patients were assessed before the intervention, using the instruments described below:

  • Customized datasheet designed by the authors for recording demographic and clinical data, including sex, age, occupation, last academic year completed, marital status, present cohabitation, diagnosis and potential associated diagnoses, treatments and equivalence of antipsychotic treatment to chlorpromazine. The initial database characterization was obtained from this demographic data. This information was collected during a conventional clinical interview with the patient and from their electronic medical history.
  • Reading Mind in the Voices–Spanish Version, RMV-SV. Adaptation of the Reading Mind in the Voices–Test Revised (RMV-TR) tool to Spanish [55], which includes 33 segments translated and adapted from English and recorded by professional actors, with 4 response options, with simple and complex emotions. This test will be applied before and after the intervention.
  • Positive and Negative Symptom Scale (PANSS) [56]: assesses the positive and negative symptom severity.
  • Kauffman Brief Intelligence Test (K-BIT) [57]: includes the measure of verbal and nonverbal intelligence in adults.

2.3.2 Usability test.

When developing software tools, their usability must be considered, including efficiency, ease-of-use and effectiveness. Many user experience questionnaires can be found in the literature, evaluating items such as user satisfaction, usefulness and attractiveness [58, 59].

To evaluate the Voices tool, a user experience questionnaire was employed. Thus, participants rated several questions on a Likert-type scale (ranging from 1 = total disagreement, to 5 = total agreement), such as frequency of Internet and computer use (0 = never/almost never, 5 = every day) and ease of connection, understanding of the program interface, autonomy, entertainment, usefulness, global perceived improvement, perceived improvement in social relationships, improvement at work, suitability of the duration and improved self-esteem after applying the program.

2.3.3 Calculating the equivalence of antipsychotic dosages.

To convert the various dosages of antipsychotic agents to chlorpromazine, we reviewed the datasheets of the various drugs and conducted a literature review on antipsychotic dosage equivalence [6063]. The main limitation of this task was the lack of consensus among the various authors for establishing these equivalences, specifically among the more recently marketed antipsychotic agents and long-acting antipsychotic agents [64], where there is a marked lack of information.

2.4 Sample size

Given that the literature has no prosodic rehabilitation instruments or training programs similar to the one we proposed, we used the results of the validation of the English version of the RMV-TR test to calculate the sample size [55]. In our case, we hypothesized that the expected difference of the means between the intervention group and the control group in the post-test would be analogous to the difference of the means between the control group without disease and the autism group of the Golan study [55] (Tables 2 and 3). We based this hypothesis on previous facial emotion recognition studies in which the treated group progressed to behaving like the healthy control group after the intervention.

2.5 Ethical aspects

This study has been conducted in accordance with national and European legislation on clinical research, following international ethical recommendations, the Declaration of Helsinki and the Council of Europe regarding the Convention on Human Rights and Biomedicine. The study complied at all times with the requirements established in the Spanish legislation in the field of biomedical research, personal data protection and bioethics. This study was approved by the local ethics committee (Clinical Research Ethics Committee of Galicia, Registration code: 2016/548) in January 2017 and registered in an international RCT database (BioMed Center: ISRCTN10712315). The clinical trial registry number is https://doi.org/10.1186/ISRCTN10712315. Since the requirement of international registration was unknown for authors, this task was slightly delayed. The authors confirm that all ongoing and related trials for this intervention are registered. Patients' ability to understand the voluntariness of the study was assessed by researchers employing clinical interview. The treating psychiatrists' opinion, based on the patients' clinical history, was also considered.

2.6 Statistical analysis

To validate the results from each of the previous studies, we performed statistical analyses to verify whether significant differences were present between the study groups, employing SPSS 22.0 [65] and Epidat 4.1 [66]. For this task, different tests were applied, and p-values were calculated. A general statistical condition for two sets to be significantly different with respect to a given variable is that the p-value [67] is less than 0.05, which means that the null hypothesis (no differences among datasets) can be rejected. This constraint was considered for the calculation of statistical differences for both types of subsets.

The following analyses were performed:

  1. Descriptive analysis: The qualitative variables are expressed as frequencies and percentages. The continuous variables are expressed as means (standard deviation) or medians (range). To determine the normality of the variables, we performed the Kolmogorov-Smirnov test or the Shapiro-Wilk test.
  2. Parametric/nonparametric test: subgroup analysis, to determine the homogeneity or heterogeneity between the study groups (chi-squared, Fisher’s exact test, Student's t-test for independent samples and the Mann-Whitney U test).
  3. Linear regression: to compare the groups pre-post intervention using the RMV-SV test as the dependent variable.

3. Results

A total of 53 participants were selected and assigned to control group (TAU) or to the intervention group (Voices+TAU). Three of them did not finish the clinical trial (two of control group and one of intervention group), therefore statistical analysis has been performed over a sample of 50.

As stated earlier, the main goal of this research study was to assess the benefits of Voices in two different ways. The first was to verify whether the clinical use of the program could help people with a mental disorder improve their social abilities. The second was to measure the usability of Voices, in terms of user-friendliness, efficiency, and ease-of-use. The results are presented in the next subsections.

3.1. Clinical results

The various data analyses yielded varying results, which are presented in the following paragraphs.

  1. Descriptive analysis: in terms of the overall sample (n = 50 patients), 90% of the patients presented a diagnosis of schizophrenia, and 76% presented no associated diagnoses.
    All patients were undergoing therapy with neuroleptics, with a chlorpromazine equivalence of 1008.30, SD = 652.75 mg. At the start of the study, 44% of the patients were undergoing therapy with benzodiazepines, 52% with antidepressants and 18% with mood stabilizers, and 72% were undergoing psychotherapy (Table 4).
  2. Parametric/nonparametric test: subgroups analysis. Overall statistically significant differences were not found among the intervention and control groups from all centers. No differences were found in the demographic and clinical variables among the groups (Table 5).
  3. Linear regression: To demonstrate the presence of differences in prosodic variables after treatment, we compared pre-post changes between the two groups, adjusting by initial values of RMV-SV. These results indicate that there were statistically significant differences in score changes between the intervention and control group in RMV-SV (β = 3,6[IC 95%], p<0.001) with a response variable in RMV post R2; = 0,617 (Table 6), (Fig 4).
thumbnail
Fig 4. RMV-SV results for both control and intervention group.

The left part of the figure represents RMV-SV scores of the control group and the right part represents the RMV-SV scores of the intervention group. The red and green boxes contain the fifty per cent of the results of the RMV-SV scores pre and post-intervention in the different groups. Whiskers indicate the extreme scores of the RMV-SV test.

https://doi.org/10.1371/journal.pone.0210816.g004

thumbnail
Table 5. Demographic and clinical characteristics by subgroups.

means and standard deviations are presented for continuous variables.

https://doi.org/10.1371/journal.pone.0210816.t005

Results for the RMV-SV values are provided in Table 7. We can see that there were not significant differences pretest between groups, whereas after training a significant improvement was shown in the intervention group (p = 0.009).

thumbnail
Table 7. RMV-SV values before and after the voices rehabilitation.

https://doi.org/10.1371/journal.pone.0210816.t007

3.2 Users’ experience

Information on the use of the Internet and computers was collected. Sixty percent of the sample had used a computer, and 48% used the Internet almost every day. Forty-nine of the 50 patients completed the training sessions.

In terms of the use of Voices, Fig 5 shows the users’ scores for all items evaluated.

As can be observed, 80% of the patients of the intervention group scored Voices with more than 4 points in the easy intelligibility and entertainment items. The item with the lowest score was the program duration, with a mean score of 2.72 out of 5 points.

4. Discussion

The results of this study suggest that the use of the Voices program improves the prosodic test scores of patients with schizophrenia or schizoaffective disorder compared with patients who are undergoing conventional rehabilitation programs. The use of this type of program could represent an improvement in the level of auditory emotion recognition and could therefore be an advance in the patients’ global psychosocial function.

The patients of the intervention group scored this tool as useful, entertaining and easy to understand. Most of the patients were familiar with the use of the Internet and computers (60% used computers frequently or daily, 48% used the Internet almost daily). This familiarity with information and communication technology might have facilitated good adherence to the program.

This sample consisted of relatively young patients (mean age, 40.9 years). Given that prosody worsens with age [19, 29, 30], younger patients could therefore constitute the key age group for starting prosodic recovery. Early rehabilitation is desirable both for the possibility of stopping the deterioration and for the effects that impaired prosodic recognition could have on global social functioning.

The selected sample presented high PANSS-N scores, which is consistent with the presence of greater prosodic deficiencies according to the reviewed literature [6870].

In terms of sex, we observed in the literature that male patients presented greater prosodic impairment than female patients [9, 7072]. In our study, there were no statistically significant differences in the subanalysis by sex, as with other reviewed studies [30].

At the diagnostic level, our patient sample included those diagnosed with schizophrenia and schizoaffective disorder, even though these are different diagnostic entities. In the reviewed studies, we detected prosodic disorders in both diagnoses in stable stages of the disease, as well as lasting deficiencies and markers [40, 73]. We therefore established that this impairment could be rehabilitated in both disorders.

Upon reading our results, we observed that the mean chlorpromazine equivalent dose for the overall sample was 1008.30, SD = 652.75 mg. When dividing the results between oral doses and injectable treatment, we observed that the mean injectable dose was larger than the oral dose (972.00, SD = 476.50 mg vs. 632.61 SD = 548.17 mg). This could be due to the lack of consensus we found in the reviewed literature sources for converting the new formulations of antipsychotic agents (monthly, quarterly, etc.) to the conventional equivalences. An in-depth review on this topic is therefore needed. In the reviewed studies, the antipsychotic treatment was not related to the deficiencies in the SC parameters [74].

We only found an online rehabilitation program (Socialville) that includes prosodic rehabilitation, although it is not its main aim [51]. Regarding prosody the program is focused in recognition of complex emotions, the natural target given that main perceptual difficulties arouse in this type of emotions [17, 28, 75]. Socialville study showed no statistically significant differences pre-post intervention in prosodic rehabilitation (p = 0.09). With our instrument, however, we achieved significance (p = 0.009). The results of the study by Nahum et al. [51] could be attributed to the small sample size (n = 17), given that it was a pilot study. New studies are currently being conducted with larger samples [52]. Moreover, the users of Socialville scored the tool as positive for entertainment, ease of use and satisfaction, results analogous to those obtained for the Voices program.

In terms of the other reviewed studies on rehabilitation programs for auditory training [44, 48, 50, 53], we found a number of similarities in the program designs, including the following:

  • In the program designed by Sacks et al. [44], in which 50 hours of computerized auditory training plus 12 hours of SC training were performed, the positive results were focused on scores obtained through the Mayer-Salovey-Caruso Emotional Intelligence Test, which assesses overall SC. As mentioned earlier, specific measures of prosody were not collected, although an improvement in this variable would be expected, as it would be in other aspects in SC. This type of study could impel the investigation of the relationship between auditory rehabilitation and overall improvement in other aspects of SC and assess the possibility that auditory rehabilitation acts as a mediator between rehabilitation in overall SC and, as hypothesized in other studies, be a predictor of social functionality [22, 76].
  • The program by Fisher et al. [53] conducted 50 hours of intensive computerized training, with an increase in demands at the auditory perception level, compared with 50 hours of computer games. The program observed an improvement in other cognitive variables such as verbal learning and working memory after the auditory training [46]. Unfortunately, as with the study by Sacks et al. [44], the Fisher program did not include prosodic variables that would enable us to compare our results with theirs, although this study supports the hypothesis that exercises in auditory perception could lead to an improvement in other more global cognitive aspects and therefore learning-induced changes in neuroplasticity.
  • The previous studies employed a notably high number of hours. Our program had a total duration of 4 hours. Based on the score on the satisfaction scale, we can deduce that the users found the sessions brief. According to Biagianti [45], there was a significant difference in auditory processing speed produced by cognitive therapy starting at 20 hours of training, producing a “plateau phase” between 20 and 40 hours of training. This would indicate that those 20 hours of intervention are optimal, which is quite far from the amount of time we dedicated to our intervention. In the studies we found, however, it is unclear what the minimum number of sessions should be to obtain positive results pre-post intervention on SC. A deeper study along this line is therefore necessary.

4.1. Limitations

Our study had a number of limitations. The study was conducted with stable patients, with no active substance abuse, treated with psychoactive drugs, with a mean age of approximately 40 years and in an outpatient regimen treated at outpatient centers. We therefore cannot make conclusions regarding acute and younger patients, those with less overall deterioration, those with substance abuse or those untreated at the pharmacological level, profiles in which prosodic disorders are also observed but in which we do not know the impact of the rehabilitation and, specifically, of our program.

There are a number of limitations inherent in the study topic, such as the lack of prosodic rehabilitation studies conducted to date [8, 37], which considerably limits the comparison with other results from preliminary studies or rehabilitation studies on more cognitive aspects than prosody.

As reflected in the discussion, another limitation is not being able to establish the minimum number of sessions at which improvements in the rehabilitation occur.

Despite the subjective assessment by the patients in terms of their social, occupational and self-esteem improvement after the use of Voices, the lack of measurement of other cognitive and function variables hinders our ability to have a more concrete view of the improvements in global function that these strategies can promote.

4.2 Conclusions and future work

The patients with schizophrenia or schizoaffective disorder treated with Voices significantly improved after the intervention in their prosodic recognition ability, measured with RMV-SV.

Eighty percent of the intervention group scored their satisfaction with the program at 4 or more points in the variables of intelligibility, easy connection, entertainment and usefulness.

This study is part of a series of studies dedicated to developing instruments for rehabilitating SC on the www.e-motionaltraining.com platform. These promising results guide us towards developing new training exercises following this model (Voices 2), towards completing a global SC treatment model that covers all SC subdomains, including prosody.

Supporting information

S1 Protocol. Ethics Comittee protocol of clinical trial in English.

https://doi.org/10.1371/journal.pone.0210816.s002

(PDF)

S2 Protocol. Ethics Comittee protocol of clinical trial in Spanish.

https://doi.org/10.1371/journal.pone.0210816.s003

(PDF)

S2 Dataset. Data analysis of clinical trial (ANOVA).

https://doi.org/10.1371/journal.pone.0210816.s005

(DOCX)

Acknowledgments

We would like to thank the following patient associations for their collaboration: APEM Carballo, Residencia Ceboliño and AFAES Portanova. We would also like to thank Luis Martínez Agulleiro and Isidro Rego Campuzano for their efforts and collaboration in the various associations. We would also like to thank María Teresa Alves (MSci) for her statistical support and Isabel Varela, Dr. Nuñez and Dr. Fontela for their help.

References

  1. 1. Brothers L. The Neural Basis of Primate Communication. Motiv Emot. [Internet].1990;14(2): 81–91.
  2. 2. Ostrom J. The sovereignty of social cognition. In: Wyers R.S. and Scrull T.K., Handbook of social cognition, vol 1. Hillsdale: Erlbaum; 1984. pp. 1–38.
  3. 3. Couture SM, Penn DL, Roberts DL. The functional significance of social cognition in schizophrenia: A review. Schizophr Bull. 2006;32 Suppl.1: 44–63.
  4. 4. Poole JH, Tobias FC, Vinogradov S. The functional relevance of affect recognition errors in schizophrenia. J Int Neuropsychol Soc; 2000;6(6):649–658. pmid:11011511
  5. 5. Ruiz-Ruiz JC, García-Ferrer S, Fuentes-Durá I. La relevancia de la cognición social en la esquizofrenia. Apuntes de psicología [Internet]. 2006[accessed 2018 Jan 30];24(1–3):137–156. Spanish. Avaliable from: http://www.apuntesdepsicologia.es/index.php/revista/article/view/74
  6. 6. Savla GN, Vella L, Armstrong CC, Penn DL, Twamley EW. Deficits in domains of social cognition in schizophrenia: A meta-analysis of the empirical evidence. Schizophr Bull. 2013;39(5):979–992. pmid:22949733
  7. 7. Aleman A, Kahn RS. Strange feelings: Do amygdala abnormalities dysregulate the emotional brain in schizophrenia? Prog Neurobiol. 2005;77(5):283–98. pmid:16352388
  8. 8. Grant N, Lawrence M, Preti A, Wykes T, Cella M. Social cognition interventions for people with schizophrenia: a systematic review focussing on methodological quality and intervention modality. Clin Psychol Rev. 2017;56:55–64. pmid:28688282
  9. 9. Vaskinn A, Sundet K, Friis S, Simonsen C, Birkenæs AB, Engh JA, et al. The effect of gender on emotion perception in schizophrenia and bipolar disorder. Acta Psychiatr Scand. 2007;116(4):263–70. pmid:17803756
  10. 10. Simpson C, Pinkham AE, Kelsven S, Sasson NJ. Emotion recognition abilities across stimulus modalities in schizophrenia and the role of visual attention. Schizophr Res. 2013;151(1–3):102–6. pmid:24126043
  11. 11. Leentjens a F, Wielaert SM, van Harskamp F, Wilmink FW. Disturbances of affective prosody in patients with schizophrenia; a cross sectional study. J Neurol Neurosurg Psychiatry. 1998;64:375–8. pmid:9527153
  12. 12. Hoekert M, Kahn RS, Pijnenborg M, Aleman A. Impaired recognition and expression of emotional prosody in schizophrenia: review and meta-analysis. Schizophr Res. 2007;96(1–3):135–45. pmid:17766089
  13. 13. Kohler CG, Walker JB, Martin EA, Healey KM, Moberg PJ. Facial emotion perception in schizophrenia: A meta-analytic review. Schizophr Bull. 2010;36(5):1009–19. pmid:19329561
  14. 14. Vogel BD, Brück C, Jacob H, Eberle M, Wildgruber D. Effects of cue modality and emotional category on recognition of nonverbal emotional signals in schizophrenia. BMC Psychiatry; 2016;16(1):218.
  15. 15. Van Rijn S. Xploring social cognitive pathways to psychopathology: Studies with Klineffelter (XXY) men. [Dissertation]. The Netherlands, Utrecht: Utretch University; 2007.
  16. 16. Murphy D, Cutting J. Prosodic comprehension and expression in schizophrenia. J Neurol Neurosurg Psychiatry. 1990;53(9):727–30. pmid:2246653
  17. 17. Leitman DI, Foxe JJ, Butler PD, Saperstein A, Revheim N, Javitt DC. Sensory contributions to impaired prosodic processing in schizophrenia. Biol Psychiatry. 2005;58(1): 56–61. pmid:15992523
  18. 18. Ross ED, Orbelo DM, Cartwright J, Hansel S, Burgard M, Testa JA, et al. Affective-prosodic deficits in schizophrenia: profiles of patients with brain damage and comparison with relation to schizophrenic symptoms. J Neurol Neurosurg Psychiatry. 2001;70: 597–604. pmid:11309452
  19. 19. Kucharska-Pietura K, David AS, Masiak M, Phillips ML. Perception of facial and vocal affect by people with schizophrenia in early and late stages of illness. Br J Psychiatry. 2005;187:523–8. pmid:16319404
  20. 20. Rossell SL, Boundy CL. Are auditory-verbal hallucinations associated with auditory affective processing deficits? Schizophr Res. 2005;78(1):95–106. pmid:16005614
  21. 21. Bozikas VP, Kosmidis MH, Anezoulaki D, Giannakou M, Karavatos A. Relationship of affect recognition with psychopathology and cognitive performance in schizophrenia. J Int Neuropsychol Soc. 2004;10(4):549–58. pmid:15327733
  22. 22. Hooker C, Park S. Emotion processing and its relationship to social functioning in schizophrenia patients. Psychiatry Res. 2002;112(1):41–50. pmid:12379449
  23. 23. Kerr SL, Neale JM. Emotion perception in schizophrenia: specific deficit or further evidence of generalized poor performance? J of Abnorm Psychol. 1993;102:312–318.
  24. 24. Haskins B, Shutty MS, Kellogg E. Affect processing in chronically psychotic patients: development of a reliable assessment tool. Schizophr Res. 1995;15(3):291–7. pmid:7632627
  25. 25. Baltaxe CA, Simmons JQ III. Speech and language disorders in children and adolescents with schizophrenia. Schizophr Bull. 1995;21(4):677–92. pmid:8749894
  26. 26. Edwards J, Pattison PE, Jackson HJ, Wales RJ. Facial affect and affective prosody recognition in first-episode schizophrenia. Schizophr Res. 2001;48(2–3):235–53. pmid:11295377
  27. 27. Amminger GP, Schäfer MR, Klier CM, Schlögelhofer M, Mossaheb N, Thompson A, et al. Facial and vocal affect perception in people at ultra-high risk of psychosis, first-episode schizophrenia and healthy controls. Early Interv Psychiatry. 2012;6(4):450–4. pmid:22650382
  28. 28. Pinheiro AP, Rezaii N, Rauber A, Liu T, Nestor PG, McCarley RW, et al. Abnormalities in the processing of emotional prosody from single words in schizophrenia. Schizophr Res. 2014;152(1):235–241. pmid:24342586
  29. 29. Dondaine T, Robert G, Péron J, Grandjean D, Vérin M, Drapier D, et al. Biases in facial and vocal emotion recognition in chronic schizophrenia. Front Psychol. 2014;5:900. pmid:25202287
  30. 30. Ramos-Loyo J, Mora-Reynoso L, Sánchez-Loyo LM, Medina-Hernández V. Sex Differences in Facial, Prosodic, and Social Context Emotional Recognition in Early-Onset Schizophrenia. Schizophr Res Treatment. 2012;2012:1–12.
  31. 31. Addington J, Piskulic D, Perkins D, Woods SW, Liu L, Penn DL. Affect recognition in people at clinical high risk of psychosis. Schizophr Res. 2012;140(1–3):87–92. pmid:22763425
  32. 32. Allott KA, Rice S, Bartholomeusz CF, Klier C, Schlögelhofer M, Schäfer MR et al. Emotion recognition in unaffected first-degree relatives of individuals with first-episode schizophrenia. Schizophr Res. 2015;161(2–3):322–8. pmid:25533595
  33. 33. Thomas ML, Green M, Hellemann G, Sugar CA, Tarasenko M, Calkins ME et al. Modeling deficits from early auditory information processing to psychosocial functioning in schizophrenia. JAMA Psychiatry. 2017;74(1):37–46. pmid:27926742
  34. 34. Gold R, Butler P, Revheim N, Hansern J, Gur RC, Kantrowitz JT et al. Auditory emotion recognition impairments in schizophrenia: Relationship to acoustic features and cognition. Am J Psychiatry. 2012;169(4):424–432. pmid:22362394
  35. 35. Kantrowitz JT, Hoptman MJ, Leitman DI, Moreno-Ortega M, Lehrfeld JM, Dias E et al. Neural Substrates of Auditory Emotion Recognition Deficits in Schizophrenia. 2015; 35(44):14909–14921. pmid:26538659
  36. 36. Martínez-Sánchez F, Muela-Martínez JA, Cortés-Soto P, García Meilán JJ, Vera Ferrándiz JA, Egea Caparrós A, et al. Can the Acoustic Analysis of Expressive Prosody Discriminate Schizophrenia? Span J Psychol. 2015;18: E86. pmid:26522128
  37. 37. Edwards J, Jackson HJ, Pattison PE. Emotion recognition via facial expression and affective prosody in schizophrenia. Clin Psychol Rev. 2002;22(6):789–832. pmid:12214327
  38. 38. Shaw RJ, Dong M, Lim KO, Faustman WO, Pouget ER, Alpert M. The relationship between affect expression and affect recognition in schizophrenia. Schizophr Res. 1999;37(3):245–50. pmid:10403196
  39. 39. Ito F, Matsumoto K, Miyakoshi T, Ohmuro N, Uchida T, Matsuoka H. Emotional processing during speech communication and positive symptoms in schizophrenia. Psychiatry Clin Neurosci. 2013;67(7):526–31. pmid:24147562
  40. 40. Hoertnagl CM, Yalcin-Siedentopf N, Baumgartner S, Biedermann F, Deisenhammer E a., Hausmann A, et al. Affective prosody perception in symptomatically remitted patients with schizophrenia and bipolar disorder. Schizophr Res. 2014;158(1–3):100–4. pmid:25096540
  41. 41. Bigelow NO, Paradiso S, Adolphs R, Moser DJ, Arndt S, Heberlein A, et al. Perception of socially relevant stimuli in schizophrenia. Schizophr Res. 2006;83(2–3):257–67. pmid:16497483
  42. 42. Brüne M. Emotion recognition, “theory of mind,” and social behavior in schizophrenia. Psychiatry Res. 2005;133(2–3):135–47. pmid:15740990
  43. 43. Green MF, Penn DL, Bentall R, Carpenter WT, Gaebel W, Gur RC, et al. Social cognition in schizophrenia: An NIMH workshop on definitions, assessment, and research opportunities. Schizophr Bull. 2008;34(6):1211–20. pmid:18184635
  44. 44. Sacks S, Fisher M, Garrett C, Alexander P, Holland C, Rose D, et al. Combining computerized social cognitive training with neuroplasticity-based auditory training in schizophrenia. Clin Schizophr Relat Psychoses. 2013;7(2):78–86A. pmid:23367504
  45. 45. Biagianti B, Fisher M, Neilands TB, Loewy R, Vinogradov S. Engagement with the auditory processing system during targeted auditory cognitive training mediates changes in cognitive outcomes in individuals with schizophrenia. Neuropsychology. 2016;30(8):998–1008. pmid:27617637
  46. 46. Genevsky A, Garrett CT, Alexander PP, Vinogradov S. Cognitive training in schizophrenia: a neuroscience-based approach. Dialogues Clin Neurosci. 2010;12(3):416–21. pmid:20954435
  47. 47. Elijah RB, Le Pelley ME, Whitford TJ. Modifying temporal expectations: Changing cortical responsivity to delayed self-initiated sensations with training. Biol Psychol. 2016;120:88–95. pmid:27628506
  48. 48. Penn D, Roberts DL, Munt ED, Silverstein E, Jones N, Sheitman B. A pilot study of social cognition and interaction training (SCIT) for schizophrenia. Schizophr Res. 2005; 80(2–3):357–9. pmid:16139480
  49. 49. Eack SM, Greenwald DP, Hogarty SS, Cooley SJ, DiBarry AL, Montrose DM, et al. Cognitive Enhancement Therapy for Early-Course Schizophrenia: Effects of a Two-Year Randomized Controlled Trial. Psychiatr Serv.2009; 60(11):1468–76. pmid:19880464
  50. 50. Eack SM, Hogarty GE, Greenwald DP, Hogarty SS, Keshavan MS. Cognitive enhancement therapy improves emotional intelligence in early course schizophrenia: Preliminary effects. Schizophr Res. 2007; 89(1–3):308–11. pmid:17055227
  51. 51. Nahum M, Fisher M, Loewy R, Poelke G, Ventura J, Nuechterlein KH, et al. A novel, online social cognitive training program for young adults with schizophrenia: A pilot study. Schizophr Res Cogn. 2014;1(1):e11–e19. pmid:25267937
  52. 52. Rose A, Vinogradov S, Fisher M, Green MF, Ventura J, Hooker C, et al. Randomized controlled trial of computer-based treatment of social cognition in schizophrenia: The TRuSST trial protocol. BMC Psychiatry. 2015;15(1):142.
  53. 53. Fisher M, Holland C, Merzenich MM, Vinogradov S. Using Neuroplasticity-Based Auditory Training to Improve Verbal Memory in Schizophrenia. 2009;166(1): 805–11.
  54. 54. Ventura J, Wood RC, Jimenez AM, Hellemann GS. Neurocognition and symptoms identify links between facial recognition and emotion processing in schizophrenia: Meta-analytic findings. Schizophr Res. 2013; 151(1–3):78–84. pmid:24268469
  55. 55. Golan O, Baron-Cohen S, Hill JJ, Rutherford MD. The “Reading the Mind in the Voice” test-revised: A study of complex emotion recognition in adults with and without autism spectrum conditions. J Autism Dev Disord. 2007;37(6):1096–106. pmid:17072749
  56. 56. Kay SR, Fiszbein A, Opfer LA. The Positive and Negative Syndrome Scale (PANSS) for Schizophrenia. Schizophrenia Bulletin. 1987; 13(2):261–76. pmid:3616518
  57. 57. Kaufman A.S., Kaufman AL. K-BIT: Test Breve de Inteligencia de Kaufman. Manual de interpretación. Madrid: TEA (1994). Spanish.
  58. 58. Law ELC, Roto V, Hassenzahl M, Vermeeren APOS, Kort J. Understanding, scoping and defining user experience. Proc 27th Int Conf Hum factors Comput Syst—CHI 09. 2009:719–28.
  59. 59. Rauschenberger M, Schrepp M, Perez-Cota M, Olschner S, Thomaschewski J. Efficient Measurement of the User Experience of Interactive Products. How to use the User Experience Questionnaire (UEQ). Example: Spanish Language Version. Int J Interact Multimed Artif Intell. 2013;2(1):39.
  60. 60. Fuller MA, Sajatovic M. Drug Information Handbook for Psychiatry: Including Psychotropic, Nonpsychotropic and Herbal Agents.7th edition. Lexi-Comp; 2009.
  61. 61. Leucht S, Samara M, Heres S, Patel MX, Woods SW, Davis JM. Dose Equivalents for Second-Generation Antipsychotics: The Minimum Effective Dose Method. Schizophr Bull. 2014;40(2):314–26. pmid:24493852
  62. 62. Leucht S, Samara M, Heres S, Patel MX, Furukawa T, Cipriani A, et al. Dose Equivalents for Second-Generation Antipsychotic Drugs: The Classical Mean Dose Method. Schizophr Bull. 2015;41(6):1397–402. pmid:25841041
  63. 63. Woods SW, Haven N. Chlorpromazine Equivalent Doses for Atypical Antipsychotics: An Update 2003–2010. 2011;34–6.
  64. 64. Rothe PH, Heres S, Leucht S. Dose equivalents for second generation long-acting injectable antipsychotics: The minimum effective dose method. Schizophr Res. 2018; 193:23–28. pmid:28735640
  65. 65. IBM Corp. IBM SPSS Statistics for Windows, Version 22.0. Armonk, NY. 2013;
  66. 66. Consellería de Sanidade, Xunta de Galicia, España; Organización Panamericana de la Salud (OPS-OMS); Universidad CES C. Epidat: programa para análisis epidemiológico de datos. Versión 4.1 [Internet]. 2014. Spanish. Avaliable from: http://dxsp.sergas.es
  67. 67. Rothery P. Grafen A. and Hails R. Modern Statistics for the Life Sciences. Oxford University Press, Oxford, 2002. Biometrics. Blackwell Publishing, Inc.; 2003; 59(1):206–7.
  68. 68. Kantrowitz JT, Leitman DI, Lehrfeld JM, Laukka P, Juslin PN, Butler PD, et al. Reduction in tonal discriminations predicts receptive emotion processing deficits in schizophrenia and schizoaffective disorder. Schizophr Bull. 2013;39(1):86–93. pmid:21725063
  69. 69. Schneider F, Gur RC, Gur RE, Shtasel DL. Emotional processing in schizophrenia: Neurobehavioral probes in relation to psychopathology. Schizophr Res. Elsevier; 1995; 17(1):67–75. pmid:8541252
  70. 70. Scholten MRM, Aleman A, Kahn RS. The processing of emotional prosody and semantics in schizophrenia: relationship to gender and IQ. Psychol Med. 2008;38(6):887–98. pmid:17949518
  71. 71. Bozikas VP, Kosmidis MH, Anezoulaki D, Giannakou M, Andreou C, Karavatos A. Impaired Perception of Affective Prosody in Schizophrenia. J Neuropsychiatry Clin Neurosci. 2006;18(1):81–5. pmid:16525074
  72. 72. Schirmer A, Kotz SA, Friederici AD. On the role of attention for the processing of emotions in speech: Sex differences revisited. Cogn Brain Res. 2005;24(3):442–52.
  73. 73. Bora E, Yucel M, Pantelis C. Cognitive functioning in schizophrenia, schizoaffective disorder and affective psychoses: Meta-analytic study. Br J Psychiatry. 2009;195(6):475–82. pmid:19949193
  74. 74. Kar SK, Jain M. Current understandings about cognition and the neurobiological correlates in schizophrenia. J Neurosci Rural Pract. 2016;7(3):412–8. pmid:27365960
  75. 75. Brazo P, Beaucousin V, Lecardeur L., Razafimandimby A, Dollfus S. Social cognition in schizophrenic patients: The effect of semantic content and emotional prosody in the comprehension of emotional discourse. Front Psychiatry. 2014;5(120):1–8.
  76. 76. Kee KKS, Green MF, Mintz J, Brekke JS. Is emotion processing a predictor of functional outcome in schizophrenia? Schizophr Bull. 2003;29(3):487–97. pmid:14609242