- Research article
- Open Access
Machine learning-based ability to classify psychosis and early stages of disease through parenting and attachment-related variables is associated with social cognition
BMC Psychology volume 9, Article number: 47 (2021)
Recent views posited that negative parenting and attachment insecurity can be considered as general environmental factors of vulnerability for psychosis, specifically for individuals diagnosed with psychosis (PSY). Furthermore, evidence highlighted a tight relationship between attachment style and social cognition abilities, a key PSY behavioral phenotype. The aim of this study is to generate a machine learning algorithm based on the perceived quality of parenting and attachment style-related features to discriminate between PSY and healthy controls (HC) and to investigate its ability to track PSY early stages and risk conditions, as well as its association with social cognition performance.
Perceived maternal and paternal parenting, as well as attachment anxiety and avoidance scores, were trained to separate 71 HC from 34 PSY (20 individuals diagnosed with schizophrenia + 14 diagnosed with bipolar disorder with psychotic manifestations) using support vector classification and repeated nested cross-validation. We then validated this model on independent datasets including individuals at the early stages of disease (ESD, i.e. first episode of psychosis or depression, or at-risk mental state for psychosis) and with familial high risk for PSY (FHR, i.e. having a first-degree relative suffering from psychosis). Then, we performed factorial analyses to test the group x classification rate interaction on emotion perception, social inference and managing of emotions abilities.
The perceived parenting and attachment-based machine learning model discriminated PSY from HC with a Balanced Accuracy (BAC) of 72.2%. Slightly lower classification performance was measured in the ESD sample (HC-ESD BAC = 63.5%), while the model could not discriminate between FHR and HC (BAC = 44.2%). We observed a significant group x classification interaction in PSY and HC from the discovery sample on emotion perception and on the ability to manage emotions (both p = 0.02). The interaction on managing of emotion abilities was replicated in the ESD and HC validation sample (p = 0.03).
Our results suggest that parenting and attachment-related variables bear significant classification power when applied to both PSY and its early stages and are associated with variability in emotion processing. These variables could therefore be useful in psychosis early recognition programs aimed at softening the psychosis-associated disability.
Schizophrenia and bipolar disorder with psychotic manifestations are two devastating psychosis-spectrum disorders that dramatically affect individuals’ quality of life and personal functioning . Indeed, they are strongly associated with lifetime disability , reduced life expectancy , and increased relative risk of suicide . Furthermore, they are both characterized by strong and largely overlapping anomalies in neurocognition and social cognition [5, 6], as well as by thought disturbances . Given this evidence and the strong and long-lasting disability affecting individuals with psychosis (PSY), especially individuals suffering from schizophrenia or from bipolar disorder with psychotic manifestations, the identification of markers of disease to be targeted in early identification or prevention strategies aimed at softening the PSY-associated burden is becoming more and more crucial in the clinical psychology and personalized medicine fields.
In the pathophysiology of psychosis, environmental factors play a crucial role . Amongst those, early adverse experiences that occurred in childhood, especially those related to psychological or physical abuse, are highly prevalent in individuals diagnosed with psychosis (PSY) . Notably, childhood traumatic experiences are associated with more severe clinical profiles and higher functional impairments already in the early stages and risk conditions of mental illness . According to previous literature, adverse childhood experiences are strongly associated with perceived negative parenting, which is in turn associated with attachment insecurity [11, 12]. Specifically, according to attachment theory , an innate motivational system prompts individuals to proximity seeking to alleviate distress. The quality of these experiences of proximity with significant others leads to the generation of individual cognitive-affective representations (i.e. “internal working models”) of self and others . These models are key to affect regulation throughout the lifespan, as they guide how information from the social world is appraised, thus in turn potentially affecting social cognition abilities . In adulthood, a secure attachment style, often originating from positive parenting experiences , is indeed associated with high distress tolerance and positive affect regulation . On the other hand, interacting with unpredictable or insensitive attachment figures may make the development of a stable and secure mental foundation more difficult [17,18,19] and lead to attachment insecurity, declined either through attachment anxiety (e.g., individuals are strongly vigilant to social threats and rejection experiences, and tend to overestimate the impact of negative emotions), or through attachment avoidance (e.g., individuals disavow the need of being comforted by others, avoid closeness and intimacy, tend to suppress the impact of emotions) . Given its association with affect regulation, it is not surprising that studies have consistently reported a significant association between attachment insecurity and social cognition impairments, a key characteristic of PSY [21, 22]. Furthermore, both negative parenting and attachment insecurity have been associated with reduced coping strategies and increased likelihood of emotional breakdowns . In this framework, low parenting abilities, as well as attachment insecurity, have been previously considered as general environmental factors of vulnerability for mental illness  whose effects are amplified by other genetic and/or environmental factors [8, 23] within the psychosis risk pathways.
This evidence, therefore, suggests that both perceived parenting and attachment style may have value as potential targets of psychosis in early recognition strategies. Indeed, several univariate studies have reported significant associations between attachment insecurity and clinically relevant aspects of psychosis, e.g. negative symptoms , paranoia , negative beliefs [26,27,28], and social withdrawal . However, univariate studies have characterized main effects or interactions between attachment security and psychosis only at the group-level, thus lacking in generalizability potential and underestimating inter-individual heterogeneity [30, 31]. Furthermore, little is known about the association of perceived negative parenting and attachment insecurity with earlier stages of psychosis, as well as with its risk conditions (i.e., clinical, familial). Thus, the extent of potential of parenting and attachment factors to be targeted in early intervention programs is still unclear. A strategy to circumvent these shortcomings is to employ machine learning techniques. Indeed, machine learning allows quantifying sensitivity, specificity and generalizability of a given set of variables at the single-subject level [32, 33], rather than just characterizing group differences. Therefore, employing machine learning to deeply investigate the discriminative power of parenting and attachment-related variables in both psychosis and early stages of disease would lead to a better understanding of how negative parenting and attachment insecurity might be considered core vulnerability factors of psychosis and its early stages. From a clinical perspective, this better understanding would potentially allow better tailoring of environmental factors within early identification programs. Specifically, accurate and generalizable machine learning models could potentially lead to the implementation of refined and individualized preventative interventions, and/or mental health promotion programs, which would in turn have a greater impact in the reduction of the burden associated with psychosis in terms of symptoms, quality of life, management .
Thus, the aim of this study is threefold: (i) to generate a parenting and attachment-based machine learning model which correctly discriminates between PSY and healthy controls (HC); (ii) to test whether this model could track the early stages of psychosis and/or risk conditions in independent samples; (iii) to investigate in both psychosis and its early stages the potential association between model’s performance and social cognition impairments. We hypothesized that both perceived parenting and attachment-related variables will bear significant PSY vs. HC classification performance. Furthermore, we hypothesized that this model will generalize to early stages of psychosis and familial risk conditions. Moreover, we expected that the discriminative ability of the model will be associated with social cognition abilities.
A total of 234 individuals, all Caucasians native of the Apulia region, Italy, participated in the study. Inclusion and exclusion criteria are reported in Supplementary Information, section "Background". The discovery sample was composed of 105 individuals, of which 71 HC and 34 PSY on stable antipsychotic treatment for at least one month (Table 1A). Of the PSY, 20 were diagnosed with schizophrenia and 14 with bipolar disorder with psychotic symptoms according to the Structural Clinical Interview for DSM IV-TR . Moreover, 90 individuals were included in the validation clinical sample (Table 1B). Of those, 60 were HC and 30 were individual at the early stages of disease (ESD) compared with PSY. Specifically, 9 were labeled as First Episode of Depression, 9 as First Episode of Psychosis, and 12 as At-Risk Mental State for psychosis. A detailed description of the clinical characteristics of the ESD group is reported in Supplementary Information, section "Background". Furthermore, 26 HC and 13 individuals with a Familial High Risk for psychosis (FHR, i.e., with no DSM IV Axis I diagnosis, but with a first-degree relative affected either by schizophrenia or by bipolar disorder—Table 1C) were included in the validation familial risk sample. Both familial risk and clinical validation samples were used for replication purposes (section "Out-of-sample validation analyses"). ANOVA and χ2 were used to test for group differences in terms of demographics both within- and between- samples (Table 1).
Perceived parental bonding and adult attachment assessment
All participants completed the Parental Bonding Instrument (PBI) for the assessment of the perceived parental bonding  (Supplementary Information, section "Methods"). The PBI is a 25-items self-report questionnaire investigating two main dimensions, “care” and “overprotection”, separately for maternal bonding and paternal bonding. The “care” dimension reflects perceived parental warmth, affection, and involvement in contrast to coldness, indifference, and rejection. On the other hand, the “overprotection” dimension reflects perceived parental psychological control and intrusion in contrast to the encouragement of autonomy and independence. The Italian version of the PBI shows good psychometric properties . In this study, we focused on PBI continuous scores of separate maternal and paternal care and overprotection (4 variables in total) for analysis purposes.
To assess the adult attachment style, all individuals underwent the 36-items self-report questionnaire Experiences in Close Relationships Scale (ECR) . The ECR allows researchers to investigate feelings and behaviors related to significant relationships in adulthood along two dimensions: "anxiety about abandonment" and "avoidance of closeness". The anxiety factor includes intense concerns for romantic relationships, fear of being abandoned and frequent requests to greater involvement of partners; the second factor, avoidance, includes difficult and uncomfortable feelings in managing emotions and in relying on partners. The Italian version of the ECR shows good psychometric properties . In this study, we focused on continuous scores of ECR anxiety and avoidance for analysis purposes.
Two-sample t-tests were employed to assess differences in discovery and validation samples for each of the PBI and ECR variables of interest (Table 2). All significant p values were < 0.05.
Social cognition assessment
All individuals were administered three tests, each aimed at investigating a different aspect of socio-cognitive abilities:
to investigate emotion perception, we employed the Facial Emotion Identification Test (FEIT) (; details about the Italian version employed can be found at ); we employed a computerized FEIT version  in which individuals were shown 19 individuals' faces each depicting one of six different emotions (happiness, sadness, anger, surprise, fear, shame), shown one at a time for 15 s, with 10 s of blank screen between each stimulus presentation. 15 photographs depict negative emotions (sadness, anger, fear, and shame), while 4 photographs depict positive emotions (happiness, and surprise). After the presentation of each stimulus, individuals were required to select which of the six emotions was depicted on the picture and to mark it on an answer form. The total test score was computed as the percentage of correct answers.
to investigate theory of mind, we employed The Awareness of Social Inference Test (TASIT) (; details about the Italian version employed can be found at ). The TASIT is composed of seven scales (positive emotions, negative emotions, sincere, simple sarcasm, paradoxical sarcasm, sarcasm enriched, lie), organized into three sections: in the section “emotion recognition”, individuals undergo 28 video-vignettes of professional actors enacting ambiguous scripts representing 7 basic emotions (happy, sad, surprised, angry, anxious, revolted, neutral), and at the end of each vignette they are asked to choose the perceived emotion of a given actor indicated in the answer form. The second section, social inference (minimal), allows researchers to investigate the understanding of conversational meanings that are determined by paralinguistic cues. Here, individuals are required to watch 15 video-vignettes of either sincere or sarcastic or paradoxical everyday conversational exchanges; for each vignette, individuals are asked 4 comprehension questions, respectively testing the understanding of actors’ beliefs, meaning, intentions, and feelings. The last section, social inference (enriched), assesses the ability to use contextual knowledge, like visual and verbal information, to derive meaning. Individuals are asked to undergo 16 video-vignettes, each one including a literally untrue comment (see Supplementary Information, section "Results" for a full description). For each vignette, individuals are asked 4 comprehension questions, respectively testing the understanding of actors’ beliefs, meaning, intentions, and feelings. For analysis purposes, we used the total number of correctly answered questions for each of the three TASIT sections.
To test the ability to manage emotions, i.e. “to be open to feelings, and to modulate them in oneself and others so as to promote personal understanding and growth of regulating emotions in oneself and in one’s relationships with others” , we employed the Branch 4 (managing emotions) of the Mayer–Salovey–Caruso Emotional Intelligence Test (MSCEIT) (, Italian version: ). MSCEIT Branch 4 allows researchers to examine the ability to manage emotions by asking individuals to read short stories about an imaginary person going through an emotionally difficult situation, and then determine how effective several different courses of action would be for that given person in coping with the difficult emotions of the story. Individuals rate every possible action ranging from «Very ineffective», to «Very effective». MSCEIT scoring was based on the consensus scoring methods outlined in the manual .
Two-sample t-tests were employed to assess differences in discovery and validation samples for FEIT, TASIT, and MSCEIT total scores employed in subsequent statistical analysis (Table 3). All p values were <0.05. In the case of significant results, TASIT p values were <0.05, False Discovery Rate (FDR) corrected for the number sections tested (i.e., 3) .
Machine learning pipeline
The overall machine learning strategy was carried out through the NeuroMiner software, version 1.0 (https://github.com/neurominer-git?tab=repositories) and consisted in building a multimodal algorithm based on the six perceived parental bonding and adult attachment related-variables (i.e., PBI maternal care, PBI paternal care, PBI maternal overprotection, PBI paternal overprotection, ECR avoidance, ECR anxiety, hereby called “features”, Table 2) which accurately discriminates between HC and PSY. With this aim, we implemented a repeated nested cross-validation strategy (CV, Supplementary Information, section "Discussion") [32, 46, 47] to identify models that contributed most to the classification pattern separating PSY and HC at the inner CV level. To enforce an unbiased estimation of classification generalizability, these models were then applied to the test data at the outer CV level, which included individuals that were not used for training the classification algorithm . We obtained a Support Vector Machine  ensemble model based on the six perceived parental bonding and adult attachment-related variables listed before. Model performance was measured using sensitivity, specificity, balanced accuracy (BAC), positive predictive value (PPV), negative predictive value (NPV), and Area-Under-the Curve (AUC) based on the class membership probability scores generated through ensemble-based majority voting in the repeated nested CV framework (Supplementary Information, section Discussion). We also assigned statistical significance to the observed classification performance of our model through permutation analysis (Supplementary, Information, sect. 5). Furthermore, to understand the importance of the input features for generating decisions (i.e., PSY or HC?), we computed for each feature the probability of being selected for classification purposes within the inner CV loop [50, 51]. A detailed description of our machine learning pipeline is reported in Supplementary Information, section "Discussion".
Further, we performed some sanity checks in order to exclude that our machine learning algorithm was associated with any clinical confound. Therefore, in the PSY group, we conducted Pearson’s r correlations between subject-specific linear SVM decision scores and, respectively, medication (expressed in chlorpromazine equivalents), level of functioning (as assessed by Global Assessment of Functioning, ), and age of onset. A more positive decision score suggests that a given individual is highly prototypical of the HC class, while a more negative decision score suggests that a given individual is highly prototypical of the PSY class.
Out-of-sample validation analyses
To investigate whether the machine learning model can discriminate between PSY and HC could have a potential prognostic validity, we externally validated the model in the validation clinical sample (Table 1B) and in the validation familial risk sample (Table 1C). With this purpose, we performed out-of-sample validation analysis by applying the SVM ensemble decision model obtained from the discovery analysis without any in-between re-training steps to both validation cohorts (i.e., ESD vs. HC, and FHR vs. HC), as already done in previous publications [51, 53].
Association analysis between decision scores and social cognition
To investigate whether the classification performance of our algorithm was associated with social cognition performance as a function of diagnosis, we tested the diagnosis (i.e., PSY vs. HC) x classification rate (i.e., correctly classified vs. misclassified individuals, based on the comparison between observed and predicted labels) interaction on social cognition (as measured by FEIT total score, TASIT total score, MSCEIT standardized total score). Analyses were controlled for age, gender and premorbid IQ (Supplementary Information, section "Background"). All significant p values were p < 0.05. In the case of significant results, TASIT p values were < 0.05, FDR corrected for the number of sections tested (i.e., 3) .
Given the validation results (see Results, section "Validation familial risk sample"), this same analysis pipeline has been repeated on the validation clinical sample.
As a sanity check, to rule out any possibility that differences in terms of social cognition performance across groups (Table 3) could have influenced the classification performance of our algorithm, we performed correlation analysis on the whole discovery sample between all features which entered the machine learning algorithm, and each socio-cognitive variable of interest used for association analysis. All p values were > 0.05, FDR corrected. Results of this sanity check are reported in Supplementary Table S2 and highlight the absence of any significant association between features entering the algorithm and socio-cognitive variables of interest.
ANOVA and χ2 analyses revealed that PSY differed significantly from HC in terms of age, WAIS and premorbid IQ (all p < 0.001, Table 1A), as well as on all measures of social cognition (all p < 0.001, Table 3A), with PSY performing significantly worse than HC. The machine learning model based on parental bonding and adult attachment-related variables correctly discriminated PSY from HC with a cross-validated BAC of 72.2% (sensitivity: 82.4%; specificity: 62.2%; Area Under the Curve: 0.71) and was significant at p < 0.001. Detailed statistics of all individual classification models are reported in Table 4. When computing the probability of each feature of being selected for classification purposes within the inner CV loop, we observed that the features with the highest probability (i.e., those that were selected the most for discrimination purposes within the CV framework) were PBI maternal care, ECR avoidance, and PBI overprotection (Fig. 1). In PSY, we found no association between SVM decision scores and, respectively, medication, GAF score and age of onset (respectively, p = 0.25, p = 0.52, p = 0.87).
Validation clinical sample
ANOVA and χ2 revealed that ESD differed significantly from HC in terms of gender distribution (p = 0.007, Table 1B) and of social inference performance (minimal, p < 0.001; enriched, p = 0.011) as measured by TASIT sections "Methods" and "Results" (Table 3B), with ESD performing worse than HC. Results from the out-of-sample validation analysis discriminating between ESD and HC based on the model classifying PSY from HC (Results section "Discovery sample") revealed that the parental bonding and adult attachment-related model discriminating between PSY and HC also discriminated between ESD and HC with a cross-validated BAC of 63.5% (sensitivity: 67.7%; specificity: 59.3%; Area Under the Curve: 0.65, Table 4).
Validation familial risk sample
ANOVA and χ2 revealed that FHR differed significantly from HC in terms of IQ (p = 0.016, Table 1C) and of minimal social inference (TASIT section "Methods", p < 0.001, Table 3C) and managing of emotions abilities (MSCEIT Branch 4, p = 0.043, Table 3C), with FHR performing worse than HC. Results from the out-of-sample validation analysis discriminating between FHR and HC based on the model classifying PSY from HC revealed that the parental bonding and adult attachment-related model discriminating between PSY and HC did not significantly discriminate between ESD and HC (cross-validated BAC: 44.2%, Table 4).
Association analysis between decision scores and social cognition
General linear models revealed a significant diagnosis x classification rate interaction on FEIT percentage of correct answers (F = 5.11, p = 0.02, Fig. 2), such that the misclassified PSY (i.e., the PSY individuals that the algorithm wrongly identified as HC) had higher percentage of correct responses than the correctly classified PSY (i.e., the PSY individuals that the algorithm correctly identified as PSY) (p = 0.03), while no differences between the correctly classified and the misclassified HC individuals were found (p = 0.58). We also found a significant diagnosis x classification rate interaction on MSCEIT Branch 4 total score (F = 6.39, p = 0.02, Fig. 3), such that the misclassified HC (i.e., the HC individuals that the algorithm wrongly identified as PSY) had lower MSCEIT total score than the correctly classified HC (i.e., the HC individuals that the algorithm correctly identified as HC, p = 0.04). On the other hand, no differences between the correctly classified and the misclassified PSY individuals were found (p = 0.09). No significant interactions were found on TASIT section-related total scores (respectively, p = 0.45, p = 0.31, p = 0.15).
Validation clinical sample
General linear models revealed a significant diagnosis x classification rate interaction on MSCEIT Branch 4 total score (F = 4.74, p = 0.03, Fig. 4), such that the misclassified ESD (i.e., the ESD individuals that the algorithm wrongly identified as HC) had higher MSCEIT total score than the correctly classified ESD (i.e., the ESD individuals that the algorithm correctly identified as ESD) (p = 0.02), while no differences between the correctly classified and the misclassified HC individuals were found (p = 0.74). No significant interactions were found on FEIT percentage of correct responses (p = 0.40) and on TASIT section-related total scores (respectively, p = 0.06, p = 0.16, p = 0.51).
In this study, we aimed at discriminating between PSY and HC within a machine learning framework based on perceived parenting and attachment-related variables, at externally validating this classification model in cohorts reflecting early stages of psychosis (i.e., ESD individuals), as well as its familial risk (i.e., FHR individuals), and at understanding across these cohorts whether algorithmic decisions were associated with social cognition impairments. To the best of our knowledge, our results for the first time offer preliminary insights about the machine learning-based classification ability of perceived quality of parenting and attachment style variables, revealing that this set of variables correctly discriminates between PSY and HC with a 72.2% BAC and significance. These findings are in line with previous literature suggesting the role of a perceived negative family environment  and insecure attachment  in the vulnerability for psychosis. Notably, the most reliable features for classification purposes were PBI maternal care, ECR attachment avoidance and PBI maternal overprotection. The PBI results are in line with previous evidence showing that expressed emotions, communication deviance, and rearing within the family have all been previously associated with the prognosis of psychosis . As concerns attachment avoidance, it has been previously associated with both positive and negative symptoms in PSY , and with psychotic symptoms, paranoia, endorsement of delusional experiences, negative affect regulation and social anhedonia in non-clinical samples [25, 55]. Nevertheless, these results should be taken with caution. Indeed, the risk pathways of psychosis are complex and heterogeneous, and reflect complex interplays between multiple genetic, environmental and neurocognitive characteristics . In this framework, our results do not suggest that perceived negative parenting and attachment insecurities are sufficient causative factors for psychosis. Rather, they highlight their potential role as general vulnerability-to-psychosis factors, whose effect may be amplified by other more specific schizophrenia and bipolar disorder-related genetic and environmental factors, possibly leading to cognitive biases in reality interpretation .
This view is further corroborated by the fact that our perceived parenting and attachment-related model correctly discriminated also unseen ESD and HC individuals with 63.5% BAC. The 8.7% BAC drop observed in comparison with the discovery sample’s performance may be explained by both clinical reasons (i.e., the ESD cohort is composed by individuals either at their first episode of psychosis or depression or by individuals at high clinical risk for psychosis, see Supplementary Information, section "Background) and demographic differences between the discovery and the validation clinical cohorts (Table 1). Despite these differences, these findings show that our model not only achieves high diagnostic performance, but it also carries an intrinsic early identification potential. Thus, they may speak in favor of the possibility of specifically targeting parenting and attachment-related factors into early identification and prevention programs, especially in terms of promotion of attachment security as a key general resilience factor . Nevertheless, future studies in larger and geographically diverse samples are warranted to realistically understand the potential of translation into clinical practice of our results.
It should be also noted that the model we generated in the PSY and HC discovery sample discriminated between FHR and HC at chance-level, thus suggesting that the general vulnerability-to-psychosis role of parenting and attachment characteristics might act only in the “late” portion of psychosis risk (as testified by the validation in ESD individuals), but not in “early” portions of psychosis risk. Indeed, FHR individuals do not have any clinical impairment or other risk conditions, but their PSY first-degree relative. This view is supported by previous evidence in which significant avoidance differences in attachment anxiety and avoidance have been found between individuals diagnosed with schizophrenia and their unaffected siblings, but not between their siblings and controls . Another aspect that should be taken into consideration is that the PBI and ECR instruments, from which the features entering the machine learning algorithm were extracted, are self-report questionnaires. Despite evidence testifying that attachment self-reports measures are highly reliable in reflecting individuals’ actual attachment dispositions [57, 58], it can’t be excluded that the internal working models of attachment experiences, as well as the perception of the parenting received, are affected by biases in reality interpretation associated with illness experience at any stage (i.e., in both PSY and ESD individuals), which should not occur when only familial or genetic risk conditions are present. Indeed, a previous contribution  showed that individuals with an ongoing depressive disorder had more negative recollections of parenting experiences than those who remitted from a depressive disorder. This evidence corroborates the hypothesis that the experience of a mental illness is associated with biases in the interpretation of memories, although it is difficult to attribute any causality or directionality to this association. Nevertheless, our findings testify the urgency of implementing psychoeducation actions in psychosis, potentially through the combination of social skills trainings and emotional/motivational support to all family members, aimed at improving illness knowledge, resilience and coping skills after adverse childhood experiences. These actions would support not only individuals suffering from psychosis but would also more likely alleviate the illness-related emotional burden of their caregivers.
We also found a significant interaction between group and classification rate on social cognition performance in the cohorts in which our models showed good classification power, which speaks in favor of targeting social cognition deficits in early identification and intervention programs through social skills trainings. Indeed, in PSY and HC individuals from the discovery sample, this interaction was present on both FEIT and MSCEIT total scores. For FEIT, PSY that the algorithm misclassified as HC had higher emotion perception and ability to manage emotions, compared with PSY correctly classified as cases, and not as controls. For MSCEIT, HC individuals that the algorithm misclassified as PSY had lower emotion perception and managing of emotions abilities, compared with HC individuals that correctly classified as controls, and not as cases. We found the interaction also in the ESD and HC validation clinical sample, but only on MSCEIT total score, such that misclassified ESD had higher managing of emotions ability compared with correctly classified ESD. In both samples, no group x classification rate interaction was found on theory of mind abilities. Taken together, these results support the view for which parenting and attachment experiences guide how the social world is appraised  to the extent that their association with social cognition abilities is significant. Notably, this association is present on both basic and complex emotional aspects of social cognition as a function of PSY diagnosis, and only on cognitive-emotional aspects in ESD individuals. Indeed, emotion perception (i.e., the conscious recognition of basic emotions on facial stimuli) has repeatedly been found as impaired in PSY [60, 61], and previous evidence revealed an association between attachment style and both behavioral and brain correlates of emotion recognition . This interaction was significant only in PSY, most likely because this basic emotion ability tends to worsen in the level of impairments along with disease chronicity and symptom severity [63, 64]. Thus, it may be that the lack of interaction on the FEIT score in ESD is due to their more preserved emotion recognition abilities. On the other hand, the presence of a significant group by classification rate interaction in both PSY and ESD on MSCEIT score is consistent with the fact that parenting and attachment-related factors significantly modulate affect regulation at a more complex level since the early stages of psychosis [65, 66]. The ability to manage emotions, indeed, is one of the four emotional intelligence branches and represents the ability of individuals to handle (both at the thought and behavior levels), their own emotions effectively . Consistently, a core concept of attachment theory is that attachment style strongly influences the appraisal of social cues, thus modulating affect regulation from childhood to adulthood .
This study has some limitations. First of all, the small sample sizes across cohorts strongly limit the generalizability of our findings, as they may be overfitted [68, 69]. Second, the use of a retrospective perceived maternal care measure and of a self-report attachment questionnaire could reflect false memories or even re-interpretation of the type of care received . However, previous literature has indicated that both measures are stable over time [57,58,59, 71], suggesting that they may overall constitute reliable measures. Third, the cross-sectional nature of this study does not allow us to give any realistic prognostic insight into psychosis and its early stages based on these findings, or to speculate on whether the experience of a mental illness impacts on the perception of negative childhood experiences, or vice versa. Longitudinal studies are warranted to investigate the prognostic relevance of our model.
Despite the difficulty in attributing any causality to the association between psychosis and perceptions of negative childhood experiences, our results support the role of perceived negative parenting and attachment insecurity as general vulnerability characteristics in psychosis and its early phases, both because of their good classification power and because of their association with key socio-cognitive psychosis phenotypes. In this view, they improve the understanding of psychosis environmental risk pathways. Furthermore, if externally validated in larger cohorts, they offer intriguing clinical insights about the possibility of promoting positive parenting and attachment security as psychosis resilience factors within early identification and early intervention programs, especially when other more psychosis-specific environmental risk factors (e.g., childhood adverse events, low socioeconomic status, an affected first-degree relative ) are present.
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
Early stages of disease
Facial emotion identification task
Familial high risk
Mayer–Salovey–Caruso emotional intelligence test
Parental bonding instrument
Individuals diagnosed with Psychosis
The awareness of social inference test
Vancampfort D, Firth J, Schuch FB, Rosenbaum S, Mugisha J, Hallgren M, Probst M, Ward PB, Gaughran F, De Hert M, et al. Sedentary behavior and physical activity levels in people with schizophrenia, bipolar disorder and major depressive disorder: a global systematic review and meta-analysis. World Psychiatry. 2017;16(3):308–15.
Bowie CR, Depp C, McGrath JA, Wolyniec P, Mausbach BT, Thornquist MH, Luke J, Patterson TL, Harvey PD, Pulver AE. Prediction of real-world functional disability in chronic mental disorders: a comparison of schizophrenia and bipolar disorder. Am J Psychiatry. 2010;167(9):1116–24.
Lomholt LH, Andersen DV, Sejrsgaard-Jacobsen C, Ozdemir CM, Graff C, Schjerning O, Jensen SE, Straszek SPV, Licht RW, Grontved S, et al. Mortality rate trends in patients diagnosed with schizophrenia or bipolar disorder: a nationwide study with 20 years of follow-up. Int J Bipolar Disord. 2019;7(1):6.
Nordentoft M, Wahlbeck K, Hallgren J, Westman J, Osby U, Alinaghizadeh H, Gissler M, Laursen TM. Excess mortality, causes of death and life expectancy in 270,770 patients with recent onset of mental disorders in Denmark, Finland and Sweden. PLoS ONE. 2013;8(1):e55176.
Bowie CR, Best MW, Depp C, Mausbach BT, Patterson TL, Pulver AE, Harvey PD. Cognitive and functional deficits in bipolar disorder and schizophrenia as a function of the presence and history of psychosis. Bipolar Disord. 2018;20(7):604–13.
Bora E, Pantelis C. Social cognition in schizophrenia in comparison to bipolar disorder: a meta-analysis. Schizophr Res. 2016;175(1–3):72–8.
Bellivier F, Geoffroy PA, Scott J, Schurhoff F, Leboyer M, Etain B. Biomarkers of bipolar disorder: specific or shared with schizophrenia? Front Biosci (Elite Ed). 2013;5:845–63.
Dean K, Murray RM. Environmental risk factors for psychosis. Dialogues Clin Neurosci. 2005;7(1):69–80.
Demjaha A, MacCabe JH, Murray RM. How genes and environmental factors determine the different neurodevelopmental trajectories of schizophrenia and bipolar disorder. Schizophr Bull. 2012;38(2):209–14.
Popovic D. RA, Dwyer D.B., Antonucci L.A., Eder J., Sanfelici R., Kambeitz-Ilankovic L., Oztuerk O.F., Dong M.S., Paul R., Paolini M., Hedderiche D., Haidl T., Kambeitz J., Ruhrmann S., Chisholm K., Schultze-Lutter F., Falkai P., Pergola G., Blasi G., Bertolino A., Lencer R., Dannlowski U., Upthergrove R., Salokangas R.K.R., Pantelis C., Meisenzahl E., Wood S.J., Brambilla P., Borgwardt S., Koutsouleris N.: Traces of trauma: a multivariate pattern analysis of childhood trauma, brain structure, and clinical phenotypes. Biol Psychiat 2020.
Chamberlain C, Gee G, Harfield S, Campbell S, Brennan S, Clark Y, Mensah F, Arabena K, Herrman H, Brown S, et al. Parenting after a history of childhood maltreatment: a scoping review and map of evidence in the perinatal period. PLoS ONE. 2019;14(3):e0213460.
van IMH, Bakermans-Kranenburg MJ: Bridges across the intergenerational transmission of attachment gap. Curr Opin Psychol 2019, 25:31–36.
Bowlby J. Attachment and loss. New York: Basic Books; 1980.
Bartholomew K, Horowitz LM. Attachment styles among young-adults: a test of a 4-category model. J Pers Soc Psychol. 1991;61(2):226–44.
Collins NL, Feeney BC. Working models of attachment shape perceptions of social support: evidence from experimental and observational studies. J Pers Soc Psychol. 2004;87(3):363–83.
Mikulincer M, Shaver PR. An attachment perspective on psychopathology. World Psychiatry. 2012;11(1):11–5.
Mikulincer M, Shaver PR. Attachment orientations and emotion regulation. Curr Opin Psychol. 2019;25:6–10.
Mikulincer M, Shaver PR. Attachment, group-related processes, and psychotherapy. Int J Group Psychother. 2007;57(2):233–45.
Mikulincer M, Gillath O, Shaver PR. Activation of the attachment system in adulthood: threat-related primes increase the accessibility of mental representations of attachment figures. J Pers Soc Psychol. 2002;83(4):881–95.
Antonucci LA, Taurisano P, Coppola G, Cassibba R. Attachment style: The neurobiological substrate, interaction with genetics and role in neurodevelopmental disorders risk pathways. Neurosci Biobehav Rev. 2018;95:515–27.
Sheinbaum T, Kwapil TR, Ballespi S, Mitjavila M, Chun CA, Silvia PJ, Barrantes-Vidal N. Attachment style predicts affect, cognitive appraisals, and social functioning in daily life. Front Psychol. 2015;6:296.
Pos K, Bartels-Velthuis AA, Simons CJ, Korver-Nieberg N, Meijer CJ, de Haan L. Group: Theory of Mind and attachment styles in people with psychotic disorders, their siblings, and controls. Aust N Z J Psychiatry. 2015;49(2):171–80.
Howes OD, Murray RM. Schizophrenia: an integrated sociodevelopmental-cognitive model. Lancet. 2014;383(9929):1677–87.
Carr SC, Hardy A, Fornells-Ambrojo M. Relationship between attachment style and symptom severity across the psychosis spectrum: a meta-analysis. Clin Psychol Rev. 2018;59:145–58.
Lavin R, Bucci S, Varese F, Berry K. The relationship between insecure attachment and paranoia in psychosis: a systematic literature review. Br J Clin Psychol. 2020;59(1):39–65.
Berry K, Wearden A, Barrowclough C. Adult attachment styles and psychosis: an investigation of associations between general attachment styles and attachment relationships with specific others. Soc Psychiatry Psychiatr Epidemiol. 2007;42(12):972–6.
Berry K, Barrowclough C, Wearden A. A review of the role of adult attachment style in psychosis: unexplored issues and questions for further research. Clin Psychol Rev. 2007;27(4):458–75.
Ponizovsky AM, Vitenberg E, Baumgarten-Katz I, Grinshpoon A. Attachment styles and affect regulation among outpatients with schizophrenia: relationships to symptomatology and emotional distress. Psychol Psychother. 2013;86(2):164–82.
Ponizovsky AM, Drannikov A. Contribution of attachment insecurity to health-related quality of life in depressed patients. World J Psychiatry. 2013;3(2):41–9.
Dwyer DB, Falkai P, Koutsouleris N. Machine learning approaches for clinical psychology and psychiatry. Annu Rev Clin Psychol. 2018;14:91–118.
Goodman SN. A comment on replication, p-values and evidence. Stat Med. 1992;11(7):875–9.
Koutsouleris N, Kahn RS, Chekroud AM, Leucht S, Falkai P, Wobrock T, Derks EM, Fleischhacker WW, Hasan A. Multisite prediction of 4-week and 52-week treatment outcomes in patients with first-episode psychosis: a machine learning approach. Lancet Psychiatry. 2016;3(10):935–46.
Koutsouleris N, Riecher-Rossler A, Meisenzahl EM, Smieskova R, Studerus E, Kambeitz-Ilankovic L, von Saldern S, Cabral C, Reiser M, Falkai P, et al. Detecting the psychosis prodrome across high-risk populations using neuroanatomical biomarkers. Schizophr Bull. 2015;41(2):471–82.
First M. B. SR, Gibbon M., Williams, J.: Structured Clinical Interview for Axis I Disorders-Patient Edition. 1996.
Parker G. The parental bonding instrument. A decade of research. Soc Psychiatry Psychiatr Epidemiol 1990, 25(6):281–282.
Scinto AMMG, Kalyvoka A, Daneluzzo E, Rossi A. The use of the Italian version of the Parental Bonding Instrument (PBI) in a clinical sample and in a student group: an exploratory and confirmatory factor analysis study. Epidemiol Psichiatr Soc. 1999;8(4):276–83.
Brennan KA CC, Shaver PR. In: Simpson JA, Rholes WS: Self-report measurement of adult attachment: an integrative overview. In: Attachment theory and close relationships. edn. Edited by Press NYG; 1998.
Picardi AVP, Toni A, D’Amico R, Bitetti D, Pasquini P. Further evidence of the validity of the Italian version of the questionnaire “Experiences in Close Relationships” (ECR), a self-report instrument to assess adult attachment. Ital J Psychopath. 2002;8(3):282–94.
Kerr SL, Neale JM. Emotion perception in schizophrenia: specific deficit or further evidence of generalized poor performance? J Abnorm Psychol. 1993;102(2):312–8.
Rocca P, Galderisi S, Rossi A, Bertolino A, Rucci P, Gibertoni D, Montemagni C, Sigaudo M, Mucci A, Bucci P, et al. Social cognition in people with schizophrenia: a cluster-analytic approach. Psychol Med. 2016;46(13):2717–29.
Erol A, Putgul G, Kosger F, Ersoy B. Facial emotion recognition in schizophrenia: the impact of gender. Psychiatry Investig. 2013;10(1):69–74.
McDonald S, Bornhofen C, Shum D, Long E, Saunders C, Neulinger K. Reliability and validity of The Awareness of Social Inference Test (TASIT): a clinical test of social perception. Disabil Rehabil. 2006;28(24):1529–42.
Mayer JDSP, Caruso DR. Mayer-Salovey-Caruso Emotional Intelligence Test (MSCEIT): Toronto. Ontario: Multi-Health Systems, Inc.; 2002.
D’Amico A CA: Traduzione ed adattamento italiano del Mayer-Salovey-Caruso Emotional Intelligence Test (MSCEIT). Firenze, Italy: OS; 2011.
Benjamini YHY. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J Roy Stat Soc: Ser B (Methodol). 1995;57(1):289–300.
Antonucci LA, Penzel N, Pergola G, Kambeitz-Ilankovic L, Dwyer D, Kambeitz J, Haas SS, Passiatore R, Fazio L, Caforio G, et al. Multivariate classification of schizophrenia and its familial risk based on load-dependent attentional control brain functional connectivity. Neuropsychopharmacology. 2020;45(4):613–21.
Koutsouleris N, Wobrock T, Guse B, Langguth B, Landgrebe M, Eichhammer P, Frank E, Cordes J, Wolwer W, Musso F, et al. Predicting response to repetitive transcranial magnetic stimulation in patients with schizophrenia using structural magnetic resonance imaging: a multisite machine learning analysis. Schizophr Bull. 2018;44(5):1021–34.
Ruschhaupt M, Huber W, Poustka A, Mansmann U: A compendium to ensure computational reproducibility in high-dimensional classification tasks. Statistical Applications in Genetics and Molecular Biology 2004, 3:Article37.
Noble WS. What is a support vector machine? Nat Biotechnol. 2006;24(12):1565–7.
Pergola G, Trizio S, Di Carlo P, Taurisano P, Mancini M, Amoroso N, Nettis MA, Andriola I, Caforio G, Popolizio T, et al. Grey matter volume patterns in thalamic nuclei are associated with familial risk for schizophrenia. Schizophr Res. 2017;180:13–20.
Antonucci LA, Pergola G, Pigoni A, Dwyer D, Kambeitz-Ilankovic L, Penzel N, Romano R, Gelao B, Torretta S, Rampino A, et al. A pattern of cognitive deficits stratified for genetic and environmental risk reliably classifies patients with schizophrenia from healthy control subjects. Biol Psychiatry. 2020;87(8):697–707.
Hall RC. Global assessment of functioning: a modified scale. Psychosomatics. 1995;36(3):267–75.
Koutsouleris N, Kambeitz-Ilankovic L, Ruhrmann S, Rosen M, Ruef A, Dwyer DB, Paolini M, Chisholm K, Kambeitz J, Haidl T, et al. Prediction models of functional outcomes for individuals in the clinical high-risk state for psychosis or with recent-onset depression: a multimodal, multisite machine learning analysis. JAMA Psychiatry. 2018;75(11):1156–72.
de Sousa P, Varese F, Sellwood W, Bentall RP. Parental communication and psychosis: a meta-analysis. Schizophr Bull. 2014;40(4):756–68.
Gumley AI, Taylor HE, Schwannauer M, MacBeth A. A systematic review of attachment and psychosis: measurement, construct validity and outcomes. Acta Psychiatr Scand. 2014;129(4):257–74.
Harder S. Attachment in schizophrenia–implications for research, prevention, and treatment. Schizophr Bull. 2014;40(6):1189–93.
Mikulincer M, Shaver PR. Boosting attachment security to promote mental health, prosocial values, and inter-group tolerance. Psychol Inq. 2007;18(3):139–56.
Belsky J. Developmental origins of attachment styles. Attach Hum Dev. 2002;4(2):166–70.
Gotlib IH, Mount JH, Cordy NI, Whiffen VE. Depression and perceptions of early parenting: a longitudinal investigation. Br J Psychiatry: J Mental Sci. 1988;152:24–7.
Lado-Codesido M, Mendez Perez C, Mateos R, Olivares JM, Garcia Caballero A. Improving emotion recognition in schizophrenia with “VOICES”: an on-line prosodic self-training. PLoS ONE. 2019;14(1):e0210816.
Branco LD, Cotrena C, Ponsoni A, Salvador-Silva R, Vasconcellos SJL, Fonseca RP. Identification and perceived intensity of facial expressions of emotion in bipolar disorder and major depression. Arch Clin Neuropsychol. 2018;33(4):491–501.
Dan O, Raz S. Adult attachment and emotional processing biases: an event-related potentials (ERPs) study. Biol Psychol. 2012;91(2):212–20.
Won S, Lee WK, Kim SW, Kim JJ, Lee BJ, Yu JC, Lee KY, Lee SH, Kim SH, Kang SH, et al. Distinct differences in emotional recognition according to severity of psychotic symptoms in early-stage schizophrenia. Front Psych. 2019;10:564.
Ruocco AC, Reilly JL, Rubin LH, Daros AR, Gershon ES, Tamminga CA, Pearlson GD, Hill SK, Keshavan MS, Gur RC, et al. Emotion recognition deficits in schizophrenia-spectrum disorders and psychotic bipolar disorder: findings from the Bipolar-Schizophrenia Network on Intermediate Phenotypes (B-SNIP) study. Schizophr Res. 2014;158(1–3):105–12.
Boldrini T, Pontillo M, Tanzilli A, Giovanardi G, Di Cicilia G, Salcuni S, Vicari S, Lingiardi V. An attachment perspective on the risk for psychosis: Clinical correlates and the predictive value of attachment patterns and mentalization. Schizophr Res. 2020;222:209–17.
Quijada Y, Tizon JL, Artigue J, Kwapil TR, Barrantes-Vidal N. Attachment style predicts 6-month improvement in psychoticism in persons with at-risk mental states for psychosis. Early Interv Psychiatry. 2012;6(4):442–9.
DeTore N.R. MKT, McGurk S.R.: What does the Managing Emotions branch of the MSCEIT add to the MATRICS consensus cognitive battery? Schizophrenia Research 2020, in press.
Schnack HG, Kahn RS. Detecting neuroimaging biomarkers for psychiatric disorders: sample size matters. Front Psych. 2016;7:50.
Sanfelici R, Dwyer DB, Antonucci LA, Koutsouleris N. Individualized diagnostic and prognostic models for patients with psychosis risk syndromes: a meta-analytic view on the state of the art. Biol Psychiatry. 2020;88(4):349–60.
Antonucci LA, Pergola G, Passiatore R, Taurisano P, Quarto T, Dispoto E, Rampino A, Bertolino A, Cassibba R, Blasi G. The interaction between OXTR rs2268493 and perceived maternal care is associated with amygdala-dorsolateral prefrontal effective connectivity during explicit emotion processing. Eur Arch Psychiatry Clin Neurosci. 2020;270(5):553–65.
Wilhelm K, Niven H, Parker G, Hadzi-Pavlovic D. The stability of the Parental Bonding Instrument over a 20-year period. Psychol Med. 2005;35(3):387–93.
We are grateful to Dr. Raffaella Romano, Dr. Annamaria Porcelli, and Dr. Marina Mancini for contributing to data collection, to Dr. Enrico D’Ambrosio for supervising participants’ recruitments, to Prof. Pasquale Musso for the crucial insights, and to all the people who took part in this research.
This study was supported from the Apulia Region funding “Early identification of psychiatric risk: a longitudinal study on endophenotypes involved in the psychosis and bipolar disorder risk” (PI: AB), and from the Structural European Funding of the Italian Minister of Education and Research (Attraction and International Mobility—AIM—action, grant agreement No 1859959). The AIM action also funds LAA’s salary. GP’s position is funded by the European Union’s Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie grant agreement No 798181. This paper reflects only the author's views and the European Union and Research Executive Agency are not liable for any use that may be made of the information contained therein. All other authors declare no biomedical financial interests and no potential conflicts of interest. The funding bodies had no role in study design, data collection, and analysis, decision to publish, or preparation of the manuscript.
Ethics approval and consent to participate
All procedures performed in this study were in accordance with the ethical standards of the institutional and/or national research committee and with the 2013 Helsinki Declaration and its later amendments or comparable ethical standards. Informed consent was obtained from all participants included in the study and, in case of minors, also from their parents or caregivers. The study protocol has been approved by the Local Ethic Committee of the Bari University Hospital (study protocol n. 4754). Written informed consent has been obtained by each individual who took part in the study if aged above 18 years old. In the case of individuals aged below 18 years old, written informed consent has been obtained by both the participant and his/her parents.
Consent for publication
AB has received lecture fees from Otsuka, Janssen, Lundbeck, and consultant fees from Biogen. GB has received lecture fees by Janssen and Lundbeck. AR has received travel fees from Lundbeck. All other authors declare no conflicts of interest.
About this article
Cite this article
Antonucci, L.A., Raio, A., Pergola, G. et al. Machine learning-based ability to classify psychosis and early stages of disease through parenting and attachment-related variables is associated with social cognition. BMC Psychol 9, 47 (2021). https://doi.org/10.1186/s40359-021-00552-3
- Parental care
- Parental overprotection
- Adult attachment style
- Machine learning
- Bipolar disorder
- Risk for psychosis