Skip to main content

Comprehensive well-being scale: development and validation among Chinese in recovery of mental illness in Hong Kong

Abstract

Background

Given the absence of a brief scale that reconciles and encompasses different conceptual definitions of well-being (physical, psychological, social and spiritual), the present research aimed at developing and validating a Comprehensive Well-Being Scale (CWBS) that encompasses these different conceptual definition and extend the definition of well-being to transcendental well-being among individuals in recovery of mental illness. The present research focuses on testing the scale among people in recovery of mental illness so that a brief and theoretically comprehensive scale would be available for mental health organization to evaluate the well-being of service users, and to develop and evaluate well-being related services.

Methods

A 56-item preliminary well-being scale was developed by a professional panel. In Study 1, 300 mental health service users in Hong Kong were recruited. Twenty items were selected through principal component analysis to form the CWBS. In Study 2, another sample of 300 service users was recruited. Confirmatory factor analysis was done to confirm a two-factor structure. Validity of the scale was also examined.

Results

The CWBS yielded good internal consistency (Cronbach’s alphas = .79–.91). The finding supported a two-factor structure, namely Intrapersonal Well-Being, and Transpersonal Well-Being, χ2 (169) = 335.61, p < .001, CFI = .90, RMSEA = .06, SRMR = .06.

Conclusions

The CWBS established concurrent and construct validity in assessing well-being among Chinese in recovery of mental illness in Hong Kong. It provided theoretical and practical implications for measuring well-being. Theoretically, it extended the concept of well-being to encompass transcendental well-being in model of recovery among individuals recovery from mental illness. Practically, it provided a tool for evaluation of well-being and service development in mental health organization.

Peer Review reports

Background

Not long ago, mental health recovery used to mean the amelioration of symptoms. With their focus on symptomatology, psychiatrists and clinical psychologists developed elaborate assessment tools to measure symptom severity levels as well as functioning. The late 1980s saw the recovery movement, an initiative by mental health service users to incorporate a broader concept of recovery. William Anthony [1] then laid out the vision of personal recovery in mental health services. Today, personal recovery is defined by the Substance Abuse and Mental Health Services Administration (SAMHSA) [2] of the United States Department of Health and Human Services as a process of change, through which individuals improve their health and wellness, live a self-directed life, and strive to reach their full potential. It is not synonymous with cure [3]. Mental health recovery is holistic, which involves not only the recovery of one’s mental state, but also an individual’s full life spectrum of mind, body, spirit, and community [2]. Along with the development, Keyes [4] proposed a complete state model of mental health, by which mental health and mental illness represent two distinct domains, i.e., the absence of mental illness does not imply the presence of mental health, and the absence of mental health does not imply the presence of mental illness. This suggests that regardless of the presence of mental illness, individuals can flourish and enjoy well-being at multiple domains. For example, personal recovery of people with schizophrenia was found to positively predict well-being above and beyond clinical and functional recovery [5]. Adopting this model, Provencher and Keyes [6] augmented the promotion of personal recovery to include positive mental health as an additional outcome. As seen from the latest development in mental health recovery, well-being is an important element that has to be incorporated in assessment, service planning and evaluation in mental health organization. The following sections will outline current definitions of well-being, highlight the importance of the impact of spiritual well-being to mental health and our proposal to develop a comprehensive well-being measure for people in recovery of mental illness.

Definitions of well-being

Well-being has long been defined by the World Health Organization (WHO) [7] as being multi-faceted, composing of physical, mental, and social dimensions beyond the absence of disease. In particular, mental well-being is further defined as the abilities of individuals to cope with daily stressors, contribute productively in the community, and actualize their potentials [8]. These components of mental well-being have been categorized as hedonic well-being, eudaimonic well-being, and social well-being [9,10,11,12]. Hedonic well-being, also known as emotional well-being or subjective well-being, involves life satisfaction, presence of positive affect, and absence of negative affect [10, 13]. This narrow rendition of happiness was deemed inadequate [14], which gave rise to the other concept of eudaimonic well-being. Deci and Ryan [15] highlighted three basic psychological needs, namely autonomy, competence and relatedness, as a core of eudaimonic well-being. Seligman’s PERMA model [16] focuses on five elements of eudaimonic well-being: positive emotions, engagement, meaning, positive relationships, and accomplishment. Ryff [14, 17] derived six elements of eudaimonic well-being, namely self-acceptance, purpose in life, autonomy, positive relations with others, environmental mastery, and personal growth. Furthermore, Keyes [9] extended eudaimonic well-being from Ryff’s [14] intrapersonal model to an interpersonal focus, and came up with five elements of social well-being, namely social coherence, social acceptance, social actualization, social contribution, and social integration. Put together, intrapersonal and interpersonal well-being are believed to be in congruence with the WHO’s definition of mental health, as well as a comprehensive working definition of well-being.

Despite its multidimensionality, the WHO’s definition of mental health has been criticized for missing a fourth dimension—spiritual well-being [18,19,20,21]. The body-mind-spirit model has had a long history in Western religions like Christianity [22] as well as Eastern religions and philosophies including Confucianism, Taoism, Buddhism, and Hinduism [23]. Nevertheless, spirituality, religion, and personal beliefs are not synonymous [24]. One of the earliest definitions of spiritual well-being by the National Interfaith Coalition on Aging (NICA) [25] is the affirmation of life in the relationship with oneself, others, nature, and God. Following the NICA definition, Fisher [26] proposed the spiritual well-being model, pertaining to domains of personal, communal, environmental, and transcendental well-being. According to Fisher [26], personal domain deals with how one intrarelates with oneself with regard to meaning, purpose, and values in life; communal domain is expressed in the quality and depth of interpersonal relationships, between the self and others, relating to morality, social justice, culture, and religion; environmental domain includes the care and nurture for the physical environment and other organisms, as well as a sense of awe and wonder; transcendental domain is the relationship of the self with something or someone beyond humanity (i.e., ultimate concern, cosmic force, transcendent reality, or God).

Importance of spiritual well-being to mental health

Spiritual well-being is important to mental health from the perspective of people in recovery [27]. In particular, research suggested that spiritual well-being is related to reduced anxiety [28, 29], depressive symptoms [28, 29], suicidal ideation [28] and improved post-traumatic recovery [29]. Despite the importance of spiritual and transcendental well-being in the mental health recovery, this aspect of well-being was not emphasized in models of mental health recovery. For instance, in the 10 guiding principles of recovery proposed by SAMHSA [2], spirituality was only very briefly mentioned under the guiding principle that recovery is holistic: ‘recovery encompasses an individual’s whole life, including mind, body, spirit, and community’. It was also not clear whether the spirit and community component encompasses aspects of communal and transcendental well-being, which highlights how an individual relates with people and things beyond themselves, including people in the community as well as the environment and the Divine [26]. Furthermore, the well-being model proposed by Keyes [9] extended the definition of well-being to a social one, but dimensions of spiritual well-being are not covered. Thus, we proposed that a comprehensive well-being model for individuals in recovery of mental illness should include physical, psychological, social and spiritual well-being.

Intrapersonal and transpersonal well-being

In this research, we proposed domains of Intrapersonal and Transpersonal Well-being to reconcile the overlaps between different conceptual definitions of well-being, as well as to fill in the existing research gap and extend the concept of well-being in people in recovery to a more comprehensive definition. As reviewed in previous sections, the personal domain of spiritual well-being proposed by Fisher [26] and the psychological well-being proposed by Ryff [14] both concern how an individual intrarelates with themselves. Also, the communal domain of spiritual well-being proposed by Fisher [26] and the social well-being proposed by Keyes [9] both regard how an individual interrelates with other people. Furthermore, Fisher’s [26] other domains of spiritual well-being, i.e., environmental and transcendental well-being, extend beyond how an individual interrelates with other people to how an individual interrelates with the environment and something or someone beyond humanity. To cover the above aspects of well-being, we proposed the following operational definitions of well-being: intrapersonal well-being as involving how an individual intrarelates with themselves, including positive physical health and a positive sense of the self [13, 14]; transpersonal well-being as encompassing how an individual relates with people and things beyond themselves, including people in the community [9] as well as the environment and the Divine [26].

Purpose of scale development

To the best of our knowledge, no scale has been developed to encompass all the domains of well-being that have been discussed in literature. A recent systematic review of 99 well-being scales identified as many as 196 dimensions that clustered around six key themes, while pinpointing the ambiguity around the conceptual similarities and differences among different dimensions [30]. Existing scales measuring well-being mainly encompass physical, psychological and social well-being, for instance, Ryff Scales of Psychological Well-being [14, 50], and Mental Health Continuum Short Form [4], but do not extend to domains of spiritual and transcendental well-being. Existing scales for measuring recovery, for instance, Recovery Assessment Scale [31], Mental Health Recovery Measure [32], and Recovery Self-Assessment [33], are limited to the mind, body, and community, but do not extend to environmental and transcendental well-being.Some scales attempt to encompass more dimensions of well-being, for instance, Body-Mind-Spirit Well-Being Inventory [34] and Holistic Well-Being Scale [35], but do not cover well-being in terms of one’s relationship with the environment and something or someone beyond humanity.

The aims of the present study were to reconcile and extend different conceptual definitions of well-being among people in recovery of mental illness to cover transcendental aspect of well-being, and to develop a comprehensive well-being scale that grasps every intra- and trans-personal domain. The current paper also aimed to provide a practical and efficient tool for mental health organization to routinely measure comprehensive well-being, and to develop and evaluate services that aim to improve the well-being of people in recovery of mental illness. In addition, the scale would also provide mental health service users a brief scale for easier assessment of well-being for increasing awareness and for monitoring of one’s mental health.

In this research, Study 1 aimed at establishing a preliminary well-being scale. This preliminary scale would then be used to form our Comprehensive Well-being Scale using principal component analysis. Study 2 aimed at confirming the factor structure established in Study 1 using confirmatory factor analysis and examining the scale’s concurrent, convergent and discriminant validity.

Study 1

The aims of Study 1 were to explore the factor structure of the scale and to select items from a preliminary well-being scale through principal component analysis to form a comprehensive well-being scale.

Method

Development of a preliminary well-being scale

To develop a preliminary well-being scale, Furr’s guidelines on scale construction [36] were followed. The guideline suggested four steps in scale construction: (1) articulation of construct and context; (2) choosing a response format and assembling initial item pool; (3) collecting data from respondents; and (4) examination of psychometric properties and quality. While step one and two would be described in this section, step three would be described in the method section and step four would be described in the results section.

First, the construct of well-being was articulated through the review of existing well-being literature as described above. We aimed at developing a well-being scale that measures intrapersonal and transpersonal well-being. As for consideration of context of scale development, the development of the scale would consider that the target population is people in recovery of mental illness. In particular, the comprehensibility and length of the scale would be considered in the process of scale development and would be described in greater details in the parts below. Second, following step two of Furr’s guideline [36], a pool of 110 items were adopted with modification and reformulated into Chinese from existing measures that tap into the two domains of well-being. Intrapersonal well-being measures included Rosenberg Self-esteem Scale [37], Ryff Scales of Psychological Well-being [12, 51], State Hope Scale [38], Emotion Reactivity Scale [39], and Nonattachment Scale [40]; four new items were proposed by a professional panel to cover the aspect of physical health. Transpersonal well-being measures included Social Connectedness Scale [41], Active and Engaged Citizenship [42], and Humanitarianism-Egalitarianism Scale [43]; three new items were proposed by the professional panel to cover the aspect of common humanity. Other measures that tap into several domains of well-being were also included: Five Facet Mindfulness Questionnaire [44], Flourishing Scale [45], and Mindful Flourishing Scale (Mak & Chow, unpublished scale).

The pool of 110 items adopted was proposed for professional panel discussion. Panelists included two clinical psychologists, one post-doctoral fellow with background in social work and psychology and one psychological well-being officer experienced in mental health and personal recovery. The panel voted on the items basing on the extent to which they measure intrapersonal and transpersonal well-being. The voting determined whether the item was initially considered as measuring intrapersonal and transpersonal well-being. Next, items that appeared to have similar wordings were grouped together. For example, the item “When I look at the story of my life, I am pleased with how things have turned out” from the Ryff Scales of Psychological Well-being [14, 50] and the item “On the whole, I am satisfied with myself” from the Rosenberg Self-esteem Scale [37] were rephrased into a single item “I feel satisfied with my life.” After discussion, a 56-item preliminary scale was drafted.

As the scale was intended to be used to assess the well-being of people in recovery of mental illness, comments from people in recovery were sought on the comprehensibility of the preliminary well-being items and on suitable length of the scale in terms of how long they can sustain their attention when completing the items. Wordings were revised so that people in recovery who helped comment on the preliminary scale can easily understand. Also, as the scale would be used primarily by mental health organizations, likely together with other scales, the scale’s brevity was our main focus. Basing on people in recovery’s comment on suitable length and the expert panel’s experience in administration of scales to people in recovery, we aimed at creating a one-page brief scale with around 20 items.

Participants and procedures

Convenience sampling was used in the study. Participants were recruited from the largest non-governmental organization providing comprehensive community-based mental health services in Hong Kong. They are individuals with mental illness currently receiving mental health service. We made a list of all service users from each of the 30 service units in the organization, excluding those who had intellectual disability or dementia, did not understand Cantonese or Chinese, or refused to participate in the study. For each list, a number was randomly assigned to each eligible service user. They were then arranged in ascending order of the randomized numbers. The number of participants invited from each list was proportional to the number of service users from each unit, making the composition of the participants a representative sample of the distribution of all service users in different centers. As a rule of thumb, a sample size of 300 is considered good for factor analyses [46]. Therefore, a total of 300 service users (132 males and 168 females) were recruited in the present study, with a mean age of 49.25 (SD = 12.25, range = 19–77). Details on marital status, education level, and occupation could be found in Table 1.

Table 1 Demographics of participants in Study 1 and Study 2

Data collection was conducted in a group format with 3 to 6 service users. Informed consent forms were completed. Participants were then given a set of questionnaires for self-administration. A student helper was available in each data collection session to assist participants with filling in the questionnaires. All participants were given HKD50 (~ USD6) supermarket coupon as incentives. The study was approved by the Survey and Behavioural Research Ethics Committee, the Chinese University of Hong Kong.

Measures

The 56-item preliminary well-being scale was administered. Participants rated the items based on a 5-point Likert scale from 1 (strongly disagree) to 5 (strongly agree).

Analysis

To examine the factor structure of the preliminary well-being scale, principal component analysis was conducted on the correlation matrix of the 56 self-developed items. The Kaiser–Meyer–Olkin (KMO) test [47] and Bartlett’s [48] test of sphericity were used to measure the sampling adequacy for conducting exploratory factor analysis. A KMO index greater than 0.6 and a significant result from the Bartlett’s test of sphericity suggest suitability [49].

Results

KMO value was 0.93, while Bartlett’s test of sphericity was found significant, χ2 (1540) = 9535.40, p < 0.001, suggesting sufficient item dependency among these 56 items for conducting exploratory factor analysis.

In terms of factor extraction, we relied on the results from Cattell’s Scree Test as well as the interpretability of the factors. Overall speaking, a two-factor structure on the well-being was suggested, accounting for 39.7% of variance of the data. Based on the oblique rotation, a total of 34 items was loaded on the first factor with non-trivial factor loadings (i.e., λ > 0.40), while 17 items were loaded on the second factor (Table 2). Five items were dropped since they were weakly associated with both two factors. As a result, 51 items were included under a two-factor model. The first factor accounted for 33.7% of variance among items (eigenvalue = 18.87); the items loaded on this factor are about how an individual intrarelates with themselves and was labelled as “Intrapersonal Well-Being.” The second factor accounted for 6.0% of variance among items (eigenvalue = 3.37); the items loaded on the second factor are about how an individual relates with people and things beyond themselves and was labelled as “Transpersonal Well-Being.”

Table 2 Factor loadings of the items in Study 1

To develop a brief scale with equal number of items measuring both Intrapersonal Well-being and Transpersonal Well-being, we selected 10 items with the highest factor loadings from each factor. The factor loading also has to be greater than 0.4 to be considered acceptable [46].The factor loadings of 10 items from the factor of Intrapersonal Well-Being were all significant, ranging from 0.69 to 0.82, while the factor loadings of the 10 items from the factor of Transpersonal Well-Being were also significant, ranging from 0.49 to 0.71. The Cronbach’s alphas for Intrapersonal Well-Being and Transpersonal Well-Being were 0.93 and 0.83, respectively.

Study 2

The aim of Study 2 was to confirm the factor structure of the CWBS using confirmatory factor analysis and to establish the concurrent, convergent and discriminant validity of the scale with reference to other existing well-being scales.

Concurrent validity of the scale was examined by correlating CWBS to several other well-being scales that encompass different domains of well-being. Given that recovery is theoretically a result of good well-being e.g. [2, 4, 6], concurrent validity with an assessment of recovery was also examined. Both factors of Intrapersonal Well-Being and Transpersonal Well-Being were hypothesized to be positively and moderately associated with measures of well-being and recovery.

Construct validity of CWBS was examined using existing measures that tap into different domains of well-being. Given our operational definitions as discussed above, Intrapersonal Well-being was hypothesized to be negatively and moderately associated with physical symptoms, depressive symptoms, anxiety symptoms, and psychological distress; Transpersonal Well-being was hypothesized to be positively and moderately associated with compassionate love, social connectedness, universalism, and self-transcendence, and negatively and moderately associated with alienation. These measures were used as construct validity indicators because most of them had been validated among Chinese, and have strong theoretical relevance to their respective domain of well-being e.g. [4, 14, 26].

Method

Participants and procedures

Participant recruitment and data collection procedure were the same as Study 1. Another group of 300 service users (118 males and 182 females) were recruited through a similar process as in Study 1, with a mean age of 49.54 (SD = 12.46, range = 19–74). Participants of Study 1 were excluded in this study. Details on marital status, education level, and occupation could be found in Table 1.

Measures

The CWBS developed in Study 1 was used. It contains 20 items and measures two domains of well-being, namely Intrapersonal Well-Being and Transpersonal Well-Being. The following scales were used to examine validity of the CWBS.

Mental Health Continuum Short Form [4]. It is a 14-item scale measuring emotional, psychological and social well-being. It was translated into Chinese and independently back-translated into English for checking its accuracy.

Holistic Well-Being Scale [35]. The Holistic Well-being Scale contains 30-items and measures affliction (emotional vulnerability, bodily irritability and spiritual disorientation) and equanimity (non-attachment, mindful awareness, general vitality and spiritual self-care). The scale is in Chinese.

Ryff Scales of Psychological Well-being [14, 50]. It is an 18-item scale measuring six aspects of psychological well-being, including self-acceptance, positive relations with others, autonomy, environmental mastery, purpose in life and personal growth. The scale was translated into Chinese and independently back-translated into English for checking its accuracy.

Recovery Assessment Scale [51]. The Recovery Assessment Scale is a 24-item scale measuring recovery in terms of personal confidence and hope, willingness to ask for help, goal and success orientation, reliance on others, and no domination by symptoms. The validated Chinese version [52] was used in the present study.

Body-Mind-Spirit Well-Being Inventory [35]. Physical symptoms was measured by the 14-item Physical Distress sub-scale of the Body-Mind-Spirit Well-Being Inventory [35]. It measures the level of subjective physical distress caused by specific physical symptoms such as “headache,” “dizziness” and “palpitation.” The scale is in Chinese.

Patient Health Questionnaire-9 [53]. Depressive symptoms were measured by the 9-item Patient Health Questionnaire 9 scale [53] The Chinese version was validated [54, 55] and used in the present study.

Generalized Anxiety Disorder-7 [56]. Anxiety symptoms were measured by the Generalized Anxiety Disorder 7-item scale [56]. The Chinese version of the scale was validated [57] and used in the present study.

Kessler Psychological Distress Scale (K6) [58]. It is a 6-item scale that measures psychological distress. The Cantonese-Chinese version of the scale was translated and validated by Lee and colleagues [59] and used in the present study.

Santa Clara Brief Compassion Scale [60]. It is a 5-item scale that measures compassionate love. It was developed from Sprecher and Fehr’s Compassionate Love Scale [61]. The scale was translated into Chinese and independently back-translated into English for checking its accuracy.

Social Connectedness Scale [41]. It is a 8-item scale measuring social connectedness. All items were reverse-coded, so that a higher score indicates a higher level of social connectedness. The scale was translated into Chinese and independently back-translated into English for checking its accuracy.

Portrait Values Questionnaire 5X Value Survey [62]. Universalism was measured by the universalism-concern and universalism-tolerance subscales of the Portrait Values Questionnaire 5X Value Survey [62]. They measure the concern and tolerance for the welfare of all people and nature. The pronoun was changed from “he/him” to “I/me.” A total score for universalism was calculated by summing up scores from the two subscales. The scale was translated into Chinese and independently back-translated into English for checking its accuracy.

Adult Self-Transcendence Inventory [63]. It is an 18-item scale that measures self-transcendence and alienation. The inventory consisted of two subscales, namely self-transcendence and alienation. Self-transcendence reflects a decreasing reliance on externals for definition of the self, increasing interiority and spirituality, and a greater sense of connectedness with past and future generations. Alienation measures the negative affect as a result of social isolation [63]. The scale was translated into Chinese and independently back-translated into English for checking its accuracy.

Analysis

Confirmatory factor analysis (CFA) was conducted to examine internal consistency and factorial validity of the CWBS. According to the criterion by Nunnally [64], a Cronbach’s alpha higher than 0.70 is considered good internal consistency. Assessment of model fit was based on multiple criteria, including absolute misfit and incremental fit indices. A CFA model with Root-Mean-Square Errors of Approximation (RMSEA) [65] < 0.08, Standardized Root Mean Squared Residual (SRMR) [66] < 0.08 and Comparative Fit Index (CFI) [67] > 0.90 would be regarded as yielding acceptable fit to the data [68]. In addition, Cohen’s [69] guideline was used to determine the strengths of correlation coefficients, with r around 0.1 indicating small effect sizes, r around 0.3 indicating medium effect sizes, and r > 0.5 indicating large effect sizes.

Concurrent, convergent and discriminant validity are examined by correlating Intrapersonal Well-Being and Transpersonal Well-being factors of the CWBS to different measures of physical, psychological and spiritual well-being.

Results

Internal consistency

The Cronbach’s alphas of Intrapersonal Well-Being and Transpersonal Well-Being were 0.91 and 0.79, respectively. Taken as a whole, these findings suggested good internal consistency.

Factorial validity

Based on the 20 items with the highest factor loadings found in a two factor-structure in Study 1, we attempted to cross-validate the factor structure of the CWBS using CFA.

Overall speaking, a two-factor CFA model yielded acceptable fit to the data, χ2 (169) = 335.61, p < 0.001, CFI = 0.90, RMSEA = 0.06, SRMR = 0.06, confirming the factorial validity of the well-being. In the CFA model (Fig. 1), items had moderate to high factor loadings in both factors. For Intrapersonal Well-Being, factors loadings were all significant and ranged from 0.60 to 0.82, with an average of 0.71. For Transpersonal Well-Being, all factors loadings were also significant and ranged from 0.34 to 0.71, with an average of 0.52. In the CFA model, the two latent factors were significantly and positively correlated, r = 0.76, p < 0.001.

Fig. 1
figure 1

The two-factor confirmatory factor analysis model in Study 2

Concurrent validity

Concurrent validity of the CWBS was conducted by investigating the correlations between its two factors and well-being and recovery. As shown in Table 3, both factors showed positive and large correlations with emotional, psychological and social well-being, holistic well-being, psychological well-being, as well as recovery.

Table 3 Correlations of the two factors of the CWBS with different measures

Convergent validity

Convergent validity of the CWBS was conducted by investigating the correlations between its two factors and different measures that tap into different domains of well-being. As shown in Table 3, Intrapersonal Well-being was negatively and strongly associated with depressive symptoms, anxiety symptoms, and psychological distress, and was negatively and moderately associated with physical symptoms. Transpersonal Well-being was positively and strongly associated with self-transcendence, and positively and moderately associated with compassionate love, social connectedness, and universalism. It was negatively and moderately associated with alienation as well.

Discriminant validity

To further examine discriminant validity of the CWBS, regression analyses were conducted, with both of its factors predicting different measures. As shown in Table 4, after controlling for the other factor, only Intrapersonal Well-being but not Transpersonal Well-being predicted physical symptoms, depressive symptoms, anxiety symptoms, and psychological distress. On the other hand, after controlling for the other factor, only Transpersonal Well-Being but not Intrapersonal Well-being predicted compassionate love, social connectedness, and universalism. Nevertheless, after controlling for the other factor, both factors still predicted self-transcendence and alienation.

Table 4 Standardized coefficients of regression analyses with the two factors of the CWBS predicting different measures

Discussions

Summary of findings

Study 1 aimed at exploring the factor structure of the CWBS and item selection. Study 2 aimed at examining the reliability and validity of the CWBS constructed from Study 1 among a sample of people in recovery in Hong Kong. The CWBS was shown to have sound psychometric properties in measuring well-being.

The two factors of the CWBS yielded satisfactory internal consistency, suggesting that it is a scale with homogeneous items measuring the same underlying construct. A two-factor model was found and confirmed in the CWBS. The two factors—Intrapersonal Well-Being and Transpersonal Well-Being—not only encompass the physical, mental, and social domains of the WHO’s [7] definition of mental health, but also extend to one’s connection with things beyond the self and humanity.

To examine the concurrent validity of the CWBS, we compared it with other existing scales measuring well-being and recovery. Concurrent validity is evident with Ryff’s [14] psychological well-being, Chan and colleagues’ [34] holistic well-being, as well as Keyes’s [4] emotional, psychological and social well-being. In addition to well-being, concurrent validity of the CWBS with recovery was demonstrated. The measuring of well-being not only informs the general population, but also sheds light on people in recovery. This is in line with Keyes’s [4] complete state model of mental health, introducing mental health, in addition to the absence of mental illness, as another distinct domain of recovery.

Construct validity of the CWBS was demonstrated by its convergent and discriminant validity. As hypothesized, Intrapersonal Well-Being was found to be associated with measures that tap into its corresponding constructs, i.e., physical symptoms, depressive symptoms, anxiety symptoms, and psychological distress. Transpersonal Well-Being was also found to be associated with measures that tap into its corresponding constructs, i.e., compassionate love, social connectedness, universalism, self-transcendence, and alienation. After controlling for the other factor, the two factors further demonstrated their discriminant validity, confirming the disassociations with unrelated constructs. The only exception is that after controlling for the other factor, both factors are still associated with self-transcendence and alienation. A possible explanation is that the Adult Self-Transcendence Inventory [63], in addition to measuring self-transcendence and alienation, takes also into account the positive and negative affects resulting from them. In fact, self-transcendence was found to be correlated with emotional well-being [70]. Besides, its strong emphasis on the self might deviate from our definition of Transpersonal Well-Being, which emphasizes more on the connectedness with society, environment, and the world at large.

Implications

The CWBS has a number of implications. Theoretically, it reconciles the overlaps between different conceptual definitions of well-being within the current literature framework, including Ryff’s [14] psychological well-being, Keyes’s [9] social well-being, and Fisher’s [26] spiritual well-being, and extends the concept to encompass transcendental well-being among individuals in recovery of mental illness. The extension is important in suggesting that current recovery model may need to include aspects of transpersonal well-being in order to have a more comprehensive conceptual and service model. Practically, it provides a comprehensive and easily administrable tool for measuring well-being. It is purported to be used by mental health practitioners and organizations who wish to incorporate a comprehensive measurement of well-being in their service, to develop services that aim to improve the well-being of people in recovery of mental illness, as well as to evaluate such services’ effectiveness. It can also be used by people in recovery of mental illness to monitor their well-being. Upon further validation studies, it can potentially be used by individuals in the general public as a check-up of their well-being status.

Limitations

Despite solid empirical evidence for the reliability and validity of the CWBS, the present study is not without its limitations. First, it is difficult to strike a balance between a broad and a brief scale, so that it could encompass the multidimensionality of well-being, and at the same time be more manageable to be used as a regular assessment for each service user in mental health organizations. Future studies could refine or even expand the items to explore the possibility of more domains. Second, our sample limits the generalizability of the findings to the general population of Hong Kong. Although the present sample involved service users from several service centers across different regions in Hong Kong, it mainly applies to people in recovery recruited from a single mental health organization. Future validation studies could consider using a more heterogeneous sample, both within and outside the mental health service sector. Third, despite efforts in establishing concurrent and construct validity of the CWBS with other scales that tap into different domains of well-being, some of the scales were translated but yet to be validated in a Chinese population. The validation results should be interpreted with caution. Much research is needed to establish psychometrically sound measures of well-being in general Chinese community. The CWBS may be tested in the general Chinese community in future study and compare the results from general public with current results obtained among people in recovery.

Conclusions

The present study is the first to expand the measure of well-being from intrapersonal and interpersonal to transpersonal among individuals in recovery of mental illness. Study 1 developed a 20-item CWBS, measuring Intrapersonal Well-Being and Transpersonal Well-Being. Study 2 provided evidence for the CWBS’s reliability, factorial validity, concurrent validity, convergent validity, and discriminant validity among Chinese in recovery of mental illness in Hong Kong. The CWBS paves the way for researchers to understand different domains of well-being, for mental health service providers to administer a broad yet brief well-being scale, for mental health service users to assess their well-being along their recovery journey, and for the public to easily assess their well-being for human flourishing.

Availability of data and materials

The datasets generated during the current study are available in the OSF repository, https://osf.io/2hqky/?view_only=196685702d3a412e8c320779224e865e

Abbreviations

CFA:

Confirmatory factor analysis

CFI:

Comparative fit index

CWBS:

Comprehensive Well-Being Scale

KMO:

Kaiser–Meyer–Olkin

NICA:

National Interfaith Coalition on Aging

RMSEA:

Root-mean-square errors of approximation

SAMHSA:

Substance Abuse and Mental Health Services Administration

SRMR:

Standardized root mean squared residual

WHO:

World Health Organization

References

  1. Anthony WA. Recovery from mental illness: the guiding vision of the mental health service system in the 1990s. Psychiatr Rehabil J. 1993;16(4):11–23. https://doi.org/10.1037/h0095655.

    Article  Google Scholar 

  2. Substance Abuse and Mental Health Services Administration. SAMHSA’s Working Definition of Recovery, 2012. Retrieved from [https://store.samhsa.gov/sites/default/files/d7/priv/pep12-recdef.pdf]. Accessed on 18th Oct 2021.

  3. Jacobson N, Greenley D. What is recovery? A conceptual model and explication. Psychiatr Serv. 2001;52(4):482–5. https://doi.org/10.1176/appi.ps.52.4.482.

    Article  PubMed  Google Scholar 

  4. Keyes CLM. Mental illness and/or mental health? Investigating axioms of the complete state model of health. J Consult Clin Psychol. 2005;73(3):539–48. https://doi.org/10.1037/0022-006X.73.3.539.

    Article  PubMed  Google Scholar 

  5. Chan RC, Mak WW, Chio FH, Tong AC. Flourishing with psychosis: a prospective examination on the interactions between clinical, functional, and personal recovery processes on well-being among individuals with schizophrenia spectrum disorders. Schizophr Bull. 2018;44(4):778–86. https://doi.org/10.1093/schbul/sbx120.

    Article  PubMed  Google Scholar 

  6. Provencher HL, Keyes CLM. Complete mental health recovery: Bridging mental illness with positive mental health. J Public Ment Health. 2011;10(1):57–69. https://doi.org/10.1108/17465721111134556.

    Article  Google Scholar 

  7. World Health Organization. Basic documents. Geneva: World Health Organization; 1948.

    Google Scholar 

  8. World Health Organization. Strengthening mental health promotion. Geneva: World Health Organization; 2001.

    Google Scholar 

  9. Keyes CLM. Social well-being. Soc Psychol Q. 1998;61(2):121–140. https://doi.org/10.2307/2787065

  10. Keyes CLM, Shmotkin D, Ryff CD. Optimizing well-being: the empirical encounter of two traditions. J Pers Soc Psychol. 2002;82(6):1007–22. https://doi.org/10.1037/0022-3514.82.6.1007.

    Article  PubMed  Google Scholar 

  11. Ryan RM, Deci EL. On happiness and human potentials: a review of research on hedonic and eudaimonic well-being. Annu Rev Psychol. 2001;52:141–66. https://doi.org/10.1146/annurev.psych.52.1.141.

    Article  PubMed  Google Scholar 

  12. Waterman AS. Two conceptions of happiness: contrasts of personal expressiveness (eudaimonia) and hedonic enjoyment. J Pers Soc Psychol. 1993;64(4):678–91. https://doi.org/10.1037/0022-3514.64.4.678.

    Article  Google Scholar 

  13. Diener E, Suh EM, Lucas R, Smith HL. Subjective well-being: three decades of progress. Psychol Bull. 1999;125(2):276–302. https://doi.org/10.1037/0033-2909.125.2.276.

    Article  Google Scholar 

  14. Ryff CD. Happiness is everything, or is it? Explorations on the meaning of psychological well-being. J Pers Soc Psychol. 1989;57(6):1069–81. https://doi.org/10.1037/0022-3514.57.6.1069.

    Article  Google Scholar 

  15. Ryan RM, Deci EL. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am Psychol. 2000;55:68–78. https://doi.org/10.1037/0003-066X.55.1.68.

    Article  PubMed  Google Scholar 

  16. Seligman MEP. Flourish: a visionary new understanding of happiness and well-being. New York: Free Press; 2011.

    Google Scholar 

  17. Ryff CD. Eudaimonic well-being, inequality, and health: Recent findings and future directions. Int Rev Econ. 2017;64(2):159–78. https://doi.org/10.1007/s12232-017-0277-4.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Chirico F. Spiritual well-being in the 21st century: It’s time to review the current WHO’s health definition? J Health Soc Sci. 2016;1(1):11–6.

    Google Scholar 

  19. Dhar N, Chaturvedi SK, Nandan D. Spiritual Health Scale 2011: Defining and measuring 4th dimension of health. Indian J Commun Med. 2011;36(4):275–82. https://doi.org/10.4103/0970-0218.91329.

    Article  Google Scholar 

  20. Larson JS. The World Health Organization’s definition of health: Social versus spiritual health. Soc Indic Res. 1996;38(2):181–92. https://doi.org/10.1007/BF00300458.

    Article  Google Scholar 

  21. Tsuang MT, Simpson JC, Koenen KC, Kremen WS, Lyons MJ. Spiritual well-being and health. J Nervous Mental Dis. 2007;195(8):673–80. https://doi.org/10.1097/NMD.0b013e31811f4062.

    Article  Google Scholar 

  22. Green JB. Body, soul, and human life: the nature of humanity in the Bible. Milton Keynes, UK: Paternoster Press; 2008. https://doi.org/10.1111/j.1468-2400.2009.00485.x

  23. Ho DYF. Selfhood and identity in Confucianism, Taoism, Buddhism and Hinduism: contrasts with the West. J Theory Soc Behav. 1995;25(2):115–39. https://doi.org/10.1111/j.1468-5914.1995.tb00269.x.

    Article  Google Scholar 

  24. Vader JP. Spiritual health: the next frontier. Eur J Pub Health. 2006;16(5):457. https://doi.org/10.1093/eurpub/ckl234.

    Article  Google Scholar 

  25. National Interfaith Coalition on Aging. Spiritual well-being: a definition. Athens, GA: Author; 1975.

  26. Fisher JW. Spiritual health: Its nature and place in the school curriculum. PhD thesis, Department of Science and Mathematics Education, University of Melbourne; 1999. Retrieved from http://hdl.handle.net/11343/39206

  27. Mental Health Foundation. Taken Seriously: The Somerset Spirituality Project. Mental Health Foundation, 2002 https://www.mentalhealth.org.uk/sites/default/files/taken-seriously.pdf. Accessed on 4th Oct 2021.

  28. Unterrainer HF, Lewis AJ, Fink A. Religious/ spiritual well-being, personality and mental health: a review of results and conceptual issues. J Relig Health. 2014;53(2):382–92. https://doi.org/10.1007/s10943-012-9642-5.

    Article  PubMed  Google Scholar 

  29. Mental Health Foundation. The Impact of Spirituality on Mental Health. Mental Health Foundation, 2006 https://www.mentalhealth.org.uk/sites/default/files/impact-spirituality.pdf. Accessed on 4th Oct 2021.

  30. Linton M-J, Dieppe P, Medina-Lara A. Review of 99 self-report measures for assessing well-being in adults: exploring dimensions of well-being and developments over time. BMJ Open. 2016;6(7):e010641. https://doi.org/10.1136/bmjopen-2015-010641.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Giffort D, Schmook A, Woody C, Vollendorf C, Gervain M. The Recovery Assessment Scale. In Ralph RO, Kidder KA, The Recovery Advisory Group. Can we measure recovery? A compendium of recovery and recovery-related instruments. Cambridge, MA: Human Services Research Institute; 2000:7–8.

  32. Oliveira-Maia AJ, Mendonça C, Pessoa MJ, Camacho M, Gago J. The mental health recovery measure can be used to assess aspects of both customer-based and service-based recovery in the context of severe mental illness. Front Psychol. 2016 Nov;3(7):1679. https://doi.org/10.3389/fpsyg.2016.01679.

    Article  Google Scholar 

  33. O'Connell M, Tondora J, Croog G, Evans A, Davidson L. From rhetoric to routine: assessing perceptions of recovery-oriented practices in a state mental health and addiction system. Psychiatr Rehabil J. 2005 Spring;28(4):378–86. doi: https://doi.org/10.2975/28.2005.378.386.

  34. Ng SM, Yau JKY, Chan CLW, Chan CHY, Ho DYF. The measurement of Body-Mind-Spirit well-being: toward multidimensionality and transcultural applicability. Soc Work Health Care. 2005;41(1):33–52. https://doi.org/10.1300/J010v41n01_03.

    Article  PubMed  Google Scholar 

  35. Chan CHY, Chan THY, Leung PPY., Brenner MJ, Wong VPY, Leung EKT et al. Rethinking well-being in terms of affliction and equanimity: Development of Holistic Well-being Scale. J Ethn Cult Divers Soc Work. 2014;23(3–4):289–308. http://dx.doi.org/https://doi.org/10.1080/15313204.2014.932550

  36. Furr R. Scale construction and psychometrics for social and personality psychology. London: SAGE Publications Ltd; 2011. doi:https://doi.org/10.4135/9781446287866

  37. Rosenberg M. Society and the adolescent self-image. Princeton, NJ: Princeton University Press; 1965. https://doi.org/10.1515/9781400876136

  38. Snyder CR, Sympson SC, Ybasco FC, Borders TF, Babyak MA, Higgins RL. Development and validation of the State Hope Scale. J Pers Soc Psychol. 1996;70(2):321–5. https://doi.org/10.1037//0022-3514.70.2.321.

    Article  PubMed  Google Scholar 

  39. Nock MK, Wedig MM, Holmberg EB, Hooley JM.. The Emotion Reactivity Scale: Development, evaluation, and relation to self-injurious thoughts and behaviors. Behavior Therapy. 2008; 2006:39(2);107–116. https://doi.org/10.1016/j.beth.2007.05.005

  40. Sahdra BK, Shaver PR, Brown KW. A scale to measure nonattachment: a Buddhist complement to Western research on attachment and adaptive functioning. J Pers Assess. 2010;92(2):116–27. https://doi.org/10.1080/00223890903425960.

    Article  PubMed  Google Scholar 

  41. Lee RM, Robbins SB. Measuring belongingness: the social connectedness and the social assurance scales. J Couns Psychol. 1995;42(2):232–41. https://doi.org/10.1037/0022-0167.42.2.232.

    Article  Google Scholar 

  42. Bobek DL, Zaff JF, Li Y, Lerner RM. Cognitive, emotional, and behavioral components of civic action: towards an integrated measure of civic engagement. J Appl Dev Psychol. 2009;30(5):615–27. https://doi.org/10.1016/j.appdev.2009.07.005.

    Article  Google Scholar 

  43. Katz I, Hass RG. Racial ambivalence and American value conflict: correlational and priming studies of dual cognitive structures. J Pers Soc Psychol. 1988;55(6):893–905. https://doi.org/10.1037/0022-3514.55.6.893.

    Article  Google Scholar 

  44. Baer RA, Smith GT, Hopkins J, Krietemeyer J, Toney L. Using self-report assessment methods to explore facets of mindfulness. Assessment. 2006;13(1):27–45. https://doi.org/10.1177/1073191105283504.

    Article  PubMed  Google Scholar 

  45. Diener E, Wirtz D, Tov W, Kim-Prieto C, Choi D, Oishi S, et al. New measures of well-being: flourishing and positive and negative feelings. Soc Indic Res. 2009;39:247–66. https://doi.org/10.1037/0022-3514.54.6.1063.

    Article  Google Scholar 

  46. Comrey A, Lee H. A first course in factor analysis. Hillsdale, NJ: Erlbaum; 1992. https://doi.org/10.4324/9781315827506

  47. Kaiser HF. A second generation little jiffy. Psychometrika. 1970;35(4):401–15.

    Article  Google Scholar 

  48. Bartlett MS. Test of significance in factor analysis. Br J Psychol. 1950;3:77–85. https://doi.org/10.1111/j.2044-8317.1950.tb00285.x.

    Article  Google Scholar 

  49. Hair JF, Black WC, Babin BJ. Multivariate data analysis: a global perspective. Upper Saddle River, NJ: Pearson Education; 2010. https://doi.org/10.4236/jep.2011.27103

  50. Ryff CD, Keyes CLM. The structure of psychological well-being revisited. J Pers Soc Psychol. 1995;69(4):719–27. https://doi.org/10.1037/0022-3514.69.4.719.

    Article  PubMed  Google Scholar 

  51. Corrigan PW, Salzer M, Ralph RO, Sangster Y, Keck L. Examining the factor structure of the Recovery Assessment Scale. Schizophr Bull. 2004;30(4):1035–41. https://doi.org/10.1093/oxfordjournals.schbul.a007118.

    Article  PubMed  Google Scholar 

  52. Mak WSS, Chan RCH, Yau SSW. Validation of the Recovery Assessment Scale for Chinese in recovery of mental illness in Hong Kong. Qual Life Res. 2016;25(5):1303–11. https://doi.org/10.1007/s11136-015-1157-6.

    Article  PubMed  Google Scholar 

  53. Kroenke K, Spitzer R, Williams W. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16(9):606–16. https://doi.org/10.1046/j.1525-1497.2001.016009606.x.

    Article  PubMed  PubMed Central  Google Scholar 

  54. Cheng C, Cheng M. To validate the Chinese version of the 2Q and PHQ-9 questionnaires in Hong Kong Chinese patients. HK Pract. 2007;29(10):381–90. https://doi.org/10.1016/j.jad.2013.07.014.

    Article  Google Scholar 

  55. Yu X, Tam WW, Wong PT, Lam TH, Stewart SM. The Patient Health Questionnaire-9 for measuring depressive symptoms among the general population in Hong Kong. Compr Psychiatry. 2012;53(1):95–102. https://doi.org/10.1016/j.comppsych.2010.11.002.

    Article  PubMed  Google Scholar 

  56. Spitzer RL, Kroenke K, Williams JBW, Lowe B. A brief measure for assessing generalized anxiety disorder. Arch Internal Med. 2006;166(10):1092–7. https://doi.org/10.1001/archinte.166.10.1092.

    Article  Google Scholar 

  57. He XY, Li CB, Qian J, Cui HS, Wu WY. Reliability and validity of a generalized anxiety disorder scale in general hospital outpatients. Shanghai Arch Psychiatry. 2010;22(4):200–3. https://doi.org/10.3969/j.issn.1002-0829.2010.04.002.

    Article  Google Scholar 

  58. Kessler RC, Barker PR, Colpe LJ, Epstein JF, Gfroerer JC, Hiripi E, et al. Screening for serious mental illness in the general population. Arch Gen Psychiatry. 2003;60(2):184–9. https://doi.org/10.1001/archpsyc.60.2.184.

    Article  PubMed  Google Scholar 

  59. Lee S, Tsang A, Ng KL, Ma YL, Guo W, Mak A, et al. Performance of the 6-item Kessler scale for measuring serious mental illness in Hong Kong. Compr Psychiatry. 2012;53(5):584–92. https://doi.org/10.1016/j.comppsych.2011.10.001.

    Article  PubMed  Google Scholar 

  60. Hwang JY, Plante TG, Lackey K. The development of the Santa Clara Brief Compassion Scale: an abbreviation of Sprecher and Fehr’s Compassionate Love Scale. Pastor Psychol. 2008;56(4):421–8. https://doi.org/10.1007/s11089-008-0117-2.

    Article  Google Scholar 

  61. Sprecher S, Fehr B. Compassionate love for close others and humanity. J Soc Pers Relat. 2005;22(5):629–51. https://doi.org/10.1177/0265407505056439.

    Article  Google Scholar 

  62. Schwartz SH, Cieciuch J, Vecchione M, Davidov E, Fischer R, Beierlein C, et al. Refining the theory of basic individual values. J Pers Soc Psychol. 2012;103(4):663–88. https://doi.org/10.1037/t07641-000.

    Article  PubMed  Google Scholar 

  63. Levenson MR, Jennings PA, Aldwin CM, Shiraishi RW. Self-transcendence: conceptualization and measurement. Int J Aging Hum Dev. 2005;60(2):127–43. https://doi.org/10.2190/XRXM-FYRA-7U0X-GRC0.

    Article  PubMed  Google Scholar 

  64. Nunnally JC. Psychometric theory. 2nd ed. New York, NY: McGraw-Hill; 1978.

    Google Scholar 

  65. Steiger JH, Lind JC. Statistically based tests for the number of common factors. Paper presented at the Annual Meeting of the Psychometric Society, Iowa City, IA; 1980.

  66. Hu L-t, Bentler PM. Fit indices in covariance structure modeling: sensitivity to underparameterized model misspecification. Psychol Methods. 1998;3(4):424–53. https://doi.org/10.1037/1082-989X.3.4.424

  67. Bentler PM. Comparative fit indexes in structural models. Psychol Bull. 1990 Mar;107(2):238–46. https://doi.org/10.1037/0033-2909.107.2.238.

    Article  PubMed  Google Scholar 

  68. Hoyle R. The structural equation modeling approach: basic concepts and fundamental issues. In Hoyle RH (Ed.), Structural Equation modeling: Concepts, issues, and applications (pp. 1–15). Thousand Oaks CA: Sage; 1995.

  69. Cohen J. A power primer. Psychol Bull. 1992;112(1):155–9. https://doi.org/10.1037/0033-2909.112.1.155.

    Article  PubMed  Google Scholar 

  70. Coward DD. Self-transcendence and correlates in a healthy population. Nurs Res. 1996;45(2):116–21. https://doi.org/10.1097/00006199-199603000-00011.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

We thank Dr. Jacky Ng for the data analysis and Ms. Natalie Leung for helping with the scale development and data collection.

Funding

No funding was received for conducting this study.

Author information

Authors and Affiliations

Authors

Contributions

GTYY and WWSM contributed to the study conception, design, and material preparation. The first draft of the manuscript was written by WWLS and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Gladys T. Y. Yeung.

Ethics declarations

Ethics approval and consent to participate

The study was approved by the Survey and Behavioural Research Ethics Committee, the Chinese University of Hong Kong. Informed consent has been obtained from all participants involved in this research. All methods were performed in accordance with the relevant guidelines and regulations.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sham, W.W.L., Yeung, G.T.Y., Mak, W.W.S. et al. Comprehensive well-being scale: development and validation among Chinese in recovery of mental illness in Hong Kong. BMC Psychol 9, 179 (2021). https://doi.org/10.1186/s40359-021-00686-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s40359-021-00686-4

Keywords