Validation of the factor structure and psychometric characteristics of the Arabic adaptation of the sense of coherence SOC-13 scale: a confirmatory factor analysis
BMC Psychology volume 10, Article number: 115 (2022)
The sense of coherence is as focused on one’s awareness of the level of pervasive, enduring, and dynamic feelings. Stronger sense of coherence leads to better physical and mental health and promotes recovery from life stressors. Sense of coherence-13 (SOC-13) is a 13-item valid and reliable measure for individual’s healthy living. However, the factor structure of SOC-13 was criticized in several cultures and languages. The current study was set to explore the factor structure of an Arabic adaptation for SOC-13.
This cross-sectional study of the SOC-13 included (n = 1235) Arabic speaking individuals. We used confirmatory factor analysis to contrast unidimensional, bidimensional, three-dimensional, and four-dimensional factor structure for the SOC-13. We carried out measurement invariance analysis across age and gender groups to examine the stability of fit indices among participants’ subgroups.
We found the reliability coefficient to be 0.82, indicative of good internal consistency. The three-factor structure, after modification of items 1, 2, and 3 was the best-fitting factor model. However, measurement invariance was indicative of discrepancy for the three-factor model between genders and age classes. The mean overall SOC-13 total score in our sample was 52.1 (SD = 16.1).
The SOC-13 showed acceptable psychometric properties in terms of internal consistency and a modified three-factor structure in its Arabic version. However, the reliability of the three underlying dimensions was sub-optimum. Moreover, the three-factor structure requires modification by either removing the first three problematic items or allowing the residuals to correlate.
Sense of coherence SOC was initially described by Aaron Antonovsky in the late 1970s , to evolve substantially afterwards over the subsequent 4 decades. The sense of coherence was viewed first as an “individual property” . However, a decade later, the concept was widened to include the nuclear family of the individual . It was further expanded by  to focus on one’s awareness of the level of pervasive, enduring, and dynamic feelings.
Furthermore, the twenty-first century research extended sense of coherence to cover wider organizations in which the individual and family would interact, affect, and affect by, for instance their workplace organization . Stronger sense of coherence meant better physical and mental health and more use of mature defence mechanisms . Strong sense of coherence has a role in mediating recovery from substantial stressors such as poly-victimization .
The principal theoretical framework that underpins the measurement power of SOC scale is the so-called Generalized Resistance Resource (GRR). GRR is a term proposed by Antonovsky  , well prior to the development of the Sense of Coherence model. GRR constitutes the adaptive coping abilities of the individual and society and, hence, it potentiates the development of a sense of coherence. GRRs facilitate person’s ability to rebound. The twelve GRR factors, upon which the SOC-29 and the SOC-13 were designed comprise a range of cultural, societal, philosophical and biopsychological resources individuals could use .
Based on his broad definition of the sense of coherence, Antonovsky   proposed a 29-item scale for its measurement. He called it the Orientation to Life Questionnaire with the subscale of comprehensibility, the cognitive dimension, to be measured collectively by 11 items. Comprehensibility was defined by Eriksson   as “the extent to which one perceives internal and external stimuli as rationally understandable, and as information that is orderly, coherent, clear, structured rather than noise—that is, chaotic, disordered, random, unexpected, and unexplained”. The context of oneself and the role one plays in that context would be far more understandable should one have mastered the faculty of building a structure out of chaos. Clearly, the ability to manage stresses is substantially improved once one makes sense of them. Therefore, comprehensibility was regarded by researchers as a prerequisite for adaptive coping .
The subdimension of manageability, the behavioural dimension, must be measured collectively by 10 items. Manageability can be defined as “the degree to which one feels that there are resources at one’s disposal that can be used to meet the requirements of the stimuli one is facing” . Such resources are divided into two categories: formal (such as public services and charitable entities) and informal (family and friends, for instance).
The remaining 8 items were set to measure the meaningfulness sub-score, which constitutes the motivational dimension. Meaningfulness is composed of motivation, commitment, dedication, will for energy spending, and the emotional meaning of being able to solve every-day problems. Meaningfulness views daily problems as “challenges” rather than “burdens” .
SOC-13 is a 13-item self-report measure developed by [Antonovsky., 1993]  from the longer SOC-29 scale to briefly assess the extent of emotional control. The SOC-13, given its strong psychometric properties, was used extensively in several settings . All items are answered on a 7-point Likert scale over a semantic differential scale with two extreme anchoring phrases. Five items (namely, items 1, 2, 3, 7, and 10) are reversed in scoring. The total score would, hence, range between 13 and 91. Low scores indicate low/weak sense of coherence, and high scores mean high/strong sense of coherence. There are 5 comprehensibility, 4 manageability, and 4 meaningfulness items, however, the scale gives a single score of sense of coherence. Example items for comprehensibility include, “Do you have the feeling that you are in an unfamiliar situation and don’t know what to do?’’ and “Does it happen that you have feelings inside you would rather not feel?”. Items identifying manageability include, “Do you have the feeling that you are being treated unfairly?” and “Has it happened that people whom you counted on disappointed you?”. Meaningful items include, “Do you have the feeling that you don’t really care about what goes on around you?” and “How often do you have the feeling that there’s little meaning in the things you do in your daily life?”. To clarify further, the comprehensibility (consists of items: 2, 6, 8, 9, and 11), manageability (consists of items: 3, 5, 10, and 13), and meaningfulness (consists of items: 1, 4, 7, and 12).
The concept of sense of coherence was examined in several contexts. A recent study, for instance, examined the association between the sense of coherence and maternal attachment to their babies . Sense of coherence was associated positively with both maternal attachment to the newly born offspring and the acceptance of maternal role.
Many studies attempted to examine the psychometric properties of the SOC-13 in its various formats. The SOC-13 was first proposed by Antonovsky  . The SOC-13 questionnaire was tested and validated in several languages. The factor structure was shown to be consistent . Recently, an orphan study  attempted to explore the validity of an Arabic version of SOC-13 among children in the UAE. They found the Cronbach’s alpha to be good at 0.75. No attempt was made to examine the factor structure in depth. This is what we intend to do in the current investigation. In-depth factor structure analysis in adults living in Saudi Arabia.
Only a dearth of studies explored the psychometric properties of the SOC-13 (or its SOC-29 parent) or even used it in the Arabic language. On the other hand, several global studies examined multicultural adaptations of the SOC-13. The remaining question is whether the thirteen items that constitute the SOC-13 scale should be regarded as a collective single dimension as envisioned by the originator of the scale [Antonovsky 1987]  and suggested by the findings of a chain of studies , or to approve of the three-dimensional structure supported by many other studies on the same SOC-13 scale .
Al-Yateem et al.   realized how the wellbeing of Arabic-speaking adolescents would be improved substantially if their sense of coherence was supported to grow. In their study, they set to evaluate the reliability and validity estimates of the Arabic adaptation of the SOC scale. They also wanted to contribute normative values for the SOC scale in the Arabic speaking United Arabic Emirates UAE population. Encouragingly, they established a very good internal consistency estimate for the SOC questionnaire, with a Cronbach's alpha of 0.75. They set the normative SOC average at 57.4, pioneering the SOC research among Arabic communities.
Lerdal et al.   surveyed (n = 428) irritable bowel syndrome patients using the Norwegian version of the SOC-13. They adopted a Rasch analysis to examine a range of psychometric properties that included internal validity, functioning, differential item functioning, person-response validity, and person-separation reliability. They found that the SOC-13 functions with good and related to the collapsing categories at the low end of the seven-item Likert style of the scale. They found that two items did not constitute a good fit in the total SOC-13, namely, item 1: “Do you have the feeling that you don’t really care about what goes on around you” and item 5: “Do you have the feeling that you are being treated unfairly?”. Removal of both substantially improved the overall fit. SOC-13, in their sample, did not satisfy characteristics of person-response validity or one-dimensionality.
A recent Slovenian study  attempted to evaluate the psychometric properties of SOC-13. The investigation included (n = 134) Multiple Sclerosis patients. With a Cronbach’s alpha of 0.83, they found the SOC-13 to be of good overall internal consistency. However, the reliability was not so good for the three subscores, therefore the authors encouraged the use of the overall summary score for the SOC-13 rather than summary statistics for the less reliable subscores. Manageability dimension had a Cronbach’s alpha of 0.66, improved to 0.69 for the meaningfulness dimension, and to 0.79 for the comprehensibility dimension. The three-factor structure provided an acceptable fit to the data, as the RMSEA was 0.059. The three factors intercorrelated substantially. However, the confirmation of three-factor structure required the authors to correlate the residuals of two-item pairs. They allowed the residuals of (Item 2: “Has it happened in the past that you were surprised by the behaviour of people whom you thought you knew well?” and Item3: “Has it happened that people whom you counted on disappointed you?”) to correlate, as they addressed participants’ expectations regarding the people around them. They also allowed residual correlations of (item 4: “Until now your life has had clear goals and purposes” and item 13: “How often do you have feelings that you’re not sure you can keep under control?”) as they were both concerned with the management of life situations in terms of clarity of goals and control of feelings.
A group of researchers from India’s Mangalore’s University  explored the psychometric characteristics of SOC-13 among second-year degree students. They focused their assessment on its comprehensiveness, appropriateness, understandability, and relevance. The Cronbach's alpha estimate of the internal consistency was 0.76. Estimate for split-half reliability was 0.71 and the estimate for Guttman split-half reliability was 0.70. SOC-13 was found to have good Test–retest reliability (0.71, P < 0.01). They found that 41% of the SOC-13 variability can be explained by the three-factor solution.
In Australia, a study examined the psychometric properties in a group of (n = 718) pregnant women . That was based on the established positive association between sense of coherence and childbearing health . They estimated the mean SOC-13 score at 67.5 (SD = 10.9). They were faced with difficulty in establishing the construct validity of the SOC 13 was difficult to establish. Construct validity was defined during their investigation to mean “the ability of an instrument to measure an abstract concept”. They decided to remove four items before they were content with the construct validity of the SOC-13 scale, namely, items 2, 3, 7, and 9. They noted sound criterion validity for the SOC-13 before and after removal of the four problematic items, as well as internal reliability.
One of the earliest attempts at using Arabic SOC scale among Arabic speaking communities was the study conducted by Cohen and Savaya  . They survey 306 divorced Muslim Arabs in Israel. Their results indicated that the sense of coherence is closely linked to mental health, however, they remain independent constructs. These were certainly important findings. However, the authors did not report on the psychometric properties of the SOC-29 scale they used. They focused the analysis primarily on the correlation between sense of coherence and mental health among the divorced Arab community who participated in the study.
Very recently, Abu-Kaf and Khalaf   evaluated the relationship between depression and acculturative stress in (n = 170) Arab undergraduate students. They used the SOC-13 scale to assess the protective impact of the sense of coherence on the depression-acculturative stress association. They viewed the sense of coherence as a healthy way of seeing life and coping with its stresses . Arab students in higher academic years demonstrated significantly better sense of coherence and less depressive symptoms. Sense of coherence was negatively associated with avoidant coping and depressive symptoms but was positively associated with active coping styles. They demonstrated that the sense of coherence constituted an indirect link between depressive symptoms and active coping (in male students) and avoidant coping (among female students).
A sample of (n = 566) dentistry students in Istanbul University completes the SOC-13 scale . The median score was found to be 56, with scores ranging between 22 and 91. Clearly, a strong sense of coherence was associated positively with better oral health-related behaviours and lower levels of stress.
A Farsi adaptation of the SOC-13 was validated favourably among a sample of (n = 375) Iranian undergraduate students . The estimate for the internal consistency of the Farsi SOC-13 was good (Cronbach’s alpha = 0.77). The correlation between test-retests was statistically significant (r = 0.66). Factor analysis extracted four factors, which explained 53.49% of the total variability.
The main objective of our current investigation is the comprehensive psychometric evaluation of the Arabic version of SOC-13 in terms of underlying three-factor structure, internal consistency, and reliability. We also aimed at evaluating the effect of background demographic factors on the SOC-13 in a large-scale sample for the Saudi public.
Eligibility criteria and data collection procedure
Demographic and SOC-13 data were collected through a predesigned questionnaire mounted onto an online portal that was distributed among potential respondents by sharing the unique link using mass email and social networking media.
The participants were form the general public of citizens and residents in Saudi Arabia. Exclusion criteria were entering incomplete or inappropriate responses to the SOC-13 questionnaire. We also excluded participants under the age of 18.
We used the Arabic version SOC-13, which was obtained from the original authors’ website with permission. The Arabic version was obtained whole from STARS: Society for Theory And Research on Salutogenesis website (https://www.stars-society.org/kccmhshvugiq). We were not directly involved in the translation or adaptation of the original SOC-13 to Arabic.
The dataset in total was automatically transferred into Microsoft Excel system sheet. The advanced statistical methods to examine the psychometric properties included confirmatory factor analysis (CFA) using R-Statistical software. CFA is a statistical technique that examines the association between latent variables and relates that with a pre-set theoretic covariance structure  and is an established statistical method to evaluate construct validity . We examined different factor structures including one-factor, two-factor, three-factor, and four-factor structures. To examine the potential baseline differences in terms of model-fit, we ran a measurement invariance anlysis across the different age, marital status, gender, employment, and psychiatric history groups. We compared the models in terms of absolute fit indices that include the Chi-Squared test, root mean square error of approximation, RMSEA, comparative fit index, CFI, goodness-of-fit index, GFI, root mean square residual RMR, and standardized root mean square residual SRMR.
For a good model-fit a chi-squared value needs to be non-significant statistically. The cut-off for comparative fit index (CFI) was set at > 0.95, and for Tucker-Lewis index (TLI) t > 0.95, and root mean square error of approximation (RMSEA) required to be < 0.06 . The cut-off for acceptable model-fit is when RMSEA is < 0.08 .
Normality was tested by visualizing the data graphically using histogram and applying shipro wilk test (for the SOC-13 the test P value was 0.1063 indicative of satisfactory normality).
Missing data were imputed using Multivariate Imputation by Chained Equations method .
Reliability: This refers to the ability of the scale to give the same results consistently if the same individual is tested at different time points. Internal consistency of the scale refers to the extent to which all items measure the same variable. We used the Cronbach’s alpha coefficient to evaluate the Arabic SOC-13 related internal consistency. Both Cronbach’s alpha and hierarchical omega were used to examine the consistency of the total SOC-13 scale and its three subscales.
Among the participants, n = 481, (38.9%) were males and n = 754, (61.1%) were females. Most participants were under 25 years of age; n = 653 (52.9%). Table 1 shows a detailed display of the basic demographic factors of the participants.
Reliability and internal consistency of the Arabic SOC-13
The reliability coefficient, Cronbach’s alpha, for the comprehensibility subscale of the Arabic SOC-13 was 0.69 (95% confidence interval CI between 0.67 and 0.72), indicative of acceptable internal consistency. None of its items has a significant impact on the overall reliability estimate. The poorest performing item in terms of internal consistency was item 2: “Has it happened in the past that you were surprised by the behaviour of people whom you thought you knew well?”. When item 2 was removed from the analysis, the reliability estimate improved to 0.73. The best performing item in terms of internal consistency was item 8: “Do you have very mixed-up feelings and ideas?”. When item 8 was removed from the analysis, the reliability estimate deteriorated to 0.57.
Similarly, the Cronbach’s alpha reliability coefficient for the manageability subscale was 0.56 (95% CI between 0.52 and 0.60), indicative of poor internal consistency. The poorest performing item in terms of internal consistency was item 3: “Has it happened that people whom you counted on disappointed you?”. When item 3 was removed from the analysis, the reliability estimate improved to 0.53. The best performing item in terms of internal consistency was item 10: “Many people—even those with a strong character—sometimes feel like sad sacks (losers) in certain situations. How often have you felt this way in the past?”. When item 10 was removed from the analysis, the reliability estimate deteriorated to 0.45.
In addition, the Cronbach’s alpha reliability coefficient for the meaningfulness subscale was 0.53 (95% CI between 0.49 and 0.57), indicative of poor internal consistency. The poorest performing item in terms of internal consistency was item 1: “Do you have the feeling that you don’t really care about what goes on around you?”. When item 1 was removed from the analysis, the reliability estimate improved to 0.61. The best performing item in terms of internal consistency was item 7: “Doing the things you do everyday is [a source of deep pleasure and satisfaction]?”. When item 7 was removed from the analysis, the reliability estimate dropped to 0.36.
Overall, the reliability coefficient for the total SOC-13 score was 0.82 (95% CI between 0.81 and 0.84), indicative of good internal consistency. All its items were of comparable impact on the overall reliability estimate. Further information is available in Additional file 1.
Split-half reliability was calculated by the Lambda4 package in R statistical software to be 0.86, and Guttman lambda split-half reliability to be 0.83.
Confirmatory factor analysis
We conducted a confirmatory factor analysis to guarantee that the three dimensions of comprehensibility, meaningfulness, and manageability conform satisfactorily to the Arabic adaptation of the SOC-13. We sequentially fitted one-factor, two-factor, three-factor, and four-factor models to the dataset. However, the three-factor model did not fit in a satisfactory way for the full 13-item dataset. Notably, measurement invariance analysis showed that the three-factor model failed to maintain its structure with sufficient stability across sociodemographic groups (see Tables 7, 8, and 9). The model structure did not pass configural invariance model level of testing. Expectedly it did not pass any subsequent strains imposed on the model. A fuller 4-factor structure fitted better than the models with fewer factors. An additional dimension (composed of item 8: “Do you have very mixed-up feelings and ideas?” which cross-loaded also on both the comprehensibility dimension and the fourth dimension, and item 9: “Does it happen that you have feelings inside you would rather not feel?” which loaded completely on the fourth dimension only) is required for the sample data to conform acceptably to the theoretical covariance structure. See Additional file 2 for a detailed account of the four-factor loading.
Three items were notably reversed in terms of scoring and loaded away from their corresponding dimensions in the four-factor full model. These were item 1: “Do you have the feeling that you don’t really care about what goes on around you?”, item 2: “Has it happened in the past that you were surprised by the behaviour of people whom you thought you knew well?”, and item 3: “Has it happened that people whom you counted on disappointed you?”.
Item 1: “Do you have the feeling that you don’t really care about what goes on around you?” cross-loaded equally on both factor one and factor three, whereas item 2: “Has it happened in the past that you were surprised by the behaviour of people whom you thought you knew well?” and item 3: “Has it happened that people whom you counted on disappointed you?” were lumped together loading unto factor three.
We further attempted to perform the confirmatory factor analysis of a three-factor model after removal of the three poorly performing items (item 1: “Do you have the feeling that you don’t really care about what goes on around you?”, item 2: “Has it happened in the past that you were surprised by the behaviour of people whom you thought you knew well?”, and item 3: “Has it happened that people whom you counted on disappointed you?”). This item-deleted three-factor model was substantially better than the full three-factor model in the full dataset and of even better fit than the 4-factor model. See Tables 2 and 3.
For a good fit, it is preferred that the comparative fit index (CFI) > 0.95, Tucker-Lewis index (TLI) > 0.95, and root mean square error of approximation (RMSEA) < 0.06 . A good fit to the dataset is shown with RMSEA value < 0.05 and an acceptable fit is when RMSEA is < 0.08 .
Discriminant validity analysis
Discriminant validity is considered an index of the difference between the three underlying constructs (namely, comprehensibility, manageability, and meaningfulness). These constructs are inherently similar, therefore a strong correlation is expected between them, and, therefore, low discriminatory power. We opted to use a multiply operationalized procedure method, as portrayed in Table 4, to examine the correlation matrix of z-transformed scores of each of the three constructs .
Convergent validity analysis
Convergent validity is the establishment of a significant correlation between different components of a measurement scale that assesses the same construct . We examined the correlation between each of the SOC-13 items and its corresponding construct. Correlation coefficients were interpreted as: 0–0.19 = very weak; 0.20–0.39 = weak; 0.40–0.59 = moderate; 0.60–0.79 = strong; 0.80–1.0 = very strong .
Clearly, all items demonstrated strong convergent validity, except SOC1 and SOC2, whose convergent validity was moderate. See Table 5.
Effect of demographic and clinical factors on SOC-13 score
The mean overall SOC-13 total score in our sample was 52.1 (SD = 16.1), ranging between 13 and 91. The median SOC-13 score was 51.
Regarding gender distribution, males scored substantially better than females. The mean SOC-13 score in men was 56.5 points, compared to the mean score of SOC-13 among women that was 49.3 points. This difference was statistically significant (t = 7.782, P < 0.0001). See Figure.
The difference in terms of age distribution was also statistically significant (F = 20.92, P < 0.0001). The 42-to-49 class scored best in terms of SOC-13 (mean = 60.8), whereas over 85 scored the lowest (mean = 48.2). See Fig. 2 (Table 7).
Regarding marital status, as shown in Fig. 3, single participants scored the least SOC-13 (mean = 49.4) compared to the married (mean = 57.0). This was statistically significant (F = 21.51, P < 0.0001).
Regarding employment status, students scored the least SOC-13 (mean = 48.4) compared to the employees (mean = 57.8). This difference was statistically significant (F = 50.46, P < 0.0001). See Fig. 4 (Table 8).
Regarding the Kingdom region of the participants, see Fig. 5, the highest SOC-13 score was observed in the Northern Region (mean = 55.7), whereas the least score was in the Eastern Region (mean = 49.5). This difference was statistically significant also (F = 3.908, P = 0.0037). See Fig. 1 below, and See Fig. 6.
Presence of psychiatric history was associated with a mean SOC-13 score of 47.3 (substantially less than for participants who reported no psychiatric history whose mean SOC-13 score was 52.5, t = 3.1289, P = 0.002195). See Fig. 7 below.
We found the overall internal consistency for the SOC-13 measure to be 0.82, quite high indeed and allows reliable decision making based on the Arabic SOC-13 scale . This corroborates the figure of 0.75 found by the Al-Yateem et al.   and is even closer to the 0.83 reliability estimate found by Stern et al.  . Several international studies have provided estimates for the reliability of the SOC-13 between 0.70 and 0.93 [31,32,33,34]. However, the reliability for the subscales was less impressive in our findings. The Cronbach’s alpha estimates were 0.69, 0.56, and 0.53 for comprehensibility, manageability, and meaningfulness subscales, respectively. The corresponding figures in the Slovenian evaluation were far better for the reliability of the subdimensions, namely, 0.66, 0.69, and 0.79, respectively . However, the Slovenian sample was far more homogeneous than our sample, as they recruited patients with Multiple Sclerosis. That homogeneity could have overestimated the reliability scores (Table 9).
Our split-half reliability and Guttmen lambda estimates were 0.86 and 0.83, respectively. They were far better than the estimates reported by Rajesh et al.  , of 0.71 and 0.70. This may indicate better stability for the Arabic SOC-13, or may be an artefact of the large sample size in our study.
Clearly, the three first items SOC1, SOC2, and SOC3 were negatively impacted on the reliability of the subscales. Many previous studies pointed out these items as problematic . They stir strong feelings of the sort of ‘how such a question could be asked?’ which could negatively affect the respondents’ choice.
Those three items were all reversed in terms of scoring. This is known to be confusing to the respondents and could have affected our participants’ interpretation of the item verbatim . In general, the use of reversely worded items serves to remove ‘acquiescence bias’. Acquiescence bias refers to the tendency of the participant to automatically tick a certain item repeatedly without comprehending its actual content . However, the inclusion of such reversely phrased items was proved to negatively affect the factor structure of the overall scale . The fact that the removal of the three reversely phrased items vastly improved the factor = structure of the SOC-13 Arabic scale can be regarded as supportive to the notion prosed by DiStefano and Motl  . They suggested that reversely worded items tend to move away from the theoretical factor structure as they measure a ‘method dimension’ that was not originally designed by the researcher. Notably, the three reversely phrased items in our sample loaded away from their corresponding factors. This could be the reason for the recently proposed notion that although reversely articulated questions may guard against acquiescence bias in collective scale scoring, they would not be expected to control acquiescence bias in the underlying latent factor structure .
Item 1: “Do you have the feeling that you don’t really care about what goes on around you?” was designed to load on the meaningfulness dimension. This is the motivational dimension concerned with commitment, dedication, the will for energy spending, and emotional meaning of being able to solve every-day problems . Item 1 clearly reflects a sense of indifference to internal or external challenges. It loaded on manageability and comprehensibility dimensions. In our participants, they were stuck more in the cognitive-behavioural aspects rather than the motivational facets of the “Do you have the feeling that you don’t really care about what goes on around you?” question. The reason is difficult to clarify.
In the study conducted by , item 1 (in addition to item 5) was noted to have a poor fit to the overall factor structure of the SOC-13. They regarded item 1 as a hurdle against satisfactory internal scale validity and suggested its permanent drop from the SOC-13. They found similar results in another survey of morbidly obsessed individuals .
Similarly, item 2: “Has it happened in the past that you were surprised by the behaviour of people whom you thought you knew well?” and item 3: “Has it happened that people whom you counted on disappointed you?” did not conform to the predesigned respective facets of cognitive and behavioural dimensions. They may measure an interactionist dimension, or a trust-building ability rather than a cognitive ‘surprise’ or behavioural ‘disappointment’ as suggested by Eriksson et al.   classification. It could well be said that they measure a ‘methods’ dimension’ given their reversely worded verbatim . The complexity of how these items interact requires well-designed exploratory studies.
A closer examination of the three problematic items could reveal a potential difference between them. Item 1 is a type of ‘negation item’, whereas both item 2 and item 3 are ‘polar opposite items’ . All these items, negation and polar opposite phrases, were shown to discourage the so-called “yea tendency”, i.e., giving a target-unrelated response to the item, thereby shaking the underlying theoretical factor structure . It may well be that the structure of these items is the main reason for their unfavourable psychometric characteristics rather than their content.
Item 2 “Has it happened in the past that you were surprised by the behaviour of people whom you thought you knew well?” was particularly tricky in numerous cultural adaptations of the SOC-13 scale, including Peruvian , Italian , and Dutch . Item 2 was regarded as troublesome in a recent survey of Swedish subjects, and the SOC-29 was substantially better in terms of factor structure when it was removed .
Clearly, item 2 bears a close relation to the concept of ‘predictability’. This predictability concept constituted one of the foci for criticism of the SOC-13 scale. Many authors argued that for a high sense of coherence there is no need for life to be predictable to the individual . Conversely, unpredictability could provide a pleasant tastefulness to a healthy life. This was proposed as the primary reason for the poor correlation of SOC-13 and physical health measures .
Our results demonstrate that for the Arabic SOC-13 to have a good fit to the underlying three-factor structure, three items require removal. Namely, item 1 needs to be removed from the meaningfulness dimension, item 2 needs to be deleted from the comprehensibility dimension, and item 3 requires elimination from the manageability dimension. Notably, these very items performed poorly in terms of internal consistency. It is unclear why the exclusion of these questions results in the improvement of reliability and model structure. One speculative explanation may be the reverse nature of the questions that merit further explanation of the social desirability bias.
We found the mean SOC-13 score to be 52.1, which was clearly lower than the mean reported by Ferguson et al.   of 67.5. This may be difficult to explain, but the sample in the Ferguson et al.   investigation consisted of homogeneous pregnant women, who were more likely to be physically and emotionally more stable (and, hence, of a higher sense of coherence) than our heterogeneous sample.
In terms of the impact of demographic variables on the sense of coherence, we demonstrated that it improves with time, till the age of 42. It then stabilizes till older age and drops in the ninth decade. This nearly agrees with the initial assumptions proposed by Antonovsky  . He suggested that the sense of coherence continues to grow until the fourth decade of life with reasonable stability until the retirement age, before it declines. However, several researchers demonstrated that the sense of coherence does not cease developing throughout life [49,50,51]. Evidence from large-scale studies was consistent that the sense of coherence increases with age as life experiences accumulate . Recent studies corroborate the notion that age does not substantially influence the sense of coherence, particularly in individuals over 65 years of age .
Expectedly, we found that subjects who reported mental health difficulties were of substantially lower levels in terms of sense of coherence than people who did not report psychological ill health. This agrees with the results of several recent investigations that confirmed that the sense of coherence can reliably predict mental health across a range of populations and age groups [54,55,56]. One likely explanation is the established inverse relationship between mental health difficulties and quality of life . One further explanation could be the limitations posed by ill mental health on physical activity and the sense of optimism .
We also demonstrated a significant impact of marital status on the sense of coherence score. Many studies were consistent in terms of the effect of family relationship on the sense of coherence .
In our exploration, we found Northern and central areas in Saudi Arabia to be exceedingly better in terms of sense of coherence than Eastern and Western parts. This may be difficult to explain fully. Urban areas were shown in many studies to be more resourceful in terms of mental health facilities that were reflected in better emotional well-being . Clearly, further research is required to explain the factors that cause such sense of coherence related disparity in Saudi Arabia to occur.
Further research should attempt rewording those three items and set up focus groups to explore how respondents felt about these specific items. It will be worthwhile examining the factor structure of the Arabic SOC-13 scale with the reversely worded items included in their nonreversed version. It is hoped that such a way of presenting the SOC-13 may improve the reliability estimates and the overall psychometric characteristics.
A focus on the cognitive-behavioural underpinnings of item 1: “Do you have the feeling that you don’t really care about what goes on around you?” Among Arabic-speaking subjects, it deserves focused and dedicated exploration via preferably qualitative methods.
Moreover, item 2: “Has it happened in the past that you were surprised by the behaviour of people whom you thought you knew well?” and item 3: “Has it happened that people whom you counted on disappointed you?” were noted to reflect something other than cognitive behavioural dimensions. Their exact latent content can be elucidated via large-scale exploratory studies that could also use qualitative design.
Future research in Saudi Arabia should attempt to clarify regional differences in terms of the sense of coherence. Factors such as urbanicity, resourcefulness, and resource accessibility should be explored as possible moderators in terms of sense of coherence and emotional well-being.
Moreover, the effect of homogeneity of the underlying study population on the reliability score deserves focused research in the future. A comparison should be made between participants with common characteristics, such as common endocrinological or neurological conditions (e.g., diabetes or multiple sclerosis), and participants with no such common characteristics.
The current study has several strengths. The sample size was large. However, one substantial imitation was recruitment of under 25 majority. That may not represent the demographics of Saudi population; therefore, care is needed when generalizing our results. Moreover, the cross-sectional and online design would not elucidate bidirectional associations or selection bias, as computer and internet literacy is an important filter in selecting participants.
Availability of data and materials
Full dataset is included as a Additional file 3 titles “SOC13-Data”.
Sense of coherence
Confirmatory factor analysis
Root mean square error of approximation
Comparative fit index
Root mean square residual
Standardized root mean square residual
Antonovsky A. Health, stress, and coping. San Francisco: Jossey-Bass Inc.; 1979.
Antonovsky A. Unraveling the mystery of health. How people manage stress and stay well. San Francisco: Jossey-Bass Publishers; 1987.
Nilsson P, Andersson IH, Ejlertsson G, Troein M. Workplace health resources based on sense of coherence theory. Int J Workplace Health Manag. 2012;5(3):156–67.
Shakeri J, Yazdanshenas Ghazwin M, Rakizadeh E, et al. Do spinal cord-injured individuals with stronger sense of coherence use different psychological defense styles? Spinal Cord. 2016;54:843–8. https://doi.org/10.1038/sc.2015.213.
Simmons J, Swahnberg K. Lifetime prevalence of polyvictimization among older adults in Sweden, associations with ill-heath, and the mediating effect of sense of coherence. BMC Geriatr. 2021;21(1):129. https://doi.org/10.1186/s12877-021-02074-4.
Horsburgh ME, Ferguson AL. Salutogenesis: origins of health and sense of coherence. In: Rice VH, editor. Handbook of stress, coping, and health: implications for nursing research, theory, and practice. 2nd ed. Thousand Oaks, CA: Sage Publications Inc; 2012. p. 180–98.
Eriksson M, Mittelmark MB. The sense of coherence and its measurement. In: Mittelmark MB, Sagy S, Eriksson M, Bauer GF, Pelikan JM, Lindström B, Espnes GA, editors. The handbook of salutogenesis. Cham: Springer; 2017.
Antonovsky A. The structure and properties of the sense of coherence scale. Soc Sci Med. 1993;36:725–33. https://doi.org/10.1016/0277-9536(93)90033-Z.
Almedom A, Tesfamichael B, Saeed Z, et al. Use of ‘sense of coherence (soc)’ scale to measure resilience in Eritrea: interrogating both the data and the scale. J Biosoc Sci. 2007;39:91–107.
Golmakani N, Gholami M, Shaghaghi F, Safinejad H, Kamali Z, Mohebbi-Dehnavi Z. Relationship between fear of childbirth and the sense of cohesion with the attachment of pregnant mothers to the fetus. J Educ Health Promot. 2020;30(9):261. https://doi.org/10.4103/jehp.jehp_46_20.
Söderhamn U, Sundsli K, Cliffordson C, Dale B. Psychometric properties of Antonovsky’s 29-item sense of coherence scale in research on older home-dwelling Norwegians. Scand J Public Health. 2015;43(8):867–74.
Al-Yateem N, Alrimawi I, Fakhry R, AlShujairi A, Rahman SA, Marzouqi AA, Rossiter R. Exploring the reliability and validity of the adapted Arabic sense of coherence scale. J Nurs Meas. 2020. https://doi.org/10.1891/JNM-D-19-00107.
Eriksson M, Lindström B. Validity of Antonovsky’s sense of coherence scale: a systematic review. J Epidemiol Community Health. 2005;59(6):460–6. https://doi.org/10.1136/jech.2003.018085.
Lerdal A, Opheim R, Gay CL, Moum B, Fagermoen MS, Kottorp A. Psychometric limitations of the 13-item sense of coherence Scale assessed by Rasch analysis. BMC Psychol. 2017;5(1):18. https://doi.org/10.1186/s40359-017-0187-y.
Stern B, Socan G, Rener-Sitar K, Kukec A, Zaletel-Kragelj L. Validation of the Slovenian version of Short Sense of Coherence Questionnaire (SOC-13) in multiple sclerosis patients. Zdr Varst. 2019;58(1):31–9. https://doi.org/10.2478/sjph-2019-0004.
Rajesh G, Eriksson M, Pai K, Seemanthini S, Naik DG, Rao A. The validity and reliability of the sense of coherence scale among Indian university students. Glob Health Promot. 2016;23(4):16–26. https://doi.org/10.1177/1757975915572691.
Ferguson S, Davis D, Browne J, Taylor J. Examining the validity and reliability of Antonovsky’s sense of coherence scale in a population of pregnant Australian women. Eval Health Prof. 2015;38(2):280–9. https://doi.org/10.1177/0163278715578558.
Ferguson S, Davis D, Browne J, Taylor J. Sense of coherence and childbearing: a scoping review of the literature. Int J Childbirth. 2014;4:134–46.
Cohen O, Savaya R. Sense of coherence and adjustment to divorce among Muslim Arab citizens of Israel. Eur J Pers. 2003;17(4):309–26. https://doi.org/10.1002/per.493.
Abu-Kaf S, Khalaf E. Acculturative stress among Arab students in Israel: the roles of sense of coherence and coping strategies. Int J Environ Res Public Health. 2020;17(14):5106. https://doi.org/10.3390/ijerph17145106.
Peker K, Bermek G, Uysal O. Factors related to sense of coherence among dental students at Istanbul University. J Dent Educ. 2012;76(6):774–82.
Mohammadzadeh A, Poursharifi H, Alipour A. Validation of sense of coherence (SOC) 13-item scale in Iranian sample. Procedia Soc Behav Sci. 2010;5:1451–5.
Byrne B. Structural equation modeling with AMOS: basic concepts, applications and programming. 2nd ed. New York, NY: Routledge; 2010.
Burns N, Grove S. The practice of nursing research: appraisal, synthesis and generation of evidence. St Louis, MI: Elsevier; 2009.
Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model. 1999;6:1–55.
Browne MW, Cudeck R. Alternative ways of assessing model fit. In: Bollen KA, Long LS, editors. Testing structural equation models. Newbury Park: Sage; 1993. p. 136–62.
Cole D, Howard GS, Maxwell SE. Effects of mono-versus multiple-operationalization in construct validation efforts. J Couns Clin Psychol. 1981;34:315–21.
Duckworth AL, Kern ML. A meta-analysis of the convergent validity of self-control measures. J Res Pers. 2011;45:259–68.
Evans J. Straightforward statistics for the behavioural sciences. Salt Lake City: Brooks/Cole; 1996.
Nunnally JC, Bernstein IH. Psychometric theory. 3rd ed. New York: McGraw-Hill; 1994.
Bonacchi A, Miccinesi G, Galli S, Chiesi F, Martire M, Guazzini M. The dimensionality of Antonovsky’s sense of coherence scales: an investigation with Italian samples. TPM. 2012;19:115. https://doi.org/10.4473/TPM19.2.4.
Sardu C, Mereu A, Sotgiu A, Andrissi L, Jacobson MK, Contu P. Antonovsky’s sense of coherence scale: cultural validation of SOC questionnaire and sociodemographic patterns in an Italian population. Clin Pract Epidemiol Ment Health. 2012;8:1. https://doi.org/10.2174/1745017901208010001.
Naaldenberg J, Tobi H, van den Esker F, Vaandrager L. Psychometric properties of the OLQ-13 scale to measure sense of coherence in a community-dwelling older population. Health Qual Life Outcomes. 2011;9:37. https://doi.org/10.1186/1477-7525-9-37.
Jakobsson U. Testing construct validity of the 13-item sense of coherence scale in a sample of older adults. Open Geriatr Med J. 2011;4:6. https://doi.org/10.2174/1874827901104010006.
Van Sonderen E, Sanderman R, Coyne JC. Ineffectiveness of reverse wording of questionnaire items: let’s learn from cows in the rain. PLoS ONE. 2013;8(7):e68967.
Watson D. Correcting for acquiescent response bias in the absence of a balanced scale: an application to class consciousness. Sociol Methods Res. 1992;21:52–88. https://doi.org/10.1177/0049124192021001003.
Zhang X, Noor R, Savalei V. Examining the effect of reverse worded items on the factor structure of the need for cognition scale. PLoS ONE. 2016;11(6): e0157795. https://doi.org/10.1371/journal.pone.0157795.
DiStefano C, Motl RW. Further investigating method effects associated with negatively worded items in self-report surveys. Struct Equ Model. 2006;13:440–64. https://doi.org/10.1207/s15328007sem1303_6.
Savalei V, Falk C. Recovering substantive factor loadings in the presence of acquiescence bias: a comparison of three approaches. Multivar Behav Res. 2014;49:407–24. https://doi.org/10.1080/00273171.2014/931800.
Lerdal A, Fagermoen MS, Bonsaksen T, Gay CL, Kottorp A. Rasch analysis of the sense of coherence scale in a sample of people with morbid obesity - a cross-sectional study. BMC Psychol. 2014;2(1):10. https://doi.org/10.1186/2050-7283-2-1.
Schriesheim CA, Eisenbach RJ, Hill KD. The effect of negation and polar opposite item reversals on questionnaire reliability and validity: an experimental investigation. Educ Psychol Meas. 1991;51(1):67–78. https://doi.org/10.1177/0013164491511005.
Böckenholt U. Contextual responses to affirmative and/or reversed-worded items. Psychometrika. 2019;84(4):986–99. https://doi.org/10.1007/s11336-019-09680-7.
Saravia JC, Iberico C, Yearwood K. Validation of sense of coherence (soc) 13-item scale in a Peruvian sample. J Behav Health Soc Issues. 2014;6(2):35–44.
Bonacchi A, Miccinesi G, Galli S, Chiesi F, Martire M, Guazzini M, et al. The dimensionality of the sense of coherence scales, an investigation on Italian sample. TPM. 2012;19(2):115–34.
Luyckx K, Goossens E, Apers S, et al. The 13-Item sense of coherence scale in Dutch-speaking adolescents and young adults: structural validity, age trends, and chronic disease. Psychol Belg. 2012;52(4):351–68.
Drageset J, Haugan G. Psychometric properties of the Orientation to Life Questionnaire in nursing home residents. Scand J Caring Sci. 2016;30(3):623–30. https://doi.org/10.1111/scs.12271.
Flensborg-Madsen T, Ventegodt S, Merrick J. Sense of coherence and physical health. A cross-sectional study using a new scale (SOC II). Sci World J. 2006;6:2200–11.
Endler CP, Haug TM, Spranger H. Sense of coherence and physical health. A “Copenhagen interpretation” of Antonovsky’s SOC concept. Sci World J. 2008;8:451–3.
Nilsson KW, Leppert J, Simonsson B, Starrin B. Sense of coherence and psychological well-being: Improvement with age. J Epidemiol Community Health. 2010;64(4):347–52.
Lindmark U, Stenstrom U, Gerdin EW, Hugoson A. The distribution of “sense of coherence”among Swedish adults: a quantitative cross-sectional population study. Scand J Public Health. 2010;38(1):1–8. https://doi.org/10.1177/1403494809351654.
Hansen AØ, Kristensen HK, Cederlund R, Tromborg H. Test–retest reliability of Antonovsky’s 13-item sense of coherence scale in patients with hand-related disorders. Disabil Rehabil. 2017;39(20):2105–11. https://doi.org/10.1080/09638288.2016.1215555.
Feldt T, Metsäpelto R-L, Kinnunen U, Pulkkinen L. Sense of coherence and five-factor approach to personality. Conceptual relationships. Eur Phychol. 2007;12(3):165–72.
Zielińska-Więczkowska H, Sas K. The sense of coherence, self-perception of aging and the occurrence of depression among the participants of the University of the Third Age depending on socio-demographic factors. Clin Interv Aging. 2020;25(15):1481–91. https://doi.org/10.2147/CIA.S260635.
Carlén K, Suominen S, Lindmark U, Saarinen MM, Aromaa M, Rautava P, Sillanpää M. Sense of coherence predicts adolescent mental health. J Affect Disord. 2020;1(274):1206–10. https://doi.org/10.1016/j.jad.2020.04.023.
López-Martínez C, Serrano-Ortega N, Moreno-Cámara S, Del-Pino-Casado R. Association between sense of coherence associated with mental health in caregivers of older adults. Int J Environ Res Public Health. 2019;16(20):3800. https://doi.org/10.3390/ijerph16203800.
Del-Pino-Casado R, Espinosa-Medina A, López-Martínez C, Orgeta V. Sense of coherence, burden and mental health in caregiving: a systematic review and meta-analysis. J Affect Disord. 2019;1(242):14–21. https://doi.org/10.1016/j.jad.2018.08.002.
Tsuno YS, Yamazaki Y. Relationships among sense of coherence, resources, and mental health in urban and rural residents in Japan. BMC Public Health. 2012;23(12):1107. https://doi.org/10.1186/1471-2458-12-1107.
Omiya T, Deguchi N, Togari T, Yamazaki Y. Factors influencing sense of coherence: family relationships, high school life and autism spectrum tendency. Children (Basel). 2020;7(9):108. https://doi.org/10.3390/children7090108.
van Buuren S, Brand JPL, Groothuis-Oudshoorn CGM, Rubin DB. Fully conditional specification in multivariate imputation. J Stat Comput Simul. 2006;76(12):1049–64.
We very much appreciate and thank the University vice Directorate for Academic support and student services at Princess Nourah bint Abdulrahman- Health Nourah Programme and we appreciate the limitless support of Saudi Association for Psychological Counselling. We acknowledge Prince Nourah bint Abdulrahman University Researchers supporting Project Number (PNURS2022R255), Prince Nourah bint Abdulrahman University, Riyadh, Saudi Arabia.
This research was funded by the Deanship of Scientific Research at Princess Nourah bint Abdulrahman University through the fast-track Research Funding Programme. Acknowledge Prince Nourah bint Abdulrahman University Researchers supporting Project Number (PNURS2022R255).
Ethics approval and consent to participate
Ethical approval was granted from Noura University Ethics Committee and Al-Hada Armed Forces Hospital Research and Ethics Committee which also gave consent for publication for the manuscript. All methods were carried out in accordance with ethics and consent guidelines and regulations. We confirmed that informed consent was obtained from all subjects and/or their legal guardian(s).
Consent for publication
The authors declare no competing interests, financial or otherwise.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Details of reliability coefficient for the total SOC-13 score and each of the three sub-scores and each of the thirteen individual items.
Detailed account of the four-factor loading for the Arabic SOC-13 data.
Full dataset for the Arabic SOC-13 responses among the participating individuals.
About this article
Cite this article
Alharbi, F.S., Aljemaiah, A.I. & Osman, M. Validation of the factor structure and psychometric characteristics of the Arabic adaptation of the sense of coherence SOC-13 scale: a confirmatory factor analysis. BMC Psychol 10, 115 (2022). https://doi.org/10.1186/s40359-022-00826-4
- Sense of coherence
- SOC-13 scale
- Arabic SOC-13 scale
- Confirmatory factor analysis
- Psychometric analysis
- Saudi Arabia