Skip to main content

Construct validity and factor structure of the Kessler-10 in South Africa

Abstract

Background

The Kessler Psychological Distress Scale (K-10) is a short screening tool developed to identify, with good sensitivity, non-specific psychological distress in the general population. Sensitivity and specificity of the K-10 have been examined in various clinical populations in South Africa; however, other psychometric properties, such as construct validity and factor structure, have not been evaluated. We present evidence of the prevalence and severity of psychological distress in an outpatient setting in South Africa and evaluate the internal reliability, construct validity, and factor structure of the K-10 in this population.

Methods

We explored prevalence estimates of psychological distress using previously established cutoffs and assessed the reliability (consistency) of the K-10 by calculating Cronbach’s alpha, item-total correlations and omega total and hierarchical coefficients. Construct validity and factor structure of the K-10 were examined through split-sample exploratory factor analysis (EFA) followed by confirmatory factor analysis (CFA), comparing several theoretical models and the EFA.

Results

Overall, there was low prevalence of psychological distress in our sample of 2591 adults, the majority of whom were between the ages of 18–44 (77.7%). The K-10 showed good construct validity and reliability, with a Cronbach’s alpha of 0.84 and omega total of 0.88. EFA yielded a four-factor solution with likely measurement artifacts. CFA showed that the four-factor model from EFA displayed the best comparative fit indices, but was likely overfitted. The unidimensional model with correlated errors was deemed the best fitting model based on fit indices, prior theory, and previous studies.

Conclusion

The K-10 displays adequate psychometric properties, good internal reliability, and good fit with a unidimensional-factor structure with correlated errors. Further work is required to determine appropriate cutoff values in different populations and clinical subgroups within South Africa to aid in determining the K-10’s clinical utility.

Peer Review reports

Background

Common mental disorders, such as mood and anxiety disorders, contribute significantly to the global disease burden [1]. Few individuals with mood and anxiety disorders receive the treatment that they need, and this is particularly true in low- and middle-income countries (LMICs) [2]. A first step toward closing this gap in care may be to use population-level studies to determine the prevalence of common mental disorders, which can help develop public health policies and plans for treatment funding [3].

Additionally, effective screening tools such as the Kessler Psychological Distress Scale (K-10) may be used in a clinical context to identify individuals at risk of mental illness and to improve treatment rates. Yet, many assessment tools have been developed in well-resourced settings and require validation within LMICs where there are significant financial and human resource constraints, including a relative lack of trained mental health care personnel [4]. Having access to validated, lay-administered tools that are easy and quick to administer make nationwide epidemiological studies more feasible [3], improving efforts to monitor and treat common mental disorders [5].

The K-10 has been used as a screening tool for mood and anxiety disorders and was specifically developed for population-based studies to identify individuals experiencing non-specific psychological distress and screen for symptoms of anxiety and depression [6]. The K-10 has shown good sensitivity and specificity for predicting mental disorders defined by the Diagnostic and Statistical Manual of Mental Disorders-5 (DSM-5; [5], as measured by the World Health Organization Composite International Diagnostic Interview (CIDI; [3, 6]. In recent years, the K-10 has gained popularity, and several studies have investigated its psychometric properties [3, 7], including in low-resource settings [3, 8,9,10,11]. Translated versions of the ten-item scale (K-10) and the abbreviated six-item scale (K-6) have strong psychometric properties in Vietnamese [12], Dutch [13], Arabic [13, 14], and Turkish language [13] with generally good discriminating ability between non-cases and cases with mental disorders as defined by the DSM-5 [5] and measured using the CIDI [3]. Studies examining the factor structure of the K-10 among various populations have found a unidimensional factor [12, 13, 15] and a unidimensional factor with correlated errors [15] for data from community-based populations, and a two-factor model with anxiety and depression symptoms converging onto two separate groupings with clinical populations with mental health conditions [15].

In South Africa, a LMIC, psychometric properties of the K-10 and abbreviated K-6 have been explored for specificity, internal consistency and sensitivity in several studies within a representative South African sample and a few clinical populations [9,10,11, 16, 17]. For example, K-10 was investigated in a nationally representative household survey of 4077 adults and demonstrated moderate discriminating ability in detecting mood and anxiety disorders compared with the CIDI; however, its sensitivity and specificity were determined to be inadequate within the South African context [9]. Therefore, further work is required to determine whether the K-10 could be feasibly used within South Africa in a cost-effective manner that would improve detection rates of common mental disorders in the country. In addition, other psychometric properties such as factor structure (i.e., the relationship between items testing the same construct) and construct validity (i.e., whether the test measures what it intends to) of the K-10 have not yet been investigated in South Africa. These are important to determine a screening tool’s validity when applied to a new population. Lastly, a few studies have investigated the prevalence of psychological distress in primary care outpatient settings in South Africa and other LMICs [10, 11, 16, 18], and the relatively high prevalence of psychological distress in these studies indicate the need for further research into screening tools such as the K-10 [11, 16, 18].

In African countries, only a few studies have investigated the factor structure of the K-10. A study in Tanzania in a clinical sample of individuals with traumatic brain injury showed acceptable psychometric properties and adequate support for both a unidimensional model of psychological distress and a two-factor model of depression and anxiety [8]. In an Ethiopian community sample, a two-factor model was derived from exploratory factor analysis (EFA) [19]. More recently, our colleagues in Ethiopia and Kenya examined the K-10 factor structure using the same study design we propose here. In Ethiopia, a two factor model emerged from the EFA and a unidimensional model with correlated errors was ultimately the best fitting model [18]. Similarly, in the sample from Kenya, a two-factor model was derived from EFA, however a unidimensional model with correlated errors again showed the best fit [20].

The objectives of the current study are to estimate the prevalence of psychological distress in South Africa and further investigate the psychometric properties of the K-10 in a sample of adults in outpatient settings in Western and Eastern Cape. We examined the reliability of the measure in South Africa with our population, and an EFA and confirmatory factor analysis (CFA) based on prior studies [12, 13, 15] were used to examine the construct validity, and factor structure of the K-10 in this context.

Methods

Study setting and sample

Data were derived from South Africa as part of the Neuropsychiatric Genetics of African Populations-Psychosis (NeuroGAP-Psychosis) study, an ongoing multi-country case–control and genome-wide association study (GWAS) to deepen understanding of genetic and environmental risk factors for psychotic disorders in Africa [21]. A full explanation of the methodology of the NeuroGAP-Psychosis study is detailed elsewhere [21]. Participants enrolled in NeuroGAP-Psychosis in South Africa were recruited starting in April 2018, and we restricted our analysis to data from South Africa through the end of March 2020. Participants were recruited from the following medical facilities: Fort England Psychiatric Hospital and satellite clinics (Grahamstown, Eastern Cape), Nelson Mandela Academic Hospital (Mthatha, Eastern Cape), Valkenberg Hospital (Cape Town, Western Cape), and several community clinics in the Cape Town Metropolitan Area. Findings for this study were limited to control participants from the parent study because the K-10 was administered only to individuals who served as controls in the NeuroGAP-Psychosis study. Control participants include individuals seeking clinical care for themselves at outpatient general medical facilities, those accompanying a friend or family member to a clinic visit, workers at the hospital/clinic, or those attending for any other reason, such as collecting a medication refill. Inclusion criteria for control participants were being from the same geographic location as NeuroGAP-Psychosis case participants but without a clinical diagnosis of psychosis and not taking psychotropic medication [21]. Exclusion criteria consisted of currently having psychotic symptoms or a past diagnosis of a psychotic disorder, currently taking medication for psychosis, undergoing treatment for alcohol or substance misuse (i.e., current inpatient or currently under acute medical care for substance misuse), or lacking the capacity to consent to the study, as determined by the University of California, San Diego Brief Assessment of Capacity to Consent [21].

Ethical approval to conduct this study was obtained from all participating sites, including the University of Cape Town Human Research Ethics Committee (REF# 466/2016), the Western Cape Government (WC_2016RP32_349), and the Walter Sisulu University Research and Ethics Committee (SOMREC #REC REF 2016-057) in South Africa and the Harvard T.H. Chan School of Public Health (#IRB17-0822) in the United States. All study protocols were approved by the above-named institutions and/or ethics committees. Informed consent was obtained from all study participants and all study procedures were conducted in accordance with the relevant guidelines and regulations.

Measures

K-10

The K-10 is a ten-item questionnaire that assesses the presence of general psychological distress experienced in the four weeks prior to administration [6]. Individual items assess symptoms commonly associated with depression and anxiety, and each is assessed on a five-point scale from 0 to 4, with increasing values corresponding to higher levels of distress. A total score is calculated by summing all items, ranging 0–40. Items are introduced with the statement, “The following questions ask about how you have been feeling during the past 30 days. For each question, please identify the best answer that describes how often you had this feeling.” Prior studies in the South African context have found cutoff values of 6 [9], 11.5 [10], and 18 [11] for current mood or anxiety disorder, and the scale has shown good internal consistency (Cronbach’s α = 0.84 [9], α = 0.87 [11], α = 0.89 [16], and α = 0.92 [17]). Cutoff values may vary based on the specific patient population being studied and may be further adjusted to balance sensitivity and specificity within the patient population in question. Other studies report brackets of total K-10 scores to discriminate between different severity levels of psychological distress, from mild to severe [16]. The above studies scored the K-10 from 10–50; therefore, reported cutoffs in this paper have been adapted to be consistent with a scale of 0–40.

Demographic characteristics

All participants enrolled in the study provided information on several demographic variables, including age, level of education, marital status, current living situation, and sex at birth. This was collected using encrypted tablets and uploaded to a secure cloud-based server.

Statistical analysis

We first used descriptive analyses [means and standard deviations (SDs) for continuous variables, and counts and percentages for categorical variables] to characterize the study sample. Next, we explored prevalence estimates of psychological distress using previously established cutoffs from other studies in South Africa and elsewhere [7, 16]. We assessed reliability (consistency) of the K-10 by calculating Cronbach’s alpha (> 0.8 considered acceptable) [22] and item-total correlations (> 0.2 considered significant)[23]. The coefficient omega total and coefficient omega hierarchical were also calculated, which are used to assess reliability of the general factor in a bifactor model [24]. In addition, we examined an aspect of construct validity through the factor structure of the K-10 by conducting a random split-sample EFA followed by CFA exploring several theoretical models and the EFA from the other split sample. CFA for the model derived from the EFA was conducted on the other half of the split-sample, whilst CFA for the other theoretical models was conducted on the full sample.

Before performing EFA, we assessed suitability of the data for performing factor analysis by calculating Bartlett’s test of sphericity [25] and the Kaiser–Meyer–Olkin measure of sampling adequacy [26]. We conducted the EFA extracted factors using a principal axis factoring with oblique rotation, which assumes correlation of variables. We used parallel analysis for polychoric factors with 50 iterations to investigate dimensionality. The number of factors retained for rotation was determined by the intersection point of the actual data plot with the simulated data plot [27]. Rotated factor loadings of > 0.3 were considered sufficient, while items with factor loadings ≥ 0.3 on more than one factor were considered cross-loading. For cross-loading items, the highest factor loading with the strongest correlation was used when assigning them to a single factor.

In the CFA, we examined results for the following four models: (1) a unidimensional model, (2) a unidimensional model with correlated errors, (3) a two-factor model with depression and anxiety as latent variables (similar to Sunderland, Mahoney, & Andrews, 2013) [15], and (4) this study’s EFA. To compare the four CFA models, we used the following metrics of model fit: a root mean square error of approximation (RMSEA) of ≤ 0.06, with a lower score indicating a better fit; a comparative fit index (CFI) of ≥ 0.90, with a higher score indicating a better fit; and a Tucker–Lewis index (TLI) of ≥ 0.90, with a higher score indicating a better fit [29, 30]. Models with scores that did not meet these thresholds were considered inadequate. Path diagrams were generated for graphical representation of factor loadings in each model. All statistical analyses were performed using Stata 15 [31]. All P values were two-sided and set at an alpha level of 0.05. CFA was conducted using diagonally weighted least squares (DWLS) to estimate the model parameters, and the full weight matrix used to compute robust standard errors, and a mean- and variance-adjusted test statistic.

Results

There were 2591 participants included in the analysis, most recruited from community clinics in Cape Town, Western Cape (n = 2423, 93.5%). The other 6.5% of participants were recruited from outpatient settings in other South African cities in the Eastern Cape, including Mthatha (n = 57) and Grahamstown (n = 95). Roughly half of participants were female (51.6%) and single (55.4%) (Table 1). A majority of participants were 18–44 years old (77.7%) and had at least some secondary level of education (91.2%).

Table 1 Participant demographics of South African sample population (N = 2591)

Scores for individual items were summed to give each participant a score out of 40, the distribution of which is represented in Fig. 1. A higher score indicates a greater likelihood of having psychological distress. We calculated prevalence proportions based on cut-off scores from prior studies of K-10 in South Africa and elsewhere [7, 16]. Only 1.7% of participants were likely to have a severe mental disorder based on a cutoff of 20 (n = 44). Using alternate cutoff scores of 6 and 10, the frequency of psychological distress was 32.6% (n = 842) and 14.9% (n = 384), respectively, and 85.1% (n = 2200) had a score of < 10.

Fig. 1
figure 1

Distribution of global K-10 scores. Scores are presented as the sum of all answers. Higher scores represent a higher likelihood of having a mental health disorder

Mean raw scores for each item were low across all items (Table 2). “Fatigue” had the highest mean score (0.86, SD = 1.09), and “so depressed” had the lowest mean score (0.13, SD = 0.51). Internal consistency was tested by calculating Cronbach’s alpha (⍺ = 0.84), which indicated good internal consistency (reliability) for the K-10 scale with this population. Removal of any question from the K-10 scale resulted in a lower Cronbach’s alpha, indicating that all items are worthy of retention. The coefficient omega hierarchical was calculated as 0.68 across all variables, and the omega total was 0.88. While there is no universally accepted guideline for adequate levels of omega reliability, omega hierarchical and omega total coefficients should exceed 0.50 at a minimum and values closer to 0.75 would be preferred [32].

Table 2 Item characteristics, item-total correlations, and ⍺ if item deleted from the K-10

EFA

Analyses testing suitability of the data showed that it was appropriate to proceed with factor analysis (Bartlett’s test of sphericity, χ2(45) = 4168.93; P < 0.001; Kaiser–Meyer–Olkin measure of sampling adequacy = 0.83). To conduct the EFA, the sample was randomly split into two datasets. Using EFA in the first subsample (N = 1295), we examined the data to assess scale dimensionality and item-factor loadings. Parallel analysis for polychoric factors with 50 iterations suggests four factors (Fig. 2).

Fig. 2
figure 2

Parallel analysis scree plot of the K-10. The number of factors retained from visual interpretation is 4 factors for EFA

Results of the EFA using an oblique rotation indicated a four-factor solution (Table 3). Two items, “depressed” (r = 1.024) and “so depressed” (r = 0.685) loaded on factor 1. Three items, “fatigue” (r = 0.379), “nervous” (r = 0.618) and “so nervous” (r = 0.985) loaded on factor 2. Two items, “restless” (r = 0.889) and “so restless” (r = 0.891) loaded on factor 3. The last three items, “lack of energy” (r = 0.501), “worthless” (r = 0.866) and “hopeless” (r = 0.744) loaded on factor 4. The four factors derived from EFA explained 63.9% of the total variance. Inter-factor correlations between factors 1 and 2 was 0.50, between factors 1 and 3 was 0.56, between factors 1 and 4 was 0.66, between factors 2 and 3 was 0.63, between factors 2 and 4 was 0.74 and between factors 3 and 4 was 0.61. There were no cross-loading items. Factor loadings for factors 1 and 3 appear to be quite high (e.g., “depressed” loading exceeds 1 at 1.024). Overall, this model does not appear to be parsimonious given that two factors have only two items each, and items seem to be grouped based on similar wording ("depressed” and “so depressed” on factor 1 and “restless” and “so restless” on factor 3).

Table 3 Factor loadings with oblique rotation for EFA of K-10

CFA

We estimated three theoretical models informed by the literature and one model informed by the EFA. The first three theoretical models were applied to the entire dataset (N = 2591). The other random split-half sample (n = 1296) was used to test the factor structures of the fourth model derived from the EFA. These models and respective factor loadings with errors are graphically represented as path diagrams (Fig. 3).

Fig. 3
figure 3

Path diagrams of the three tested theoretical structure models for the K-10 (models 1–3) and the model derived from EFA (model 4). Factor loadings are standardized estimates

The four models were tested for comparative fit (Table 4). Factor loadings for all models (as seen in Fig. 3) were acceptable and above the 0.4 cut-off. Model 4 derived from the EFA and tested using the other half of the split-sample showed the best fit indices (CFI = 0.97, TLI = 0.95, RMSEA = 0.06). A unidimensional model with correlated errors (Model 2) showed the second-best fit (CFI = 0.95, TLI = 0.93, RMSEA = 0.07). This model was composed of one factor, psychological distress, but incorporated correlated errors between the following pairs: “depressed” and “so depressed,” “restless” and “so restless,” “nervous” and “so nervous.” The other two models performed poorly across all fit indices, with CFI ≤ 0.90, TLI ≤ 0.90, and RMSEA ≥ 0.10. Model 1 was composed of one factor, psychological distress, loading onto all K-10 items. This model had poor overall fit (CFI = 0.79, TLI = 0.72, RMSEA = 0.14). Model 3 was composed of two factors, depression, and anxiety, and displayed poor fit overall (CFI = 0.82, TLI = 0.76, RMSEA = 0.13).

Table 4 Confirmatory factor analysis fit statistics for each of the four models

Discussion

Our main findings were that: (1) there were low levels of non-specific psychological distress in a South African urban and peri-urban outpatient setting, (2) the K-10 displayed good construct validity and reliability, and (3) a unidimensional model with correlated errors was the best-fitting model in our population based on both prior theory and research evidence and as indicated by the model fit indices. A four-factor model (derived from the EFA analysis of our data) displayed the best fit indices comparatively but produced a model solution that was likely due to methodological artifacts with similarly worded items converging together.

Overall, there were low levels of psychological distress in our sample. Most participants (85.1%) obtained a K-10 score less than 10, and only 1.7% of participants had a score higher than 20, which has been reported as a cutoff for severe psychological distress in South Africa [16]. We did not identify a cut-off score for our sample because we lacked a measure for criterion validity. However, we calculated prevalence proportions based on cut-off scores from prior studies in South Africa [7, 16]. Our findings showed lower levels of psychological distress compared with prior research in South Africa [11, 16, 17, 33, 34]. A previous study in a South African outpatient hospital demonstrated no significant distress in only 50.3% of participants [16]. The other 49.7% of participants scored greater than 10, and displayed higher levels of psychological distress compared to our study, with 17.1% of participants with scores greater than 20. Similar high levels were found in other clinical groups in South Africa, such as patients with tuberculosis [17], HIV-positive individuals [11], and antenatal women [10, 35]. The differences in overall levels of psychological distress in different clinical populations in South Africa may be due to medical condition-specific factors, or may be reflective of regional socioeconomic variability across South Africa [36]. Most of our sample was recruited from Cape Town and surrounding areas. On the other hand, our findings are similar to the prevalence of mild or moderate psychological distress with cutoff scores of 6 (32.5%) or 10 (14.8%) in other population-based studies in Australia [7]. Prevalence of low (85.1%) and severe (1.7%) levels of psychological distress in our sample is therefore consistent with non-clinical samples and is lower than clinical samples, which may be expected as our study was conducted among a diverse group of participants in outpatient settings. These include people seeking healthcare for themselves, caregivers bringing a friend or family member to a clinic, workers at a hospital/clinic, and people getting a prescription refill.

Regarding its psychometric properties, the K-10 demonstrated good construct validity and reliability when used among South African adults attending outpatient clinics. The overall Cronbach’s alpha was 0.84, which is consistent with other studies both in South Africa and other settings [6, 8, 9, 11, 14, 17, 35, 37]. In addition, the coefficient omega hierarchical was 0.68 across all variables, and the omega total was 0.88, both of which are close to the recommended 0.75 [32]. The EFA yielded a four-factor solution; this model produced the best-fitting indices across CFAs. However, inferences from the four-factor model in our study is limited as the model has fewer degrees of freedom and two of the factors have only two items with similar wording (i.e., “restless” and “so restless” on one factor and “depressed” and “so depressed” on another factor). Next to this four-factor model, the best-fitting model following CFA was a unidimensional model with correlated errors, which is also consistent with previous studies that showed a unidimensional model to be the best fit [3, 6, 15].

The K-10 was originally reported to have a unidimensional factor structure [6], similar to the abbreviated K-6 [3]. However, multidimensional factor structures have been suggested in several studies, including with a group of post-natal women in Ethiopia and a sample of patients with traumatic brain injury in Tanzania [8, 14, 15, 28, 37, 38]. However, this is the first investigation of the factor structure of the K-10 in South Africa. EFA yielded a four-factor structure, but the individual factor loadings were not consistent with previous multidimensional models derived from EFA in other countries [14, 15, 28, 38]. Overall, differences in factor structures across studies may be due to differences in cultural interpretation of depression and anxiety symptoms. Additionally, the variance explained by the four-factor model was only 63.9%. The low variance found in our study is indicative that the items on the K-10 may not be sufficiently explaining the model. Additional items incorporating local expressions of distress might help clarify the factor structures and improve the variance in the screening measure.

Multidimensional factor structures typically report an anxiety factor and a depression factor for two-dimensional models; however, these may be subdivided into a second-order factor structure wherein second-order anxiety is represented by a nervous factor and an agitation factor, and second-order depression is represented by a fatigue factor and a negative affect factor [38]. This is similar to the pattern of factor loadings in other two-factor models [14, 15, 28].

In our study, the pattern of association of individual items with either anxiety or depression was different. “Depressed” and “so depressed” loaded on a single factor representing depression. “Restless” and “so restless” also loaded on a single factor. “Nervous,” “so nervous” and “fatigue” loaded on a third factor, which may represent anxiety. Finally, “lack of energy,” “worthless” and “hopeless” loaded on a fourth factor. This combination differs from previous reports as it combines nervousness with fatigue rather than restlessness and shows a dissociation of psychological nervousness from physical restlessness in the factor loadings. Also, symptoms traditionally linked to depression such as lack of energy, worthlessness and hopelessness were loaded on a separate factor rather than being associated with the depression factor as reported in other studies [14, 15, 28, 38]. Though it is possible that these differences are due to cultural interpretations, translations, expression, or experience of depression and anxiety and their associated features within our study sample; a more likely interpretation is that the EFA represents measurement artifacts given that similarly worded items were grouped together.

While EFA yielded a four-factor structure, and CFA confirmed this to be the best-fitting model, a one-factor solution of non-specific psychological distress with correlated errors also showed good results with regards to fit indices and is consistent with prior studies [3, 6, 20, 39]. A unidimensional model with correlated errors appears to be a more appropriate model given its adequacy of fit and correlation with previous theory and research [3, 6, 15]. Studies in other countries have reported similar RMSEA values for a unidimensional model [15, 38], although multifactorial models have shown better fit in other countries, particularly in Australia [38, 40] and specifically in clinical populations [15]. Both unidimensional models and multidimensional models for the K-10 have shown adequate fit in other LMICs, such as Kenya, Tanzania, Ethiopia, and West Bank territory [8, 14, 20, 37, 39]. Next to the four-factor solution, our findings suggest a unidimensional model for the K-10 in South Africa, which is consistent with work on the K-6 [3], and helps confirm its construct validity within this context. The lack of prior, local studies investigating factor structure of the K-10 for comparison limits the contextual interpretation of our results.

Future directions and limitations

Previous studies in South Africa have been unable to determine a cutoff value for psychological distress that optimally balances sensitivity, specificity, and positive predictive value (PPV) for the K-10 [9]. These should be balanced, particularly in resource-constrained settings, to avoid misallocation of resources for false positives, ensure a low false negative rate, and reduce the likelihood of missing treatable psychopathology [35]. Future studies comparing the K-10 with a gold-standard diagnostic instrument for psychopathology, such as the CIDI, would help to establish cutoff scores for the K-10 in South Africa that optimally balance sensitivity, specificity, and PPV. An option in future studies could be to report a range of cutoff values, which would aid in interpreting the results, stratifying findings based on severity, and informing future cutoff scores in validation studies and may be clinically useful [41].

Findings from this study should be understood within its limitations. We report on factorial validity of K-10, which is one aspect of construct validity. Research on other methods to measure construct validity may also be needed to replicate our findings. In addition, other aspects of validity including convergent and criterion validity are not addressed and should be examined in future studies. Our study sample consisted of a diverse group of individuals as control participants, both healthcare seeking-populations and non-healthcare seeking-populations in a larger study, who may vary from the general population in unknown ways and may limit the generalizability of our findings. Despite these limitations, our study consisted of a large sample size and is the first of its nature to examine factor structure of K-10 in South Africa. Areas for further research include investigating differences between subgroups, including the presence or absence of medical comorbidities, recent potentially traumatic events, and language and ethnicity differences. Future studies may also compare the K-10 with gold-standard diagnostic instruments to further investigate criterion validity, including sensitivity and specificity of the K-10 in South Africa, and convergent validity by comparison with other tests.

Conclusion

The K-10 was appropriate for use as a tool to measure non-specific psychological distress among South African adults with adequate psychometric properties, good internal reliability, and good fit using a unidimensional model with correlated errors. This is consistent with previous work on the K-10 and K-6 in South Africa, Kenya and Ethiopia, and in other countries such as Australia. Future development of use of the K-10 in South Africa may include determining clinically significant cutoff values, addressing cultural elements, investigating the K-10 in different regions of South Africa and comparing the K-10 to other gold-standard diagnostic instruments to determine its clinical utility, sensitivity, and specificity in diverse populations. Further research is required to determine construct and criterion validity of the K-10 items incorporating local expressions of distress in the South African setting.

Availability of data and materials

This data will be made available through the United States’ National Institute of Mental Health Data Archive (NDA) through this website: https://nda.nih.gov/edit_collection.html?id=3805.

Abbreviations

CIDI:

Composite International Diagnostic Interview

CFA:

Confirmatory factor analysis

CFI:

Comparative fit index

DF:

Degrees of freedom

DSM-5:

Diagnostic and Statistical Manual of Mental Disorders-5

EFA:

Exploratory factor analysis

GWAS:

Genome-wide association study

IQR:

Inter-quartile range

K-6:

Kessler Psychological Distress Scale (6-item scale)

K-10:

Kessler Psychological Distress Scale (10-item scale)

LMICs:

Low- and middle-income countries

NeuroGAP:

Neuropsychiatric genetics of African populations

PPV:

Positive predictive value

RMSEA:

Root mean square error of approximation

SD:

Standard deviation

TLI:

Tucker–Lewis index

References

  1. Murray CJL, Vos T, Lozano R, Naghavi M, Flaxman AD, Michaud C, et al. Disability-adjusted life years (DALYs) for 291 diseases and injuries in 21 regions, 1990–2010: a systematic analysis for the Global Burden of Disease Study 2010. Lancet. 2012;380(9859):2197–223.

    Article  Google Scholar 

  2. Kohn R, Saxena S, Levav I, Saraceno B. The treatment gap in mental health care. Bull World Health Organ. 2004;82:858–66.

    PubMed  PubMed Central  Google Scholar 

  3. Kessler RC, Green JG, Gruber MJ, Sampson NA, Bromet E, Cuitan M, et al. Screening for serious mental illness in the general population with the K6 screening scale: results from the WHO World Mental Health (WMH) survey initiative. Int J Methods Psychiatr Res. 2010;19(Suppl. 1):4–22.

    Article  Google Scholar 

  4. Ramlall S. The Mental Health Care Act No 17—South Africa. Trials and triumphs: 2002–2012. Afr J Psychiatry (S Afr). 2012;15(6):407–10.

    Google Scholar 

  5. American Psychiatric Association, Association American Psychiatric. Diagnostic and statistical manual of mental disorders: DSM-5. 5th ed. Arlington: American Psychiatric Association; 2013.

    Book  Google Scholar 

  6. Kessler RC, Andrews G, Colpe LJ, Hiripi E, Mroczek DK, Normand SLT, et al. Short screening scales to monitor population prevalences and trends in non-specific psychological distress. Psychol Med. 2002;32(6):959–76.

    Article  Google Scholar 

  7. Andrews G, Slade T. Interpreting scores on the Kessler Psychological Distress Scale (K10). Aust N Z J Public Health. 2001;25(6):494–7.

    Article  Google Scholar 

  8. Vissoci JRN, Vaca SD, El-Gabri D, de Oliveira LP, Mvungi M, Mmbaga BT, et al. Cross-cultural adaptation and psychometric properties of the Kessler Scale of Psychological Distress to a traumatic brain injury population in Swahili and the Tanzanian Setting. Health Qual Life Outcomes. 2018;16(1):4–11.

    Article  Google Scholar 

  9. Andersen LS, Grimsrud A, Myer L, Williams DR, Stein DJ, Seedat S. The psychometric properties of the K10 and K6 scales in screening for mood and anxiety disorders in the South African Stress and Health study. Int J Methods Psychiatr Res. 2011;20(4):215–23.

    Article  Google Scholar 

  10. Spies G, Stein DJ, Roos A, Faure SC, Mostert J, Seedat S, et al. Validity of the Kessler 10 (K-10) in detecting DSM-IV defined mood and anxiety disorders among pregnant women. Arch Womens Ment Health. 2009;12(2):69–74.

    Article  Google Scholar 

  11. Spies G, Kader K, Kidd M, Smit J, Myer L, Stein DJ, et al. Validity of the K-10 in detecting DSM-IV-defined depression and anxiety disorders among HIV-infected individuals. AIDS Care. 2009;21(9):1163–8.

    Article  Google Scholar 

  12. Kawakami N, Tran TTT, Watanabe K, Imamura K, Nguyen HT, Sasaki N, et al. Internal consistency reliability, construct validity, and item response characteristics of the Kessler 6 scale among hospital nurses in Vietnam. PLoS ONE. 2020;15(5):1–15.

    Article  Google Scholar 

  13. Fassaert T, De Wit MAS, Tuinebreijer WC, Wouters H, Verhoeff AP, Beekman ATF, et al. Psychometric properties of an interviewer-administered version of the Kessler Psychological Distress scale (K10) among Dutch, Moroccan and Turkish respondents. Int J Methods Psychiatr Res. 2009;18(3):159–68.

    Article  Google Scholar 

  14. Easton SD, Safadi NS, Wang Y, Hasson RG. The Kessler psychological distress scale: translation and validation of an Arabic version. Health Qual Life Outcomes. 2017;15(1):1–7.

    Article  Google Scholar 

  15. Sunderland M, Mahoney A, Andrews G. Investigating the factor structure of the Kessler Psychological Distress Scale in community and clinical samples of the Australian population. J Psychopathol Behav Assess. 2012;34(2):253–9.

    Article  Google Scholar 

  16. Peltzer K, Pengpid S, Skaal L. Prevalence of psychological distress and associated factors in urban hospital outpatients in South Africa. S Afr J Psychiatry. 2012;18(1):10–5.

    Google Scholar 

  17. Peltzer K, Naidoo P, Matseke G, Louw J, Mchunu G, Tutshana B. Prevalence of psychological distress and associated factors in tuberculosis patients in public primary care clinics in South Africa. BMC Psychiatry. 2012;12(1):89.

    Article  Google Scholar 

  18. Ayana TM, Roba KT, Mabalhin MO. Prevalence of psychological distress and associated factors among adult tuberculosis patients attending public health institutions in Dire Dawa and Harar cities, Eastern Ethiopia. BMC Public Health. 2019;19(1):1392.

    Article  Google Scholar 

  19. Hanlon C, Medhin G, Selamu M, Breuer E, Worku B, Hailemariam M, et al. Validity of brief screening questionnaires to detect depression in primary care in Ethiopia. J Affect Disord. 2015;186:32–9.

    Article  Google Scholar 

  20. Ongeri L, Ametaj A, Kim H, Stroud RE, Newton CR, Kariuki SM, et al. Measuring psychological distress using the K10 in Kenya. J Affect Disord. 2022;303:155.

    Article  Google Scholar 

  21. Stevenson A, Akena D, Stroud RE, Atwoli L, Campbell MM, Chibnik LB, et al. Neuropsychiatric genetics of african populations-psychosis (NeuroGAP-Psychosis): a case-control study protocol and GWAS in Ethiopia, Kenya, South Africa and Uganda. BMJ Open. 2019;9(2):e025469.

    Article  Google Scholar 

  22. Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychom. 1951;16(3):297–334.

    Article  Google Scholar 

  23. Piedmont RL. Inter-item correlations. Encycl Qual Life Well-Being Res. 2014;3303–4.

  24. McDonald R. Test theory: a unified treatment. Hillsdale: Erlbaum; 1999.

    Google Scholar 

  25. Bartlett M. Tests of significance in factor analysis. Br J Stat Psychol. 1950;3(2):77–85.

    Article  Google Scholar 

  26. Kaiser H, Rice J. Little Jiffy, Mark Iv. Educ Psychol Meas. 1974;34:111–7.

    Article  Google Scholar 

  27. Schermelleh-Engel K, Moosbrugger H, Müller H. Evaluating the fit of structural equation models: tests of significance and descriptive goodness-of-fit measures. MPR-Online. 2003;8:23–74.

    Google Scholar 

  28. Sunderland M, Mahoney A, Andrews G. Erratum: Investigating the factor structure of the Kessler psychological distress scale in community and clinical samples of the Australian population (Journal of Psychopathology. 2012;34:253-259). J Psychopathol Behav Assess. 2013;35(4):603–4.

    Article  Google Scholar 

  29. Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model. 1999;6(1):1–55.

    Article  Google Scholar 

  30. Bentler PM. Comparative fit indexes in structural models. Psychol Bull. 1990;107(2):238–46.

    Article  Google Scholar 

  31. StataCorp. Stata statistical software: release 15. College Station: StataCorp LLC; 2017.

    Google Scholar 

  32. Reise SP, Bonifay WE, Haviland MG. Scoring and modeling psychological measures in the presence of multidimensionality. J Pers Assess. 2013;95(2):129–40.

    Article  Google Scholar 

  33. Deribew A, Tesfaye M, Hailmichael Y, Apers L, Abebe G, Duchateau L, et al. Common mental disorders in TB/HIV co-infected patients in Ethiopia. BMC Infect Dis. 2010;10(1):1–8.

    Article  Google Scholar 

  34. Tola HH, Shojaeizadeh D, Garmaroudi G, Tol A, Yekaninejad MS, Ejeta LT, et al. Psychological distress and its effect on tuberculosis treatment outcomes in Ethiopia. Glob Health Action. 2015;8(1):29019.

    Article  Google Scholar 

  35. Van Heyningen T, Honikman S, Tomlinson M, Field S, Myer L. Comparison of mental health screening tools for detecting antenatal depression and anxiety disorders in South African women. PLoS ONE. 2018;13(4):1–18.

    Google Scholar 

  36. Statistics South Africa. Men, women and children findings of the living conditions survey 2014/2015. Pretoria; 2018. https://www.statssa.gov.za/publications/Report-03-10-02/Report-03-10-022015.pdf.

  37. Tesfaye M, Hanlon C, Wondimagegn D, Alem A. Detecting postnatal common mental disorders in Addis Ababa, Ethiopia: validation of the Edinburgh Postnatal Depression Scale and Kessler Scales. J Affect Disord. 2010;122:102–8.

    Article  Google Scholar 

  38. Brooks RT, Beard J, Steel Z. Factor structure and interpretation of the K10. Psychol Assess. 2006;18(1):62–70.

    Article  Google Scholar 

  39. Milkias B, Ametaj A, Alemayehu M, Girma E, Yared M, Kim HH, et al. Psychometric properties and factor structure of the Kessler-10 among Ethiopian adults. J Affect Disord. 2022;303:180–6.

    Article  Google Scholar 

  40. Berle D, Starcevic V, Milicevic D, Moses K, Hannan A, Sammut P, et al. The factor structure of the Kessler-10 questionnaire in a treatment-seeking sample. J Nerv Ment Dis. 2010;198(9):660–4.

    Article  Google Scholar 

  41. Manea L, Gilbody S, McMillan D. Optimal cut-off score for diagnosing depression with the Patient Health Questionnaire (PHQ-9): a meta-analysis. CMAJ. 2012;184(3):E191–6.

    Article  Google Scholar 

Download references

Acknowledgements

This research was supported by the Stanley Center for Psychiatric Research at Broad Institute of MIT and Harvard. The authors thank all dedicated members of the NeuroGAP-Psychosis team across all sites for their technical assistance as well as the participants who made this work possible.

Funding

The NeuroGAP-Psychosis study was funded by the Stanley Center for Psychiatric Research at Broad Institute of MIT and Harvard. RS, AS, DJS, and BG are supported in part by the National Institute of Mental Health (NIMH) (R01MH120642 and U01MH125045). AA is supported by NIMH T32MH017119. NIMH had no role in the study design, data collection, analysis, or interpretation, writing of the report, or the decision to submit the article for publication.

Author information

Authors and Affiliations

Authors

Contributions

JH was the main contributor to the writing of the manuscript. JH, AA and HK conducted statistical analyses. JH, AA, and BG drafted the manuscript. BG helped with conceptualization of paper. All authors (JH, QC, AA, HK, RJ, RES, AS, ZZ, DJS and BG) interpreted the data, critically revised the draft for important intellectual content, read, edited, and approved the final manuscript.

Corresponding author

Correspondence to Jacob Hoffman.

Ethics declarations

Ethical approval and consent to participate

Ethical approval to conduct this study was obtained from all participating sites, including the University of Cape Town Human Research Ethics Committee (REF# 466/2016), the Western Cape Government (WC_2016RP32_349), and the Walter Sisulu University Research and Ethics Committee (SOMREC #REC REF 2016-057) in South Africa and the Harvard T.H. Chan School of Public Health (#IRB17-0822) in the United States. All experimental protocols were approved by the above-named institutions and/or ethics committees. Informed consent was obtained from all study participants and all experiments were conducted in accordance with the relevant guidelines and regulations.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hoffman, J., Cossie, Q., Ametaj, A.A. et al. Construct validity and factor structure of the Kessler-10 in South Africa. BMC Psychol 10, 177 (2022). https://doi.org/10.1186/s40359-022-00883-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s40359-022-00883-9

Keywords