South Korean validation of the COVID-related-PTSD scale in a non-clinical sample exposed to the COVID-19 pandemic
BMC Psychology volume 10, Article number: 135 (2022)
The threat of COVID-19 outbreak in South Korea and around the globe challenged not only physical health but also mental health, increasing the chances of disorders such as posttraumatic stress disorder (PTSD). Such pandemic situation can be referred to a traumatic event for citizens. The present study aims to examine the psychometric properties of the PTSD Checklist (PCL-5), which is named the K-COVID-related-PTSD. The scale measures PTSD symptomology in the context of the COVID-19 pandemic in South Korea. A total of 1434 South Korean citizens were included in this study. The data were statistically analyzed using SPSS 21.0 and Mplus 8.0. The results of confirmatory factor analysis demonstrated a superior fit for the seven-factor hybrid model (x2 = 1425.445 (df = 149), CFI = 0.950, TLI = 0.937, SRMR = 0.033, RMSEA = 0.077) consisting of re-experiencing, negative affect, anxious arousal, dysphoric arousal, avoidance, anhedonia, and externalizing behaviors. Furthermore, the K-COVID-related-PTSD showed a satisfactory level of internal consistency (α = 0.793 to α = 0.939) with good convergent and discriminant validity. Finally, concurrent validity was confirmed by the significant correlations with all the negative mental health outcomes, such as PTSD symptoms, somatization, depression, anxiety, anger, negative affect, job burnout, and suicidal ideation. Overall, the current results demonstrate the K-COVID-related-PTSD is a valid scale and therefore has important implications for future pandemic-related studies.
The COVID-19 outbreak was declared a pandemic by the World Health Organization (WHO) on March 11, 2020, and the disease continues to cause significant damage worldwide. In response to the pandemic crisis, health organizations and ministries have adopted several non-pharmacological measures, such as social/physical distancing and lockdowns, isolation of COVID-19 positive and suspected COVID-19 patients, and quarantine of exposed individuals. While these efforts have reduced the spread of COVID-19, isolation and social distancing have negatively impacted the mental health of many individuals [1, 2]. Apart from the physical toll of the disease itself, individuals experience psychological distress due to traumatic stressors related to isolation, disturbed routines, and family and social life (e.g., loss of family and loved ones due to COVID-19) . In particular, several studies have shown that individuals may experience the spread of COVID-19, and social distancing and self-quarantine measures are instituted to mitigate its spread as a traumatic stressor [4, 5]. Notably, trauma exposure is the primary etiologic risk factor for many mental illnesses, including posttraumatic stress disorder (PTSD).
PTSD refers to specific negative symptoms that might occur in individuals after exposure to one or more traumatic events . Although the rate of PTSD in the general population is between 5 and 10%, its incidence can be as high as 45.9% among direct victims of disasters [7, 8]. During previous serious infectious disease outbreaks, the prevalence of PTSD ranged from 40 to 76%. A survey of survivors 3 years after the SARS epidemic in Hong Kong and China showed that over 40% of them displayed symptoms of PTSD . In addition, results from a 1-year follow-up study of Ebola-infected patients in Sierra Leone documented a PTSD diagnosis rate of 76% . With regard to South Korean samples, 41.7% of Middle East respiratory syndrome survivors displayed PTSD symptoms 12 months after their diagnosis . As such, a pandemic of an unrecognized infection can be defined as a traumatic experience of acute and chronic effects at the individual and community levels. The fear of contagion and the risk of death for oneself and loved ones refers to a direct threat. In addition, indirect consequences were found to result in comorbid conditions including psychological distress, mood disorders, and general psychological symptoms of PTSD. Moreover, previous studies on the COVID-19 pandemic have found that a high risk of developing PTSD is not only valid in survivors, victim families, healthcare workers, and individuals with direct contact with infection, but also in the general population subjected to prolonged restrictive measures .
PTSD is classified as a type of trauma- and stressor-related disorder according to the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5). Specific criteria focused on identifying the causes and symptoms are required for the diagnosis of PTSD. PTSD can be diagnosed after exposure to a traumatic event and includes four specific dimensions (re-experiencing the trauma, avoiding reminders of the trauma, negative alterations in cognitions and mood, and alterations in arousal and reactivity) . Following this criterion, the PCL-5 is one of the most studied screening instruments for adults at risk of developing PTSD. Initially, it was developed with four sub-factors (re-experiencing, avoidance, negative alterations in cognition and mood, and alterations in arousal). However recent PCL-5 studies have shown that PTSD symptoms can be described as having as many as six or seven factors [13,14,15,16]
The anhedonia model, as proposed by a Chinese study from a sample of the Wenchuan earthquake, has six factors: intrusion, avoidance, negative affect, anhedonia, dysphoric arousal, and anxious arousal . This model separates negative alterations in cognition and mood factors into two distinct factors representing changes in negative versus positive affect. Similarly, the seven-factor hybrid model suggested by Armour et al.  was integrated from several six-factor models, distinguishing “externalizing behavior” as a factor in PTSD. This seven-factor hybrid model consisted of the following factors: re-experiencing, negative affect, anxious arousal, dysphoric arousal, avoidance, anhedonia, and externalizing behaviors. However, research on veterans showed mixed results, in which PTSD symptoms were derived as a single factor .
Based on these models, research on PCL-5 validation has been conducted in different countries in relation to various traumatic experiences and has compared different factor models based on their psychometric adequacy. Previous CFA studies have shown that the DSM-5 four-factor model is the best-fitting model in countries such as Brazil , Germany , Turkey , and Malaysia . In addition, the six-factor model was found to fit well in Bangladesh (Islam et al. 2021) and the Netherlands , while the seven-factor model displayed a superior fit in France , Italy , and the Netherlands . In South Korea, a previous validation study with Vietnam War veterans supported the superiority of the single-factor model , while the seven-factor hybrid model was found to be the most appropriate in another PCL-5 validation study with adults .
Several psychiatric comorbidities have been reported in disaster situations. Previous research has found that anxiety, depression, anger, and stress are common comorbid clinical conditions associated with PTSD symptoms. Moreover, suicidal thoughts and job burnout appear when continuously exposed to infectious and disaster situations [26,27,28,29,30,31,32,33]. However, we are unaware of any research that has examined the dimensional structure of the PCL-5 and its association with other mental health outcomes among South Koreans during the COVID-19 pandemic. Therefore, to confirm the validity of the Korean version of the PCL-5, the correlation between PTSD symptoms and related variables, as well as the K-COVID-related-PTSD scale, which measures PTSD symptoms, was analyzed. This study is important because it not only develops a Korean version of the COVID-related-PTSD scale but also estimates the total score that represents the overall severity of PTSD in Korean society due to the COVID-19 pandemic. Considering the unique characteristics of the COVID-19 pandemic in South Korea, this study aimed to examine the psychometric properties of the PCL-5.
The first goal of the current research was to assess the psychometric properties of the COVID-related-PTSD scale, which was designed to investigate the severity of PTSD symptoms in the South Korean population during the COVID-19 crisis. This assessment was performed by testing the scale’s factorial structure (one, four, six, or seven factors) using a CFA approach. The second goal was to examine its reliability and concurrent validity by exploring the relationship between COVID-related-PTSD and variables related to pandemic situations such as PTSD, somatization, stress, depression, anger, negative affect, fear, distrust, job burnout, satisfaction with life, and suicidal ideation.
This study used a national sample by implementing an online survey based on the South Korean population census standard in 2018, including age, gender, and residential area. Initially, 2440 individuals entered the survey and 988 participants who did not meet the criterion of the present study or did not complete the survey were excluded, indicating completion rate of 59.5%. Lastly, 18 participants were excluded due to careless responses by screening partially random or inattentive data. Thus, a total of 1434 participants were used for the final analysis. Among the total sample, 731 (51%) were men and 703 (49%) were women. The mean age of the participants, who ranged from 19 to 84 years of age, was 44.34 (SD = 13.93). All participants met the following eligibility criteria: They were able to read and write Korean proficiently, were able to provide informed consent, and were aged 19 years or older. Table 1 provides detailed sociodemographic information as well as COVID-19-related information of the total sample.
The survey was conducted via an Internet survey company between February 19 and March 3, 2021. The number of confirmed COVID-19 cases and deaths in South Korea during the survey period were 91,236 and 1612, respectively. During this period, government regulations that mandated social distancing, banned private gatherings of more than five individuals, and ensured that restaurants and bars were closed after 10 pm were in place in the nation’s capital area. In addition, the AstraZeneca and Pfizer vaccination campaigns had begun in Hong Kong, Nepal, the United States, and Japan for high-risk groups (e.g., people with chronic diseases, medical staff, and older adults). The participants were assured that their data would remain confidential and anonymous, and their informed consent for participating in this study was subsequently taken. The survey took approximately 20–30 min to complete, and online credit points of around 3 US dollars that can be converted into cash were provided to the participants as compensation. The questionnaire consisted of two sections. The first section asked about participants’ sociodemographic information, including sex, occupation, residential area, socio-economic level based on the OECD standards of the middle class, and household types as well as COVID-19-related experiences. The second section included the PCL-5 and different sociological and psychological scales. The survey company is certified by ISO 9001, indicating that it meets the most recognized quality management system standards. To ensure the security of the survey, the company used a firewall (WAF) and the DigiCert security service. Moreover, all survey responses were collected through an encrypted secure socket layer (SSL), which enabled authentication, encryption, and decryption of data. Finally, all data were removed securely once the operation of the system expired. The current study was approved by the Institutional Review Board (IRB) of the university to which the researchers were affiliated, and all methods were performed in accordance with the relevant guidelines and regulations.
To measure the level of the participants’ PTSD symptoms, we used the Korean version  of the PTSD Checklist (PCL-5)  which later applied the diagnostic criteria of the DSM-5 . The PCL-5 has 20 items, and the sub-factors are re-experiencing (five items; e.g., “painful and unwanted memories about the stressful experience repeatedly come to mind”); avoidance (two items; e.g., “avoiding memories, thoughts, or emotions related to the stressful experience”); negative alterations in cognition and mood (seven items; e.g., “difficulty remembering important parts of the stressful experience”); and hyperarousal (six items; e.g., “nervousness, anger, externalizing behavior, or explosive/aggressive behavior”). Responses are provided using a 5-point Likert scale that ranges from “not at all” (0 points) to “very much” (4 points). Higher scores indicate more severe PTSD symptoms. According to a recent South Korean PCL-5 validation study by Lee et al. , Cronbach’s alpha coefficients were 0.90, 0.87, 0.91, and 0.92 for re-experiencing, avoidance, negative alterations in cognitions and mood, and hyperarousal, respectively. In this study, the PCL-5 showed good internal consistency with Cronbach’s alpha coefficients of 0.93, 0.88, 0.90, and 0.91, and composite reliability (CR) of 0.94, 0.88, 0.90, and 0.91 for re-experiencing, avoidance, negative alterations in cognitions and mood, and hyperarousal, respectively.
In this study, we used the Korean version of the PC-PTSD-5 (K-PTSD-5) scale developed by Yum  to screen for PTSD symptoms. Originally, the PC-PTSD-5 scale was developed by Prins et al.  and revised by Prins et al. . The K-PTSD-5 consists of five items as a single factor, with items scored dichotomously as either “yes” (1 point) or “no” (0 point). Higher scores indicate a higher risk of symptoms, and the cutoff point for high-level PTSD symptoms was estimated to be 3. The Cronbach’s alpha coefficient of K-PC-PTSD-5 was 0.73, and in this study was 0.66.
The revised Patient Health Questionnaire (PHQ-15) by Kroenke, Spitzer, and Williams (2002) was used to assess the pattern and severity of the physical symptoms . The PHQ-15 consists of 15 items extracted from the PHQ . Each item is scored on a 3-point Likert scale ranging from “not bothered at all” (0 points) to “very distressed” (2 points). The cumulative score ranged from 0 to 45, with a higher score indicating a higher level of physical symptoms. Cronbach’s alpha coefficient of the Korean version of the PHQ-15 was 0.73 . In this study, Cronbach’s alpha coefficient was 0.87.
The Center for Epidemiological Studies Depression Scale (CES-D), a self-reporting simple screening test tool developed by the American Institute of Mental Health (1971) and validated by Radloff , was used to examine the participants’ level of depression. The scale was originally validated by Cho and Kim  and the short Korean version of the CES-D-10 was standardized by Shin . The scale consists of ten items, and participants were asked to answer questions pertaining to the symptoms of depression experienced over the past week, with either “yes” (1 point) or “no” (0 points). The cutoff point that indicated a significant level of depression was estimated to be 3. According to Shin , Cronbach’s alpha coefficient was 0.79. In this study, Cronbach’s alpha coefficient was 0.83.
The Generalized Anxiety Scale (GAD-7), developed by Spitzer et al.  and later validated in Korean by Seo and Park , was used to identify the anxiety level of the participants and probable cases of generalized anxiety disorder. Seven items that asked about participants’ anxiety and worries related to the COVID-19 crisis were rated using a 4-point Likert scale ranging from “not at all” (0 points) to “nearly every day” (3 points). A higher total score indicates a higher severity of anxiety symptoms, with an optimal cutoff point of 5. Of a total score of 21, 5 or more, 10 or more, and 15 or more are classified as mild, moderate, and severe anxiety symptoms, respectively. In the validation study conducted by Seo and Park , the Cronbach’s alpha coefficient was 0.92. In this study, it was 0.93.
The Dimensions of Anger Reactions-5 (DAR-5) scale, which was developed by Forbes et al. , was used to measure the level of anger symptoms. It was first translated into Korean by bilingual researchers and later back-translated by a professor of counselling and Ph.D. researchers. Discrepancies were noted and discussed until the final version was completed. It has five items: frequency, intensity, duration, aggression, and interference with social relations. On the original scale, participants were asked to respond while recalling their daily lives over the past 4 weeks. However, in this study, participants responded while thinking about the difficulties they experienced in their daily lives during the COVID-19 pandemic to measure individual anger symptoms. The participants responded using a 5-point Likert scale ranging from “none of the time” (1 point) to “all of the time” (5 points). Higher scores reflected worse anger symptoms. Cronbach’s alpha coefficient for all items of the original DAR-5 was 0.90, indicating a high level of reliability. In this study, Cronbach’s alpha coefficient was 0.91.
The Positive and Negative Affect Schedule (PANAS) scale, which was developed and validated by Hong  based on circumstances in Korea, was used. The PANAS is a widely used checklist that reflects two subscales containing 11 items of positive affect and 11 items of negative affect. Each item is scored on a 5-point Likert scale ranging from “not at all” (1 point) to “very much” (5 points). As this study aimed to measure the negative affect of citizens during the COVID-19 crisis, 11 items of negative affect were extracted for use. Cronbach’s alpha coefficient of the Korean version of the PANAS  was 0.90. In this study, Cronbach’s alpha coefficient was 0.93.
We used the Maslach Burnout Inventory-General Survey (MBI-GS) developed by Schaufeli  to measure job burnout. The original MBI-GS consists of 16 items, including five items that measure exhaustion, five items that measure cynicism, and six items that measure professional efficacy. A validation study of the South Korean version  that consisted of only 15 items was conducted, and the remaining item was translated and back-translated by Ph.D.-level researchers. All items are scored on a seven-point scale; higher scores on exhaustion and cynicism and lower scores on professional efficacy indicate a higher level of burnout. In Shin’s  study, Cronbach’s alpha coefficients for exhaustion, cynicism, and professional efficacy were 0.90, 0.81, and 0.86, respectively. In this study, Cronbach’s alpha coefficients for exhaustion, cynicism, and professional efficacy were 0.92, 0.90, and 0.92, respectively.
To assess the degree of suicidal ideation, a Korean validation study  of the Depressive Symptom Inventory-Suicidality Subscale (DSI-SS), a subscale of the Hopelessness Depression Symptom Questionnaire , was used. The items were about the frequency, intensity, controllability, and content of the suicidal thoughts. Each item is rated on a 4-point Likert scale (0–3 points), and the total score ranges from 0 to 12 points. Higher scores are indicative of greater severity of suicidal ideation. Cronbach’s alpha coefficient of the Korean version of the DSI-SS was 0.93. In this study, Cronbach’s alpha coefficient was 0.95.
Descriptive statistics were used to analyze the participants’ characteristics, and a normality test was subsequently conducted to determine if the data followed a normal distribution, followed by item-total correlation analysis. Subsequently, CFA was conducted to evaluate four potential structural models of the K-COVID-PTSD scale based on theoretical and empirical evidence of PTSD. First, a single-factor model, in which all items were loaded onto one general factor, was tested. The DSM-5 four-factor model, which included re-experiencing, avoidance, negative alterations in cognition and mood, and hyperarousal, was tested next. We then examined the third model, a six-factor anhedonia model that consisted of re-experiencing, negative affect, anxious arousal, dysphoric arousal, avoidance, and anhedonia. Finally, we tested a seven-factor model suggested by Armour et al. , which included re-experiencing, avoidance, negative affect, anhedonia, externalizing behavior, anxious arousal, and dysphoric arousal. A CFA was conducted using maximum likelihood (ML) estimation. Model fit indices were examined using the chi-square test, comparative fit index (CFI), Tucker-Lewis index (TLI), standardized root mean square residual (SRMR), and root mean square error of approximation (RMSEA). 0.90 or higher for the TLI and CFI values is regarded as a satisfactory fit , and lower SRMR values are desirable . Values of < 0.08 are within the acceptable range for RMSEA, and values of ≤ 0.06 show a close fit to the data. Additionally, the Akaike information criterion (AIC) and Bayesian information criteria (BIC) indices were used to compare the different models [56, 57]. Next, the reliability analysis was followed by a Cronbach’s alpha analysis. Next, the reliability analysis was followed by a Cronbach’s alpha analysis. A Cronbach’s alpha value of 0.7 and above is considered to indicate good internal reliability. Additionally, convergent validity was assessed by composite reliability (CR) and average variance extracted (AVE). The acceptable value of CR and AVE is 0.7 and 0.5, respectively [58, 59]. The discriminant validity through chi-square difference analysis was assessed. The differences larger than 3.84 indicate a significant level of discriminant validity. Lastly, the concurrent validity of the scale was verified via Pearson correlations between measures of PTSD, somatization, depression, anxiety, posttraumatic anger, negative affect, job burnout, and suicidal ideation, respectively. The data were statistically analyzed using SPSS 21.0 and Mplus 8.0.
The normality test was performed by calculating the mean, standard deviation, skewness, and kurtosis. The skewness ranged from 314 to 1.371, and the kurtosis ranged from − 0.956 to 0.738. The values of both skewness and kurtosis were below the absolute values of skewness ( ≤|2.0|) and kurtosis ( ≤|4.0|) , indicating that the items followed a normal distribution. Also, all items must be properly correlated with the total scale to maintain the scale's homogeneity while utilizing the measurement tool. As indicated in Table 2, correlations varied from 0.621 to 0.810 (p < 0.01), which deemed appropriate, indicating a value over 0.50.
In the CFA, the parameters for the measurement model were estimated using the ML method with Mplus 8.0. The fit of each model was evaluated using SRMR, RMSEA, and TLI, which are indices that favor simplicity without being affected by the sample size, and CFI, a goodness-of-fit index that is less sensitive to the sample size and measures the error of the model (see Table 3). An RMSEA and SRMR of less than 0.08, and a CFI and TLI of 0.90 or more are considered to be adequate model fits. The CFA revealed that the value of the one-factor model was 4866.417 (df = 170, p < 0.001; CFI = 0.818, TLI = 0.796, RMSEA = 0.139, and SRMR = 0.066), indicating that the model was inadequate. The CFA of the DSM four-factor model presented a value of 2678.033 (df = 164, p < 0.001); CFI = 0.902, TLI = 0.887, RMSEA = 0.103), indicating that this model was also inadequate. The six-factor model showed adequate CFI, TLI, and SRMR values of 0.902, 0.925, and 0.035, respectively, but inadequate RMSEA value of 0.084. However, the value of the seven-factor model was 1425.445 (df = 149, p < 0.001; CFI = 0.950, TLI = 0.937, RMSEA = 0.077), indicating adequate to good fit indices. Additionally, the AIC value (63,648.541) for the seven-factor model was lower than that of the one-factor (67,047.512), four-factor (64,871.128), and six-factor models (63,948.969), indicating a better comparative fit. In addition, considering the BIC value, the model with the lowest absolute value of BIC became the optimal model , indicating that the seven-factor model showed the lowest BIC index, with the difference being greater than 10 . On the basis of these considerations, a seven-factor model was selected. Confirmation of the factor loadings revealed that the factor loading of the items was 0.5 or more in all models, which was also appropriate (see Table 3).
The items of each model of K-COVID-related-PTSD exhibited high internal reliability (see Table 4). The Cronbach’s alphas for the subscales were all good and adequate, considering the single-factor model (Cronbach’s α = 0.965), the DSM-5 four-factor model (Cronbach’s α = 0.881–0.939), and the seven-factor model (Cronbach’s α = 0.793–0.939). In addition, the correlations between the subscales of the selected seven-factor model fell within the recommended level, ranging from 0.524 to 0.792 . Overall, this reflected the independence and multidimensionality of each subscale. Additionally, the AVE and CR were checked to verify the convergent validity of the seven-factor model, which was found to be the most suitable for the factor structure of K-COVID-related-PTSD. The results showed that the CR values were all higher than the AVE values, with values higher than 0.7, indicating good convergent validity of the scale [58, 63].
As a result of conducting a chi-square difference test to confirm discriminant validity, the difference between all sub-factors of K-COVID-related-PTSD showed a value much higher than the 3.84 threshold, indicating each subscale acting as a distinct concept (see Table 5). Overall, these reflect the independence and multidimensionality of each subscale.
The significant correlations were found between K-COVID-related-PTSD and other related variables, as well as the CI value of each correlation. Regarding the effect size, the value fell between 0.103 and 0.408, interpreted as small to moderate level. As presented in Table 6, The K-COVID-related-PTSD and its subscales displayed a strong positive correlation with PTSD symptoms, somatization, depression, anxiety, and anger. Additionally, the full scale and its subscales displayed a comparatively low positive correlation with negative affect, job burnout, and suicidal ideation.
The outbreak of the COVID-19 pandemic worldwide was a traumatic event that challenged individuals’ physical and mental health, highlighting the importance of managing disorders such as PTSD. The aim of this study was to examine the psychometric properties of the PCL-5 scale, which investigates PTSD symptomology, in the context of the COVID-19 pandemic in South Korea. The results revealed that the seven-factor COVID-related-PTSD scale exhibited superior fit indices with good internal reliability, good convergent and discriminant validity, and concurrent validity, thereby demonstrating that it is psychometrically sound and culturally relevant.
The results of this study supported the seven-factor model by comparing it with the single-factor, four-factor, and six-factor models in the context of COVID-19. Equivalent factor models were extracted in Italy and China during the COVID-19 outbreak [12, 64]. However, based on studies on the use of the PCL-5 in relation to various kinds of traumatic events such as transportation accidents, exposure to war, financial crises, and bereaved experiences, varying factor solutions were yielded. Other studies with individuals who were injured in car and motor vehicle accidents [23, 65] and individuals who were exposed to lifetime traumatic events [20,21,22] found the four-factor model to be the best fit. A South Korean study on PCL-5 with Korean veterans of the Vietnam War supported a one-factor model . However, it is difficult to generalize the results because of the specificity of the study sample. Recently, a study conducted with the South Korean national survey data supported a seven-factor model, which is in line with the results of the present study even though the type of traumatic event differed . Moreover, many recent PCL-5 studies have shown that PTSD symptoms can be further subdivided into six- or seven-factor models [13,14,15,16]. Considering the previous results of both the original PCL-5 scale and pandemic-specific scale, the results of the present study appear to be reasonable. Furthermore, K-COVID-related-PTSD demonstrated good convergent and discriminant validity. As suggested by Ashbaugh et al. , the seven-factor model best describes and covers all the PTSD symptoms with each subscale independently measuring according to the targeted content.
The concurrent validity of the K-COVID-related-PTSD was satisfactory in that all of the variables (PTSD, somatization, depression, anxiety, traumatic anger, negative affect, job burnout, and suicidal ideation) were positively correlated with the complete scale as well as all seven subscales. This result is consistent with the previous validation studies of the PCL-5, which illustrated that negative psychological variables were closely related to and coexisted with PTSD symptoms [12, 22, 66, 67]. Moreover, previous studies have found that variables such as job burnout and suicidal ideation are closely related to pandemic-induced PTSD symptoms [68, 69], which is consistent with the present study.
The present study has several limitations that should be considered. First, it relied on a single self-report measure. To overcome this limitation, additional assessment methods, such as structured interviews or observational measures, are recommended to ensure the validity of the data. Second, despite the large sample size, the cross-sectional nature of the study limited the inference of causal relationships between variables. Therefore, longitudinal research that considers different pandemic-related contexts, such as the vaccination rate, social distancing rate, and severity of the pandemic, would serve to further validate the scale. Third, as the study utilized a nonclinical sample, future studies with clinical samples diagnosed with psychopathologies should be replicated to improve the validity of the study. If possible, cross-cultural studies would lead to a broader understanding of this scale.
Despite these limitations, the findings in this study appear to be critical in establishing effective therapeutic approaches during and after similar disastrous situations. Such unexpected pandemic outbreaks can cause devastating psychological outcomes at the individual and community level. Therefore, further use of the tool to understand the predictors in the context of pandemics is recommended.
To our knowledge, the present study is the first to translate and evaluate the psychometric properties of COVID-related-PTSD in South Korea, considering the COVID-19 pandemic as a traumatic event. The results showed that the K-COVID-related-PTSD is a valid and reliable instrument for screening PTSD symptoms during the COVID-19 pandemic. The COVID-19 pandemic has been estimated to not be an isolated event but a calamitous event that bears a high possibility of reoccurring even after resolution. Therefore, measuring the consequences of a pandemic could be useful in preparing for similar future situations. Another key strength of the present study is that it used a nationwide sample, which can be interpreted as being more representative of the South Korean population. Future studies should not only confirm the results of the present study but also examine other facets of mental health and trauma within the context of the pandemic.
Availability of data and materials
The datasets used and/or analyzed during the current study are not publicly available due to the datasets currently being used for ongoing research, but are available from the corresponding author upon reasonable request.
Akaike information criterion
Average variance extracted
Bayesian information criteria
Center for Epidemiological Studies Depression Scale
Confirmatory factor analysis
Comparative fit index
Dimensions of Anger Reactions
Depressive symptom inventory-suicidality subscale
Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition
Exploratory factor analysis
Generalized Anxiety Scale
Institutional Review Board
Maslach Burnout Inventory-General Survey
Positive and Negative Affect Schedule
Patient Health Questionnaire
Root mean square error of approximation
Standardized root mean square residual
Secure socket layer
Tucker Lewis index
Alonzi S, La Torre A, Silverstein MW. The psychological impact of preexisting mental and physical health conditions during the COVID-19 pandemic. Psychol Trauma Theory Res Pract Policy. 2020;12(S1):S236. https://doi.org/10.1037/tra0000840.
COVID TG. Psychological impacts and post-traumatic stress disorder among people under COVID-19 quarantine and isolation: a global survey. Int J Environ Res Public Health. 2021;18(11):5719. https://doi.org/10.3390/ijerph18115719.
Hetkamp M, Schweda A, Bäuerle A, Weismüller B, Kohler H, Musche V, Skoda EM. Sleep disturbances, fear, and generalized anxiety during the COVID-19 shut down phase in Germany: relation to infection rates, deaths, and German stock index DAX. Sleep Med. 2020;75:350–3. https://doi.org/10.1016/j.sleep.2020.08.033.
Brooks SK, Webster RK, Smith LE, Woodland L, Wessely S, Greenberg N, Rubin GJ. The psychological impact of quarantine and how to reduce it: rapid review of the evidence. Lancet. 2020;395(10227):912–20. https://doi.org/10.1016/S0140-6736(20)30460-8.
Hawryluck L, Gold WL, Robinson S, Pogorski S, Galea S, Styra R. SARS control and psychological effects of quarantine, Toronto, Canada. Emerg Infect Dis. 2004;10(7):1206. https://doi.org/10.3201/eid1007.030703.
American Psychiatric Association. Diagnostic and statistical manual of mental disorders: DSM-5. United States. 2013.
Neria Y, Nandi A, Galea S. Post-traumatic stress disorder following disasters: a systematic review. Psychol Med. 2008;38(4):467–80. https://doi.org/10.1017/S0033291707001353.
Luo XW, Cai TS, Gao XP, Chen JD. The investigation of mental state in victims of Wen-chuan Earthquake. Chin J Clin Psychol. 2008;16:571–3.
Hong X, Currier GW, Zhao X, Jiang Y, Zhou W, Wei J. Posttraumatic stress disorder in convalescent severe acute respiratory syndrome patients: a 4-year follow-up study. Gen Hosp Psychiatry. 2009;31(6):546–54. https://doi.org/10.1016/j.genhosppsych.2009.06.008.
Jalloh MF, Li W, Bunnell RE, Ethier KA, O’Leary A, Hageman KM, Sengeh P, Jalloh MB, Morgan O, Hersey S, Marston BJ, Dafae F, Redd JT. Impact of Ebola experiences and risk perceptions on mental health in Sierra Leone, July 2015. BMJ Glob Health. 2018;3(2): e000471. https://doi.org/10.1136/bmjgh-2017-000471.
Park HY, Park WB, Lee SH, Kim JL, Lee JJ, Lee H, Shin HS. Posttraumatic stress disorder and depression of survivors 12 months after the outbreak of Middle East respiratory syndrome in South Korea. BMC Public Health. 2020;20(1):1–9. https://doi.org/10.1186/s12889-020-08726-1.
Forte G, Favieri F, Tambelli R, Casagrande M. COVID-19 pandemic in the Italian population: validation of a post-traumatic stress disorder questionnaire and prevalence of PTSD symptomatology. Int J Environ Res Public Health. 2020;17(11):4151. https://doi.org/10.3390/ijerph17114151.
Ashbaugh AR, Houle-Johnson S, Herbert C, El-Hage W, Brunet A. Psychometric validation of the English and French versions of the posttraumatic stress disorder checklist for DSM-5 (PCL-5). PLoS ONE. 2016;11(10): e0161645. https://doi.org/10.1371/journal.pone.0161645.
Bovin MJ, Marx BP, Weathers FW, Gallagher MW, Rodriguez P, Schnurr PP, Keane TM. Psychometric properties of the PTSD checklist for diagnostic and statistical manual of mental disorders–fifth edition (PCL-5) in veterans. Psychol Assess. 2016;28(11):1379. https://doi.org/10.1037/pas0000254.
Van Praag DL, Fardzadeh HE, Covic A, Maas AI, von Steinbüchel N. Preliminary validation of the Dutch version of the Posttraumatic stress disorder checklist for DSM-5 (PCL-5) after traumatic brain injury in a civilian population. PLoS ONE. 2020;15(4): e0231857. https://doi.org/10.1371/journal.pone.0231857.
Wortmann JH, Jordan AH, Weathers FW, Resick PA, Dondanville KA, Hall-Clark B, Foa EB, Young-McCaughan S, Yarvis JS, Hembree EA, Mintz J, Litz BT. Psychometric analysis of the PTSD Checklist-5 (PCL-5) among treatment-seeking military service members. Psychol Assess. 2016;28(11):1392. https://doi.org/10.1037/pas0000260.
Liu P, Wang L, Cao C, Wang R, Zhang J, Zhang B, Wu Q, Zhang H, Zhao Z, Fan G, Elhai JD. The underlying dimensions of DSM-5 posttraumatic stress disorder symptoms in an epidemiological sample of Chinese earthquake survivors. J Anxiety Disord. 2014;28(4):345–51. https://doi.org/10.1016/j.janxdis.2014.03.008.
Armour C, Tsai J, Durham TA, Charak R, Biehn TL, Elhai JD, Pietrzak RH. Dimensional structure of DSM-5 posttraumatic stress symptoms: support for a hybrid Anhedonia and Externalizing Behaviors model. J Psychiatr Res. 2015;61:106–13. https://doi.org/10.1016/j.jpsychires.2014.10.012.
Grau P, Garnier-Villarreal M, Wetterneck C. An analysis of the latent factor structure of the Posttraumatic Stress Disorder Checklist for DSM-5 (PCL-5) in a PTSD partial hospitalization program. Traumatology. 2019;25(4):269. https://doi.org/10.1037/trm0000200.
Pereira-Lima K, Loureiro SR, Bolsoni LM, Apolinario da Silva TD, Osório FL. Psychometric properties and diagnostic utility of a Brazilian version of the PCL-5 (complete and abbreviated versions). Eur J Psychotraumatol. 2019;10(1):1581020. https://doi.org/10.1080/20008198.2019.1581020.
Krüger-Gottschalk A, Knaevelsrud C, Rau H, Dyer A, Schäfer I, Schellong J, Ehring T. The German version of the Posttraumatic Stress Disorder Checklist for DSM-5 (PCL-5): psychometric properties and diagnostic utility. BMC Psychiatry. 2017;17(1):1–9. https://doi.org/10.1186/s12888-017-1541-6.
Boysan M, Guzel Ozdemir P, Ozdemir O, Selvi Y, Yilmaz E, Kaya N. Psychometric properties of the Turkish version of the PTSD Checklist for Diagnostic and Statistical Manual of Mental Disorders, (PCL-5). Psychiatry Clin Psychopharmacol. 2017;27(3):300–10. https://doi.org/10.1080/24750573.2017.1342769.
Bahari R, Alwi MNM, Ahmad MR. Translation and validation of the Malay posttraumatic stress disorder checklist for DSM-5 (MPLC-5). Malays J Med Health Sci. 2019;15(Suppl 1):15–20.
Kim JW, Chung HG, Choi JH, So HS, Kang SH, Kim DS, Moon JY, Kim TY. Psychometric properties of the Korean version of the PTSD Checklist-5 in elderly Korean Veterans of the Vietnam War. Anxiety Mood. 2017;13(2):2586. https://doi.org/10.24986/anxmod.2017.13.2.123.
Lee D, Gu M, Kwon W, Kim S. A study on reliability and validity of the Korean Version of PCL-5 (posttraumatic stress disorder checklist for DSM-5) for adults. Korean J Couns Psychother. 2020;32(2):559–82. https://doi.org/10.23844/kjcp.2020.05.32.2.559.
Bryant-Genevier J, Rao CY, Lopes-Cardozo B, Kone A, Rose C, Thomas I, Orquiola D, Lynfield R, Shah D, Freeman L, Becker S, Byrkit R. Symptoms of depression, anxiety, post-traumatic stress disorder, and suicidal ideation among state, tribal, local, and territorial public health workers during the COVID-19 Pandemic—United States, March–April 2021. Morb Mortal Wkly Rep. 2021;70(26):947. https://doi.org/10.15585/mmwr.mm7026e1.
Chen R, Sun C, Chen JJ, Jen HJ, Kang XL, Kao CC, Chou KR. A large-scale survey on trauma, burnout, and posttraumatic growth among nurses during the COVID-19 pandemic. Int J Ment Health Nurs. 2021;30(1):102–16. https://doi.org/10.1111/inm.12796.
Li X, Fu P, Fan C, Zhu M, Li M. COVID-19 stress and mental health of students in locked-down colleges. Int J Environ Res Public Health. 2021;18(2):771. https://doi.org/10.3390/ijerph18020771.
Megalakaki O, Kokou-Kpolou CK, Vaudé J, Park S, Iorfa SK, Cénat JM, Derivois D. Does peritraumatic distress predict PTSD, depression and anxiety symptoms during and after COVID-19 lockdown in France? A prospective longitudinal study. J Psychiatr Res. 2021;137:81–8. https://doi.org/10.1016/j.jpsychires.2021.02.035.
Mencía-Ripley A, Paulino-Ramírez R, Féliz-Matos L, Ruiz-Matuk CB, Sánchez-Vincitore LV. Psychological responses to the COVID-19 outbreak are related to trust in public institutions: implications for management of emerging infectious diseases. InterAmerican J Med Health. 2021. https://doi.org/10.31005/iajmh.v4i.164.
Oh J, Neal ZP. Two’s company, but Four’sa crowd: the relationship among COVID-19 stress, household size, and life satisfaction. Collabra Psychol. 2021;7(1):24923. https://doi.org/10.1525/collabra.24923.
Velotti P, Civilla C, Rogier G, Beomonte ZS. A fear of COVID-19 and PTSD symptoms in pathological personality: the mediating effect of dissociation and emotion dysregulation. Front Psychiatry. 2021;12:250. https://doi.org/10.3389/fpsyt.2021.590021.
Zhang S, Zhou Y, Ge LK, Zeng L, Liu Z, Qian W, Zhang X. Interaction of insomnia and somatization with post-traumatic stress disorder in pregnant women during the COVID-19 pandemic. Neuropsychiatr Dis Treat. 2021;17:2539. https://doi.org/10.1016/j.psychres.2020.112921.
Park JE, Kang SH, Won SD, No DY, Kim WH. Assessment instruments for disaster behavioral health. Anxiety Mood. 2015;11(2):91–105.
Weathers FW, Litz BT, Herman DS, Huska JA, Keane TM. The PTSD checklist (PCL): reliability, validity, and diagnostic utility. In: Annual convention of the international society for traumatic stress studies. 1993;462.
Blevins CA, Weathers FW, Davis MT, Witte TK, Domino JL. The posttraumatic stress disorder checklist for DSM-5 (PCL-5): development and initial psychometric evaluation. J Trauma Stress. 2015;28(6):489–98. https://doi.org/10.1002/jts.22059.
Yum YS. Validation of the Korean version of the Primary Care PTSD Screen for DSM-5(PC-PTSD-5). Chungbuk National University. 2017. http://www.riss.kr.ca.skku.edu:8080/link?id=T14437978.
Prins A, Ouimette P, Kimerling R, Cameron RP, Hugelshofer DS, Shaw-Hegwer J, Sheikh JI. The primary care PTSD screen (PC-PTSD): development and operating characteristics. Prim Care Psychiatry. 2003;9(1):9–14.
Prins A, Bovin MJ, Smolenski DJ, Marx BP, Kimerling R, Jenkins-Guarnieri MA, Kaloupek DG, Schnurr PP, Kaiser AP, Leyva YE, Tiet QQ. The primary care PTSD screen for DSM-5 (PC-PTSD-5): development and evaluation within a veteran primary care sample. J Gen Intern Med. 2016;31(10):1206–11. https://doi.org/10.1007/s11606-016-3703-5.
Kroenke K, Spitzer RL, Williams JB. The PHQ-15: validity of a new measure for evaluating the severity of somatic symptoms. Psychosom Med. 2002;64(2):258–66.
Spitzer RL, Kroenke K, Williams JB. Validation and utility of a self-report version of PRIME-MD: the PHQ Primary Care Study. Primary care evaluation of mental disorders. Patient health questionnaire. JAMA. 1999;282(18):1737–44. https://doi.org/10.1001/jama.282.18.1737.
Han CS. Psychometric properties of the patient health questionnaire-15 (PHQ-15) for measuring the somatic symptoms of psychiatric outpatients. Psychosom J Korean Med Sci. 2009;77(4):1099–106.
Radloff LS. The CES-D scale: a self-report depression scale for research in the general population. Appl Psychol Meas. 1977;1(3):385–401. https://doi.org/10.1016/S0033-3182(09)70859-X.
Cho MJ, Kim GH. The center for epidemiologic studies depression scale (CES-D). J Korean Neuropsychiatr Assoc. 1993;32(3):381–99.
Shin SY. Korean short version of the center for epidemiologic studies depression scale (CES-D). Seoul National University. 2011. http://dcollection.snu.ac.kr:80/jsp/common/DcLoOrgPer.jsp?sItemId=000000030438.
Spitzer RL, Kroenke K, Williams JB, Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. 2006;166(10):1092–7. https://doi.org/10.1001/archinte.166.10.1092.
Seo JG, Park SP. Validation of the generalized anxiety disorder-7 (GAD-7) and GAD-2 in patients with migraine. J Headache Pain. 2015;16(1):1–7. https://doi.org/10.1186/s10194-015-0583-8.
Forbes D, Alkemade N, Mitchell D, Elhai JD, McHugh T, Bates G, Novaco RW, Bryant R, Lewis V. Utility of the dimensions of anger reactions-5 (DAR-5) scale as a brief anger measure. Depress Anxiety. 2014;31(2):166–73. https://doi.org/10.1002/da.22148.
Hong CH. Validation study of the Korean Emotional Experience Scale. Korean J Clin Psychol. 2004;23(3):771–87.
Schaufeli WB. Maslach burnout inventory-general survey (MBIGS). Maslach burnout inventory manual. 1996.
Shin KH. The Maslach bunout inventory-general survey (MBI-GS): an application in South Korea. Korean J Clin Psychol. 2003;16(3):1–17.
Suh S, Ryu H, Chu C, Hom M, Rogers ML, Joiner T. Validation of the Korean depressive symptom inventory-suicidality subscale. Psychiatry Investig. 2017;14(5):577. https://doi.org/10.4306/pi.2017.14.5.577.
Metalsky GI, Joiner TE. The hopelessness depression symptom questionnaire. Cogn Ther Res. 1997;21(3):359–84. https://doi.org/10.1023/A:1021882717784.
Barrett P. Structural equation modeling: adjudging model fit. Personal Individ Differ. 2007;42(5):815–24. https://doi.org/10.1016/j.paid.2006.09.018.
Byrne BM. Structural equation modeling with AMOS: basic concepts. Applications, and programming. 2001.
Kass RE, Raftery AE. Bayes factors. J Am Stat Assoc. 1995;90:773–95.
Raftery AE. Bayesian model selection in social research. Sociol Methodol. 1995;25:111–64. https://doi.org/10.2307/271063.
Fornell C, Larcker DF. Evaluating structural equation models with unobservable variables and measurement error. J Market Res. 1981;18(1):39–50. https://doi.org/10.1177/002224378101800104.
Hair JF, Anderson RE, Babin BJ, Black WC. Multivariate data analysis: a global perspective. 2010;7.
Hong S, Malik ML, Lee MK. Testing configural, metric, scalar, and latent mean invariance across genders in sociotropy and autonomy using a non-Western sample. Educ Psychol Meas. 2003;63(4):636–54. https://doi.org/10.1177/0013164403251332.
Nagin DS. Group-based modeling of development. Cambridge: Harvard University Press; 2005.
Kline RB. Principles and practice of structural equation modeling. New York: Guilford publications; 2005.
Anderson JC, Gerbing DW. Structural equation modeling in practice: a review and recommended two-step approach. Psychol Bull. 1988;103(3):411. https://doi.org/10.1037/0033-2909.103.3.411.
Cheng P, Xu LZ, Zheng WH, Ng RM, Zhang L, Li LJ, Li WH. Psychometric property study of the posttraumatic stress disorder checklist for DSM-5 (PCL-5) in Chinese healthcare workers during the outbreak of corona virus disease 2019. J Affect Disord. 2020;277:368–74. https://doi.org/10.1016/j.jad.2020.08.038.
Cernovsky ZZ, Fattahi M, Litman LC, Diamond DM. Validation of the PTSD checklist for DSM-5 (PCL-5) on patients injured in car accidents. Eur J Med Health Sci. 2021;3(2):154–9. https://doi.org/10.24018/ejmed.2021.3.2.790.
Liu CH, Zhang E, Wong GTF, Hyun S. Factors associated with depression, anxiety, and PTSD symptomatology during the COVID-19 pandemic: clinical implications for US young adult mental health. Psychiatry Res. 2020;290: 113172. https://doi.org/10.1016/j.psychres.2020.113172.
Tang W, Hu T, Hu B, Jin C, Wang G, Xie C, Chen S, Xu J. Prevalence and correlates of PTSD and depressive symptoms one month after the outbreak of the COVID-19 epidemic in a sample of home-quarantined Chinese university students. J Affect Disord. 2020;274:1–7. https://doi.org/10.1016/j.jad.2020.05.009.
Czeisler MÉ, Lane RI, Petrosky E, Wiley JF, Christensen A, Njai R, Weaver MD, Robbins R, Facer-Childs ER, Barger LK, Czeisler CA, Rajaratnam SM. Mental health, substance use, and suicidal ideation during the COVID-19 pandemic—United States, June 24–30, 2020. Morb Mortal Wkly Rep. 2020;69(32):1049. https://doi.org/10.15585/mmwr.mm6932a1.
Talaee N, Varahram M, Jamaati H, Salimi A, Attarchi M, Kazempour Dizaji M, Sadr M, Hassani S, Farzanegan B, Monjazebi F, Seyedmehdi SM. Stress and burnout in health care workers during COVID-19 pandemic: validation of a questionnaire. J Public Health. 2020. https://doi.org/10.1007/s10389-020-01313-z.
This study was supported by the National Research Foundation of Korea (Award No.: 2021S1A3A2A02089682).
Ethics approval and consent to participate
Approval was obtained from the Institutional Review Board (protocol no. SKKU 2020-05-005) of Sungkyunkwan University. All methods throughout the study were performed in accordance with the relevant guidelines and regulations. Informed consent was obtained from all participants prior to their enrollment in the study.
Consent for publication
In the present study, the authors affirm that human research participants provided informed consent for the publication of the study.
The authors declare that they have no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Lee, H.J., Kim, Y.J. & Lee, D.H. South Korean validation of the COVID-related-PTSD scale in a non-clinical sample exposed to the COVID-19 pandemic. BMC Psychol 10, 135 (2022). https://doi.org/10.1186/s40359-022-00844-2
- COVID pandemic
- Posttraumatic stress disorder checklist
- South Korea