Skip to main content

Validation of the PCL-5 in Dutch trauma-exposed adults

Abstract

Background

The PTSD Checklist for DSM-5 (PCL-5) is an internationally widely used self-report questionnaire that can be used to screen for probable diagnosis of posttraumatic stress disorder (PTSD). Information on the psychometric properties of the Dutch PCL-5 is currently lacking.

Objective

We aimed to validate the Dutch PCL-5 in a sample of Dutch adults with prior (suspected) serious injury and establish the optimal cut-off for probable PTSD diagnosis herein.

Methods

Data for the current study were collected as part of a long-term follow-up measurement of the TraumaTIPS cohort, where adults admitted to an emergency department following (suspected) serious injury completed a follow-up measurement 12–15 years post-trauma. Of N = 333 eligible participants, n = 192 (57.7%) consented and completed the PCL-5 alongside self-report instruments measuring depression (QIDS), PTSD (IES-R), and quality of life (WHO-QOL and EQ-6D). In total, n = 185 participants also completed a clinician administered interview for PTSD (CAPS-5). Most participants were men (66%) and on average 54 years old (SD = 12.41). We evaluated the diagnostic utility of the PCL-5 using Youden index and tested reliability and convergent validity.

Results

The PCL-5 demonstrated excellent diagnostic accuracy with a cut-off point of 16 resulting in an optimal Youden index (0.90) for screening purposes with a high sensitivity (1.00) and specificity (0.90). A cut-off of 22 yielded a slightly lower Youden index (0.84) but better positive predictive value (0.50 instead of 0.33) than the cut-off of 16. A cut-off of 29 resulted in the most accurate prevalence estimates. The PCL-5 showed a high internal consistency (Cronbach’s α = 0.94), excellent inter-item and item-total correlations and good convergent validity (r > .5 for CAPS-5, IES-R and QIDS).

Conclusions

The PCL-5 is a reliable and valid measurement for PTSD symptoms and probable diagnosis and shows excellent screening abilities in Dutch adults with prior (suspected) serious injury, with a lower optimal cut-off compared to previously found in clinical populations. We recommend a cut-off of 22 for screening purposes and a cut-off of 29 for prevalence estimates in Dutch trauma-exposed adults.

Peer Review reports

Background

More than 80% of the individuals in the Netherlands experience at least one – and often multiple – potentially traumatic events throughout the course of their lives [1]. After exposure to a potentially traumatic event, many individuals initially experience post-traumatic symptoms such as intrusive memories about the event or sleeping problems. These symptoms usually subside within a few weeks, but for some they persist and develop into post-traumatic stress disorder (PTSD; [2]). The conditional risk of developing PTSD following a potentially traumatic event is on average 4.0%. The majority of the participants in the current study were admitted to the Emergency Department (ED) following road traffic accidents. Data from the World Health Organization mental health surveys indicate that exposure to automobile crashes and other life-threatening accidents are common potentially traumatic events, with 14.1% and 6.3% of the global population, respectively, experiencing such events at some point in their lives. The risk of developing PTSD related to automobile crashes is 2.1% and 5.1% for other life-threatening accidents. Hence, these events represent a significant public health concern [3]. PTSD includes intrusions about the traumatic event, avoidance of feelings and thoughts related to the event, negative alterations in mood and cognitions and alterations in arousal and reactivity [2]. PTSD represents a great burden both to the individual and society and is associated with many negative long-term outcomes, such as increased risk for morbidity and mortality, impaired work productivity and reduced quality of life [4,5,6,7]. When untreated, PTSD generally persists for many years [8], stressing the importance of identifying and treating individuals with PTSD.

Over the past decades, many studies found strong support for the clinical effectiveness and cost-effectiveness of trauma-focused treatments for PTSD [9,10,11]. However, most people with PTSD do not receive professional treatment [4, 12,13,14]. Even when patients seek treatment for their complaints, PTSD is often not recognized by physicians and therapists in routine clinical settings [14,15,16,17]. Reasons for this ‘treatment gap’ include limited available resources at mental healthcare institutions and a lack of knowledge about PTSD in healthcare in general [14]. Efficient and accurate screening tools are crucial to improve recognition of PTSD and overcome the treatment gap. Screening tools are usually filled out by trauma-exposed individuals themselves either online or via pencil-and-paper and therefore can be used in diverse settings without much effort or expert knowledge about PTSD required.

The PTSD Checklist for DSM-5 (PCL-5; [18]) is a 20-item self-report screening questionnaire that assesses the 20 DSM-5 diagnostic symptoms of PTSD and has been widely studied across the globe [19]. Research showed that the PCL-5 has an acceptable internal consistency, test-retest reliability and construct validity. However, most validation studies (> 65%) did not assess the actual diagnostic accuracy of the PCL-5 to determine a probable PTSD diagnosis, probably due to the time-consuming process of administering clinician administered interviews for PTSD [19]. Studies which assessed the diagnostic accuracy of the PCL-5 showed mixed results both regarding the optimal cut-off of the PCL-5 for determining a probable PTSD diagnosis (ranging from 22 to 49) and the performance of the PCL-5 with sensitivity ranging between 0.5 and 1, and specificity ranging between 0.35 and 0.97 [19]. Hence, there does not seem to be one general optimal cut-off point of the PCL-5 for determining probable PTSD. Despite the lack of information about the optimal cut-off points for the PCL-5 in many settings, it is still broadly used. Given the broad range of optimal cut-off points for the PCL-5, this might lead to many false positive or negative screenings. Therefore, recent studies have warned against overreliance on the PCL-5 as a measure of PTSD diagnostic status, especially when a used cut-off is not validated for the specific population and/or language of interest (e.g., [20]). The optimal cut-off varies across populations and languages, stressing the importance of establishing the diagnostic accuracy of the PCL-5 in various settings. Thus, more information about the performance and optimal cut-off of the PCL-5 across diverse populations is crucial.

Up to now the majority of the studies assessing the diagnostic accuracy of the PCL-5 included clinical treatment-seeking samples (usually from mental healthcare institutes), military personnel or student cohorts [19]. Only three out of the 64 validation studies (5%) included a trauma-exposed sample [21,22,23] and eight studies (12.5%) included community participants of which six included online samples recruited via Mturk [19]. This limits the generalizability of the results to very specific groups. Importantly, to reduce the treatment gap it is crucial that PTSD can also be effectively recognized in trauma-exposed individuals rather than treatment-seeking individuals. This is important since most trauma-exposed individuals with PTSD never seek treatment or their complaints are not correctly recognized by physicians precluding them from seeking help at a mental healthcare institute (e.g., [14]). Only one study assessed the general psychometric properties of the Dutch PCL-5 [24]. This study included 495 civilians after traumatic brain injury. The Dutch PCL-5 showed a high internal consistency and criterion validity. However, this study only relied on self-reported information and was therefore unable to test the screening ability of the Dutch PCL-5.

In addition to screening for probable PTSD on an individual level, the PCL-5 is often used to assess the prevalence of PTSD within a population. Recent meta-analyses summarizing PTSD prevalence estimates showed that screening instruments such as the PCL-5 are the most commonly used instruments for determining PTSD prevalence estimates [25,26,27]. In fact, only one meta-analysis was able to include a sufficient number of studies using clinician-assessed measures to investigate whether the type of assessment (screening versus clinician-assessed) moderated PTSD prevalence estimates [27]. Unsurprisingly, they found higher prevalence estimates for self-report compared to clinician-assessed instruments. Since the prevalence of PTSD in most populations is generally low compared to the prevalence of not having PTSD, a screening instrument with identical sensitivity and specificity will assign more false positives compared to false negatives. For example, with a PTSD prevalence of 10% and a sensitivity and specificity of 0.90, such screening will result in 1 false negative (10% of the 10 participants with PTSD) and 9 false positives (10% of the 90 participants without PTSD). When the optimal cut-off point is uncorrected for this imbalance, this will result in a large overestimation of the PTSD prevalence (in this example the prevalence estimate would be 18%, with 9 true positives and 9 false positives). Hence, it is important to separately provide optimal cut-off points of the PCL-5 for two purposes: (1) studies and/or clinical practice focused on identifying individuals with PTSD and (2) epidemiological studies into the prevalence of PTSD interested in the average prevalence across participants.

In the current study, we aimed to validate the PCL-5 in a sample of Dutch adults admitted to an emergency department (ED) following (suspected) serious injury 12–15 years ago and establish the diagnostic utility for screening on an individual level (i.e. optimal cut-off for probable PTSD diagnosis) and for determining prevalence estimates in this population. We also assessed the reliability and convergent validity of the Dutch PCL-5.

Methods

Participants

Data for the current study were collected as part of a long-term follow-up measurement of the TraumaTIPS cohort [28] 12–15 years after emergency department admission following (suspected) serious injury. The main aim of this long-term follow-up study was to determine long-term PTSD prevalence and associated adverse psychological, functional and economic outcomes within this sample. See Karchoud, Haagsma et al. [7] for the main outcome paper of this follow-up including information on the prevalence and associated psychological, functional and economic impact of long-term PTSD. All participants from the TraumaTIPS cohort were transported by ambulance or helicopter to the level-1 trauma centers of the Academic Medical Center (AMC) or VU University Medical Center (in Dutch ‘Vrije Universiteit Medisch Centrum’; VUmc) in Amsterdam, the Netherlands. Participants were presented with suspected severe injuries that required specialized acute medical care. Inclusion criteria of the TraumaTIPS cohort were: (a) age of 18 years or older; (b) proficiency in Dutch and (c) having experienced a potential traumatic event. Exclusion criteria were: (a) the injury resulting from deliberate self-harm; (b) suspected severe neurological conditions; (c) a psychotic disorder; (d) a bipolar disorder; (e) depressive disorder with psychotic features; (f) moderate to severe traumatic brain injury and (g) permanent residency outside the Netherlands. The follow-up assessment included no further in- or exclusion criteria, but specific inclusion (proficiency in Dutch) and exclusion (suspected severe neurological conditions clearly impairing cognition) criteria were checked again to ensure that participation was feasible. The follow-up assessment was exempted from formal review by the Medical Ethical Review Committee of the Amsterdam University Medical center (W20_035#20.063).

Procedure

During their past participation, TraumaTIPS cohort study participants provided permission to contact them for follow-up measurements during the informed consent procedure. All original participants were contacted in the current study, except for those who withdrew their informed consent during the TraumaTIPS cohort study. We used existing contact details from 12 to 15 years ago, to contact eligible participants via telephone and email. When contact was established, we first verified their identification via a telephone conversation using personal details and by probing about their past index event in relation to their past research participation. After a positive ID- and contact details verification, study information about the TraumaTIPS long-term follow-up assessment was sent via email, including a link to the online informed consent form. Participants were asked to provide informed consent and thereafter fill out an online survey (consisting of several self-report questionnaires). Additionally, they completed the CAPS-5 interview online via a videocall-platform with a trained assessor. Participants were asked to complete the online survey before, or shortly after, partaking in the online CAPS-5 interview. See Karchoud, Haagsma [7] for more information on the current sample including flow diagram of recruitment process and comparison between completers and non-completers. In short, completers had significantly higher education levels (p < .001); less often a non-Dutch origin (p < .001); were more often in a committed relationship (p = .007); and reported lower PTSD symptom severity (p = .016) in the follow-up assessments of the original study compared to non-participants of the long-term follow-up.

Measures

PCL-5

The PTSD checklist for DSM-5 (PCL-5) is a 20-item self-report questionnaire assessing probable PTSD diagnosis and PTSD symptom severity in the past month [29, 30]. For the current study, participants were instructed to keep the suspected severe injury in relation to their past research participation (i.e. their index event for research participation) in mind when filling out the PCL-5. During the PCL-5, participants are asked how much they have been bothered by each symptom over the past month. Every item is answered on a 5-point Likert scale ranging from not at all (0) to extremely [4]. The items can be categorized into four domains based on the DSM-5 with every item corresponding to a DSM-5 symptom: intrusions (five items), avoidance (two items), negative alterations in cognitions and mood (seven items) and hyperarousal (six items). Domain scores are calculated by summing the items of the domain. PCL-5 total score can be derived by summing the 20 items (range between 0 and 80) with higher scores indicating higher symptom severity. The Dutch translation of the PCL-5 has been established alongside the CAPS-5 translation [31] via an official translator and five senior psychotrauma experts who provided feedback on the translated PCL-5 in several rounds.

CAPS-5

The clinician-administered PTSD scale for DSM-5 (CAPS-5) is a clinician-assessed structured interview assessing PTSD diagnosis and symptom severity in the past month with 20 items [31, 32]. For the current study, participants were instructed to keep the suspected severe injury in relation to their past research participation (i.e. their index event for research participation) in mind during the CAPS-5 administration. Every item of the CAPS-5 is answered on a 5-point Likert scale ranging from not at all (0) to extremely [4]. For establishing a PTSD diagnosis, an item with a score of 2 or higher is considered endorsed. Every item of the CAPS-5 corresponds to the same DSM-5 symptom as the item of the PCL-5. A diagnosis of PTSD requires at least one clinically relevant intrusion item, at least one avoidance item, two negative alterations in cognitions and mood, two hyperarousal items and clinically significant distress or functional impairment. CAPS-5 total score can also be derived by summing the 20 items (range between 0 and 80) with higher scores indicating higher symptom severity. Previous validation studies in the United States and the Netherlands showed that the CAPS-5 PTSD diagnosis corresponded well with the CAPS-4 (kappa = 0.83), and CAPS-5 total scores showed a high internal consistency (α = 0.88) and test-retest reliability (ICC = 0.78; 31, 32). In the current study, the internal consistency of the CAPS-5 total score was high (α = 0.89). The CAPS-5 was administered by an assessor with a master’s degree in clinical psychology (IK) with previous extensive experience in CAPS-5 administration in the context of an international multi-center randomized clinical trial, who for the current study additionally completed several scoring exercises and reviewed mock CAPS-5 administrations and was supervised throughout the interview period. Every month a random selection of 15% of the audiotaped CAPS-5 measurements has been scored by a second researcher (independent of the original assessment) for interrater purposes. Both agreement on PTSD diagnoses (Cohen’s kappa = 1) and PTSD symptom severity (ICC = 0.80) was excellent.

IES-R

The impact of event scale: revised (IES-R) is a 22-item self-report questionnaire assessing PTSD symptom severity in the past week according to the DSM-IV [33]. The IES-R items do not refer to an index event. Every item is answered on a 5-point Likert scale ranging from not at all (0) to extremely [4]. The IES-R consists of three domains: intrusion, avoidance, and hyperarousal. Since the IES-R was not updated to match the DSM-5 PTSD criteria, it does not include the domain ‘negative alterations in cognitions and mood’. Moreover, the number of items per PTSD domain differs between DSM-IV and DSM-5. For example, the IES-R includes eight items tapping in avoidance instead of two items in the PCL-5 and CAPS-5. Total IES-R score can be derived by summing the 22 items (range between 0 and 88) with higher scores indicating higher symptom severity. Previous validation studies in the Netherlands showed that total IES-R scores from the Dutch version of the IES-R have a high internal consistency (α = 0.88) and showed adequate convergent validity [34]. In the current study, the internal consistency of the IES-R total score was high (α = 0.96).

QIDS-SR

The quick inventory of depressive symptomatology – self-reported (QIDS-SR) is a 16-item self-report questionnaire assessing symptoms for major depressive disorder in the past week according to the DSM-IV [35]. Items are answered on a 4-point Likert scale. The QIDS-SR consists of nine domains. Domain scores are based on the maximum score out of the items within the domain. Total QIDS-SR scores can be derived by summing the total domain scores (range between 0 and 27) with higher scores indicating higher symptom severity. A systematic review and meta-analysis from validation studies across the globe (including the Netherlands) showed that the QIDS-SR generally has an acceptable internal consistency (α > 0.65) and a moderate to high convergent validity [36]. In the current study, the internal consistency of the QIDS-SR total score was high (α = 0.80).

WHO-QOL

The World Health Organization Quality of Life –Abbreviation (WHO-QOL) is a 26-item self-report questionnaire assessing quality of life [37]. Items are answered on 5-point Likert scales. The WHO-QOL consists of four domains: physical health (PHYS), psychological (PSYCH), social relations (SOCIAL) and environment (ENVIR). Items within a domain can be summed and transformed on a scale from 0 to 100 with higher scores indicating better quality of life. A validation studies from the Netherlands showed that The WHO-QOL domains have an acceptable to good internal consistency (α ranging between 0.66 and 0.80) and a moderate to high convergent validity [38]. In the current study, the internal consistency of the WHO-QOL domains was moderate to high (α ranges between 0.72 and 0.87).

EQ-6D VAS scale

The EuroQol 6 dimensions Visual Analogue Scale (EQ-6D VAS scale) is one item assessing current health-related quality of life [39]. The item is scored on a scale from 0 (worst imaginable health) to 100 (best imaginable health). A systematic review summarizing validation studies of the EQ-6D (including the Netherlands) showed that the VAS scale demonstrates moderate to strong convergent validity [39].

LEC-5

The Life Events checklist for the DSM-5 (LEC-5; 18) is a 16-item self-report questionnaire assessing exposure to potentially traumatic events (PTEs). Each item represents one category of PTEs and participants are asked whether they experienced the event themselves, witnessed the event, encountered the event during work or learned about the event happening to a close friend or family member. For the current study, participants were asked to report on trauma exposure since the index trauma (suspected serious injury). A LEC-5 total score was calculated by summing all types of trauma exposure and all types of experiencing the event resulting in a possible range of 0–64 [40].

ISS and GCS

The Injury Severity Score (ISS; [41]) is an anatomical scoring system assessing the severity of injuries from patients with an overall severity score (range 0–75 with higher scores indicating more severe injuries). The Glasgow Coma Scale (GCS; [42]) (GCS) is a neurological scale assessing level of consciousness with three items: eye response (range 1–4), verbal response (range 1–5) and motor response (range 1–6). Total score can be calculated by summing all items (range 3–15) with higher scores indicating better consciousness.

Statistical analyses

The statistical analysis plan of this study has been pre-registered prior to the analysis at the Open Science Framework (OSF; [43]). Analyses were performed using IBM SPSS Statistics Version 28.0 and R version 3.6.1 using package OptimalCutpoints [44].

For determining the diagnostic utility of the PCL-5 in screening for PTSD according to the CAPS-5 on an individual level, we used the Youden index which maximizes both sensitivity and specificity [45]. We used Receiver Operating Curve (ROC) analysis to determine the Area Under the Curve (AUC), sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) of the optimal cut-off point. The sensitivity, specificity, and Area Under The Curve (AUC) of the PCL-5 are satisfactory when > 0.75 for probable DSM-5 PTSD diagnosis according to CAPS-5 [46, 47]. For prevalence estimates, we provide the optimal cut-off score resulting in the most accurate prevalence estimates by balancing the number of false positives and false negatives. Note that this does not take any other screening performance indices into account and is only based on the cut-off resulting in the most accurate prevalence of PTSD on a group level.

To determine the reliability of the PCL-5, we calculated the Cronbach’s α of the PCL-5 total score and domain scores, and we assessed the corrected item-total (correlation between each item and the total score excluding that item) and inter-item correlations of the PCL-5 items. The Cronbach’s α of the PCL-5 total symptom score and domain scores is satisfactory when high (α ≥ 0.75), item total correlation is satisfactory when high (≥ 0.30), and inter-item correlation is satisfactory when moderate (between 0.15 and 0.50; [48]).

For determining the convergent validity of the PCL-5, we correlated the PCL-5 total score with theoretically similar constructs (CAPS-5 total score), related constructs (total QIDS-SR and IES-R scores) and theoretically opposite constructs (EQ-6D VAS score and WHO-QOL domain scores). We used the Spearman’s rho correlation coefficient because the PCL-5 total scores were not normally distributed. For similar constructs convergent validity is satisfactory when the correlation is high (r = ≥ 0.50, p < .05; 50). For related constructs, the convergent validity is satisfactory when the correlation is moderate (r = ≥ 0.30, p < .05). For theoretically opposite constructs, convergent validity is satisfactory when the correlation is negative and moderate (r ≤ − .30; [49]).

Results

Sample characteristics

Of the N = 333 eligible participants, n = 192 (57.7%) consented and completed all self-report measures in the current study. Of these, 185 participants also completed the CAPS-5 interview. Most participants were men (66%) and on average 54 years old (SD = 12.41). See Table 1 for characteristics of participants. Note that the Injury Severity Score (ISS) and Glasgow Come Scale (GCS) included missing data and were available for n = 157 (82% of the sample) and n = 147 (77% of the sample) respectively. PCL-5 total scores ranged between 0 and 70 (M = 6.83, SD = 10.41). CAPS-5 total scores ranged between 0 and 41 (M = 4.08, SD = 7.08). Nine participants out of the 185 (4.9%) met criteria for a PTSD diagnosis according to the CAPS-5. Table 2 lists the mean PCL-5 item scores for men and women separately.

Table 1 Characteristics of the participants
Table 2 PCL-5 item scores (mean and standard deviation) for men and women

Diagnostic utility

The cut-off score with the highest Youden index of the PCL-5 for screening (on an individual level) for probable PTSD was 16. This cut-off yielded an excellent Youden’s index (0.90), sensitivity (1.00) and specificity (0.90). See Table 3 for more details and Fig. 1 for Receiver Operating Characteristics (ROC) curve. Hence, this cut-off resulted in 100% of the PTSD patients being correctly classified as having PTSD according to CAPS-5 and 90% of the patients without PTSD being correctly classified as not having PTSD. One-third of the people who screened positive were actually diagnosed with PTSD, while all people with a negative screening were not diagnosed with PTSD. The likelihood of having PTSD increases by almost 10 times (9.78) with a positive screening, while the likelihood of having PTSD with a negative screening is zero (no one with a negative screening actually had PTSD). Psychometric properties of all possible PCL-5 cut-offs are listed in Appendix 2. Note that a higher PCL-5 cut-off of 22 corresponds to a somewhat lower but still excellent Youden’s index (0.84), sensitivity (0.89) and specificity (0.95), and a higher positive predictive value (0.50) that the cut-off of 16 (0.33). Thus, a slightly lower sensitivity of this cut-off results in considerable higher chance of being a true positive when screening positive (50% instead of 33%). Therefore, this cut-off is recommended for screening purposes. An even higher cut-off would reduce the sensitivity considerably (to maximally 0.78 for a cut-off of 23) while the positive predictive value would only increase marginally (for the cut-off of 23 it is even decreased to 0.47 ; see Appendix 2).

For prevalence estimates, the optimal cut-off score of the PCL-5 was 29. This cut-off resulted in a reliable prevalence estimate of 5.41% in the current sample, close to the actual prevalence of 4.9% as determined using the CAPS-5.

Table 3 Cut-off points and performance of the PCL-5 for screening and prevalence estimates
Fig. 1
figure 1

Receiver Operating Characteristics (ROC) curve of the PCL-5

Reliability

The PCL-5 total scores showed an excellent internal consistency (Cronbach’s α = 0.94). Cronbach’s α if item deleted indicated no possible improvements. In addition, PCL-5 domain intrusions (Cronbach’s α = 0.86), avoidance (Cronbach’s α = 0.79), negative alterations in cognitions and mood (Cronbach’s α = 0.85) and hyperarousal (Cronbach’s α = 0.86) all showed a good to excellent internal consistency. All corrected item-total correlations ranged between 0.34 and 0.78 with most (88%) inter-item correlations ranging between 0.15 and 0.60. PCL-5 item 8 (trouble remembering) was the only item with lower inter-item correlations (0.08 with item 1 and item 3). See Appendix 1 for complete inter-item correlation matrix.

Convergent validity

Table 4 displays the correlation matrix between the PCL-5 total score and total scores of related constructs. The PCL-5 was strongly related to similar constructs with large correlation coefficients. Note that the correlation between the PCL-5 total score and some theoretically divergent constructs (WHO-social domain and EQ-6D vas scale) did not reach the predefined threshold of a moderate correlation.

Table 4 Spearman’s rho correlation matrix of PCL-5 total score with total scores of measures for convergent validity

Discussion

The main aim of the present study was to validate the PCL-5 in a sample of Dutch adults admitted to an emergency department following (suspected) serious injury 12–15 years ago and more specifically to establish the performance of the PCL-5 in screening for PTSD within this sample. We found that the PCL-5 was an excellent screener for PTSD in this sample and demonstrated good psychometric properties in general. This implies that the PCL-5 can be effectively used to screen for PTSD on an individual level and for prevalence estimates in Dutch adults following exposure to (suspected) serious injuries.

We identified a PCL-5 total score of 16 or higher as cut-off with the best sensitivity and specificity for screening on an individual level for probable PTSD according to the CAPS-5. With this cut-off, all screening performance indices (sensitivity, specificity and AUC) of the PCL-5 were much better than the predefined minimum of 0.75. Nevertheless, we recommend a PCL-5 cut-off of 22 for screening purposes since this cut-off results in a higher chance of being a true positive when scoring above the cut-off while it still shows excellent performance indices. Since only about 1 out of 20 people in the current sample have PTSD, the number of false positives with a cut-off of 16 would be considerable. Therefore, the reduction in sensitivity with the threshold of 22 (and consequently additional missed patients with PTSD) seems worth the increase in chance that someone with a positive screening result actually has PTSD. This is especially relevant in settings where resources are limited or when it is not crucial that all true positives are correctly classified, for example in research. Notably, previous PCL-5 validation studies (all non-Dutch and usually including treatment-seeking samples) identified optimal cut-off scores of a PCL-5 total score between 23 and 49 [19], and as such the cut-offs we identified for Dutch individuals with prior (suspected) serious injury are somewhat lower. It has already been documented that the optimal cut-off of the PCL-5 varies due to contextual factors such as sample characteristics, cultural context and severity and prevalence of PTSD and comorbid conditions [19, 20]. The impact of the prevalence of the screening outcome within the investigated sample on the observed screening performance has been documented for decades across disciplines. This has been referred to as the spectrum effect [50, 51]. In the current study, we included a non-clinical trauma-exposed sample with a PTSD prevalence rate of 4.9% while previous studies often validated the PCL-5 in treatment seeking samples with much higher prevalence rates by definition [19]. Since many trauma-exposed individuals do not develop PTSD, prevalence rates and severity of PTSD are expected to be lower compared to treatment-seeking samples resulting in a relatively low optimal cut-off score. We also identified the optimal PCL-5 cut-off point for prevalence estimates. This is relevant for epidemiological studies interested in the point prevalence across participants rather than individual screening outcomes. Using the optimal cut-off point of 16 for screening on an individual level would result in an overestimation of the PTSD prevalence within the whole sample because most participants do not have PTSD (95%), resulting in more false positives than false negatives. We identified an optimal PCL-5 total score cut-off of 29 for PTSD prevalence estimates.

Our results imply that the Dutch PCL-5 can be effectively used to screen in Dutch individuals following exposure to (suspected) serious injuries both for clinical and research purposes. Note that the current sample includes a high percentage of male participants compared to the general Dutch society. The traumatic events presented at emergency departments are often from a physical rather than a sexual nature, while women more often experience sexual violence compared to men (e.g., [1, 13, 52, 53]). Thus, we expect that this is not problematic for the generalization of the current results to screening in emergency department settings, but results need to be replicated for screening in different settings, for example in victims of sexual violence or other interpersonal violence. Future research might also validate the PCL-5 in a Dutch treatment seeking sample to verify whether the low cut-off from the current study is indeed explained by the non-clinical sample or whether there is also a cultural element. Although the overall screening performance of the PCL-5 in the current study was excellent, the specificity was not perfect, thus resulting in false positives. These false positives may either be people without any mental health disorder or people with a mental health disorder with symptom overlapping with PTSD, such as depressive disorders. Such false positives have to be identified with follow-up clinician-administered interviews to avoid people receiving treatment which may not be needed or focusing on the wrong disorder.

Furthermore, we found that the Dutch PCL-5 is reliable, illustrated by excellent internal consistency, inter-item and corrected item-total correlations. This corresponds to previous PCL-5 validation studies [19]. We also found excellent convergent validity compared to clinical measures of PTSD and depression, but weaker relationships between PCL-5 total scores and measures of quality of life, especially the social relations domain. Most previous validation studies did not include a measure related to quality of life or social relations. One previous study included social support as measure of discriminant validity and found – similar to our finding – a modest relationship between PCL-5 total scores and social support [54]. Moreover, we found similarly modest relationships between other measures of PTSD (the CAPS-5 and DSM-IV based IES-R) and the social relations domain of quality of life in the current study so the modest convergent validity of the PCL-5 with quality of life does not seem to point towards problems with the PCL-5 specifically but more towards a generally weak relationship between PTSD and the social relations domain of quality of life. We conclude that overall the current data supports the convergent validity of the PCL-5.

Our study has several limitations. Firstly, the sample size was relatively small precluding investigation of the factor structure of the Dutch PCL-5, as is common in validation research. Secondly, this study was part of a long-term follow-up of trauma-exposed individuals and therefore the potentially traumatic event happened over a decade ago for all participants. About 5% of the respondents currently met criteria for PTSD related to this event which was comparable to the PTSD prevalence 12 months after the event (4.5%; 28). However the prevalence one month after the potentially traumatic event was higher (about 9%) and the optimal cut-off for probable PTSD might therefore be slightly different at this timepoint. More generally, research indicates that the prevalence of PTSD decreases until about 3–6 months following a potentially traumatic event [55]. Hence, we recommend to investigate the generalizability of the current findings for routine screening programs implemented within the first months after exposure to a potentially traumatic event. Thirdly, although the PCL-5 and CAPS-5 were specifically administered in relation to the index trauma of 12–15 years ago, we cannot exclude the possibility that previous or later trauma exposure nor psychiatric history affected the reported symptom severity. Fourthly, similar to past studies in individuals exposed to traumatic injuries [56] the current sample included predominantly men. It is currently still unclear how gender impacts screening performance and optimal cut-off scores [57, 58]. Future studies might focus on whether optimal cut-offs are similar for men and women. Fifthly, the current study predominantly included individuals with injuries resulting from non-interpersonal or non-intentional events, mostly traffic accidents. A previous PCL-5 validation study in the United States identified a higher optimal cut-off for probable PTSD in those with intentional injuries compared to non-intentional injuries [21]. Therefore, future studies might further investigate the optimal PCL-5 cutoffs for those with non-intentional injuries in the Netherlands. Moreover, research into the use of the PCL-5 for population who experienced other types of traumatic events is important such as sexual violence or death of a loved one. Lastly, as we did not include a retest measurement we are unable to provide information about the test-retest reliability of the Dutch PCL-5.

Despite the aforementioned limitations, the current study provides crucial information about the use of the Dutch PCL-5 in trauma-exposed individuals. We found that the Dutch PCL-5 is valid and reliable. Importantly, we found that the optimal cut-off for probable PTSD is relatively low in this trauma-exposed population compared to previous studies in usually help-seeking samples, but corresponds very well with actual PTSD diagnosis according to the CAPS-5. This implies that the PCL-5 can be effectively used to screen for PTSD in a sample of adults previously exposed to (suspected) serious injuries. More research into the optimal cut-off of the PCL-5 is important, especially in trauma-exposed populations where PTSD severity and prevalence rates are higher than the current sample. PTSD is often not recognized or misdiagnosed and therefore left untreated [14]. Screening for PTSD in a population following trauma exposure might be an important strategy to identify those with PTSD effectively so that they can receive evidence-based treatment.

Data availability

The preregistered data analysis plan, data file, syntax and outcome files are available on the Open Science Framework (OSF; https://osf.io/skfbq). We will document our data and code availability in the FAIR Traumatic Stress Data Sets library of the Global Collaboration on Traumatic Stress (GCTS).

Abbreviations

PCL-5:

PTSD Checklist for DSM-5

PTSD:

Posttraumatic stress disorder

AMC:

Academic Medical Center

VUmc:

VU University Medical Center

CAPS-5:

Clinician-administered PTSD scale for DSM-5

IES-R:

The impact of event scale: revised

QIDS-SR:

The quick inventory of depressive symptomatology – self-reported

WHO-QOL:

The World Health Organization Quality of Life –Abbreviation

EQ-6D VAS scale:

The EuroQol 6 dimensions Visual Analogue Scale

OSF:

Open Science Framework

ROC:

Receiver Operating Curve

AUC:

Area Under the Curve

PPV:

Positive predictive value

NPV:

Negative predictive value

References

  1. de Vries GJ, Olff M. The lifetime prevalence of traumatic events and posttraumatic stress disorder in the Netherlands. J Trauma Stress. 2009;22(4):259–67.

    Article  PubMed  Google Scholar 

  2. APA. Diagnostic and statistical manual of mental disorders. 5th ed. Washington: American Psychiatric Association; 2013.

    Google Scholar 

  3. Liu H, Petukhova MV, Sampson NA. Association of DSM-IV Posttraumatic stress disorder with traumatic experience type and history in the World Health Organization World Mental Health Surveys (74, pg 270, 2017). Jama Psychiatry. 2017;74(7):764.

    Google Scholar 

  4. Kessler RC. Posttraumatic stress disorder: the burden to the individual and to society. J Clin Psychiat. 2000;61:4–14.

    Google Scholar 

  5. Pagotto LF, Mendlowicz MV, Coutinho ESF, Figueira I, Luz MP, Araujo AX, Berger W. The impact of posttraumatic symptoms and comorbid mental disorders on the health-related quality of life in treatment-seeking PTSD patients. Compr Psychiat. 2015;58:68–73.

    Article  PubMed  Google Scholar 

  6. Pacella ML, Hruska B, Delahanty DL. The physical health consequences of PTSD and PTSD symptoms: a meta-analytic review. J Anxiety Disord. 2013;27(1):33–46.

    Article  PubMed  Google Scholar 

  7. Karchoud JF, Haagsma JA, Karaban I, Hoeboer CM, van de Schoot R, Olff M, van Zuiden M. Long-term PTSD Prevalence and Associated Adverse Psychological, Functional, and Economic Outcomes: A 12–15 Year Follow-up of Adults with Suspected Serious Injury. submitted.

  8. Kessler RC, Aguilar-Gaxiola S, Alonso J, Benjet C, Bromet EJ, Cardoso G et al. Trauma and PTSD in the WHO World Mental Health Surveys. Eur J Psychotraumato. 2017;8.

  9. Mavranezouli I, Megnin-Viggars O, Daly C, Dias S, Welton NJ, Stockton S, et al. Psychological treatments for post-traumatic stress disorder in adults: a network meta-analysis. Psychol Med. 2020;50(4):542–55.

    Article  PubMed  Google Scholar 

  10. Mavranezouli I, Megnin-Viggars O, Grey N, Bhutani G, Leach J, Daly C et al. Cost-effectiveness of psychological treatments for post-traumatic stress disorder in adults. PLoS ONE. 2020;15(4).

  11. Watts BV, Schnurr PP, Mayo L, Young-Xu Y, Weeks WB, Friedman MJ. Meta-analysis of the efficacy of treatments for posttraumatic stress disorder. J Clin Psychiatry. 2013;74(6):e541–50.

    Article  PubMed  Google Scholar 

  12. Bromet EJ, Karam EG, Koenen KC, Stein DJ. Trauma and posttraumatic stress disorder: global perspectives from the WHO world mental health surveys. Cambridge University Press; 2018.

  13. Hyland P, Vallieres F, Cloitre M, Ben-Ezra M, Karatzias T, Olff M, et al. Trauma, PTSD, and complex PTSD in the Republic of Ireland: prevalence, service use, comorbidity, and risk factors. Soc Psych Psych Epid. 2021;56(4):649–58.

    Article  Google Scholar 

  14. Alonso J, Liu ZR, Evans-Lacko S, Sadikova E, Sampson N, Chatterji S, et al. Treatment gap for anxiety disorders is global: results of the World Mental Health Surveys in 21 countries. Depress Anxiety. 2018;35(3):195–208.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Zimmerman M, Mattia JI. Is posttraumatic stress disorder underdiagnosed in routine clinical settings? J Nerv Mental Disease. 1999;187(7):420–8.

    Article  Google Scholar 

  16. da Silva HC, da Rosa MMF, Berger W, Luz MP, Mendlowicz M, Coutinho ESF, et al. PTSD in mental health outpatient settings: highly prevalent and under-recognized. Braz J Psychiat. 2019;41(3):213–7.

    Article  Google Scholar 

  17. Davidson JRT. Recognition and treatment of posttraumatic stress disorder. Jama-J Am Med Assoc. 2001;286(5):584–8.

    Article  Google Scholar 

  18. The Life. Events Checklist for DSM-5 (LEC-5) [Internet]. 2013.

  19. Forkus SR, Raudales AM, Rafiuddin HS, Weiss NH, Messman BA, Contractor AA. The posttraumatic stress disorder (PTSD) checklist for DSM-5: a systematic review of existing psychometric evidence. Clin Psychol-Sci Pr. 2022.

  20. Bovin MJ, Marx BP. The problem with overreliance on the PCL–5 as a measure of PTSD diagnostic status. 2023.

  21. Geier TJ, Hunt JC, Nelson LD, Brasel KJ, deRoon-Cassini TA. Detecting PTSD in a traumatically injured population: the diagnostic utility of the PTSD Checklist for DSM-5. Depress Anxiety. 2019;36(2):170–8.

    Article  PubMed  Google Scholar 

  22. Geier TJ, Hunt JC, Hanson JL, Heyrman K, Larsen SE, Brasel KJ, deRoon-Cassini TA. Validation of abbreviated four- and eight-item versions of the PTSD Checklist for in a traumatically injured sample. J Trauma Stress. 2020;33(3):218–26.

    Article  PubMed  Google Scholar 

  23. Moodliar R, Russo J, Bedard-Gilligan M, Moloney K, Johnson P, Seo S, et al. A pragmatic Approach to Psychometric comparisons between the DSM-IV and DSM-5 posttraumatic stress disorder (PTSD) checklists in acutely injured trauma patients. Psychiatry. 2020;83(4):390–401.

    Article  PubMed  Google Scholar 

  24. Van Praag DLG, Fardzadeh HE, Covic A, Maas AIR, von Steinbuchel N. Preliminary validation of the Dutch version of the posttraumatic stress disorder checklist for DSM-5 (PCL-5) after traumatic brain injury in a civilian population. PLoS ONE. 2020;15(4).

  25. Oakley LD, Kuo WC, Kowalkowski JA, Park W. Meta-analysis of Cultural influences in Trauma exposure and PTSD Prevalence Rates. J Transcult Nurs. 2021;32(4):412–24.

    Article  PubMed  Google Scholar 

  26. Grekin R, O’Hara MW. Prevalence and risk factors of postpartum posttraumatic stress disorder: a meta-analysis. Clin Psychol Rev. 2014;34(5):389–401.

    Article  PubMed  Google Scholar 

  27. Rezayat AA, Sahebdel S, Jafari S, Kabirian A, Rahnejat AM, Farahani RH, et al. Evaluating the prevalence of PTSD among children and adolescents after earthquakes and floods: a systematic review and Meta-analysis. Psychiat Quart. 2020;91(4):1265–90.

    Article  PubMed  Google Scholar 

  28. Mouthaan J, Sijbrandij M, de Vries GJ, Reitsma JB, van de Schoot R, Goslings JC et al. Internet-based early intervention to prevent posttraumatic stress disorder in Injury patients: Randomized Controlled Trial. J Med Internet Res. 2013;15(8).

  29. Boeschoten MA, Bakker A, Jongedijk R, Olff M. PTSS checklist voor de DSM-5 [PTSD checklist for DSM-5]. Diemen: Arq Nationaal Psychotrauma Centrum; 2014.

    Google Scholar 

  30. Blevins CA, Weathers FW, Davis MT, Witte TK, Domino JL. The posttraumatic stress disorder checklist for DSM-5 (PCL-5): development and initial psychometric evaluation. J Trauma Stress. 2015;28(6):489–98.

    Article  PubMed  Google Scholar 

  31. Boeschoten MA, Van der Aa N, Bakker A, Ter Heide FJJ, Hoofwijk MC, Jongedijk RA et al. Development and evaluation of the Dutch clinician-administered PTSD scale for DSM-5 (CAPS-5). Eur J Psychotraumato. 2018;9(1).

  32. Weathers FW, Bovin MJ, Lee DJ, Sloan DM, Schnurr PP, Kaloupek DG, et al. The clinician-administered PTSD scale for DSM-5 (CAPS-5): development and initial psychometric evaluation in military veterans. Psychol Assess. 2018;30(3):383–95.

    Article  PubMed  Google Scholar 

  33. Weiss DS. The impact of event scale: revised. Cross-cultural assessment of psychological trauma and PTSD. 2007:219 – 38.

  34. Olde E, Kleber RJ, van der Hart O, Pop VJM. Childbirth and posttraumatic stress responses - a validation study of the Dutch impact of event scale - revised. Eur J Psychol Assess. 2006;22(4):259–67.

    Article  Google Scholar 

  35. Rush AJ, Trivedi MH, Ibrahim HM, Carmody TJ, Arnow B, Klein DN, et al. The 16-item Quick Inventory of Depressive Symptomatology (QIDS), clinician rating (QIDS-C), and self-report (QIDS-SR): a psychometric evaluation in patients with chronic major depression. Biol Psychiat. 2003;54(5):573–83.

    Article  PubMed  Google Scholar 

  36. Reilly TJ, MacGillivray SA, Reid IC, Cameron IM. Psychometric properties of the 16-item Quick Inventory of Depressive Symptomatology: a systematic review and meta-analysis. J Psychiat Res. 2015;60:132–40.

    Article  PubMed  Google Scholar 

  37. Skevington SM, Lotfy M, O’Connell KA. The World Health Organization’s WHOQOL-BREF quality of life assessment: psychometric properties and results of the international field trial - A report from the WHOQOL group. Qual Life Res. 2004;13(2):299–310.

    Article  PubMed  Google Scholar 

  38. Trompenaars F, Masthoff E, Heck G, Hodiamont P, Vries J. Content validity, construct validity, and reliability of the WHOQOL-Bref in a population of Dutch adult psychiatric outpatients. Qual Life Res. 2005;14(1):151–60.

    Article  PubMed  Google Scholar 

  39. Feng YS, Kohlmann T, Janssen MF, Buchholz I. Psychometric properties of the EQ-5D-5L: a systematic review of the literature. Qual Life Res. 2021;30(3):647–73.

    Article  PubMed  Google Scholar 

  40. Weis CN, Webb EK, Stevens SK, Larson CL, deRoon-Cassini TA. Scoring the life events Checklist: comparison of three scoring methods. Psychol Trauma-Us. 2022;14(4):714–20.

    Article  Google Scholar 

  41. Baker SP, O’Neill B, Haddon W Jr., Long WB. The injury severity score: a method for describing patients with multiple injuries and evaluating emergency care. J Trauma. 1974;14(3):187–96.

    Article  PubMed  Google Scholar 

  42. Teasdale G, Jennett B. Assessment of Coma and impaired consciousness - practical scale. Lancet. 1974;2(7872):81–4.

    Article  PubMed  Google Scholar 

  43. Hoeboer C, van Zuiden M, Olff M, Karchoud JF, Karaban I. PCL-5 validation with CAPS-5 in 2-ASAP study. 2023.

  44. López-Ratón M, Rodríguez-Álvarez MX, Cadarso-Suárez C, Gude-Sampedro F. OptimalCutpoints: an R Package for selecting Optimal cutpoints in Diagnostic tests. J Stat Softw. 2014;61(8):1–36.

    Article  Google Scholar 

  45. Schisterman EF, Perkins N. Confidence intervals for the Youden index and corresponding optimal cut-point. Am J Epidemiol. 2005;161(11):S9–S.

    Article  Google Scholar 

  46. Mandrekar JN. Receiver operating characteristic curve in Diagnostic Test Assessment. J Thorac Oncol. 2010;5(9):1315–6.

    Article  PubMed  Google Scholar 

  47. Power M, Fell G, Wright M. Principles for high-quality, high-value testing. Evid Based Med. 2013;18(1):5–10.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Clark LA, Watson D. Constructing validity: New Developments in creating objective Measuring instruments. Psychol Assess. 2019;31(12):1412–27.

    Article  PubMed  PubMed Central  Google Scholar 

  49. Post MW. What to do with moderate reliability and validity coefficients? Arch Phys Med Rehab. 2016;97(7):1051–2.

    Article  Google Scholar 

  50. Usher-Smith JA, Sharp SJ, Griffin SJ. The spectrum effect in tests for risk prediction, screening, and diagnosis. Bmj-Brit Med J. 2016;353.

  51. Ransohoff DF, Feinstein AR. Problems of spectrum and bias in evaluating the efficacy of diagnostic tests. N Engl J Med. 1978;299(17):926–30.

    Article  PubMed  Google Scholar 

  52. Einarsdottir TS, Asgeirsdottir BB, Sigurvinsdottir R, Ullman SE, Gudmundsdottir B. Prevalence of trauma exposure and PTSD symptoms among the Icelandic population: gender and regional differences. Scand J Public Healt. 2023.

  53. Goldstein RB, Smith SM, Chou SP, Saha TD, Jung J, Zhang HT, et al. The epidemiology of DSM-5 posttraumatic stress disorder in the United States: results from the national epidemiologic survey on Alcohol and related Conditions-III. Soc Psych Psych Epid. 2016;51(8):1137–48.

    Article  Google Scholar 

  54. Hall BJ, Yip PSY, Garabiles MR, Lao CK, Chan EWW, Marx BP. Psychometric validation of the PTSD Checklist-5 among female Filipino migrant workers. Eur J Psychotraumato. 2019;10(1).

  55. Santiago PN, Ursano RJ, Gray CL, Pynoos RS, Spiegel D, Lewis-Fernandez R et al. A systematic review of PTSD Prevalence and trajectories in DSM-5 defined Trauma exposed populations: intentional and non-intentional traumatic events. PLoS ONE. 2013;8(4).

  56. Haering S, Schulze L, Geiling A, Meyer C, Klusmann H, Schumacher S, et al. Higher risk-less data: a systematic review and meta-analysis on the role of sex and gender in trauma research. J Psychopathol Clin Sci. 2024;133(3):257–72.

    Article  PubMed  Google Scholar 

  57. Brewin CR. Systematic review of screening instruments for adults at risk of PTSD. J Trauma Stress. 2005;18(1):53–62.

    Article  PubMed  Google Scholar 

  58. Magwood O, Bellai-Dussault K, Fox G, McCutcheon C, Adams O, Saad A, Kassam A. Diagnostic test accuracy of screening tools for post-traumatic stress disorder among refugees and asylum seekers: a systematic review and meta-analysis. J Migration Health. 2023;7.

Download references

Funding

This study was funded by the Netherlands Organisation for Health Research and Development (ZonMw; #636340004).

Author information

Authors and Affiliations

Authors

Contributions

MvZ and MO obtained funding and designed the study. IK JFK and MvZ collected the data. CMH analyzed the data and wrote the main manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Chris M. Hoeboer.

Ethics declarations

Ethics approval and consent to participate

Written informed consent was obtained from all study participants. The follow-up assessment used in the current study was exempted from formal review by the Medical Ethical Review Committee of the Amsterdam University Medical center (W20_035#20.063).

Consent for publication

Not applicable.

Conflict of interest

The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary Material 1

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hoeboer, C.M., Karaban, I., Karchoud, J.F. et al. Validation of the PCL-5 in Dutch trauma-exposed adults. BMC Psychol 12, 456 (2024). https://doi.org/10.1186/s40359-024-01951-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s40359-024-01951-y