Skip to main content

Advertisement

We’d like to understand how you use our websites in order to improve them. Register your interest.

Validation of a brief mental health screening tool for pregnant women in a low socio-economic setting

Abstract

Background

In South Africa, the prevalence of symptoms of common mental disorders (CMD), i.e. depression, anxiety and suicidal thoughts are high. This study aimed to use a cognitive interviewing technique to validate the content and structure of a 4-item screening tool, to adapt the tool accordingly, and to use receiver operating curve (ROC) analysis to determine the optimum cut-point for identifying pregnant women with symptoms of CMD.

Methods

We conducted a mixed method study at a Midwife Obstetric Unit in Cape Town. Women attending the clinic for their first antenatal visit during the recruitment period, whose first language was English, Afrikaans or isiXhosa, were invited to participate. A 4-item screening tool was administered in the first language of the interviewee, after which a cognitive interviewing technique was used to examine the question-response processes and considerations used by respondents as they formed answers to the screening tool questions. The Edinburgh Postnatal Depression Scale (EPDS) was used to identify women with symptoms of CMD.

Results

A 2-week recall period performed well. Questions about (1) being unable to stop worrying, or thinking too much, (2) feeling down, depressed or hopeless, and (3) having thoughts and plans to harm yourself, were well understood. The question that referred to feeling little interest or pleasure in doing things, was poorly understood across all languages. Using ROC analysis with the EPDS as the reference standard, and a cut-point of ≥13, we showed that a 3-item version of the screening tool was able to correctly classify 91% of the women screened.

Conclusions

Cognitive interviewing enabled testing and refining of the language and constructs of an ultra-brief screening tool. The shortened, 3-item tool is well understood and effective at identifying pregnant women with symptoms of CMD, across the three most commonly spoken languages and cultures in Cape Town.

Peer Review reports

Background

In developed countries, the prevalence of maternal depression ranges between 7 and 15% [1], while in low- and middle-income countries (LMIC), the prevalence measured by both screening or diagnostic tools are as high as 20–26% [2]. In addition to depression, evidence suggests that anxiety occurs frequently during pregnancy, and may be even more common than depression. In a systematic review of anxiety during pregnancy, Brunton et al. reported global prevalence rates ranging from as low as 18% to as high as 60% [3]. Suicidal ideation and behaviour have also become increasingly reported during the perinatal period, with prevalence rates of between 6 and 18% [4,5,6,7]. In South Africa, similar to many other LMIC, the prevalence of depression, anxiety and suicidality is high. A recent study in Cape Town reported that the diagnostic prevalence of maternal depression was 22% [8], anxiety was 23% [9] and suicidal ideation and behaviour was 18% [4].

Common mental disorders (CMD), defined as symptoms of depression and anxiety, are of particular concern during the perinatal period because of its disabling effect on maternal functioning and on social and economic self-fulfilment, as well as the negative consequences for the health and development of infants and children [10]. Globally, about 80% of women affected by CMD during the perinatal period are not identified or treated [11]. At the time this research was conducted, routine screening for symptoms of CMD was not provided in South African primary care antenatal settings, despite the South African Mental Health Act explicitly stating that mental health care should routinely be provided within the general health environment, at primary and community level. The absence of routine screening was partly due to the lack of a short, simple and easily administered screening tool.

Both the Whooley questions and the Edinburgh Postnatal Depression Scale (EPDS) [12,13,14,15] have been validated against diagnostic criteria in research contexts in South Africa. In Johannesburg, the EPDS was validated against the Diagnostic and Statistical Manual (DSM-IV) [16] criteria for depression in a sample of postnatal women [12]. The study found that when using a threshold of 11, the EPDS identified 100% of women with major depression and 70.6% of women with minor depression (sensitivity = 80%; specificity = 76.6%). In a study in Cape Town, the anxiety subscale of the EPDS - which consists of questions 3, 4 and 5 - was validated against the Mini-International Neuropsychiatric Interview diagnostic criteria [17] and found to correctly classify 61% of the sample of pregnant women (Area Under the Curve (AUC) = 0.69; sensitivity = 67%; specificity = 59%) [15].

Even though the EPDS has been validated in research settings in South Africa, its structure is not feasible to be routinely used in busy, low resource primary care settings by non-specialist health workers due to its length (10-items) and Likert scoring system. Furthermore, several of the idiomatic constructs embedded in this Scottish-derived tool are culture-bound, e.g. “things have been getting on top of me” and “seeing the funny side of things”. These idioms are poorly understood in the typical South African linguistic context, unless careful explanations are given, such as can occur in research settings. Aside from screening administrators themselves potentially misunderstanding the items, it is time-consuming to explain the meanings of poorly understood items and thus, this would not logistically be feasible in the typical service environment. The Whooley questions, which consist of two items, with a possible third item, have also been validated in South Africa, [15] but generalisability of the results of this study is limited as a psychiatrist conducted both the screening and diagnostic procedures.

To address the gap between the too long EPDS and too short Whooley questions, the Perinatal Mental Health Project (PMHP) developed an English language, 4-item screening tool, for identifying pregnant women with symptoms of CMD and suicidal ideation in a low socio-economic setting in South Africa [18]. In the tool’s development, psychometric analysis was used to compare the performance of several commonly used screening tools, and the individual items within these tools, against the reference standard performance of the Expanded MINI (MINI Plus Version 5.0.0) clinical diagnostic interview [17]. Using Receiver Operating Characteristic (ROC) analysis with the MINI as the reference standard, this 4-item tool correctly classified 75% of the sample of women, when a cut-point of two out of a possible four was used (AUC = 0.76; sensitivity = 65%; specificity = 82%) [18]. The 4-item screening tool (Table 1) was derived from the Whooley [19], the Generalised Anxiety Scale (GAD-2) [20] and the EPDS [13]. The GAD and EPDS items were converted from their original Likert format to binary format for consistency and the time recall period was standardised to the prior 4 weeks.

Table 1 Questions making up the screening tool used in Phase 1 and Phase 2 of validation process

This study aims to further validate the 4-item screening tool [18] by (1) using a cognitive interviewing technique, in three local languages, in a sample of pregnant women from a low resource setting, to validate the content and structure, i.e. the construct validity of the 4-item screening tool, (2) adapting the tool accordingly, and (3) using ROC analysis, with the EPDS as the reference standard, to determine the optimum cut-point to be used to identify symptoms of CMD in pregnant women.

Methods

This study used a mixed method design and was conducted in Cape Town, South Africa between September and October 2017. Data were collected using questionnaires (quantitative) and semi-structured interviews (qualitative).

An amendment to the initial PMHP study’s ethical approval was obtained from the Human Research and Ethics Committee at the University of Cape Town (HREC REF: 131/2009). The Western Cape Provincial Department of Health approved the use of the research site. Participants who were identified as needing mental health support were referred to a qualified, on-site counsellor for free services. All participants were informed that they were free to withdraw from the study at any time without consequences. Those who participated in the study provided written, informed consent (and unassisted consent in the case of participants younger than 18 years, as the study was linked to a therapeutic intervention that did not require parental consent) after the procedure had been verbally explained to them. Consent forms were available in English, Afrikaans and isiXhosa. No financial incentives were provided for participating in the study.

Setting

This study was conducted at the Hanover Park Midwife Obstetric Unit (MOU), a public, primary healthcare facility in Cape Town, South Africa. The Hanover Park MOU offers free antenatal and postnatal services to pregnant and postpartum women. Approximately 10–15 women attend this facility for their first antenatal appointment every day. Hanover Park is a low-income, residential suburb that experiences high rates of gang activity, violent crimes and school drop-out [21]. More than half the women attending the MOU are unemployed, while 42% are considered to be food insecure [22].

Participants

Women attending the MOU for their first antenatal visit during the recruitment period, whose first language was English, Afrikaans or isiXhosa, were invited to participate in the study. As home language is related to race, income and education in the South African context, due to the legacy of Apartheid [23], the demographic profile of the participants are presented in Table 2. A total of 66 women, aged between 15 and 38 years (mean = 27.5; SD = 5.7), consented to being interviewed and having their interview recorded in a private interview room. None of the women who were invited to participate, declined. The most commonly spoken home language was English (n = 30; 45.4%), followed by Afrikaans (n = 19; 28.8%) and IsiXhosa (n = 17; 25.8%). Women who spoke isiXhosa were significantly older than those who spoke English or Afrikaans (p = 0.035). Women who spoke Afrikaans had significantly more pregnancies (p = 0.031) and a lower level of education than women who spoke English or isiXhosa (p = 0.020). The prevalence of depression (defined as scoring < 13 on the EPDS) was 24.3% (n = 16). Significantly fewer women who spoke English (n = 3; p = 0.042) screened positive for depression using the EPDS, compared to those who spoke Afrikaans (n = 7) and those who spoke isiXhosa (n = 6). The majority of women were in the first trimester of their pregnancy.

Table 2 Demographic characteristics of women by language of interview

Data collection

Questionnaires and a structured interview guide were translated and adapted using the World Health Organisation (WHO) recommended method of forward and back-translation [24]. English questionnaires (EPDS and 4-item screening tool) and a structured interview guide were forward translated into Afrikaans and isiXhosa by health professionals who were bilingual and familiar with the terminology used in the tools. During the translation process, emphasis was placed on the conceptual and cultural equivalence versus the linguistic equivalence of words and phrases. For each of the translated languages, an expert panel convened to identify and resolve the ambiguous expressions and discrepancies between the forward translation and the original English version. The Afrikaans and isiXhosa versions were then back-translated into English by a different health professional who was familiar with the terminology used in the tools, as well as the language nuances of the local community. The Afrikaans and isiXhosa tools were then pre-tested on one individual, representative of each of the target populations. The final version of the tools resulted from two iterations of this process.

First-language English, Afrikaans and isiXhosa speaking women fieldworkers, who had a Bachelor’s degree and professional counselling experience, were trained to seek consent and administer the questionnaires and semi-structured interviews. Pregnant women, attending the MOU for their first antenatal appointment were approached in the waiting areas between routine assessments. The interview process took between 15 and 30 min to complete, was conducted in the participants’ first language, and took place between routine assessments. A socio-demographic questionnaire was used to collect information on participants’ age, number of pregnancies, level of education and employment status. Thereafter, the 4-item screening tool was administered, and responses captured. This was followed immediately by a semi-structured interview which was audio-recorded. The qualitative interview did not affect the responses to the 4-item screening tool.

Cognitive interviewing or question testing is a technique involving a systematic, in-depth approach to assessing the validity of questionnaire content and structure [25,26,27]. This technique is based on a theory that distinguishes four stages of cognitive processing in response to questioning – understanding, memory, assessment and response [28]. It is used to determine the ways in which participants interpret questions and apply those questions to their own lives, experiences, and perceptions. It is used to investigate how different groups of participants may interpret or process questions differently.

The question-evaluation method of cognitive interviewing [25] was used to examine the question-response processes and considerations used by participants as they formed answers to the screening tool questions. The interview structure consisted of participants providing information to reveal the thinking processes behind their particular answers to the four screening questions. They were asked why they answered the questions as they did, in order to identify problems with interpretive errors and recall accuracy. Interviewers probed participants for concrete examples to support their item responses. Once the interviews were completed, the EPDS was administered. The EPDS, using a cut-point of 13 or more [29, 30], has been found to identify depressive symptoms in South African antenatal women in studies that used diagnostic data as reference standards. The results from both the EPDS and the 4-item screening tool (the latter using a cut-point of ≥2) were used to identify women with symptoms of CMD in the study sample. Women who screened positive on either of the tools were referred to the on-site, mental health counsellor for counselling and support.

A two-phased, iterative approach was used. Phase 1 consisted of interviewing approximately 30 participants, including approximately 10 from each language group. Recruitment continued until data saturation had been reached, i.e. when no new information was discovered in the data analysis. In an attempt to reduce the response error in Phase 1, the interviews were analysed, and adaptations made to the screening tool. One of the adaptations included changing the four-week recall period to 2 weeks, to align with the recall period used in diagnostic interviews. Phase 2 consisted of using the adapted screening tool to interview an additional 36 women (Table 1). Recruitment continued until data saturation had been reached.

Data analysis

The semi-structured interviews that were conducted in English were transcribed, while interviews conducted in Afrikaans and isiXhosa were translated into English and transcribed by native speakers of each language trained by the lead author. The interview text was analysed separately by two researchers with a third researcher resolving any differences. Analysis included determining how various constructs were understood based on a list of pre-selected criteria developed by all the authors (Table 3).

Table 3 Coding of constructs

Textual data were quantified or coded numerically, by the lead author, and captured in a spreadsheet for analysis. The process of quantifying textual data helped to counteract bias and improve reliability [31].

Quantitative data were captured in Microsoft Excel and exported to STATA/SE statistical software package version 14.2 (StataCorp., College Station, TX, USA) for analysis. Continuous variables that were not normally distributed were described using medians and interquartile ranges, and associations measured using the Kruskal Wallis test for nonparametric variables. Categorical variables were described using frequency and percentages, and associations measured using Fisher’s exact chi-square test as the sample sizes were small.

ROC curves were used to describe the performance of the 4-item screening tool using the EPDS as the reference standard, for phase 1 and phase 2 separately. Sample size calculations (type I error = 0.05; power = 0.08; AUC = 0.8–0.9) indicated that 10–20 participants were needed. The AUC was used to assess the diagnostic performance of the screening tool. In addition, sensitivity, specificity and the percentage correctly classified were calculated for all cut-points.

Results

These results report on the understanding of the constructs making up the screening tool, and the ability of the two iterations of the screening tool to correctly identify symptoms of mental illness when compared to the EPDS.

Understanding the screening tool constructs

The proportion of affirmative answers to the 4-item screening tool questions in the three languages was not significantly different (p > 0.05), except for the first question which related to anxiety symptoms in phase 1 (Table 4). In phase 1, significantly more women who spoke Afrikaans as a first language endorsed this item (p = 0.047), compared to women who spoke English or isiXhosa as a first language.

Table 4 Affirmative (yes) answers to screening tool by phase and language of interview

The 4-week recall period used in phase 1 was often misinterpreted (41% referred to the correct time period) (Table 5). When using the 4-week recall period, we found that more than half the women interviewed used the time of their learning of their being pregnant as a point of reference. When asked about the time period they had been considering when responding to the screening tool, many women replied ‘just before I found out I was pregnant’ or ‘since I found out I was pregnant’. After we changed the recall period to 2 weeks (i.e. phase 2), 82% of women understood the time construct to refer to the prior 2 week period. When asked about the time period they were thinking about, many women referred to ‘this week and last week’, or ‘in the last two weeks’, or ‘two weeks ago’. When asked about the frequency of the symptoms, ‘often’ was interpreted by many to refer to ‘now and then’, ‘once’, ‘twice’ or they referred to a specific day or event. Hence, the language of the frequency construct was changed to ‘on some or most days’ in phase 2. This improved the ‘in scope’ interpretation.

Table 5 In scope understanding of time construct and questions in the screening tool by phase and language of interview

The first and second questions about feeling ‘unable to stop worrying, or thinking too much’ and feeling ‘down, depressed or hopeless’ were understood to reflect symptoms of anxiety and depression respectively, in both phases and all three languages. Women frequently used the words ‘stress’ or ‘stressful’ or ‘stressing’ to describe both feelings. The two feelings were often linked together, with women explaining that ‘being unable to stop thinking and worrying’ would cause them to feel ‘down, depressed or hopeless’.

The third question in the screening tool ‘felt little pleasure or interest in doing things that you used to enjoy before?’ was not understood by 48% of participants in phase 1, to refer to the concept of anhedonia, i.e. the inability to feel and experience pleasure in normally pleasurable activities [32]. After adjusting the question in phase 2, to ‘been concerned/troubled about having little interest or pleasure in doing things?’, only 44% of women interpreted the construct within the scope of anhedonia. When the women were asked to give a reason for feeling ‘little pleasure or interest in doing things’ they reported feeling ‘sleepy’, ‘tired’, ‘lazy’ or having ‘low energy’ since they found out about the pregnancy.

The fourth question in the screening tool on ‘thoughts and plans to harm yourself’ was understood in phase 1, by 90% of the women, to reflect both ideation and planning for suicide. The question did not require any change for the second phase.

Screening tool ability to detect symptoms of depression, anxiety and suicidality

ROC analysis was performed, using the EPDS as the reference standard (cut-point ≥13), for phase 1 and phase 2 separately (Table 6). The AUC was higher in phase 2 (AUC = 0.959 & 0.928) compared to phase 1 (AUC = 0.841 & 0.865), for both the 4-item and 3-item (without the anhedonia question) screening tools respectively. In both phase 1 and phase 2, when using the same cut-point of ≥2, the 3-item screening tool correctly classified a greater proportion of the sample than the 4-item screening tool. The 3-item screening tool was able to correctly classify 87% in phase 1, and 91% in phase 2, while the 4-item screening tool correctly classified 73% in phase 1 and 74% in phase 2.

Table 6 ROC analysis of 4-question screening tool against the EPDS (using ≥13 as the cut-point)

Discussion

We used cognitive interviewing to validate the content and structure of a 4-item screening tool used to screen pregnant women for symptoms of CMD and suicidality. Across the three languages, despite some significant differences in socio-demographic characteristics, women’s understanding of the various questions were similar. Although the numbers were small, we found that their language did not influence their interpretation of the questions. We found that the 2-week recall period performed better than the 4-week recall. The anhedonia question that referred to feeling ‘little interest or pleasure in doing things’ was poorly understood in both phases of the study and across all languages, as women associated feeling a decreased interest and pleasure in doing things to be related to tiredness commonly experienced in the first trimester of pregnancy. Using ROC analysis with the EPDS as the reference standard, we showed that a 3-item version of the screening tool (without the anhedonia question) was able to correctly classify 91% of the women screened.

A number of screening questionnaires, including the EPDS [33], Whooley [15], Patient Health Questionnaire 9 (PHQ-9) [34], Kessler-10 [35] and GAD-2 [36] have been used in studies to screen perinatal women for CMD and suicidality. These screening tools have recall periods varying from 7 days (EPDS) to 1 month (Whooley and Kessler-10). In addition, the Expanded MINI-International Neuropsychiatric Interview [37] is a structured diagnostic interview which refers to a 2-week recall period to diagnose current depression, and a 6-month recall period to diagnose a current anxiety disorder as per the latest versions of the major diagnostic manuals used globally: the DSM 5 (Diagnostic and Statistical Manual of Mental Disorders) [38] and the ICD (International Classification of Diseases) [39].

When using the 4-week recall period, we found that more than half the women interviewed did not consider how they had felt before their pregnancy as they often referred to ‘just before I found out I was pregnant’ or ‘since I found out I was pregnant’. After changing the recall period to 2 weeks (as used in diagnostic interviews), we observed considerable increased coherence in their understanding of the time construct. We could find no other studies that reported similar findings, possibly due to the limited practice of reporting the participants’ understanding of recall periods. However, there is the possibility that learning one is pregnant may result in an adjustment response that is not necessarily pathological in the socio-economically deprived context in which this study took place. A brief recall period may thus falsely include those still adjusting to the news of their pregnancy by expressing symptoms of depression and anxiety. Furthermore, the items used to generate the tool were originally selected from a regression analysis against a diagnostic gold standard where diagnostic criteria were strictly observed [18].

We found that the word ‘often’ used in phase 1, as well as ‘on some or most days’ used in phase 2, seemed to cause participants to consider a specific day or event rather than considering a continuous period of time. This is supported by a Kenyan study [40] of HIV positive men and women using the PHQ-9 screening tool. Monahan et al. [40] reported that participants found it confusing to relate the phrase ‘more than half the days’ to the 2-week recall period. Similarly, we found that the women, when asked about their feelings ‘on some or most days’ during the last 2 weeks, did not consider the time period being referred to, but instead referred to a specific day or event. This suggests that time periods are not necessarily useful unless asking about specific events (e.g. taking of medication or visits to the health facility).

In both phases of the study, we found that the anhedonia question elicited ‘out of scope’ interpretations resulting in a number of false positives, irrespective of language or recall period. Many women reported feeling tired, sleepy, or lazy during their pregnancy. They reported having little energy to do the things they normally enjoyed doing. Similar high levels of false positives were reported by Darwin et al. [41] in a study using the Whooley question in a sample of British women in the first trimester of pregnancy. While the phrasing of the question may require adjustment to include a more specific explanation, the inclusion of additional phrases would increase the complexity of the questions, thus reducing the functional utility of the tool. As our objective is to validate a tool that is as brief as possible for busy clinical settings, and for use by a range of provider cadres, it was reassuring to note that removal of the item yielded improved psychometric properties. The ROC analysis showed that 91% of women we correctly classified with the remaining three questions.

In South Africa, the prevalence of perinatal mental disorders is high [8, 9, 42] and has been linked to poverty [43]. Untreated anxiety and depression during the perinatal period has significant, intergenerational effects on the health of mothers and children. However, the perinatal period also provides health care workers with a unique opportunity to identify and treat vulnerable women, as more than 90% of pregnant women access health care facilities during this period [44]. Yet, South African public health facilities do not currently provide routine screening to pregnant women as a result of the overburdened health care system, lack of political will, concern about lack of referral sources and institutional stigma [45]. To screen women attending busy maternity clinics routinely, health care providers require a brief, locally validated tool, which is simple to use, culturally relevant, transdiagnostic (i.e. can identify women with symptoms of depression, anxiety and suicidality), and can be administered by non-specialist care providers. While this study has successfully validated such a screening tool, there remains a number of barriers to integrating screening into routinely provided maternal care. Concerns have been raised regarding the acceptability and benefit of routine screening, limitations of screening tools leading to false positives and negatives, the feasibility of follow-up and access to quality mental health care, as well as the financial cost [46, 47]. However, there is also growing evidence that demonstrates how screening and treating CMD in LMIC improves health outcomes [48].

This study has several strengths. We used a well-recognised scientific methodology, namely cognitive interviewing, to understand the way in which the constructs making up the screening tool performed. This method allowed us to analyse interpretative patterns across groups, as well as the accuracy of the translations. We used an iterative approach which allowed us to refine the tool, before conducted the second set of interviews.

This study also has limitations. Due to limited funds, we did not compare our results to a diagnostic interview, but used another screening tool, the EPDS, instead. While this may be a potential threat to the internal validity, the EPDS has been shown to have good sensitivity and specificity compared to diagnostic interviews in South Africa [49]. In addition, the applicability of our findings may be more generalizable to depression than anxiety since the EPDS anxiety sub-scale was only able to correctly classify 61% of pregnant women.

Additional research is needed to compare the ability of the screening tool to identify symptoms of depression, anxiety or suicidality to that of a diagnostic test, in various settings and stages of pregnancy, including the postpartum period and with adolescent mothers.

Conclusions

In this study, cognitive interviewing methods were used systematically to test the questionnaire items of an ultra-brief screening tool for perinatal CMD and suicidality. This iterative process enabled testing and refining of the language and constructs in order to ascertain that the tool is well understood and effective at identifying pregnant women with symptoms of CMD. In addition, the tool is valid across the three most commonly spoken languages and cultures in Cape Town.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

AUC:

Area under the curve

CMD:

Common mental disorders

DSM:

Diagnostic and statistical manual

EPDS:

Edinburgh Postnatal Depression Scale

GAD:

Generalised Anxiety Scale

HREC:

Human Research Ethics Committee

ICD:

International Classification of Diseases

LMIC:

Low- and Middle-Income Countries

MOU:

Midwife Obstetric Unit

PHQ:

Patient Health Questionnaire

PMHP:

Perinatal Mental Health Project

ROC:

Receiver Operating Curve

WHO:

World Health Organisation

References

  1. 1.

    Grote NK, Bridge JA, Gavin AR, Melville JL, Iyengar S, Katon WJ. A meta-analysis of depression during pregnancy and the risk of preterm birth, low birth weight, and intrauterine growth restriction. Arch Gen Psychiatry. 2010;67(10):1012–24.

  2. 2.

    Gelaye B, Rondon MB, Araya R, Williams MA. Epidemiology of maternal depression, risk factors, and child outcomes in low-income and middle-income countries. Lancet Psychiatry. 2016;3(10):973–82.

  3. 3.

    Brunton RJ, Dryer R, Saliba A, Kohlhoff J. Pregnancy anxiety: a systematic review of current scales. J Affect Disord. 2015;176:24–34.

  4. 4.

    Onah MN, Field S, Bantjes J, Honikman S. Perinatal suicidal ideation and behaviour: psychiatry and adversity. Arch Women Ment Health. 2017;20(2):321–31.

  5. 5.

    e Couto TC, Brancaglion MYM, Cardoso MN, Faria GC, Garcia FD, Nicolato R, et al. Suicidality among pregnant women in Brazil: prevalence and risk factors. Arch Women Ment Health. 2016;19(2):343–8.

  6. 6.

    Zhong Q, Gelaye B, Rondon MB, Sánchez SE, Simon GE, Henderson DC, et al. Using the patient health questionnaire (PHQ-9) and the Edinburgh postnatal depression scale (EPDS) to assess suicidal ideation among pregnant women in Lima, Peru. Arch Women Ment Health. 2015;18(6):783–92.

  7. 7.

    Huang H, Faisal-Cury A, Chan Y, Tabb K, Katon W, Menezes PR. Suicidal ideation during pregnancy: prevalence and associated factors among low-income women in São Paulo, Brazil. Arch Women Ment Health. 2012;15(2):135–8.

  8. 8.

    van Heyningen T, Myer L, Onah M, Tomlinson M, Field S, Honikman S. Antenatal depression and adversity in urban South Africa. J Affect Disord. 2016;203:121–9.

  9. 9.

    van Heyningen T, Honikman S, Myer L, Onah MN, Field S, Tomlinson M. Prevalence and predictors of anxiety disorders amongst low-income pregnant women in urban South Africa: a cross-sectional study. Arch Womens Ment Health. 2017;20(6):765–75.

  10. 10.

    Manikkam L, Burns JK. Antenatal depression and its risk factors: an urban prevalence study in KwaZulu-Natal. S Afr Med J. 2012;102(12):940–4.

  11. 11.

    Condon J. Women’s mental health: a “wish-list” for the DSM V. Arch Women Ment Health. 2010;13(1):5–10.

  12. 12.

    Lawrie T, Hofmeyr G, De Jager M, Berk M. Validation of the Edinburgh postnatal depression scale on a cohort of south African women. S Afr Med J. 1998;88(10):1340–4.

  13. 13.

    Cox JL, Holden JM, Sagovsky R. Detection of postnatal depression: development of the 10-item Edinburgh postnatal depression scale. Br J Psychiatry. 1987;150(6):782–6.

  14. 14.

    De Bruin GP, Swartz L, Tomlinson M, Cooper PJ, Molteno C. The factor structure of the Edinburgh postnatal depression scale in a south African peri-urban settlement. S Afr J Psychol. 2004;34(1):113–21.

  15. 15.

    Marsay C, Manderson L, Subramaney U. Validation of the Whooley questions for antenatal depression and anxiety among low-income women in urban South Africa. S Afr J Psychiatry. 2017;23(1):1–7.

  16. 16.

    Frances AJ, Widiger TA, Pincus HA. The development of DSM-IV. Arch Gen Psychiatry. 1989;46(4):373–5.

  17. 17.

    Lecrubier Y, Sheehan D, Hergueta T, Weiller E. The mini international neuropsychiatric interview. Eur Psychiatry. 1998;13(1004):198s.

  18. 18.

    McKenna A, Abrahams Z, Marsay M, Honikman S. Screening for common perinatal mental disorders in South Africa. 2017; Available at: https://pmhp.za.org/wp-content/uploads/SouthAfricanScreeningAdvisory_PMHP.pdf. Accessed 11 Apr 2018.

  19. 19.

    Whooley M. Whooley questions for depression screening. 2016; Available at: http://whooleyquestions.ucsf.edu/. Accessed 27 Feb 2018.

  20. 20.

    Skapinakis P, Kroenke K, Spitzer R, Williams J. The 2-item generalized anxiety disorder scale had high sensitivity and specificity for detecting GAD in primary care. Evid Based Med. 2007;12(5):149.

  21. 21.

    City of Cape Town. Hanover Park - a public investment framework. 2015; Available at: http://resource.capetown.gov.za/documentcentre/Documents/City%20strategies,%20plans%20and%20frameworks/Hanover%20Park%20Public%20Investment%20Framework_22%20October%202015.pdf. Accessed 5 Dec 2017.

  22. 22.

    Abrahams Z, Lund C, Field S, Honikman S. Factors associated with household food insecurity and depression in pregnant south African women from a low socio-economic setting: a cross-sectional study. Soc Psychiatry Psychiatr Epidemiol. 2018;53:1–10.

  23. 23.

    South African History Online. Race and ethnicity in South Africa. 2019; Available at: https://www.sahistory.org.za/article/race-and-ethnicity-south-africa. Accessed 18 Aug 2019.

  24. 24.

    World Health Organisation. Process of translation and adaptation of instruments. 2018; Available at: http://www.who.int/substance_abuse/research_tools/translation/en/. Accessed 7 Feb 2018.

  25. 25.

    Miller K, Chepp V, Willson S, Padilla JL. Cognitive interviewing methodology. Hoboken: Wiley; 2014.

  26. 26.

    Willis GB. Cognitive interviewing: a tool for improving questionnaire design. Hoboken: Sage Publications; 2004.

  27. 27.

    Collins D. Pretesting survey instruments: an overview of cognitive methods. Qual Life Res. 2003;12(3):229–38.

  28. 28.

    Tourangeau R, Rasinski KA. Cognitive processes underlying context effects in attitude measurement. Psychol Bull. 1988;103(3):299.

  29. 29.

    Rochat TJ, Richter LM, Doll HA, Buthelezi NP, Tomkins A, Stein A. Depression among pregnant rural south African women undergoing HIV testing. JAMA. 2006;295(12):1373–8.

  30. 30.

    Rochat T, Tomlinson M, Newell M, Stein A. Depression among pregnant women testing for HIV in rural South Africa: Implications for VCT. 9th international AIDS impact conference; 2009.

  31. 31.

    Bazeley P. Computer assisted integration of mixed methods data sources and analyses. USA: Sage Publications; 2010.

  32. 32.

    Faithe Brynie. Depression and anhedonia. 2018; Available at: https://www.psychologytoday.com/blog/brain-sense/200912/depression-and-anhedonia. Accessed 6 Mar 2018.

  33. 33.

    Tsai AC, Scott JA, Hung KJ, Zhu JQ, Matthews LT, Psaros C, et al. Reliability and validity of instruments for assessing perinatal depression in African settings: systematic review and meta-analysis. PLoS One. 2013;8(12):e82521.

  34. 34.

    Sidebottom AC, Harrison PA, Godecker A, Kim H. Validation of the patient health questionnaire (PHQ)-9 for prenatal depression screening. Arch Women Ment Health. 2012;15(5):367–74.

  35. 35.

    Spies G, Stein D, Roos A, Faure S, Mostert J, Seedat S, et al. Validity of the Kessler 10 (K-10) in detecting DSM-IV defined mood and anxiety disorders among pregnant women. Arch Women Ment Health. 2009;12(2):69–74.

  36. 36.

    Suzuki S, Eto M. Screening for depressive and anxiety symptoms during pregnancy and postpartum at a Japanese perinatal center. J Clin Med Res. 2017;9(6):512–5.

  37. 37.

    Sheehan D, Lecrubier Y, Sheehan KH, Sheehan K, Amorim P, Janavs J, et al. Diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatr. 1998;59:22–33.

  38. 38.

    American Psychiatric Association. Diagnostic and statistical manual of mental disorders, fifth edition. Available at: https://dsm.psychiatryonline.org/doi/book/10.1176/appi.books.9780890425596. Accessed 19 Apr 2018.

  39. 39.

    World Health Organisation. Classification - ICD-10 online versions. 2018; Available at: http://www.who.int/classifications/icd/icdonlineversions/en/. Accessed 19 Apr 2018.

  40. 40.

    Monahan PO, Shacham E, Reece M, Kroenke K, Ong’or WO, Omollo O, et al. Validity/reliability of PHQ-9 and PHQ-2 depression scales among adults living with HIV/AIDS in western Kenya. J Gen Intern Med. 2009;24(2):189.

  41. 41.

    Darwin Z, McGowan L, Edozien LC. Identification of women at risk of depression in pregnancy: using women’s accounts to understand the poor specificity of the Whooley and Arroll case finding questions in clinical practice. Arch Women Ment Health. 2016;19(1):41–9.

  42. 42.

    Rochat TJ, Tomlinson M, Bärnighausen T, Newell M, Stein A. The prevalence and clinical presentation of antenatal depression in rural South Africa. J Affect Disord. 2011;135(1):362–73.

  43. 43.

    Lund C, Breen A, Flisher AJ, Kakuma R, Corrigall J, Joska JA, et al. Poverty and common mental disorders in low and middle income countries: a systematic review. Soc Sci Med. 2010;71(3):517–28.

  44. 44.

    Statistics South Africa. Millenium Development Goals 5: Improve maternal health 2015. 2015; Available at: http://www.statssa.gov.za/MDG/MDG_Goal5_report_2015_.pdf. Accessed 3 Apr 2018.

  45. 45.

    Schneider M, Baron E, Breuer E, Docrat S, Honikman S, Onah M, et al. Integrating mental health into South Africa’s health system: current status and way forward. S Afr Health Rev. 2016;1:153–63.

  46. 46.

    Thombs BD, Coyne JC, Cuijpers P, de Jonge P, Gilbody S, Ioannidis JP, et al. Rethinking recommendations for screening for depression in primary care. Can Med Assoc J. 2012;184(4):413–8.

  47. 47.

    Thombs BD, Arthurs E, Coronado-Montoya S, Roseman M, Delisle VC, Leavens A, et al. Depression screening and patient outcomes in pregnancy or postpartum: a systematic review. J Psychosom Res. 2014;76(6):433–46.

  48. 48.

    Rahman A, Fisher J, Bower P, Luchters S, Tran T, Yasamy MT, et al. Interventions for common perinatal mental disorders in women in low-and middle-income countries: a systematic review and meta-analysis. Bull World Health Organ. 2013;91:593–601I.

  49. 49.

    Van Heyningen T, Myer L, Tomlinson M, Field S, Honikman S. Screening for common perinatal mental disorders in low-resource, primary care, antenatal settings in South Africa. CPMH Policy Brief; 2014.

Download references

Acknowledgements

The authors wish to acknowledge and thank the staff and study participants at the Hanover Park Midwife Obstetric Unit, as well as Liesl Hermanus and Rethabile Leanya for their assistance.

Funding

We would also like to thank the philanthropic organisations (Ackerman Family Foundation, Eric and Sheila Samson Foundation, the Freddy Hirsh group, Harry Crossley Foundation and the Heneck Family Foundation) that provided general support funding to the Perinatal Mental Health Project.

Author information

Affiliations

Authors

Contributions

ZA, MS, SF and SH contributed to the study design and reviewed the interview schedule drafted by ZA. ZA oversaw data collection. ZA and SF analysed the text. MS resolved any differences. ZA drafted the manuscript, provided critical review of the draft manuscript. ZA, MS, SF and SH read and approved the final manuscript.

Corresponding author

Correspondence to Zulfa Abrahams.

Ethics declarations

Ethics approval and consent to participate

Ethical approval for the study was obtained from the Human Research and Ethics Committee at the University of Cape Town as an amendment to the initial PMHP study’s ethical (HREC REF: 131/2009). In addition, the Western Cape Provincial Department of Health approved the use of the research site. Those who participated in the study provided written, informed consent or assent after the procedure had been verbally explained to them.

Consent for publication

Not Applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Abrahams, Z., Schneider, M., Field, S. et al. Validation of a brief mental health screening tool for pregnant women in a low socio-economic setting. BMC Psychol 7, 77 (2019). https://doi.org/10.1186/s40359-019-0355-3

Download citation

Keywords

  • Common mental disorders
  • ROC analysis
  • Cognitive testing
  • Low-resource setting
  • Pregnancy