Validation of the Behavioral Anger Response Questionnaire for Children (BARQ-C) in a large community sample of Vietnamese middle adolescents in Hanoi
BMC Psychology volume 10, Article number: 199 (2022)
Depression and other forms of psychological distress are common among Vietnamese adolescents and increase the risk of mental health problems in adulthood. As anger coping is a robust predictor of adolescent mental health difficulties, and there appear to be cultural variations in anger coping, a measure of adolescent anger coping styles that has been validated using a non-Western adolescent sample is required to inform and support early intervention to prevent or treat mental health difficulties in Vietnamese adolescents. This study examined the construct validity (structural and external) of the Behavioral Anger Response Questionnaire for Children in Vietnam (BARQC-V).
Baseline data sourced from a recent randomised control trial conducted with Grade 10 Vietnamese adolescents aged 14 to 16 (N = 1084) were used to examine multiple aspects of construct validity: factorial structure (evaluated using factor analysis); internal consistency (tested using Cronbach’s alpha coefficient); and external aspect (assessed using Pearson’s correlation coefficients between the BARQC-V and Vietnamese translations of the Coping Self-Efficacy Scale, Centre for Epidemiologic Studies Depression Scale Revised, Mental Health Continuum Short Form, and the Depression Anxiety and Stress Scale).
Evaluating factorial structure using confirmatory factor analysis failed to converge on a solution. Exploratory factor analysis yielded a 5-factor structure model that explained 49.32% of the BARQC-V’s total variance and was deemed to be a good fit by the final confirmatory factor analysis. Cronbach’s alpha coefficients of the 5 factors demonstrated acceptable internal reliability for the BARQC-V’s sub-scales. Concerning concurrent validity, three sub-scales predicted well-being and mental health difficulties: the maladaptive anger coping styles Rumination and Direct Anger-out were positively associated with depression and distress, and negatively associated with coping self-efficacy and mental well-being; and the adaptive anger coping style Assertion was positively associated with coping self-efficacy and mental well-being, and negatively associated with depression.
The BARQC-V provides a validated measure of three anger coping strategies used by adolescents in Vietnam (Rumination, Direct Anger-out, and Assertion) that can be used to improve detection and treatment of mental health difficulties in this population, and as a starting point by future research to develop a much-needed gold standard measure of anger coping for adults, adolescents and children world-wide.
Depression and other forms of psychological distress are common among Vietnamese adolescents and increase the risk of mental health problems in adulthood [1, 2]. Anger coping, the modification of heightened anger by aggressively venting or keeping angry feelings to oneself , is a robust predictor of mental health difficulties in adolescents. and there are cultural variations in anger coping . To detect maladaptive anger coping in Vietnamese adolescents to facilitate intervention to prevent and diminish psychological distress, a measure of adolescent anger coping styles validated using a non-Western population is required.
Anger, a negative feeling state with specific cognitive appraisals, physiological changes and action tendencies , is associated with several mental disorders, many of which do not include anger as a key symptom, for example mood disorders, disrupted eating, and substance-related disorders [6, 7]. Research shows a close relationship between anger and depression in community [8, 9] and patient populations [10, 11], with depressed people experiencing more anger  and using more anger suppression (concealment of angry feelings) than non-depressed people . Although anger is generally perceived as maladaptive [13, 14], it can be adaptive (i.e., protective against psychopathology), especially when it is communicated in a helpful manner . As adolescents commonly experience anger, which has been linked with mental health problems during puberty [16, 17], and has been found to predict maladjustment in adulthood [7, 18, 19], understanding processes used to manage anger is important.
Emotion regulation refers to cognitive strategies used to manage feelings, thoughts and behaviour to cope with challenging situations in an effective and socially acceptable manner [20, 21]. Helpful (adaptive) strategies are associated with mental health, while unhelpful (maladaptive) strategies are associated with mental illness [22, 23].
Three anger coping emotion-regulation strategies are theorised to be adaptive: reappraisal, the generation of benign or positive interpretations of a stressful situation to reduce distress [24, 25]; problem solving, a conscious attempt to change a stressful situation or contain its consequences [26, 27]; and acceptance of an experienced emotion without attempting to control or change it [25, 28]. Conversely, three maladaptive anger coping emotion-regulation strategies increase the risk of depression: suppression of unwanted thoughts which paradoxically increases the accessibility of the suppressed thought, increases emotional arousal, and interferes with habituation to emotional stimuli [29, 30]; avoidance which increases negative thoughts and prevents remedial action ; and rumination which interferes with effective problem solving and increases indecision  by repetitively focusing on the emotion and its causes and consequences [32, 33]. A meta-analysis of 114 studies examined the relationships between these six emotion-regulation strategies and symptoms of internalising disorders (anxiety and depression) and externalising disorders (disrupted eating and substance-related disorders) . Acceptance, reappraisal and problem solving were associated with reduced anxiety and depression, while rumination, avoidance and suppression were associated with increased anxiety and depression. Effect sizes (interpreted as large (> 0.40), medium (0.10–0.39), or small (< 0.10) ) emerged as large for rumination; medium to large for avoidance, problem solving, and suppression; and small to medium for reappraisal and acceptance.
Research into cultural variations in anger coping is in its infancy . It has been postulated that Asian cultures tend to value family and the group ahead of individual needs; emphasise harmony, self-restraint and affective control; and encourage individuals to adapt to their environment in order to fit in [35, 36]. Anger tends to be socially perceived as maladaptive for relationships and is strongly discouraged as its expression may draw attention to the individual, encourage disharmony, and demonstrate a lack of self-restraint [37, 38]. Studies with Vietnamese children and adults living in America suggest that they are more likely than their Western counterparts to suppress anger [39, 40], implying that Vietnamese adolescents living in Vietnam would suppress their anger also. However, the manner in which Vietnamese adolescents living in Vietnam actually cope with anger is unknown.
Measuring anger coping
Although many anger coping styles likely exist [41,42,43], a preponderance of anger coping scales only measure a few anger coping styles such as anger-out (expressed anger) or anger-in (suppressed anger). The Behavioral Anger Response Questionnaire (BARQ) was developed to measure anger coping in adults using 37 items grouped into six sub-scales, each of which represented an anger coping style . It was suggested that two sub-scales represented maladaptive anger coping styles: Direct Anger-out (extreme expression) and Avoidance (extreme suppression and similar to anger-in); that three sub-scales represented adaptive anger coping styles: Assertion (akin to problem-solving), Social Support-seeking (recruiting support from others to boost anger coping), and Diffusion (suppressing or redirecting angry feelings e.g., by engaging in another activity); and that Rumination measured the degree to which adults repeatedly think about their response to anger . The BARQ has demonstrated good internal consistency (mean α = 0.76, range 0.65–0.85) and acceptable construct validity .
Martin and Dahlen  compared the BARQ to the State-Trait Anger Expression Inventory-2 (STAXI-2) . Findings suggested that Rumination represented extreme suppression, contrary to an earlier suggestion that Avoidance represented extreme suppression; that Direct Anger-out and Rumination were maladaptive anger coping styles; and that Assertion, Social Support-seeking, Diffusion and Avoidance were adaptive anger coping styles. They recommended additional research to re-evaluate the meaning of the BARQ sub-scales.
The Behavioral Anger Response Questionnaire for Children (BARQ-C) was developed to measure anger coping styles in children and adolescents  by rewording some items to make them more relevant to this population, and was validated using a sample aged 11.1–16.3 years old (British n = 393, Dutch n = 299). The Social Support-seeking and Assertion anger coping sub-scales yielded good psychometric properties in both samples. Good internal consistency for Direct Anger-out and Rumination emerged after removing one Direct Anger-out item and two Rumination items that did not load on their intended factors. Cronbach’s alphas for the Diffusion and Avoidance sub-scales were unacceptable but all items were retained as removing weaker items highlighted by factor analysis did not improve internal consistency. The authors recommended that future research endeavour to improve the BARQ-C.
A few studies have used the BARQ-C in populations from Asia. Using the 37-item BARQ-C to explore the influence of anger coping on the mental health and friendship quality of Chinese adolescents (N = 630, 12–16 years old) found that the influence of Social Support-seeking on mental health problems was fully mediated by friendship quality, the influence of Assertion on mental health problems was partially mediated by friendship quality, and mental health problems were predicted by the Direct Anger-out and Rumination coping styles . The impact of self-esteem (measured using the Rosenberg Self-esteem Scale) and anger coping (measured using a 33-item version of the BARQ-C after removing one Rumination item, one Avoidance item and two Diffusion items) on anger was explored with adolescents in Indonesia with a history of juvenile delinquency (N = 178, 12–20 years old) . Direct Anger-out and Rumination had a significant influence on the level of anger. A modified 24-item BARQ-C was used to explore the socio-cultural perspective on anger regulation in Chinese children from Hong Kong and Dutch Children (N = 131, 11 years old) . Chinese children were more likely to react tolerantly to the aggressor, whereas Dutch children indicated that they would verbally confront the aggressor. Although the BARQ-C has not been validated using a non-Western population, given the lack of a gold standard measure of anger coping (in adults and/or children regardless of culture), face validity of the BARQ-C suggested that it had potential for research in Vietnam to detect anger coping among adolescents.
Anger and mental health of adolescents in Vietnam
Depression and other mental health problems in adolescence are a prominent public health problem worldwide , with depressive disorders the fourth leading cause of disability-adjusted life-years in adolescents aged 10–24 years . As the majority of first onset depression occurs during adolescence  and increases the risk of mental health problems in adulthood , adolescence offers a crucial window for the prevention, detection and early treatment of depression. Mental health problems, including depression, are common among adolescents in Vietnam, with up to 23% of Vietnamese adolescents experiencing clinically significant symptoms of depression . While findings show that anger coping styles predict mental health problems in adolescents, and continue to impact on mental health in adulthood , there is a paucity of research exploring this association in non-Western cultures. Hence, a validated instrument that measures anger coping styles used by Vietnamese adolescents is required to inform and support early intervention to prevent or treat depression.
The present study
This study aimed to examine multiple aspects of the construct validity of the BARQ-C for use with high school students in Vietnam, including its structural aspect (factorial structure, measurement invariance, and internal consistency), and external aspect (concurrent validity). The study used baseline data collected in a school-based cluster randomised controlled trial (RCT) that explored the impact of a resilience intervention on the mental health of Vietnamese adolescents in Hanoi . Considering past research, it was hypothesised that the Direct Anger-out and Rumination anger coping styles would be maladaptive, and therefore positively associated with depression and distress, and negatively associated with coping self-efficacy and mental well-being [46, 47]. Further, it was hypothesised that the Assertion, Social-support Seeking, Avoidance and Diffusion anger coping styles would be adaptive, and therefore positively associated with coping self-efficacy and mental well-being, and negatively associated with depression and distress [24,25,26,27,28].
The study took place in Hanoi, the capital of Vietnam. Vietnam is a Southeast Asian country with a population of 96 million, 8 million of whom live in Hanoi. Children and adolescents account for a third of Vietnam’s population, and about 92% of school-age children (6–18 years old) attend school . Hanoi’s population is split equally between those living in its urban and rural districts. The average national per capita income in 2019 was USD2,590, and Vietnam is classified as a lower-middle income country .
Study design and participants
This is a secondary analysis of baseline data collected using a multiple-stage sampling method in the aforementioned RCT of adolescent mental health in Vietnam . An independent statistician conducted the selection process. In the first stage, two districts were randomly selected from 12 urban districts and another two districts were randomly selected from 18 rural districts in Hanoi. In the second stage, in each of the selected districts, two high schools were randomly selected and four grade 10 classes from each of the selected schools were randomly chosen. All students in the selected classes (14–16 years old) were invited to participate in the RCT, with 1084 students providing consent (552 controls and 532 interventions; 60.7% female, Mage = 15.3 years). All participants of the RCT were included in this validation study.
All measures were translated into Vietnamese using a standardised procedure (translate, culturally verify and back-translate). This procedure has been established and used in previous studies [58,59,60].
Behavioral Anger Response Questionnaire for Children and Adolescents (BARQ-C) 
Anger coping strategies were assessed using the 37-item BARQ-C translated into Vietnamese (BARQC-V). The BARQ-C includes statements about the manner in which the respondent might react when feeling angry, e.g., “I put what happened out of my mind”, “I hit or push the person who made me angry”, and “In a calm voice, I tell the person who made me angry how I honestly feel”. Each statement is rated on a three-point scale according to the extent to which the respondent endorses the statement: 1 (not true), 2 (sometimes true), or 3 (often true). The items are typically grouped into six anger coping strategies (sub-scales): Direct Anger-out (7 items); Assertion (6 items); Social Support-seeking (6 items); Diffusion (6 items); Avoidance (6 items); and Rumination (6 items). Item scores within each sub-scale are summed to obtain a score for each sub-scale, with higher sub-scale scores indicating that the respondent is more likely to use the anger coping strategy.
Coping Self-Efficacy Scale (CSES) 
The CSES is a 26-item measure of one’s confidence in performing coping behaviours when faced with life challenges and demonstrates high reliability (α = 0.95). Using the CSES translated into Vietnamese (CSES-V), participants responded to item statements (e.g., “Keep from feeling sad”, “Make new friends”, and “Pray or meditate”) on an 11-point Likert scale, ranging from 0 (cannot do at all) to 10 (certain can do). Scores were summed, with higher results showing a greater degree of self-efficacy to cope under duress. Using the baseline data from this RCT, evidence for a 3-factor structure and good internal consistency of the CSES-V for use among Vietnamese adolescents has been established (emotion-focused sub-scale α = 0.91, problem-focused sub-scale α = 0.86, social support/interaction coping strategies sub-scale α = 0.75, whole scale α = 0.93) .
Centre for Epidemiologic Studies Depression Scale Revised (CESD-R) 
Depressive symptoms were measured using the Vietnamese translation of this 20-item scale (CESDR-V) which reflects the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition (DSM-IV) definition of Major Depressive Disorder . Participants responded to each item (e.g., “I felt sad”, “I slept much more than usual”, and “I wanted to hurt myself”) using a 5-point Likert scale, ranging from 0 (not at all or less than one day in the past week) to 4 (nearly every day for two weeks). The total scale scores ranged from 0 to 80, with higher scores indicating more depressive symptoms. As specified by the developers of this scale, a total score ≥ 16 was indicative of clinically significant depressive symptoms. Construct validity of the CESDR-V using the RCT’s baseline data has yielded evidence of unidimensional measurement, excellent internal consistency (α = 0.92), and measurement invariance between boys and girls.
Mental Health Continuum Short Form (MHC-SF) 
General mental well-being was assessed using the Vietnamese translation of the 14-item MHC-SF (MHCSF-V). Participants indicated how often over the past month they felt each mental well-being statement e.g., “interested in life”, “confident to think or express your own ideas and opinions”, and “that your life has a sense of direction or meaning to it” using a score from 0 (never) to 5 (every day). Item scores are summed to yield a global well-being score from 0 to 70, with higher global well-being scores indicative of better mental well-being. The construct validity of the MHCSF-V for use in adolescents in Vietnam has been established, and internal consistency was high (α = 0.88) .
Depression Anxiety and Stress Scales (DASS) 
Symptoms of depression, anxiety and stress were assessed using the Vietnamese translation of the 21-item version of the DASS which consists of three 7-item sub-scales that can be summed to yield scores for Depression (DASS21D-V), Anxiety (DASS21A-V) and Stress (DASS21S-V); and a total distress score DASS21-V. Based on their experience over the past week, participants responded to each item (e.g., “I felt that I had nothing to look forward to”, “I felt I was close to panic”, and “I felt that I was using a lot of nervous energy”) using a 4-point Likert scale, ranging from 0 (did not apply to me at all) to 3 (applied to me very much, or most of the time). Higher sub-scale scores indicate more symptoms of the mental health difficulty measured by the sub-scale. Evidence for the factorial structure and internal consistency of the DASS21-V for use among Vietnamese adolescents has been established (DASS21D-V α = 0.84, DASS21A-V α = 0.74, DASS21S-V α = 0.76) .
The data analysed in this study were collected at recruitment (baseline) in the RCT (other data collection points were post-intervention (about two months after recruitment), and at 6-month follow-up). An anonymous questionnaire was distributed to the student participants at school during a usual 45-min class. Two research assistants from the Hanoi University of Public Health provided instructions about questionnaire completion and supervised the students to ensure privacy and confidentiality. Students returned the questionnaire in a sealed envelope provided at the beginning of the session. Students who declined to participate or did not have parental consent to participate were invited to do their homework in the school library (44 students, 3.9%).
This study examined two aspects of construct validity of the BARQC-V: its structural validity (factorial structure, measurement invariance, and internal consistency), and external validity (concurrent validity) . Confirmatory factor analysis was conducted using IMB AMOS version 28 and remaining analyses were carried out using IBM SPSS Statistics 28.0.1.
The factorial structure of the BARQC-V was examined first using confirmatory factor analysis with 6 correlated factors specified. Next, exploratory factor analysis using maximum likelihood extraction was used. The number of factors selected was decided based on the Kaiser criterion (eigenvalues > 1). The scree plot, total percent variance explained, and meaningful factors were used to select factors if more than one factor met the Kaiser criterion. After the number of factors was determined, an oblique rotation (promax) was applied when more than one factor was found. Items with factor loadings < 0.3 were interpreted as being not salient , and were omitted from the final version of the BARQC-V. The internal consistency of each BARQC-V sub-scale was tested using Cronbach’s alpha coefficient. A coefficient > 0.7 indicated acceptable internal reliability.
To determine whether the BARQC-V correlated with measures of related constructs, its concurrent validity was examined using Pearson’s correlation coefficients between the scores of the three sub-scales of the CSES-V, the CESDR-V, the MHCSF-V, and the three sub-scales of the DASS21-V. Correlations were interpreted as strong (≥ 0.5), moderate (0.3–0.49), weak (0.1–0.29), or negligible/no correlation (< 0.1) .
All BARQC-V items exhibited a spread of responses. The 3-point response scale limits the assessment of normality. However, the central response was the most common for all but nine items. There were little missing data, with less than 1% missing for all items (maximum n = 7).
An initial confirmatory factor analysis using the 37 BARQC-V items with 6 correlated factors specified failed to converge on a solution due to multiple mis-specified items (see Table 1). Exploratory factor analysis specifying 6 factors and using the maximum likelihood extraction method and promax rotation with Kaiser normalization provided further evidence that a 6-factor model resulted in a poor fit (see Table 2). Using exploratory factor analysis to identify low-loading items by analysing one sub-scale at a time and removing the low-loading items, and then analysing all remaining items and removing those that cross-loaded resulted in a clean 22-item 5-factor solution (see Table 3). While four of the five factors are made up of a subset of items within their original factor, one factor is a combination of Diffusion and Avoidance items and has been renamed “Distraction”. The scree plot confirmed five eigenvalues above the inflection point (see Table 4). The 5-factor structure explained 49.32% of the total variance of the BARQC-V.
A final confirmatory factor analysis of the modified 5-factor structure converged χ2(199) = 762.21. Absolute fit indices indicated acceptable fit, RMSEA = 0.052, 90% CI [0.048, 0.056], SRMR = 0.060. This indicates that the model is a good fit for the data in this population. In contrast, relative fit indices did not reach commonly recommend cut-off values, CFI = 0.860. The basis for comparison for relative fit indices is a model with no associations between variables. It is likely that the modest correlations between items in the BARQC-V (as discussed in the context of internal consistency) account for the modest CFI value.
Using the 5-factor structure, internal consistency of four of the five BARQC-V sub-scales was slightly below the commonly suggested criterion of 0.7 (Rumination α = 0.66, Assertion α = 0.73, Social Support-seeking α = 0.68, Distraction α = 0.62, and Direct Anger-out α = 0.66). There are three reasons why these values should be interpreted with reference to both the low number of items per subscale and the 3-point response format. First, a low number of items substantially increases the item intercorrelations required to achieve the 0.7 criterion . Second, the 3-point response scale introduces more error variance compared to a response scale with more response options. Finally, despite the limitations of 3-point scales, they are often employed in measures intended for self-response from children for pragmatic reasons. For all sub-scales, none of the included items degraded the sub-scale’s alpha coefficient.
Table 5 presents evidence of the concurrent validity of the BARQC-V. The Rumination coping style showed a large, positive association with stress; a moderate, positive association with depression and anxiety; a moderate, negative association with emotion-focused coping self-efficacy; and a small, negative association with problem-focused coping self-efficacy, social support-seeking coping self-efficacy, and mental well-being. The Direct Anger-out coping style was positively but weakly associated with depression and stress; negatively but weakly associated with emotion-focused and problem-focused coping self-efficacy and mental well-being; and was not associated with social support-seeking coping self-efficacy. The Assertion anger coping style showed a positive, moderate association with problem-focused coping self-efficacy; a positive but weak association with emotion-focused coping self-efficacy, social support-seeking coping self-efficacy, and mental well-being; and a negative, small association with depression. The Social Support-seeking anger coping style was positively but weakly associated with social support-seeking coping self-efficacy, mental well-being, anxiety and stress. The Distraction anger coping style was positively but weakly associated with emotion-focused and problem-focused coping self-efficacy.
This study established partial evidence of the construct validity of the BARQC-V for use by adolescents attending high school in Vietnam. Removing low- and cross-loading items yielded a 5-factor structure that explained 49.32% of the total variance of the BARQC-V, similar to the total variance explained by the 6-factor structure of the BARQ-C (45.7% for the UK sample and 47.7% for the Dutch sample) . Congruent with the findings of Miers and colleagues , a 6-factor structure of the BARQC-V did not emerge. All factors in the 5-factor structure demonstrated acceptable internal consistency.
Concerning external validity, three BARQC-V sub-scales predicted both well-being and mental health difficulties. As hypothesised, the Rumination anger coping style was positively associated with depression and distress, and negatively associated with coping self-efficacy and mental well-being, adding weight to the proposition that Rumination is a maladaptive anger coping style , at least in Vietnamese adolescents. Similarly, as hypothesised but with weaker associations than the Rumination anger coping style, the Direct Anger-out anger coping style appears to be a maladaptive anger coping style because it was positively associated with depression and distress, and negatively associated with two aspects of coping self-efficacy (emotion-focused and problem-focused) and mental well-being. Also, as hypothesised, Assertion appears to measure an adaptive anger coping style in Vietnamese adolescents as it was positively associated with coping self-efficacy and mental well-being, and negatively associated with depression.
Contrary to expectations, Social Support-seeking and Distraction did not demonstrate the consistent pattern of associations expected of adaptive anger coping styles. It is possible that Social Support-seeking has elements of problem-solving, an adaptive anger coping strategy (i.e., Item 15, “I leave the situation, find someone to listen to my story, and ask for advice”), as well as elements of the maladaptive rumination anger coping strategy used to strengthen beliefs about the angering event or person , (i.e., Item 9, “I leave the situation and look for someone who will agree with me”; Item 21, “I think about the problem first and then talk about it with someone”, and Item 27, “I leave the situation and call a friend or family member to tell him/her how I feel”). Concerning the Distraction anger coping style, created by combining the remaining items from the Avoidance and Diffusion sub-scales after excluding low- and cross-loading items, it is possible that the items in this sub-scale require a level of psychological insight more accessible in adults than adolescents to recognise that keeping busy or trying to forget the angering event were an indirect response to anger.
The decision to exclude 15 BARQC-V items in this validation study was based on the identification of low- and cross-loading items detected with exploratory factor analysis. Recall that the 37-item BARQ was developed to detect anger coping strategies used by adults in Canada . The BARQ-C was developed by rewording some BARQ items to better suit children and adolescents, validating it using a sample of British and Dutch children, and excluding 3 items because they did not load on the respective factors . Interestingly, the two items excluded in this study from the BARQC-V Rumination sub-scale because they did not load on the Rumination factor (Item 4, “I try to understand why I got upset”, and Item 10, “I imagine how I could get even with the person who made me angry”) were also excluded in the original BARQ , suggesting that these items are not useful for construct validation.
Strengths, limitations and suggestions for future research
By providing evidence on multiple aspects of the construct validity of the BARQ-C in a large sample of randomly selected Vietnamese adolescents, this study retained items from all original BARQ sub-scales while yielding a pragmatic measure of three anger coping strategies (Rumination, Direct Anger-out, and Assertion) used by adolescents in a non-Western lower-middle income country. This measure can be used to detect the use of maladaptive anger coping so as to intervene to prevent and diminish depression and other mental health difficulties. Interestingly, Vietnamese adolescents’ use of the Direct Anger-out and Assertion anger coping strategies suggests that contrary to the implied assumption that Vietnamese adolescents would suppress their anger to conform with cultural group norms of harmony, self-restraint and affective control [35,36,37,38], globalisation may have diminished the difference between adolescents living in Asian countries and those living in other countries  and warrants further research. Further, future research should explore the nature of Social Support-seeking and Distraction to determine whether they are adaptive or maladaptive anger coping strategies, and whether they are used in the same manner across cultures. In addition, future research should examine the BARQC-V’s anger coping strategies as combined predictors of mental wellbeing and depression.
A limitation of this study is its exclusive use of self-report measures which may create problems of response bias and common method variance. Future research should consider using additional sources of information (e.g., a coping diary) to strengthen findings. In addition, generalisation of findings is limited to Vietnamese adolescents attending high school in Hanoi. Hence, future research that includes a wide range of children and adolescents from non-Western, lower-middle income countries would provide an opportunity to strengthen the validity of the BARQC-V. Similarly, as the BARQ-C does not appear to have been honed since 2007, and there does not appear to be a gold standard measure of anger coping, future research that includes a wide range of children and adolescents from Western countries would provide an opportunity to strengthen the validity of the BARQ-C. Further, as the validation of the BARQ does not appear to have been strengthened for nearly two decades, and has not been validated across cultures, future research that includes adults from diverse cultures would be worthwhile to create a gold standard measure of anger coping in adults.
This study provides sound evidence of the structural aspect of construct validity of the BARQC-V when used with adolescents attending high school in the capital of Vietnam, a lower-middle income country in South-East Asia that tends to value family and the group ahead of individual needs. It also provides partial evidence of the external aspect of construct validity of the BARQC-V: the Rumination, Direct Anger-out, and Assertion sub-scales were found to predict well-being and mental health difficulties in this sample and may be useful in school-based mental health promotion programs, and for school counsellors, psychologists, and primary health care providers who work with adolescents in Vietnam to detect maladaptive anger coping so as to intervene to prevent and diminish depression and other forms of psychological distress in this population. Importantly, the BARQC-V provides a validated measure of three anger coping strategies used by adolescents in Vietnam that can be used as a starting point by future research to develop a gold standard measure of anger coping for adults, adolescents and children world-wide.
Availability of data and materials
The data that support the findings of this study are available from Dr Thach Tran (firstname.lastname@example.org) but restrictions apply to the availability of these data, which were used under license for the current study, and so are not publicly available. Data are however available from the authors upon reasonable request and with permission of Dr Thach Tran.
Behavioral Anger Response Questionnaire for Children in Vietnam
Coping Self-efficacy Scale—Vietnamese version
Mental Health Continuum Short Form—Vietnamese version
Centre for Epidemiologic Studies Depression Scale Revised—Vietnamese version
Depression Anxiety and Stress Scales 21 items—Depression sub-scale—Vietnamese version
Depression Anxiety and Stress Scales 21 items—Anxiety sub-scale—Vietnamese version
Depression Anxiety and Stress Scales 21 items—Stress sub-scale—Vietnamese version
Le MT, Holton S, Nguyen HT, Wolfe R, Fisher J. Poly-victimisation and health risk behaviours, symptoms of mental health problems and suicidal thoughts and plans among adolescents in Vietnam. Int J Ment Health Syst. 2016;10:66. https://doi.org/10.1186/s13033-016-0099-x.
Le MT, Nguyen HT, Tran TD, Fisher JR. Experience of low mood and suicidal behaviors among adolescents in Vietnam: findings from two national population-based surveys. J Adolesc Health. 2012 Oct 1;51(4):339–48. https://doi.org/10.1016/j.jadohealth.2011.12.027.
Miers AC, Rieffe C, Meerum Terwogt MM, Cowan R, Linden W. The relation between anger coping strategies, anger mood and somatic complaints in children and adolescents. J Abnorm Child Psychol. 2007;35(4):653–64. https://doi.org/10.1007/s10802-007-9120-9.
Ohbuchi KI, Tamura T, Quigley BM, Tedeschi JT, Madi N, Bond MH, et al. Anger, blame, and dimensions of perceived norm violations: culture, gender, and relationships. J Appl Soc Psychol. 2004;34(8):1587–603. https://doi.org/10.1111/j.1559-1816.2004.tb02788.x.
Kassinove H, Sukhodolsy DG. Anger disorders: science, practice and common sense issues. In: Kassinove H, editor. Anger disorders: definition, diagnosis, and treatment. Washington, DC: Taylor & Francis; 1995. p. 1–26.
Aldao A, Nolen-Hoeksema S, Schweizer S. Emotion-regulation strategies across psychopathology: a meta-analytic review. Clin Psychol Rev. 2010;30(2):217–37. https://doi.org/10.1016/j.cpr.2009.11.004.
Stringaris A, Cohen P, Pine DS, Leibenluft E. Adult outcomes of youth irritability: a 20-year prospective community-based study. Am J Psychiatry. 2009;166(9):1048–54. https://doi.org/10.1176/appi.ajp.2009.08121849.
Kashdan TB, Roberts JE. Social anxiety, depressive symptoms, and post-event rumination: affective consequences and social contextual influences. J Anxiety Disord. 2007;21(3):284–301. https://doi.org/10.1016/j.janxdis.2006.05.009.
Price NN, Scelsa VL, Zeman JL, Luebbe AM. Profiles of adolescents’ sadness, anger, and worry regulation: characterization and relations with psychopathology. Emotion. 2022. https://doi.org/10.1037/emo0001084.
Besharat MA, Abdolmanafi A, Farahani H, Khodaii MR. The moderating role of locus of control on the relationship between anger and depression in patients with major depression disorder. Procedia Soc Behav Sci. 2011;30:302–6.
Novaco RW. Anger and psychopathology. In: Potegal M, Stemmler G, Spielberger C, editors. International handbook of anger: constituent and concomitant biological, psychological, and social processes. New York: Springer; 2010. p. 465–97.
Cheng H, Mallinckrodt B, Wu L. Anger expression toward parents and depressive symptoms among undergraduates in Taiwan. Couns Psychol. 2005;33(1):72–97. https://doi.org/10.1177/0011000004270343.
Goleman D. Destructive emotions. London: Bloomsbury Publishing; 2004.
Howells K. Anger and its links to violent offending. Psychiatry Psychol Law. 2004;11(2):189–96. https://doi.org/10.1375/pplt.2004.11.2.189.
Taylor JL, Novaco RW. Anger treatment for people with developmental disabilities. Chichester: Wiley; 2005.
Nock MK, Kazdin AE, Hiripi E, Kessler RC. Lifetime prevalence, correlates, and persistence of oppositional defiant disorder: results from the National comorbidity Survey Replication. J Child Psychol Psychiatry. 2007;48(7):703–13. https://doi.org/10.1111/j.1469-7610.2007.01733.x.
Reyes LR, Meininger JC, Liehr P, Chan W, Mueller WH. Anger in adolescents: sex, ethnicity, age differences, and psychometric properties. Nurs Res. 2003;52(1):2–11. https://doi.org/10.1097/00006199-200301000-00002.
Copeland WE, Shanahan L, Egger H, Angold A, Costello EJ. Adult diagnostic and functional outcomes of DSM-5 disruptive mood dysregulation disorder. Am J Psychiatry. 2014;171(6):668–74. https://doi.org/10.1176/appi.ajp.2014.13091213.
Pickles A, Aglan A, Collishaw S, Messer J, Rutter M, Maughan B. Predictors of suicidality across the life span: the Isle of Wight study. Psychol Med. 2010;40(9):1453–66. https://doi.org/10.1017/S0033291709991905.
Eisenberg N, Spinrad TL. Emotion-related regulation: sharpening the definition. Child Dev. 2004;75(2):334–9. https://doi.org/10.1111/j.1467-8624.2004.00674.x.
Eisenberg N, Fabes RA, Guthrie IK, Reiser M. Dispositional emotionality and regulation: their role in predicting quality of social functioning. J Pers Soc Psychol. 2000;78(1):136–57. https://doi.org/10.1037//0022-35220.127.116.11.
Ehring T, Fischer S, Schnülle J, Bösterling A, Tuschen-Caffier B. Characteristics of emotion regulation in recovered depressed versus never depressed individuals. Pers Individ Dif. 2008;44(7):1574–84. https://doi.org/10.1016/j.paid.2008.01.013.
Rottenberg J, Gross JJ, Gotlib IH. Emotion context insensitivity in major depressive disorder. J Abnorm Psychol. 2005;114(4):627–39. https://doi.org/10.1037/0021-843X.114.4.627.
Gross JJ. The emerging field of emotion regulation: an integrative review. Rev Gen Psychol. 1998;2(3):271–99. https://doi.org/10.1037/1089-2618.104.22.1681.
Wante L, Van Beveren ML, Theuwis L, Braet C. The effects of emotion regulation strategies on positive and negative affect in early adolescents. Cogn Emot. 2018;32:988–1002. https://doi.org/10.1080/02699931.2017.1374242.
Billings AG, Moos RH. The role of coping responses and social resources in attenuating the stress of life events. J Behav Med. 1981;4(2):139–57. https://doi.org/10.1007/BF00844267.
D’Zurilla TJ, Chang EC, Nottingham EJ, Faccini L. Social problem-solving deficits and hopelessness, depression, and suicidal risk in college students and psychiatric inpatients. J Clin Psychol. 1998;54(8):1091–107. https://doi.org/10.1002/(SICI)1097-4679(199812)54:8%3c1091::AID-JCLP9%3e3.0.CO;2-J.
Kohl A, Rief W, Glombiewski JA. How effective are acceptance strategies? A meta-analytic review of experimental results. J Behav Ther Exp Psychiatry. 2012;43(4):988–1001. https://doi.org/10.1016/j.jbtep.2012.03.004.
Gross JT, Cassidy J. Expressive suppression of negative emotions in children and adolescents: theory, data, and a guide for future research. Dev Psychol. 2019;55:1938–50. https://doi.org/10.1037/dev0000722.
Wenzlaff RM, Wegner DM. Thought suppression. Annu Rev Psychol. 2000;51:59–91. https://doi.org/10.1146/annurev.psych.51.1.59.
Ward A, Lyubomirsky S, Sousa L, Nolen-Hoeksema S. Can’t quite commit: rumination and uncertainty. Pers Soc Psychol Bull. 2003;29(1):96–107. https://doi.org/10.1177/0146167202238375.
Watkins ER. Constructive and unconstructive repetitive thought. Psychol Bull. 2008;134(2):163–206. https://doi.org/10.1037/0033-2909.134.2.163.
Gilbert P, Cheung M, Irons C, McEwan K. An exploration into depression-focused and anger-focused rumination in relation to depression in a student population. Behav Cogn Psychother. 2005;33(3):273–83. https://doi.org/10.1017/S1352465804002048.
Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. Hillsdale: Erlbaum; 1988.
Fernandez I, Carrera P, Paez D, Alonso-Arbiol I, Campos M, Basabe N. Prototypical anger components: a multilevel study. Cross Cult Res. 2014;48(4):400–24. https://doi.org/10.1177/1069397114523932.
Pham NC, Li Y, Schapsis C, Hossain T, Pham HH, Fischer D, et al. Intrinsic cultural factors that helped Vietnam overcome the covid-19 pandemic compared with other countries. Asia Pac J Health Manag. 2020;15(3):7–12. https://doi.org/10.24083/apjhm.v15i3.425.
Markus HR, Kitayama S. Culture and the self: implications for cognition, emotion, and motivation. Psychol Rev. 1991;98(2):224–53. https://doi.org/10.1037/0033-295X.98.2.224.
Weiss B, Dang M, Trung L, Nguyen MC, Thuy NTH, Pollack A. A nationally representative epidemiological and risk factor assessment of child mental health in Vietnam. Int Perspect Psychol. 2014;3(3):139–53. https://doi.org/10.1037/ipp0000016.
Butler EA, Lee TL, Gross JJ. Emotion regulation and culture: are the social consequences of emotion suppression culture-specific? Emotion. 2007;7(1):30–48. https://doi.org/10.1037/1528-3522.214.171.124.
Cole PM, Bruschi CJ, Tamang BL. Cultural differences in children’s emotional reactions to difficult situations. Child Dev. 2002;73(3):983–96. https://doi.org/10.1111/1467-8624.00451.
Friedman HS, Tucker JS, Reise SP. Personality dimensions and measures potentially relevant to health: a focus on hostility. Ann Behav Med. 1995;17(3):245–53. https://doi.org/10.1007/BF02903919.
Martin RC, Dahlen ER. Anger response styles and reaction to provocation. Pers Individ Dif. 2007;43(8):2083–94. https://doi.org/10.1016/j.paid.2007.06.022.
Miller TQ, Jenkins CD, Kaplan GA, Salonen JT. Are all hostility scales alike? Factor structure and covariation among measures of hostility. J Appl Soc Psychol. 1995;25(13):1142–68. https://doi.org/10.1111/j.1559-1816.1995.tb02611.x.
Linden W, Hogan BE, Rutledge T, Chawla A, Lenz JW, Leung D. There is more to anger coping than “in” or “out.” Emotion. 2003;3(1):12–29. https://doi.org/10.1037/1528-35126.96.36.199.
Spielberger CD. State-trait anger expression inventory-revised. Odessa: Psychological Assessment Resources, Inc; 1999.
Shi R, Wang KT, Xie Z, Zhang R, Liu C. The mediating role of friendship quality in the relationship between anger coping styles and mental health in Chinese adolescents. J Soc Personal Relat. 2019;36(11–12):3796–813. https://doi.org/10.1177/0265407519839146.
Putri MA, Hidayah P. A comparative study: the effect of self-esteem and anger coping strategies on the level of anger among ordinary teenagers and teenage prisoners. In: Ariyanto AA, Muluk H, Newcombe P, Piercy FP, Poerwandari FK, Suradijono SHR, editors. Diversity in unity: perspectives from psychology and Behavioral Science. Leiden: Taylor & Francis; 2018. p. 65–72.
Novin S, Tso IV, Konrath SH. Self-related and other-related pathways to subjective well-being in Japan and the United States. J Happiness Stud. 2013;15:995–1014.
Liu Q, He H, Yang J, Feng X, Zhao F, Lyu J. Changes in the global burden of depression from 1990 to 2017: findings from the Global Burden of Disease study. J Psychiatr Res. 2020;126:134–40. https://doi.org/10.1016/j.jpsychires.2019.08.002.
GBD 2019 Diseases and Injuries Collaborators. Global burden of 369 diseases and injuries in 204 countries and territories, 1990–2019: A systematic analysis for the Global Burden of Disease Study 2019. Lancet. 2020;396(10258):1204–22. https://doi.org/10.1016/S0140-6736(20)30925-9
Kessler RC, Berglund P, Demler O, Jin R, Merikangas KR, Walters EE. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National comorbidity Survey Replication. Arch Gen Psychiatry. 2005;62(6):593–602. https://doi.org/10.1001/archpsyc.62.6.593.
Johnson D, Dupuis G, Piche J, Clayborne Z, Colman I. Adult mental health outcomes of adolescent depression: a systematic review. Depress Anxiety. 2018;35(8):700–16. https://doi.org/10.1002/da.22777.
Thai TT, Cao PLT, Kim LX, Tran DP, Bui MB, Bui HHT. The effect of adverse childhood experiences on depression, psychological distress and suicidal thought in Vietnamese adolescents: findings from multiple cross-sectional studies. Asian J Psychiatry. 2020;53:10213s4. https://doi.org/10.1016/j.ajp.2020.102134.
Kerr MA, Schneider BH. Anger expression in children and adolescents: a review of the empirical literature. Clin Psychol Rev. 2008;28(4):559–77. https://doi.org/10.1016/j.cpr.2007.08.001.
Tran T, Nguyen HT, Shochet I, Wurfl A, Orr J, Nguyen N, et al. School-based, two-arm, parallel, controlled trial of a culturally adapted resilience intervention to improve adolescent mental health in Vietnam: study protocol. BMJ Open. 2020;10(10): e039343. https://doi.org/10.1136/bmjopen-2020-039343.
GSO. Population and housing census; 2019
World B. Country data. Vietnam: World Bank; 2021. Available from: http://data.worldbank.org/country/vietnam
Fisher J, Tran TD, Biggs B, Dang TH, Nguyen TT, Tran T. Intimate partner violence and perinatal common mental disorders among women in rural Vietnam. Int Health. 2013;5(1):29–37. https://doi.org/10.1093/inthealth/ihs012.
Tran TD, Tran T, La B, Lee D, Rosenthal D, Fisher J. Screening for perinatal common mental disorders in women in the north of Vietnam: a comparison of three psychometric instruments. J Affect Disord. 2011;133(1–2):281–93. https://doi.org/10.1016/j.jad.2011.03.038.
Tran TD, Kaligis F, Wiguna T, Willenberg L, Nguyen HTM, Luchters S, et al. Screening for depressive and anxiety disorders among adolescents in Indonesia: formal validation of the centre for epidemiologic studies depression scale—Revised and the Kessler psychological distress scale. J Affect Disord. 2019;246:189–94. https://doi.org/10.1016/j.jad.2018.12.042.
Chesney MA, Neilands TB, Chambers DB, Taylor JM, Folkman S. A validity and reliability study of the coping self-efficacy scale. Br J Health Psychol. 2006;11(3):421–37. https://doi.org/10.1348/135910705X53155.
Tran T, La N, Nguyen H, Shochet I, Nguyen N, Wurfl A, et al. Validation of the coping self-efficacy scale: vietnamese version for adolescents. BMC Psychol Vietnamese Vers. 2022;10(1):59. https://doi.org/10.1186/s40359-022-00770-3.
Eaton WW, Smith C, Ybarra M, Muntaner C, Tien A. Center for epidemiologic studies depression scale: review and revision (CESD and CESD-R). In: Maruish ME, editor. The use of psychological testing for treatment planning and outcomes assessment: instruments for adults. Lawrence Erlbaum Associates Publishers; 2004. p. 363–77.
American Psychiatrist Association. (APA, 2000). Text Revised (DSM-IV-TR). 4th ed. 2000. Diagnostic and statistical manual of mental disorders.
Keyes CL, Wissing M, Potgieter JP, Temane M, Kruger A, van Rooy S. Evaluation of the mental health continuum-short form (MHC-SF) in Setswana-speaking South Africans. Clin Psychol Psychother. 2008;15(3):181–92. https://doi.org/10.1002/cpp.572.
Ha TTK. Subjective well-being of adolescents and their parents in Vietnam. In: Rich GJ, Jaafar JLS, Barron D, editors. Psychology in Southeast Asia: sociocultural, clinical, and health perspectives. Routledge; 2020. p. 116–33.
Lovibond SH, Lovibond PF. Manual for the depression anxiety stress scales. 2nd ed. Sydney: Psychology Foundation of Australia; 1995.
Flake JK, Pek J, Hehman E. Construct validation in social and personality research: current practice and recommendations. Soc Psychol Pers Sci. 2017;8(4):370–8. https://doi.org/10.1177/1948550617693063.
Field A. Discovering statistics using SPSS. 4th ed. London: SAGE; 2013.
Cortina JM. What is coefficient alpha? An examination of theory and applications. J Appl Psychol. 1993;78(1):98–104. https://doi.org/10.1037/0021-9010.78.1.98.
Kuppens P, Van Mechelen I, Meulders M. Every cloud has a silver lining: interpersonal and individual differences determinants of anger-related behaviors. Pers Soc Psychol Bull. 2004;30(12):1550–64. https://doi.org/10.1177/0146167204271176,PMID15536239.
Ho H-A, Martinsson P, Olsson O. The origins of cultural divergence: evidence from Vietnam. J Econ Growth. 2022;27(1):45–89. https://doi.org/10.1007/s10887-021-09194-x.
The authors are grateful to the participants who contributed data to this research.
This work was supported by the Australian National Health and Medical Research Council [GNT1158429]; the Vietnam National Foundation for Science and Technology Development [NHMRC.108.01-2018.02]. TT is supported by a Monash Strategic Bridging Fellowship; JF is supported by a Finkel Professorial Fellowship, which is funded by Finkel Foundation.
Ethics approval and consent to participate
This study was a part of a trial study that has been approved by Monash University Human Research Ethics Committee (Certificate Number: 21455), Melbourne, Victoria, Australia; the Institutional Review Board of the Hanoi University of Public Health (488/2019/YTCC-HD3), Hanoi, Vietnam; and Queensland University of Technology's Office of Research Ethics and Integrity (2000000087). Written informed consent was obtained from a parent or guardian for participants under 16 years old. All methods were carried out in accordance with relevant guidelines and regulations.
Consent for publication
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Shochet, I., Orr, J., Cockshaw, W. et al. Validation of the Behavioral Anger Response Questionnaire for Children (BARQ-C) in a large community sample of Vietnamese middle adolescents in Hanoi. BMC Psychol 10, 199 (2022). https://doi.org/10.1186/s40359-022-00907-4