Skip to main content

Stigma towards people with tuberculosis: a cross-cultural adaptation and validation of a scale in Indonesia

Abstract

Introduction

Tuberculosis (TB) remains a highly stigmatised disease that can cause or exacerbate mental health disorders. Despite increased awareness of the importance of reducing TB stigma, validated tools to measure TB stigma remain scarce. This study aimed to culturally adapt and validate the Van Rie TB Stigma Scale in Indonesia, a country with the second largest TB incidence worldwide.

Methods

We validated the scale in three phases: translation, cultural adaptation, and psychometric evaluation. We invited diverse experts to an interdisciplinary panel for the cross-cultural adaptation, then performed a psychometric evaluation of the scale: exploratory and confirmatory factor analyses, reliability analysis, and correlation analysis with Patient Health Questionnaire 9 [PHQ-9].

Results

We culturally adapted the original scale's language and content during the translation and cultural adaptation phases. After psychometric evaluation with 401 participants in seven provinces of Indonesia, we removed two items. The new scale had two forms: (A) patient and (B) community perspective forms. Both forms had good internal consistency, with respective Cronbach's alpha values of 0.738 and 0.807. We identified three loading factors in Form A (disclosure, isolation, and guilty) and two loading factors in Form B (isolation and distancing). The scale showed correlation with PHQ-9 (Form A, rs = 0.347, p < 0.001; Form B, rs = 0).

Conclusions

The culturally adapted Indonesian version of Van Rie's TB Stigma Scale is comprehensive, reliable, internally consistent, and valid. The scale is now ready for applied scale-up in research and practice to measure TB-stigma and evaluate the impact of TB-stigma reduction interventions in Indonesia.

Peer Review reports

Introduction

Tuberculosis (TB) remains a highly stigmatised and stigmatising disease [1, 2]. People with TB and its associated symptoms and signs, such as cough and weight loss, are often exposed to negative attitudes from people around them [3]. This may take the form of avoidance of being close to someone with TB and can lead to isolation, rejection or exclusion from the community and their workplace, or even from their close family and healthcare staff who provide care for them [4]. All these behaviours, increase the risk of mental health disorders among people with TB. Although some TB-stigma may be grounded in justifiable public health concerns regarding avoidance of TB transmission, much TB-stigma relates to myths and misconceptions about TB, including TB being incurable, hereditary, curse, and spread by non-respiratory routes such as sharing cutlery [5, 6].

TB-stigma has been recognized by the World Health Organization (WHO) [7] and the United Nations [8] as a key barrier to eliminating TB globally. Stigma experienced or anticipated by people having TB-related symptoms can negatively influence their access to TB diagnostic and treatment services leading to delayed diagnosis and suboptimal engagement with care. In this way, TB-stigma can be associated with challenges to treatment adherence, which can reduce TB treatment success [1, 9,10,11] and increase the risk of TB transmission and the development of drug-resistant TB. More broadly, there is also emerging evidence that TB-stigma can result in mental health disorders [12] and catastrophic out-of-pocket costs and lost income [13, 14].

Given these problems, measuring TB-stigma is critical to understand its prevalence, roots, and determinants, and to assess the effectiveness of potential TB-stigma mitigation strategies [11]. There have been multiple scales and tools developed to assess TB-stigma [15, 16]. However, such scales and tools need to be adapted, validated, piloted, and refined before scale-up in a specific community or population to ensure their accuracy, reliability, and robustness. One of the most widely used tools is Van Rie’s TB Stigma scale [17, 18]. This scale has showed good internal consistency and been validated in various languages and settings including Thailand [17], Portugal [19], Mexico [20], Turkey [21], and Vietnam [22].

Despite measuring and addressing TB-stigma being a vital component to ending TB and relieve mental problems among people with TB, many high TB burden countries still lack locally adapted and validated TB-stigma scales. We aimed to translate, adapt, and validate the Van Rie’s TB Stigma Scale in Indonesia, a middle-income country with the second highest TB incidence worldwide.

Methods

Instrument

The original Van Rie’s TB Stigma Scale consists of two main parts: Part A 'Community perspectives toward TB’ with 11 items and Part B 'Patient perspectives toward TB’ with 12 items. In each item, participants are provided with four answer options: strongly disagree (0), disagree (1), agree (2), and strongly agree (3) [17].

We translated, adapted, and validated the scale in three consecutive phases from January to July 2022 (Fig. 1). In December 2021, before study initiation, we approached Van Rie and collaborators to seek advice and gained approval to adapt the scale to the Indonesian setting.

Fig. 1
figure 1

Flow of cross-cultural adaptation and validation of the scale

Phase 1: forward translation, consolidation, and backward translation

We followed existing guidance in forward and backward translation [23,24,25]. We appointed two independent Indonesian doctoral/post-doctoral researchers with experience in TB and community research who have published peer-reviewed scientific articles about TB in high-quality journals, and are fluent in English and Bahasa (the Indonesian lingua franca), to translate the original scale from English into Bahasa. After the translation, we discussed the two translated versions internally, compared the translated versions with the original one, and agreed on one ‘consolidated version’ of the tools. The consolidated version of the tools was backward translated from Bahasa to English by a separate sworn translator who had never seen the original version. We compared the original with the back-translated versions, collectively judged their alignment to be good, and concluded that, despite few literal differences, the translation had the same meaning with the original version.

Phase 2: cross-cultural adaptation

We purposively invited diverse in-country, interdisciplinary experts: a psychiatrist, a psychologist, a pulmonologist, a community medicine specialist, Indonesian National Tuberculosis Program (NTP) manager, and staffs from TB-related non-governmental organizations to join an advisory panel. The panel provided suggestions to improve the scale, including the clarity of the terms/words used and contextualization to the Indonesian setting.

We revised the translated scale based on the panel meeting and agreed on the pre-final version of the scale in Bahasa. Phrases and terms that had not been completely agreed by the panel were highlighted and further evaluated during cognitive debriefing with 10 adults with TB. We asked the participants whether they understood the items, found ambiguous words or phrases, or felt uncomfortable with any words or items (i.e., items that offended, insulted, or were perceived to be culturally inappropriate). The project team discussed all the suggestions provided by participants, and subsequently revised and finalized the tools for Phase 3.

Phase 3: Psychometric evaluation

Study sites

The study sites were seven provinces of Indonesia: Jakarta, West Sumatra, Jambi (which represented the Western part of Indonesia), South Sulawesi, West Kalimantan, and Bali (Central part), and Maluku (Eastern part). These sites were purposively selected due to TB burden, urban–rural mix, and pre-existing research infrastructure and networks.

Participant selection and sample size

In each province, we consulted with NTP officers in province and district levels to purposively select two districts representing an urban and rural area, respectively. We then selected adults with pulmonary drug-susceptible TB (DS-TB), aged ≥ 18 years old, from primary health centres, public hospitals, and private hospitals. We selected participants consecutively from the National TB Program Registers at each health facility from the newest diagnosed, based on their TB treatment status as follows:

  1. A.

    People receiving TB treatment in the intensive treatment phase (the first two months of a standard six-month DS-TB first treatment regimen) and who had never previously received TB treatment,

  2. B.

    People who were diagnosed with TB but never started the TB treatment (henceforth termed “lost to follow up to treatment”), or

  3. C.

    People receiving a six-to-nine-month DS-TB re-treatment regimen, at any phase of treatment.

We selected these respondent groups on the assumption that TB-stigma is experienced during care seeking and early treatment when signs and symptoms of the disease are most obvious and that people who had adverse TB treatment outcomes and had had previous TB episodes were a group at high risk of experiencing TB-stigma. We excluded people with extrapulmonary or (multi) drug-resistant TB (MDR-TB).

There are various recommendations to determine sample size for tool validation [26, 27]. We determined the sample size based on the need to conduct an Alpha Cronbach test and factor analyses. With an assumption that the tools had good internal consistency (Alpha Cronbach of 0.8), confidence level of 95%, and margin of error of 5%, we required at least 246 participants for this validation study [28]. For factor analysis, we assumed that the level of communality was good (0.92). With a wide level of communality and four loading factors, we required at least 240 participants for conducting factor analysis [29].

Data collection and statistical analyses

We recruited interviewers with a background in health sciences (medical students, medical doctors, nurses, midwifes or public health graduates) in each province. We then provided a one-day online training to explain the study background, the instruments used, participant selection, and how to ask participants using the instrument.

All interviews were conducted using paper-based questionnaires. After the interview, interviewers entered the data to the RedCap platform (https://redcap.fk.ui.ac.id) for data checking, cleaning, and validation. Data were collected from March 1 to July 31, 2022. Once the data were cleaned and validated, we started data analysis using IBM SPSS 27.0 and RStudio.

Floor or ceiling effects

We first performed a descriptive analysis to check the presence of floor or ceiling effects—a condition in which more than 15% of participants choose an item with either the maximum or the minimum score on the scale [30]. Items identified as having a floor or ceiling effect were discussed amongst the project team and considered for exclusion from the scale.

Internal consistency

In this study, we applied both exploratory and confirmatory factor analyses to check the scale’s internal consistency. We performed an exploratory factor analysis (EFA) and set a threshold of 0.7 for Kaiser–Meyer–Olkin’s (KMO) and 0.05 for Bartlett's test value to check the fitness of the model [31], and further clarified with Horn's parallel analysis test [32]. Factor analysis was performed by assessing the Eigenvalues ​​using principal axis analysis with varimax rotation to determine the number of factors or domains. We included factors which had eigenvalues > 1, logical and theoretical links between the items, and contained three or more items loading ≥ 0.4. The EFA was performed using IBM SPSS version 25.0. We measured the Cronbach's alpha values for total items and the values per item. A coefficient of > 0.8 was considered to have good to very good internal consistency [33].

A confirmatory factor analysis (CFA) was applied using lavaan package in R. The model was evaluated by calculating Root Mean Square Error of Approximation (RSMEA), Standardized Root Mean Square Residual (SRMR), Comparative Fit Index (CFI) and Tucker-Lewis Index (TLI). RSMEA of less than 0.05 was considered “close” fit and the value of 0.05–0.08 as reasonable model-data fit [34]. The CFI and TFI of more than 0.90 and SRMR of less than 0.08 were also set as thresholds of model fitness [35].

Construct validity

In this validation study, we also asked participants the Patient Health Questionnaire (PHQ-9) (Additional file 1: S1). We applied Spearman’s correlation coefficients (rs) to assess the correlations between the loading factors and total stigma scale scores with the total score of PHQ-9. A significant positive correlation between stigma scores and depressive symptoms (rs = 0.3 to 0.5 for significantly moderate correlation) would indicate that the scale has construct validity and potential discriminatory power to identify depressive symptoms.

Ethical considerations

This study received a research ethical approval from the Ethics Committee of the Faculty of Medicine, University of Indonesia (No. KET-60/UN2.F1/ETIK/PPM.00.02/2022, on January 17, 2022). Participants received a complete explanation before signing consent to join the interview, and they were allowed to withdraw their participation from this study without any consequences. This study was also supported by the Ministry of Health of the Republic of Indonesia and received research permit from all local health offices in the seven selected Provinces.

Reporting

Our study design and reporting conforms to the ISPOR principles of translation and cross-cultural adaptation framework [24] (Additional file 1: S2).

Results

Participants characteristics

We consecutively selected 410 participants. Nine participants refused to join the study, resulting in 401 (98%) participants interviewed, all of whom (100%) completed the interview. Sociodemographic and clinical characteristics of participants are shown in Fig. 2 and Table 1.

Fig. 2
figure 2

Participant allocation in each facility

Table 1 Participants characteristics, n = 401

Phase 1: translation, consolidation, and back translation

After translation to Bahasa, we did not find significant issues or errors. Following discussion amongst the project team, we decided to reverse the order of the Forms from the Van Rie scale so that ‘Patient perspective toward TB’ came first (Form A) and ‘Community perspective toward TB’ (Form B) follows. This was done because it was perceived that beginning the tool by asking statements using the first-person point of view (i.e., “I feel that….”) was easier to understand and preferable to beginning the tool with the more abstract third person point of view statements (i.e., “Some people feel that…”). Following this consolidated version of the scale, there was no further change, addition, or removal of items and no significant issues were identified after back translation to English.

Phase 2: cross-cultural adaptation

We provided the expert panel with the consolidated version of the scale in Bahasa and the original version of the scale. The panel suggested some additional refinement to wording to be more appropriate to the Indonesian cultural context. For example, the panel suggest using ‘kesepian’ in Bahasa to refer to isolation despite sometimes being translated into English as ‘lonely’. We also changed ‘careless behaviour’ to ‘risky behaviour’ since the change in Bahasa (‘Perilaku ceroboh’ to ‘Perilaku berisiko’) was perceived to be more easily interpreted by participants. The panel did not suggest addition or removal of any scale items.

We tested the pre-final version of the scale with 10 consecutively selected adults with TB in Puskesmas. All participants understood and were able to answer all items. One participant did not know what HIV/AIDS disease is but understood the word after explanation by researcher. One participant was not sure what the word ‘disgusting’ (“menjijikkan” in Bahasa) meant in the context but understood the word after explanation in local dialect. For those two related items, we added explanation notes for interviewers to be used during interviews. Since there was no substantial change from pre-final and final version of the scale, we included the 10 field test responses in the full psychometric evaluation.

Phase 3: validation with psychometric evaluation

Floor and ceiling effect

We identified floor effects on several items (i.e., P2, P3, P5, P7, P10, P11, C18, and C23) and a ceiling effect in only one item (P4). (Table 2) After discussion amongst the project team, we decided to remove P4 from the scale because, in addition to this ceiling effect, it was perceived that the item “I keep my distance from others to avoid spreading TB germs”, could have been temporally influenced by the social distancing and public health measures related to the COVID-19 pandemic rather than specifically TB.

Table 2 Floor and ceiling effects in each item

Internal consistency

The scales had good internal consistency, with a Cronbach's alpha value of 0.738 for Form A (Patient Perspective) and 0.807 for Form B (Community Perspective). There was no single item which significantly reduced the alpha score (Table 3).

Table 3 Factor loadings and Cronbach's alpha of the scale

In EFA of the 11-item Form A, the KMO value was 0.775, Bartlett's test value was 894.737 (p < 0.001) and three distinct factors were identified and characterised: disclosure (P6, P7, P9, and P12), isolation (P1, P2, P3, and P5), and guilt (P8, P10, and P11).

The KMO value of the 11-item Form B was 0.881, Bartlett's test value was 1675.587 (p < 0.001), and two factors were identified and characterised: isolation (C13, C14, C15, C,16, C17, and C22) and distancing (C18, C19, C20, and C21). C23 was not conclusive with loading values of 0.321 for factor 1 and 0.373 for factor 2. Because of its inconclusive loading value, the project team decided to exclude item C23 from the scale, leaving the 10-item scale for CFA. Scree plots,reproduced correlations tables, and average variance, composite reliability, and maximum shared variance of TB-Stigma Scale domains are provided in Additional file 1: S3–S6.

Confirmatory factor analysis

In CFA of Form A scale, we found the the scaled (robust) chi-square of X2(df) = 169.35(41) for our model (p < 0.05). (Fig. 3) The scaled fit indices showed a good fit with the RMSEA value of 0.088, the SRMR of 0.062, CFI of 0.849 and TLI of 0.798. The R2 values between loading factors ranged from 0.06 to 0.15. The R2 values for each item were uniform for F1 (ranged from 0.61–0.81), F2 (0.64–0.74) and F3 (0.36–0.52).

Fig. 3
figure 3

Confirmatory factor analysis of (A) Form A: patient perspective and (B) Form B: Community Perspective of the TB stigma scale in people with TB in Indonesia. F: loading factors; V: tool’s item; RMSEA: root mean square error of approximation; TLI: Tucker Lewis index; CFI: comparative fit index; LF: covariance between factors; R: variance indicating magnitude of relationship of items to factor; R2: percentage of variance of each item explained by factor; 1-R2: percentage of variance of each item not explained by factor

For Form B, we removed C23 in the CFA. The scaled (robust) chi-square for our model of Form B was X2(df) = 127.39 (34) (p < 0.05, Fig. 3). The model was a considerably fit in the scaled fit indices, with the RMSEA value of 0.083, the SRMR of 0.045, CFI 0.940. and TLI of 0.920. The R2 values between loading factors ranged was 0.17. The R2 values for each item were uniform for F1 (ranged from 0.61–0.81) but widely distributed for F2 (0.36–0.78).

Construct validity

The reliability of PHQ-9 was good, with Cronbach's alpha of 0.837. We then used the PHQ-9 to assess the construct validity of the Indonesian version of TB-Stigma Scale. Form A had moderate correlation with Form B (rs = 0.416, p < 0.001) and PHQ-9 (rs = 0.347, p < 0.001, Table 4). Form B had a weak correlation with PHQ-9 (rs = 0.119, p < 0.001) but the distancing factor was not significantly correlated with PHQ-9.

Table 4 Correlation of Stigma Scale Form A (Patient Perspective) with Form B (Community Perspective) and with PHQ-9 score

Discussion

This is the first study adapting and validating Van Rie’s TB Stigma Scale to the Indonesian setting. Despite multiple studies assessing TB-stigma in Indonesia [36,37,38,39], none have previously described adaptation and validation of a TB-stigma scale prior to implementation. This new Indonesian version of the scale, consisting of an 11-item Form A (Patient Perspective) and a 10-item Form B (Community Perspective), was found to be reliable, internally consistent, and valid, and fills the knowledge gap.

During validation, two items were removed: “I keep my distance from others to avoid spreading TB germs” (Item P4, Form A) and “Some people prefer not to have those with TB living in their community” (Item C23, Form B). Item P4 showed a ceiling effect, which may have been influenced by increased knowledge and awareness of social distancing and community-level public health measures during the COVID-19 pandemic when this study was conducted [40, 41]. It was perceived that this item could not specifically assess TB stigma. Future studies measuring TB-stigma, therefore, should consider incorporation of items relating to COVID-19 on responses given alterations in societal norms and behaviour since the pandemic began, especially in the South-East Asian Region. Item C23, despite being found to be clear, understandable, and reliable, was not aligned with a specific factor following EFA. The reason behind is unclear. While there is evidence that people with TB may be avoided by others and excluded from certain social activities [42], the evidence is less clear on exclusion, banishment, or being ostracized from communities in the current context of Indonesia rather than the exclusion of people with HIV/AIDS [43] or those from the LGBTQplus community [44].

Despite the low prevalence of HIV in the seven selected provinces and general population of Indonesia [45], the study found that items relating to HIV/AIDS (P7, P11, and C15) were still relevant to participants and perceived to be important to maintain in the scale, as findings from Thailand [17] and Brazil [19]. This is different to a study from Vietnam, which consider the items as of less relevant because of the low local prevalence of TB/HIV co-infection [22]. Importantly, and similar to a study in Mexico [20], our EFA results showed that HIV-related items did not form distinct loading factors. Instead, item P7 was more closely related to the “Disclosure” loading factor and item P11 was more related to the “Guilty”. These findings may indicate that HIV/AIDS is still viewed prejudicially and associated with significant stigma in Indonesian communities.

The new scale we have developed was able to capture several types of TB-stigma. In Form A, the ‘Disclosure’ loading factor represented anticipated stigma, which is an expectation and fear of discrimination and behaviour of others towards people with TB who disclose their TB status. The ‘Isolation’ loading factor is more likely to represent enacted or experienced stigma, which is indicated by feeling hurt, feeling lonely, and losing friends. The ‘Guilty’ loading factor implies self-stigma, indicated by people with TB accepting a negative stereotype about themselves and feeling guilt and shame related to their diagnosis. Our finding of groups of loading factors is helpful because it can enable identification of potential target populations for interventions to reduce TB-stigma and support consideration the mechanisms by which the interventions may be expected to achieve impact [46]. For example, interventions focusing on wide public health communications through mass media may work by reducing enacted stigma, interventions targeted towards people or groups at high risk of TB may work by mitigating anticipated stigma and may eventually reduce delay to TB diagnosis, and interventions among people with TB will focus on relieving self-stigma and associated deterioration in mental health.

Both forms of the Indonesian version of TB Stigma Scale showed good internal consistency. This finding is consistent with findings of validation studies of the Van Rie scale in other settings [17, 19,20,21,22]. The overall model fitness, indicated by Chi-Square test, showed a P-value of < 0.05, which was encouraging but may have related to large sample size [47]. However, the scaled fitness indices, indicated by RSMEA, CFI, and TLI, showed good fitness supporting the interpretation that the scale was reliable and consistent [31, 34, 35].

Previous published review showed that most studies measuring TB-stigma used disparate, unvalidated tools, which limited interpretation of their results and hindered cross-country comparisons [46]. The findings of our study in Indonesia will contribute to a growing evidence base on locally and culturally appropriate and validated TB stigma measurements tools. Expanded use of such tools will not only be of benefit to the NTP and the people they serve but will also enhance the systematic evaluation of the impact of TB-stigma reduction interventions, which up to now have lacked validated tools [46].

Although we selected participants from seven provinces, given the wide geographical and cultural contexts of Indonesia, it remains vital to assess whether the scale is generalizable nationally or requires further adjustment and refinement to specific populations, cultures, and regions of Indonesia. People living in different geographical areas, speaking different dialects, and having different sets of values, beliefs, experiences, and communication styles in community may influence the interpretation to question items [48]. This study excluded people with DR-TB and focused on people diagnosed with DS-TB because they constitute the majority of people with TB in Indonesia and are at risk of acquired drug-resistance if their adherence is poor. This focus on people with DS-TB may limit the generalizability of our findings and the use of the validated tool amongst people with DR- and MDR-TB in Indonesia.

Conclusions

We designed, implemented, and evaluated a culturally adapted version of Van Rie’s TB Stigma Scale, which was found to be comprehensive, reliable, internally consistent, and valid in the Indonesian setting. The final scale, which is ready to implement both within research programmes and programmatically, consisted of an 11-item Form A (Patient Perspective) and a 10-item Form B (Community Perspective). The scale could support identification of TB-affected people and communities at greatest risk of stigma and enable evaluation of the impact of TB-stigma reduction interventions in these vulnerable groups.

Availability of data and materials

Data generated or analysed during this study are available and accessible by requesting to corresponding author.

References

  1. Datiko DG, Jerene D, Suarez P. Stigma matters in ending tuberculosis: nationwide survey of stigma in Ethiopia. BMC Public Health. 2020;20(1):190.

    Article  PubMed  PubMed Central  Google Scholar 

  2. Thomas BE, Stephen A. Tuberculosis related stigma in India: roadblocks and the way forward. Expert Rev Respir Med. 2021;15(7):859–61.

    Article  PubMed  Google Scholar 

  3. Oladele DA, Idigbe IE, Ekama SO, Gbajabiamila T, Ohihoin AG, David AN, Ezechi OC, Odunukwe NN, Salako BL. “Their place is beyond the town’s border”: a qualitative exploration of stigma associated with tuberculosis in rural and urban areas of Lagos, Nigeria. Health Soc Care Commun. 2021;29(6):1789–98.

    Article  Google Scholar 

  4. Pradipta IS, Idrus LR, Probandari A, Lestari BW, Diantini A, Alffenaar JWC, Hak E. Barriers and strategies to successful tuberculosis treatment in a high-burden tuberculosis setting: a qualitative study from the patient’s perspective. BMC Public Health. 2021;21(1):1903.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Nyasulu P, Phiri F, Sikwese S, Chirwa T, Singini I, Banda HT, Banda R, Mhembere T, Chimbali H, Ngwira B, et al. Factors influencing delayed health care seeking among pulmonary tuberculosis suspects in rural communities in Ntcheu District. Malawi Qual Health Res. 2015;26(9):1275–88.

    Article  PubMed  Google Scholar 

  6. Chang SH, Cataldo JK. A systematic review of global cultural variations in knowledge, attitudes and health responses to tuberculosis stigma. Int J Tuberc Lung Dis. 2014;18(2):168–73.

    Article  PubMed  Google Scholar 

  7. World Health O. Ethics guidance for the implementation of the end TB strategy. Geneva: World Health Organization; 2017.

    Google Scholar 

  8. Daftary A, Mitchell EMH, Reid MJA, Fekadu E, Goosby E. To end TB, first-ever high-level meeting on tuberculosis must address stigma. Am J Trop Med Hyg. 2018;99(5):1114–6.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Woith WM, Larson JL. Delay in seeking treatment and adherence to tuberculosis medications in Russia: a survey of patients from two clinics. Int J Nurs Stud. 2008;45(8):1163–74.

    Article  PubMed  Google Scholar 

  10. Courtwright A, Turner AN: Tuberculosis and Stigmatization: Pathways and Interventions. Public Health Reports 2010, 125(4_suppl):34–42.

  11. Sommerland N, Wouters E, Mitchell EMH, Ngicho M, Redwood L, Masquillier C, van Hoorn R, van den Hof S, Van Rie A. Evidence-based interventions to reduce tuberculosis stigma: a systematic review. Int J Tuberc Lung Dis. 2017;21(11):81–6.

    Article  PubMed  Google Scholar 

  12. Lee LY, Tung HH, Chen SC, Fu CH. Perceived stigma and depression in initially diagnosed pulmonary tuberculosis patients. J Clin Nurs. 2017;26(23–24):4813–21.

    Article  PubMed  Google Scholar 

  13. Zimmerman E, Smith J, Banay R, Kau M, Garfin AMCG. Behavioural barriers and perceived trade-offs to care-seeking for tuberculosis in the Philippines. Glob Public Health. 2022;17(2):210–22.

    Article  PubMed  Google Scholar 

  14. Onazi O, Gidado M, Onazi M, Daniel O, Kuye J, Obasanya O, Odusote T, Gande S. Estimating the cost of TB and its social impact on TB patients and their households. Public Health Action. 2015;5(2):127–31.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Challenge TB: TB stigma measurement guidance. Den Haag: KNCV; 2018.

  16. Partnership STB. TB stigma assessment - implementation handbook. Geneva: Stop TB Partnership; 2019.

    Google Scholar 

  17. Van Rie A, Sengupta S, Pungrassami P, Balthip Q, Choonuan S, Kasetjaroen Y, Strauss RP, Chongsuvivatwong V. Measuring stigma associated with tuberculosis and HIV/AIDS in southern Thailand: exploratory and confirmatory factor analyses of two new scales. Trop Med Int Health. 2008;13(1):21–30.

    Article  PubMed  Google Scholar 

  18. Bergman A, McNabb K, Farley JE: A systematic review and psychometric appraisal of instruments measuring tuberculosis stigma in Sub-Saharan Africa. Stigma and Health 2021:No Pagination Specified-No Pagination Specified.

  19. Crispim JEA, Touso MM, Yamamura M, Popolin MP, Garcia MC, Santos CB, Palha PF, Arcêncio RA. Cultural adaptation of the Tuberculosis-related stigma scale to Brazil. Cien Saude Colet. 2016;21(7):2233–42.

    Article  PubMed  Google Scholar 

  20. Moya EM, Biswas A, Chávez Baray SM, Martínez O, Lomeli B. Assessment of stigma associated with tuberculosis in Mexico. Public Health Action. 2014;4(4):226–32.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Beser A, Bahar Z, Kıssal A, Cal A, Cavusoglu F, Mert H, Capık C. Psychometric properties of the Turkish version of the Tuberculosis-Related Stigma scale. Acta Paulista de Enfermagem. 2018;31(4):374–81.

    Article  Google Scholar 

  22. Redwood L, Mitchell EMH, Nguyen TA, Viney K, Duong L, Phạm HT, Nguyen BH, Nguyen VN, Fox GJ. Adaptation and validation of the Van Rie tuberculosis stigma scale in Vietnam. Int J Infect Dis. 2022;114:97–104.

    Article  PubMed  Google Scholar 

  23. Brislin RW. Back-translation for cross-cultural research. J Cross Cult Psychol. 1970;1(3):185–216.

    Article  Google Scholar 

  24. Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, Erikson P. Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: report of the ISPOR task force for translation and cultural adaptation. Value Health. 2005;8(2):94–104.

    Article  PubMed  Google Scholar 

  25. International Test Commission: ITC guidelines for translating and adapting tests (Second Edition) www.InTestCom.org: International Test Commission; 2017.

  26. Krabbe PF. The measurement of health and health status: concepts, methods and applications from a multidisciplinary perspective. London: Elsevier; 2017.

    Book  Google Scholar 

  27. Kyriazos TA. Applied psychometrics: sample size and sample power considerations in factor analysis (EFA, CFA) and SEM in general. Psychology. 2018;9(8):25.

    Article  Google Scholar 

  28. Bujang MA, Omar ED, Baharum NA. A review on sample size determination for Cronbach’s alpha test: a simple guide for researchers. Malays J Med Sci. 2018;25(6):85–99.

    PubMed  PubMed Central  Google Scholar 

  29. Mundfrom DJ, Shaw DG, Ke TL. Minimum sample size recommendations for conducting factor analyses. Int J Test. 2005;5(2):159–68.

    Article  Google Scholar 

  30. Terwee CB, Bot SDM, de Boer MR, van der Windt DAWM, Knol DL, Dekker J, Bouter LM, de Vet HCW. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34–42.

    Article  PubMed  Google Scholar 

  31. Taherdoost H, Sahibuddin S, Jalaliyoon N. Exploratory factor analysis; concepts and theory. Adv Appl Pure Math. 2022;27:375–82.

    Google Scholar 

  32. John MT, Reissmann DR, Feuerstahler L, Waller N, Baba K, Larsson P, Čelebić A, Szabo G, Rener-Sitar K. Exploratory factor analysis of the oral health impact profile. J Oral Rehabil. 2014;41(9):635–43.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Taber KS. The use of Cronbach’s alpha when developing and reporting research instruments in science education. Res Sci Educ. 2018;48(6):1273–96.

    Article  Google Scholar 

  34. Xia Y, Yang Y. RMSEA, CFI, and TLI in structural equation modeling with ordered categorical data: the story they tell depends on the estimation methods. Behav Res Methods. 2019;51(1):409–28.

    Article  PubMed  Google Scholar 

  35. Lt Hu. Bentler PM: Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Modeling. 1999;6(1):1–55.

    Article  Google Scholar 

  36. Probandari A, Sanjoto H, Mahanani MR, Azizatunnisa L, Widayati S. Being safe, feeling safe, and stigmatizing attitude among primary health care staff in providing multidrug-resistant tuberculosis care in Bantul District, Yogyakarta Province, Indonesia. Hum Resour Health. 2019;17(1):16.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Fitri S, Tahlil T, Susanti SS: Stigma in Tuberculosis sufferers: a study in Simeulue regency, Aceh Indonesia. Int J Nurs Educ 2022;14(2).

  38. Widowati I, Balgis B, Mulyani S: Relationship of age, gender, and history of comorbid diseases in TB patients toward self-stigma TB in Surakarta. Indonesian J Public Health Nutrit 2021;2(1).

  39. Rakhmawati W, Nilmanat K, Hatthakit U. Moving from fear to realization: family engagement in tuberculosis prevention in children living in tuberculosis Sundanese households in Indonesia. Int J Nurs Sci. 2019;6(3):272–7.

    PubMed  PubMed Central  Google Scholar 

  40. Fuady A, Khoe LC, Azzahra TB, Lestari HM, Sutanto RL, Yo EC, Suryoadji KA, Sudarsono NC, Findyartini A. Good knowledge but poor practice toward COVID-19 among Indonesian youth. Asia Pac J Public Health. 2021;33(5):605–7.

    Article  PubMed  Google Scholar 

  41. Sari DK, Amelia R, Dharmajaya R, Sari LM, Fitri NK. Positive correlation between general public knowledge and attitudes regarding COVID-19 outbreak 1 month after first cases reported in Indonesia. J Community Health. 2021;46(1):182–9.

    Article  PubMed  Google Scholar 

  42. Rakhmawati W, Nilmanat K, Hatthakit U: Living with stigma: the experience of tuberculosis patients and family caregivers in Indonesia. Indian J Public Health Res Dev 2019, 10(10).

  43. Wulandari LPL, Ruddick A, Guy R, Kaldor J. “Self-testing sounds more private, rather than going to the clinic and everybody will find out”: Facilitators and barriers regarding HIV testing among men who purchase sex in Bali, Indonesia. PLoS ONE. 2019;14(4): e0214987.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Badgett ML, Hasenbush A, Luhur WE: LGBT exclusion in Indonesia and its economic effects: Williams Institute, UCLA School of Law; 2017.

  45. Ministry of Health Republic of Indonesia: Laporan perkembangan HIV/AIDS dan penyakit infeksi menular seksual (PIMS) Triwulan I Tahun 2021. Jakarta: Kementerian Kesehatan RI; 2021.

  46. Nuttall C, Fuady A, Nuttall H, Dixit K, Mansyur M, Wingfield T. Interventions pathways to reduce tuberculosis-related stigma: a literature review and conceptual framework. Infect Dis Poverty. 2022;11(1):101.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Alavi M, Visentin DC, Thapa DK, Hunt GE, Watson R, Cleary M. Chi-square for model fit in confirmatory factor analysis. J Adv Nurs. 2020;76(9):2209–11.

    Article  PubMed  Google Scholar 

  48. Basterra MdR, Trumbull E, Solano FG: Cultural validity in assessment : addressing linguistic and cultural diversity (1st ed.): Routledge; 2011.

Download references

Acknowledgements

We acknowledge the supports from Fajri Gafar and Trisasi Lestari in translating the original scale to Indonesian; and Risatianti Kolopaking, Feranindhya Agiananda, Diah Handayani, Angelin Yuvensia, and Indonesian National TB Program officers in providing suggestion and insightful comments during expert panel meeting. We thank all enumerators (Annisa Melianriza, Rima Moehira [West Sumatera]; Fauzan Imari, Aprilya Elchamonika, Rania Nabila Balkis [Jambi]; Salsabila Auni Putri, Rossa Maulida Falatehan [Jakarta]; Prihan Fakhri [West Kalimantan]; IDGA Narendra Suputra, Ni Kadek Putri Ayu Aprilia Swandewi, Ni Wayan Hilda Yani, I Made Tejamurti Anggara, Ida Ayu Made Gia Cahyani [Bali]; Mardiana, Jumriana, Husnul Khotimah, Dian Nur Alisah [South Sulawesi]; and Saada Lestaluhu, Mahvut T, Sakina A. Tehuayo, Sitti Johri Nasela, Samsia Rumuar, Rafela Suarlembit, Rahma Abdurahman Suatkab [Maluku]), province-, district-, and Puskesmas-level TB officers in seven provinces. We also thank Annelies Van Rie and Aaron Kipp for allowing us to validate their original scale to Indonesian setting.

Funding

This study had funding from PUTI Q1 Grant, Universitas Indonesia (Grant No. NKB-1103) and the Royal Society of Tropical Medicine and Hygiene, United Kingdom (Grant No. 19590206). TW is supported by grants from the Wellcome Trust, UK (209075/Z/17/Z), the Medical Research Council, Department for International Development, and Wellcome Trust (Joint Global Health Trials, MR/V004832/1), and the Medical Research Foundation (Dorothy Temple Cross International Collaboration Research Grant, MRF-131–0006-RG-KHOS-C0942).

Author information

Authors and Affiliations

Authors

Contributions

Conceptualization: AFy, TW; Data curation: AFy, BA, FY, SR, AFg, AS, FFY, HS, IGWAEP; Investigation: AFy, BA, FY, SR, AFg, AS, FFY, HS, IGWAEP; Formal analysis: AFy, BA, FY; Study management: AFy, AS; Methodology: AFy, MM, TW; Supervision: AFy, MM, TW; Validation: AFy, MM, TW; Visualization: AFy, FY; Writing—original draft: AFy, BA; Writing—review and editing: AFy, BA, FY, SR, AFg, AS, FFY, HS, IGWAEP, MM, TW; Funding acquisition: AFy, AS, TW. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Ahmad Fuady.

Ethics declarations

Ethical approval and consent to participate

This study involved human participants, and all procedures in this study were in accordance with the ethical standards of the research committee and with the 1964 Helsinki declaration. The protocol and its amandment were approved by the Ethics Research Committee of the Faculty of Medicine, University of Indonesia (No. KET-60/UN2.F1/ETIK/PPM.00.02/2022, on January 17, 2022). Participants received a complete explanation before signing consent to join the interview. Although there were participants with no formal schooling, all participants could read and sign consent. Written informed consent was obtained from all the participants of the study.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

Supplementary File: S1–S6.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Fuady, A., Arifin, B., Yunita, F. et al. Stigma towards people with tuberculosis: a cross-cultural adaptation and validation of a scale in Indonesia. BMC Psychol 11, 112 (2023). https://doi.org/10.1186/s40359-023-01161-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s40359-023-01161-y

Keywords