- Research article
- Open Access
Psychometric properties of the Inventory of Life Quality in children and adolescents in Norwegian Sign Language
BMC Psychology volume 9, Article number: 89 (2021)
Several studies have assessed the Quality of Life (QoL) in Deaf and hard-of-hearing (DHH) children and adolescents. The findings from these studies, however, vary from DHH children reporting lower QoL than their typically hearing (TH) peers to similar QoL and even higher QoL. These differences have been attributed to contextual and individual factors such as degree of access to communication, the participants’ age as well as measurement error. Using written instead of sign language measures has been shown to underestimate mental health symptoms in DHH children and adolescents. It is expected that translating generic QoL measures into sign language will help gain more accurate reports from DHH children and adolescents, thus eliminating one of the sources for the observed differences in research conclusions. Hence, the aim of the current study is to translate the Inventory of Life Quality in Children and Adolescents into Norwegian Sign Language (ILC-NSL) and to evaluate the psychometric properties of the self-report of the ILC-NSL and the written Norwegian version (ILC-NOR) for DHH children and adolescents. The parent report was included for comparison. Associations between child self-report and parent-report are also provided.
Fifty-six DHH children completed the ILC-NSL and ILC-NOR in randomized order while their parents completed the parent-report of the ILC-NOR and a questionnaire on hearing- and language-related information. Internal consistency was examined using Dillon-Goldstein’s rho and Cronbach’s alpha, ILC-NSL and ILC-NOR were compared using intraclass correlation coefficients. Construct validity was examined by partial least squares structural equation modeling (PLS-SEM).
Regarding reliability, the internal consistency was established as acceptable to good, whereas the comparison of the ILC-NSL with the ILC-NOR demonstrated closer correspondence for the adolescent version of the ILC than for the child version. The construct validity, as evaluated by PLS-SEM, resulted in an acceptable fit for the proposed one-factor model for both language versions for adolescents as well as the complete sample.
The reliability and validity of the ILC-NSL seem promising, especially for the adolescent version, even though the validation was based on a small sample of DHH children and adolescents.
Quality of life in Deaf and hard-og-hearing children and adolescents
The number of studies on Quality of Life (QoL) in Deaf and hard-of-hearing (DHH) children and adolescents has increased over the past decades, mainly focusing on children with cochlear implants. However, as Hintermair , points out, several aspects make it difficult to compare these studies. Among these are differences in the definition of QoL, ranging from Health-Related QoL (HRQoL) to social well-being, different types of assessments (generic QoL measures, ad-hoc tools designed for specific studies, and parents’ qualitative reports after their children’s cochlear implantation), and different informants (parents and children) as well as differences in access to communication and peers. Researchers such as Warner-Czyz et al.  have demonstrated the importance of including both parents’ and children’s perceptions. They found that 4–7-year-old DHH children in their study reported better QoL than their parents. Chmiel et al.  support this necessity based on parents reporting better QoL for their 3–20-year-old DHH children and adolescents after cochlear implantation when compared with their children’s self-report. Fellinger et al.  also report low agreement between parents and their 6–16-year-old DHH children and adolescents on the Inventory of Life Quality in Children and Adolescents (ILC). Parents report the same level of QoL for their DHH children as parents of a typically hearing (TH) normative sample. The DHH children themselves report being less satisfied with play/hobbies when alone, as well as physical health, compared with TH normative data. The same DHH children report better QoL related to school and family. Other researchers such as Pardo-Gijarro et al. , on the other hand, find moderate agreement between Spanish DHH children and adolescents and their parents when using a written and a Spanish sign language version of the KIDDSCREEN27, with correlations between 0.377 and 0.753. Discrepancies between child- and parent-report have also been reported for TH children and adolescents [6, 7]. Therefore, the multi-informant approach has been emphasized for accessing QoL. Other factors that are likely to have contributed to differences in DHH children and adolescents’ QoL are variations in participants’ age, their preferred mode of communication and degree of hearing loss. It has previously been found for both TH and DHH children that older adolescents report lower QoL [5, 8,9,10]. The development of reliable and valid QoL instruments in sign language will help gain more accurate reports from DHH children who use sign language as their preferred language, thus eliminating one of the sources for the observed differences in research conclusions. In the present study, the term “children” is used for those aged 11 and younger, whereas “adolescents” refers to those aged 12 and older.
In their systematic review Roland, Fischer, Tran, et al.  report that 11 of 16 studies based on DHH children and adolescents and validated QoL measures find significantly lower QoL when compared with normative scores or TH controls, whereas five studies do not identify such differences in QoL. Their meta-analysis reveals that DHH children and adolescents report decreased QoL in the social and school domains based on the Pediatric Quality of Life Inventory (PedsQL). Unfortunately, there are some issues with this systematic review . One problem is the lack of information about the informants for the specific studies.
Another issue with Roland, Fischer, Tran, et al.’s  systematic review is that Hintermair’s  and Fellinger, Holzinger, Sattel, et al.’s  results are cited wrongly, that is, a maximum of 9 out of 16 studies (not 11 out of 16 as the authors state) find significantly lower QoL when compared with normative scores or TH controls. Hintermair  finds that mainstreamed DHH children and adolescents report better QoL based on the total QoL score, as well as in the domains of school, physical health, mental health, and global QoL, on the ILC than a normative TH sample. The effect sizes for the reported differences were small to moderate. Fellinger, Holzinger, Gerich, et al.  and Hintermair  report QoL being unrelated to the type and degree of hearing loss in DHH adults, children and adolescents respectively, whereas others such as Tsimpida, Kaitelidou, and Galanis  find that DHH adults with a higher degree of hearing loss report lower QoL. Kushalnagar, Topolski, Schick et al.  demonstrate that adolescents (11–18 years old) report higher QoL when they perceive that they understand most of their parents’ expressive communication. This was not dependent on their preferred communication modality or degree of hearing loss. Adolescents with a preference for a combination of sign language and speech, however, reported experiencing less stigma than those with a strong preference for speech only .
Assessing QoL in DHH children and adolescents
Language and communication are essential for assessing QoL. Sign languages are natural languages that share many linguistic characteristics with spoken languages but also have specific features due to their manual-visual nature . Studies have also shown that cultural context influences the understanding of seemingly identical wordings, especially when translating from written text to sign language [16, 17]. The acknowledgment of sign languages as natural languages has helped lead to a shift from viewing DHH people in a medical and disability perspective to a socio-cultural one, appreciating deaf culture with its language, history, traditions, art and values [18, 19]. For several DHH children and adolescents written language is considered as their second language. Studies have reported reading difficulties for many DHH children and adolescents [20,21,22], which in turn are likely to affect their ability to complete written forms, compromising the validity of assessments based on written forms. When assessing symptoms of mental health problems in DHH children and adolescents, it has been confirmed that the use of written self-report measures can lead to underestimating symptoms [23, 24]. Most measures are designed for assessing TH people. A common solution in clinical practice is the use of sign language interpreters, who will provide on-the-spot translations, which will be influenced by their training and experience and therefore vary across settings and children . Pardo-Guijarro, Martínez-Andrés, Notario- Pacheco et al.  emphasize the need to translate valid and reliable generic QoL measures into sign language to assess QoL in DHH children and adolescents and compare them to their TH peers’ QoL. Assessment tools for QoL exist in some sign languages so far—American , Austrian , and Spanish Sign Language . To the best of our knowledge, there is a lack of such instruments and a lack of studies on QoL in Norwegian DHH children and adolescents.
The Inventory of Life Quality (ILC)
The ILC is a brief measure to assess QoL in children and adolescents. The measure is based on the concept of the individual’s perception of their position in life, including their health, functioning, and participation in routines and activities as compared to their peers [6, 7]. It consists of seven items. One item for Global QoL and six items addressing the child’s physical and mental health, school and family functioning, social contact with peers as well as play/hobbies when alone. The ILC is a multi-informant assessment and can be completed by children, adolescents, and young adults aged 6–21 and their parents. For children aged 6–11, the self-report is administered as an interview. Achenbach, McConaughy and Howell  among others, emphasize the importance of multi-informant assessments for capturing the unique perspectives held by each informant.
The original German validation found acceptable internal consistency (α = 0.63 self-report and α = 0.76 parent report) and test–retest reliability (r = 0.72 self-report and r = 0.80 parent report) for the QoL score (LQ0–28) for community samples. Convergent validity with the Kinder Lebensqualität Fragebogen (KINDL) was shown to be moderate. Construct validity based on Principal Component Analysis was found to be acceptable for the one-component model in a community sample (self- and parent-report; N = 9292 and N = 1109) and a two-component model in a clinical sample (self- and parent-report; N = 605 and N = 568) . For the two-component model, one component consisted of one item only (play/hobbies when alone) and the other component of the other six items. Based on the low number of items as well as the nature of the clinical sample and the relatively lower number of participants, the authors concluded that the one-component model fit the theoretical model best . The importance of examining psychometric properties for measures of QoL in both community and clinical samples has been demonstrated by Jozefiak, Mattejat and Remschmidt  amongst others when examining the relationship between depression and QoL.
The validation of the Norwegian self and parent report  found satisfactory internal consistency for adolescents aged 11 and older (self-report: Cronbach’s α = 0.80–0.82, parent report: α = 0.78). For children aged ten and younger, internal consistency was somewhat lower (α = 0.64). The two-week test–retest reliability for the self-report was found to be high (r = 0.86). The one-factor model of the ILC based on confirmatory factor analysis demonstrated good fit in three community samples and acceptable fit in the fourth (clinical) sample. Moderate correlations between the KINDL and ILC self-report were found, supporting convergent validity . A systematic Norwegian review based on five studies of the psychometric properties of the ILC confirmed these findings .
To the best of our knowledge, the ILC has only been used to study QoL in DHH in Germany, Austria, and Norway. Construct validity for DHH children and adolescents has only been studied in Germany . In this sample, the DHH children and adolescents were all mainstreamed, indicated a preference for spoken language, and were assessed with the original written version. Hintermair  finds satisfactory internal consistency (α = 0.71) for the ILC in this German DHH sample with 212 participants; interitem correlations showed the same pattern as for TH children and adolescents with the items “Mental Health” and “Global QoL”, demonstrating the highest correlations with the QoL score (LQ0–28). A principal component analysis with subsequent varimax rotation resulted in the best fit for the two-component solution, “Family” and “Alone (play/hobbies),” constituting one component, while the other five items constituted the other component. Hintermair  concludes that these results support the use of the ILC for DHH mainstreamed children and adolescents with a preference for spoken language.
Except for the pilot study by Aanondsen et al. , there are hardly any studies on Norwegian DHH children and adolescents’ QoL, and no studies validating assessment tools in NSL for assessing QoL in DHH children and adolescents. Norway is unique in offering the parents of DHH children and adolescents 40 weeks (i.e., 2–4 weeks/year) of NSL classes over the course of 16 years, with all expenses covered. Therefore, one might expect a higher level of sign language skills among Norwegian DHH children and adolescents and their parents. This, in turn, may have a positive influence on their QoL. The inconsistencies in previous studies regarding DHH children and adolescents’ QoL necessitate valid tools, both written and in sign language, to bridge the gap. The present study contributes to this by both translating the ILC to NSL as well as providing psychometric properties for the Norwegian version of the ILC self-report (ILC-NOR) and the NSL version (ILC NSL). The ILC NSL is the first instrument translated to NSL for assessing QoL in Norwegian DHH children and adolescents.
The main aims of the present study were to translate and validate the ILC self-report in NSL (ILC-NSL) and compare it with the ILC-NOR in Norwegian DHH children and adolescents. Both self-reports of the ILC were compared with the parent report. Finally, the usability of the ILC-NSL for signing DHH children and adolescents was assessed from the children and adolescents’ perspective.
We addressed the following research questions.
What is the internal consistency of the ILC-NSL and ILC-NOR for DHH children and adolescents?
What are the correlations between the total scores and items between the self-report ILC-NSL and ILC-NOR?
What is the construct validity of the ILC-NSL and ILC-NOR for DHH children and adolescents?
What are the correlations between the QoL score (LQ0–28) and items between the self-reports (ILC-NSL and ILC-NOR) and parent report?
What do DHH children and adolescents think about the usability of the ILC-NSL and ILC-NOR?
Caluraud, Marcolla-Bouchetemblé, de Barros et al.  report that hearing loss (HL) of > 40 dB affects 1.4 per 1000 infants (mild HL in 13%, moderate HL in 50%, severe HL in 17%, and profound HL in 20%). In central and northern Norway, this amounts to 266 children and adolescents with a HL of > 40 dB, that is, 45 with severe and 53 with profound HL based on a population of 189,737 children and adolescents aged 6–18.
DHH children and adolescents aged 6–17 were recruited from the part- and full-time students at A.C. Møller school, a Deaf school for central and northern Norway during the school year of 2016/17. DHH adolescents aged 15–20 attending Tiller upper secondary school in central Norway with NSL as their first or second language were also invited. The overall response rate for the combined subsamples was 87% (60/69) (see Fig. 1).
Two children were excluded because of a lack of fluency in Norwegian sign language. Apart from fluency in both written and signed Norwegian (NSL), we applied no exclusion criteria. In total, 56 DHH children and adolescents (67.9% girls) participated in the current study, with a mean age of 12.4 years (SD = 3.65; range = 6–20) and a mean nonverbal IQ of 106.91 (SD = 17.74; range = 49–143). The participant with the lowest non-verbal IQ was included in further analysis despite being an extreme outlier in the IQ distribution (range excluding outlier = 74–143). Thirty-seven of the 42 (88.1%) mothers had completed 12 years or more of education, whereas 28 of the 41 (68.3%) fathers had completed 12 years or more of education. Data were collected between November 1, 2016 and May 9, 2017. The majority of the DHH children and adolescents (69%) mainly attended mainstream schools while spending two to six weeks at the deaf school per school year.
Hearing- and language-related information for the participants in the current study can be found in Tables 1 and 2.
Sociodemographic and hearing-related information
A questionnaire completed by the parents was used to assess the participants’ age, sex, type and severity of HL, type of education, and parents’ attendance of sign language classes. The same questionnaire was also used in a previous study by the same authors .
Spoken language skills
Categories of Auditory Performance (CAP; Archbold, Lutman and Marshall ) and Speech Intelligibility Rating (SIR, Allen, Nikolopoulos, Dyar et al. ) were used to assess participants’ speech intelligibility and listening skills. The CAP is a single-item scale with a range of 0–7. Level 0 is “no awareness of environmental sounds”, and Level 7 “uses a telephone with a known speaker.” The SIR is also a single-item scale with a range of 1–5. Level 1 is “connected speech is unintelligible”, and 5 “connected speech is intelligible to all listeners.” The interrater reliability of the Danish version is based on the reports of two teachers and was reported as good (CAP: kappa = 0.785; SIR: kappa = 0.848; Dammeyer ). The Norwegian versions of the CAP and SIR were recently used in a study by Aanondsen, Jozefiak, Heiling et al.  for a similar group of participants. The scores of CAP and SIR were combined to form the Spoken Language Skills Score.
Sign language skills
The Norwegian versions of the Sign Language Production Scale (SPS) and the Sign Language Understanding Scale (SUS) were used to assess Sign Language Skills . The SPS and SUS were designed as as a short screening of sign language skills for research purposes and have previously been used in Norway . SUS and SPS are based on the structure and range of CAP and SIR. The SPS is a single-item scale with a range of 1–5. Level 1 is “the child does not produce real signs” and Level 5 “the child uses fluent and almost conventional correct sign language.” The SUS is a single-item scale with a range of 0–7. Level 0 is “does not react to or does not comprehend signs” and Level 7 “is able to participate in long and complex conversations in sign language.” The interrater reliability of the Danish version based on the reports of two teachers was reported as good (kappa = 0.944 for SUS and kappa = 0.921 for SPS; Dammeyer ). The Danish version  of Assessing British Sign Language Development: Receptive Skills Test  was used to assess the validity of the SUS. The SUS and the sign language receptive skills test correlated significantly (Spearman rank correlation coefficient = 0.905, p < 0.000; ). The validity of the SPS could not be evaluated due to the lack of a comparable assessment. The scores of SPS and SUS were combined to form the “Sign Language Skills Score”.
The Leiter International Performance Scale – Third Edition (Leiter-3) was used to assess nonverbal intelligence. It includes the following subtests: Figure Ground, Form Completion, Classification/Analogies, and Sequential Order. The sum of the scaled scores for these subtests constitutes the composite score of nonverbal IQ and is converted to the standard score .
Quality of life (QoL)
The Inventory of Life Quality in Children and Adolescents—ILC [6, 7] is a multi-informant assessment for QoL based on seven items. One item assesses overall QoL, and six items address the child’s physical and mental health, school and family functioning, social contact with peers, play/hobbies when alone. Items are rated on a 5-point Likert scale from 1 = “Very Good” to 5 = “Very Bad.” The QoL score (LQ0–28) is calculated by multiplying the mean of the seven items by seven and subtracting 35, thus obtaining absolute values with a range of 0 to 28; higher scores representing better QoL (LQ0–28) and lower QoL scores reflecting poorer overall QoL [6, 7].
In the current study, we administered the written parent report (ILC-NOR) and the self-report versions for children (6–11) and adolescents (12 and older) in both written and signed Norwegian (ILC-NOR and ILC-NSL), according to the manual . Because of the differences reported  in internal consistency between the adolescent (Cronbach’s α = 0.81) and the child version (Cronbach’s α = 0.64), psychometric properties will be reported separately for the child and the adolescent versions, as well as for the complete sample (CA).
The translation process
The translation of the ILC was conducted based on the guidelines for cross-cultural adaptation of written self-report measures by Beaton, Bombardier, Guillemin et al.  with adaptations suggested by Roberts, Wright, Moore et al. . Suggestions were based on the differences in syntax, morphology and prosody of sign languages and their visual nature. The same translation process was applied and described in this study by Aanondsen, Jozefiak, Heiling et al. . The ILC-NOR went through two independent forward and backward translations from written Norwegian to NSL. Two bilingual deaf native NSL users with university degrees in teaching conducted and recorded these. The semantic, conceptual, lexical, and cultural differences were discussed by a panel. Members of the panel were the translators, a clinical psychologist, a colleague with a graduate degree in medicine specializing in child and adolescent psychiatry, and a consultant with a master’s degree in language and communication and fluency in NSL. Based on these discussions, the panel developed a consensus-based forward translation that was filmed. Teachers from the local deaf school were used as a focus group. Best practice recommends including DHH children and adolescents in these focus groups. Due to constraints related to time and access to children of the right ages, teachers, who meet DHH children and adolescents with varying degrees of NSL and ages were recruited instead. The teachers (Deaf, hearing, and CODA, that is, a TH person raised by deaf parents) were asked to evaluate whether DHH children and adolescents with a mixture of language experiences and levels of fluency would be able to understand the translation. Based on the feedback of the focus group, the consensus version was adjusted and filmed again. Two hearing sign language interpreters, one with a background as a CODA and a master’s degree in language and communication conducted the backward translations of the final consensus version. These were reviewed by the panel and compared with the original written Norwegian version.
The author of the Norwegian version of the ILC, Thomas Jozefiak, approved the items and made suggestions for those not approved on behalf of the copyright holders (Hogrefe). These items went back through the translation cycle until final approval was achieved. After the final approval, the ILC-NSL was filmed professionally and prepared for interactive online administration using Select Survey.
The enrolled children and adolescents and their parents received oral/signed and written information about participating in the study during their first attendance at the school after the survey had been initiated. Written informed consent was obtained from the adolescents and parents prior to inclusion, according to the study’s survey procedures. The participating children and adolescents responded to the web-based ILC-NSL and ILC-NOR as well as a question about the usability of the two language versions and completed a nonverbal cognitive assessment. The nonverbal cognitive assessment was administered by a psychologist experienced in working with DHH children in mental health services and fluent in NSL. The administration of the ILC-NSL and ILC-NOR were conducted on two separate occasions with an interval of two to three days. The order of these two administrations was randomized. Parents also responded to a questionnaire on socioeconomic status, as well as questionnaires assessing their children’s mental health, communication skills in spoken and signed Norwegian, and hearing status. DHH children and adolescents had access to their teacher and a psychologist, both of whom were fluent in NSL, during data collection. When the children and adolescents asked for help with the ILC-NSL, they received support in NSL, whereas the children and adolescents replying to the ILC-NOR were assisted in spoken Norwegian or sign-supported speech.
Missing values on five cases with ≤ 3 missing item values were substituted using expectation maximization (EM; ). Gender differences in item and scale mean scores were analyzed using independent samples t-tests. Mean differences were calculated. Bootstrapped confidence intervals were calculated using the bias corrected and accelerated method (BCa) and B = 1000 bootstrap samples. Differences between spoken and sign language skills were analyzed using paired sample t-tests for both age groups.
Dillon –Goldstein’s rho (DG rho) was used to assess internal consistency because of the limitations of Cronbach’s α, such as assumptions of uncorrelated errors, tau-equivalence and normality . As most authors, however, report internal consistency based on Cronbach’s α, we also calculated Cronbach’s α, including bootstrapped confidence intervals for comparison. DG rho and Cronbach’s α were interpreted as acceptable internal consistency at 0.6–0.7, and as good internal consistency when > 0.7. Intraclass correlation coefficients (ICC) based on a two-way mixed effects model with absolute agreement were used to evaluate associations between the scale and item scores of the two self-reports (ILC-NSL and ILC-NOR). Intraclass correlation coefficients (ICC) were calculated for each of the seven items and the QoL score LQ0–28 to compare the two language versions of the self-report. We calculated Spearman’s rank correlations to assess multi-informant correlations between the QoL scores on the parent and self-reported versions (NSL and NOR).
Partial least squares structural equation modeling (PLS-SEM) is a robust method when dealing with small sample sizes because it is nonparametric and makes fewer distributional assumptions. PLS-SEM, however, is mostly used for exploratory purposes because it lacks goodness of fit measures. Because of the small sample size, we primarily used PLS-SEM to establish factor loadings and discriminant validity (average variance extracted (AVE)) as suggested by Hair, Hult, Ringle et al. . Standardized factor loadings greater than 0.4 were considered acceptable . Factors with AVE scores greater than 0.5 were regarded as satisfactory for convergent/discriminant validity. Fornell and Larcker , however, argue that AVE > 0.4 can be treated as acceptable if composite reliability is above 0.6.
As a supplementary analysis of the confirmed ILC factor structure, we used confirmatory factor analysis (CFA) with the weighted least squares means and variances adjusted (WLSMV) estimation method for categorical variables. The chi-square test, the normed chi-square (χ2/df), the root mean square error of approximation (RMSEA), comparative fit index (CFI) and Tucker-Lewis Index (TLI) were used to assess model fit. A non-significant chi-square test, CFI and TFI > 0.9, RMSEA < 0.1 were considered indicators of acceptable goodness of fit according to Mehmetoglu and Jakobsen , whereas CFI and TFI > 0.95 and RMSEA < 0.05 were considered as indicators of good model fit . A normed chi-square of < 2.0 was considered as good for this study, and ratios of < 5.0 as acceptable . Standardized factor loadings greater than 0.4 were considered acceptable . Hair, Hult, Ringle et al.  point out that a small sample size can cause problems with underidentified models and nonconvergence in CFA. The estimator WLSMV has been shown to overestimate interfactor correlations when the sample size is relatively small . Due to these problems, the CFA was used as a supplementary analysis only and can be found in Additional file 1: Appendix C. All analyses were conducted separately for the child and the adolescent versions, as well as for the complete age sample, that is, both the child and adolescent versions combined (CA).
The CFA was conducted in MPlus version 8. All otheranalyses were conducted in Stata/SE 14.2 for Windows. PLS-SEM, including AVE, was conducted in Stata by applying the module for PLS-SEM . For all analyses, two-sided p-values < 0.05 were considered statistically significant.
Written informed consent was obtained from the parents and adolescents older than 16 prior to inclusion, as well as oral/signed informed consent from the children and adolescents under the age of 16. Study approval was given by the Regional Committees for Medical and Health Research Ethics (reference number: 2015/1739/REK midt).
Table 3 presents the means and standard deviations for the DHH participants on the self-report of the ILC (ILC-NSL and ILC-NOR). A table with mean differences for all items and bootstrapped confidence intervals can be found in Additional file 1: Appendix A. The full distribution of all items and QoL score for both self-reports is reported in Additional file 1: Appendix B.
Independent sample t-tests for the complete sample showed a significant gender difference for the QoL score LQ0–28 (girls: M = 20.916, SD = 0.780; boys: M = 24.239, SD = 0.651); t(54) = − 2.720, p = 0.009 for the ILC-NOR and none for the ILC-NSL.
As can be seen in Table 4, internal consistency based on DG rho and Cronbach’s α was found to be good for all scales and age versions, except for the ILC-NSL child version, which demonstrated acceptable internal consistency based on Cronbach’s α and good internal consistency based on DG rho.
Comparison of the ILC-NSL and ILC-NOR
To compare the ILC-NSL with the ILC-NOR self-report, intraclass correlation coefficients (ICC) were calculated for each of the seven items and the QoL score (Table 5).
The ICCs between the LQ0–28 of the ILC-NSL and ILC-NOR were highly significant at p < 0.001 for the complete sample, as well as for the adolescent version, but not for the child version.. The items on the adolescent versions were all significantly correlated, moderately to strongly (0.441–0.867), while none of the items on the child versions correlated significantly.
The standardized factor loadings and AVE of the one-factor model are displayed in Table 6 for the ILC-NSL and ILC-NOR.
All factor loadings were above the recommended 0.4 for both adolescent versions and the complete sample. The factor loading for “Family” on the ILC-NOR child as well as those for “Alone” and “Physical Health” on the ILC-NSL child were lower than recommended. AVE was above the acceptable 0.5 for the ILC-NOR CA and ILC-NOR child. Fornell and Larcker , however, argue that AVE > 0.4 can be treated as acceptable if composite reliability, in this case, DG’s rho, is above 0.6. This was the case for the complete sample as well as the child and adolescent versions of both the ILC-NSL and the ILC-NOR. Supplementary analyses based on CFA support these findings and can be found in Additional file 1: Appendix C.
Multi-informant correlations between the LQ0–28 scores of DHH children and adolescents and their parents on the self-report ILC-NSL and ILC-NOR are presented in Tables 7 and 8. Correlations between the self- and parent-reported QoL score (LQ0–28) were not significant for any of the versions. There was a moderate correlation for LQ0–28 of the adolescent ILC-NSL and the parent ILC. Analysis of the multi-informant correlations at the item level did not demonstrate significant correlations for any of the versions.
The DHH children and adolescents’ preferences for the presentation of the ILC are presented in Table 9.
During administration of the ILC-NSL and ILC-NOR, some of the children and adolescents commented that they spent more time completing the ILC-NSL because it took longer to view the video clips of the signed items than to read the items.
Internal consistency was established as good for both language and age versions. A comparison of the two language versions showed that the adolescent version corresponded closely for both item and total scores, whereas the child version did not correspond well between the languages. Construct validity based on PLS-SEM was found to be acceptable for the proposed one-factor model for both language versions and all ages.. This is also in line with the previously confirmed one-factor model based on the original theoretical concept of QoL that the ILC is based on [6, 7].
The ILC-NSL and ILC-NOR demonstrated similar psychometric properties to those reported for the ILC in other studies both for TH [6, 7] and DHH children and adolescents . The ILC-NSL demonstrated the same pattern as the original Norwegian validation (ILC-NOR) with lower internal consistency based on Cronbach’s α for the child version than the adolescent version . The relative cognitive immaturity in younger children or the significantly lower NSL skills may be a possible explanation for this.
Associations between the two language versions of the self-report were high for both item and scale scores for the ILC adolescent version. They were higher than we expected based on other studies comparing written and sign language versions of mental health assessments [23, 24]. This may indicate a close correspondence between the ILC-NSL and ILC-NOR because of equivalent phrasing in written Norwegian and NSL. Other reasons for the close correspondence may have been the high number of children and adolescents with a spoken language preference among this DHH sample or possibly good literacy, which was not assessed. The associations between the two language versions of the child self-report, however, were much weaker, indicating problems with the translation, literacy, or Norwegian sign language skills. As no DHH children or adolescents were included in the focus groups during the translation process, it is possible that the translation was not clear or not at an appropriate level for DHH children with varying NSL skills. Including them in the focus group, however, would have decreased the number of potential participants for this study. Literacy was not assessed in the current study; therefore, it is difficult to conclude on this matter. Other possible reasons for this finding might be that the child version is constructed for individual administration but was administered in groups in the current study. The individual administration is designed as a conversation with the child and contains longer sentences and explanations than the adolescent version. As the younger participants have attended deaf school less than the adolescents and their parents have received fewer sign language lessons, the children’s sign language skills might not enable them to cope with the longer sentences. Therefore, they might have benefitted from the adolescent version with its shorter and simpler sentences. Consequently, we suggest that a validation study be carried out for younger DHH children using the adolescent version of the ILC-NSL after having included DHH children in focus groups on this NSL version and making adjustments if necessary.
There was a moderate, but not significant, correlation between adolescent self-reports (ILC-NSL and ILC-NOR) and parent reports for QoL scores LQ0–28 whereas the two language versions of the child self-report showed no associations with the parent reports. This is somewhat in contrast to the significant, but low informant agreement reported previously  for TH children and adolescents, whereas other researchers on DHH child and adolescent QoL report similar low agreement with parent reports [2, 3, 49] as seen in our study. Pardo-Guijarro, Martínez-Andrés, Notario- Pacheco et al. , reason that hearing parents experience the impact of their children’s deafness on QoL to a larger degree than their children. Warner-Czyz, Loy, Roland et al.  argue that several aspects of QoL are less observable for parents, such as self-esteem, family, and friends. Others [4, 50] have suggested that DHH children and adolescents not sharing the same mode of communication with their parents might lessen the parents’ insight into their children’s subjective world, including QoL. Aanondsen, Jozefiak, Heiling et al.  find parent–DHH child correlations for the Strengths and Difficulties Questionnaire (SDQ) assessing mental health, close to those reported in another study  for TH children and adolescents. The difference in parent–child agreement between the SDQ and ILC might be related to the different nature of the items describing QoL compared with mental health symptoms (SDQ), which are more easily observed by others. This illustrates the definition of QoL as a subjective concept. The low agreement between parents and DHH, as well as TH children and adolescents, emphasizes the need to consider the self-report as the authentic QoL report, whereas the parent report should be used as supplemental information from a more remote informant . This conclusion enhances the importance of developing sign language versions of generic QoL instruments for capturing DHH children and adolescents’ own views. This does not, however, lessen the importance of assessing parents’ perspective on their children’s QoL as is also emphasized by the authors of the ILC [6, 7].
Most of the DHH children and adolescents reported preferring the written instrument (ILC-NOR), and this preference was more pronounced for the adolescents than the children, possibly reflecting the lower NSL competence among children and their parent-reported preference for spoken Norwegian. There may have been subsamples based on spoken or sign language proficiency that could have influenced these results. These were not examined, however, due to the small sample size. Spontaneous feedback during administration indicated that the preference for the written version (ILC-NOR) was related to the less time-consuming nature of this version. Greater mastery of literacy in DHH adolescents could explain their preference for the written version of the ILC. The preference of the written version, however, is somewhat surprising given that other studies report reading difficulties to be frequent in many DHH children and adolescents [20, 22, 53] and their preference for sign language. As we only assessed spoken and sign language skills but not literacy, we could not test this.
Strengths and limitations
A major strength of the current study is the use of a generic assessment tool for QoL that was translated into NSL, and that also examined psychometric properties for both written and sign language for DHH children and adolescents. A further strength of the choice of the ILC is the multi-informant perspective. Both these factors have been found necessary to solve some of the current inconsistencies in findings on the QoL of DHH children and adolescents.
A major limitation of the present study is the small sample size due to the limited number of signing DHH children and adolescents in the population. The sample size here was smaller than the minimum number of cases recommended for multivariate analyses based on covariance, especially when analyzing the child and the adolescent versions separately. This, in turn, poses a problem for a thorough psychometric evaluation of the ILC-NSL and ILC-NOR for DHH children and adolescents. Alternatively, the hypotheses could have been framed more precisely and tailored to the expected small sample size, in turn choosing statistical procedures more in line with these. By reporting the confidence intervals for the results, we have attempted to partly compensate for this. To offset the effects of small sample size, we have also used the PLS-SEM, which is known to be robust for such situations . The combination of analyses used here was chosen as the best practical solution for the small sample size but leaves room for uncertainty regarding the conclusions.
A further limitation is the short interval of two to three days between the administration of the two language versions. This may have led to participants remembering their former answers and creating a bias. The randomized order of administration of the two versions was conducted to counteract this.
The lack of including the target population for the ILC-NSL in the focus group for the translation is a further limitation as well as the use of single-item measures to assess spoken and sign language skills which cannot be regarded as a complete assessment of the participants’ communication skills. A minor limitation is the absence of a gold standard for establishing convergent validity for QoL in DHH children and adolescents. The use of a written instrument, such as the KIDSCREEN, as a gold standard, however, would not have been reliable or valid because of the evidence showing that many DHH children and adolescents have reading difficulties [20, 22, 53] even though this did not seem prominent in our sample. Another translation cycle into NSL and validation of this translation would have been necessary and too time-consuming for the scope of the current study. A further limitation is the lack of test–retest reliability.
The evaluation of the psychometric properties of the self-report ILC-NSL is promising. The use of the self-report ILC-NSL for assessing QoL in DHH children and adolescents is essential given its subjective nature. For children younger than the age of 11, the use of the ILC-NSL is more questionable, possibly because of their lower sign language skills. Until better alternatives are developed, we suggest that the psychometric properties of the written and NSL adolescent versions are studied for DHH children after focus groups are conducted, including representatives for the target population. Alternatively, that it is investigated whether individual rather than group administration may result in better usability and validity of the child ILC-NSL and ILC-NOR. Based on the children and adolescents’ feedback, we recommend presenting both the written and NSL versions in combination to evaluate QoL among DHH children and adolescents rather than using only one language. Further research on DHH children and adolescents is needed to solve the current inconsistencies in the findings related to QoL. Because of the small number of signing DHH children and adolescents in the population, cross-cultural studies should be encouraged; this would increase the possibility of conducting research on larger samples, as well as allowing for an examination of cross-cultural similarities and differences.
Availability of data and materials
The datasets generated and analyzed during the current study are not publicly available because of the sensitivity of the information, as well as the small sample size. They are available from the local research committee or the corresponding author upon reasonable request.
Quality of life
Deaf and hard-of-hearing
Pediatric Quality of Life Inventory
Norwegian Sign Language
Kinder Lebensqualität Fragebogen
The Inventory of Life Quality
Categories of Auditory Performance
Speech Intelligibility Rating
Sign Language Production Scale
Sign Language Understanding Scale
Children and adolescents—complete sample
Children of deaf adults
- DG rho:
Intraclass correlation coefficients
Confirmatory factor analysis
Weighted least squares means and variances adjusted
Root mean square error of approximation
Comparative fit index
Partial least squares structural equation modeling
Average variance extracted
Hintermair M. Health-related quality of life and classroom participation of deaf and hard-of-hearing students in general schools. J Deaf Stud Deaf Educ. 2011;16(2):254–71.
Warner-Czyz AD, Loy B, Roland PS, Tong L, Tobey EA. Parent versus child assessment of quality of life in children using cochlear implants. Int J Pediatr Otorhinolaryngol. 2009;73(10):1423–9.
Chmiel R, Sutton L, Jenkins H. Quality of life in children with cochlear implants. Ann Otol Rhinol Laryngol. 2000;109:103–5.
Fellinger J, Holzinger D, Sattel H, Laucht M. Mental health and quality of life in deaf pupils. Eur Child Adolesc Psychiatry. 2008;17(7):414–23.
Pardo-Guijarro MJ, Martínez-Andrés M, Notario- Pacheco B, Solera-Martínez M, Sánchez-López M, Martínez-Vizcaíno V. Self-reports versus parental perceptions of health-related quality of life among deaf children and adolescents. J Deaf Stud Deaf Educ. 2015;20(3):275–82.
Jozefiak T, Mattejat F, Remschmidt H. Inventory of Life Quality in children and adolescents manual, Norwegian Version. Stockholm: Hogrefe; 2012.
Mattejat F, Remschmidt H. Das Inventar zur Erfassung der Lebensqualitaet bei Kindern un Jugendlichen (ILK) [The inventory of quality of life in children and adolescents ILC]. Bern: Verlag Hans Huber; 2006.
Aanondsen CM, Heiling K, Nøvik TS, Jozefiak T. Quality of Life, family function and mental health of deaf and hard-of-hearing adolescents in mental health services in Norway—a pilot study. Int J Ment Health Deaf. 2018;4(1):3–13.
Jozefiak T, Larsson B, Wichstrom L. Changes in quality of life among Norwegian school children: a six-month follow-up study. Health Qual Life Outcomes. 2009;7:7.
Warner-Czyz AD, Loy B, Tobey EA, Nakonezny P, Roland PS. Health-related quality of life in children and adolescents who use cochlear implants. Int J Pediatr Otorhinolaryngol. 2011;75(1):95–105.
Roland L, Fischer C, Tran K, Rachakonda T, Kallogjeri D, Lieu JE. Quality of life in children with hearing impairment: systematic review and meta-analysis. Otolaryngol Head Neck Surg. 2016;155(2):208–19.
Fellinger J, Holzinger D, Gerich J, Goldberg D. Mental distress and quality of life in the hard of hearing. Acta Psychiatr Scand. 2007;115(3):243–5.
Tsimpida D, Kaitelidou D, Galanis P. Determinants of health-related quality of life (HRQoL) among deaf and hard of hearing adults in Greece: a cross-sectional study. Arch Public Health. 2018;76:55.
Kushalnagar P, Topolski TD, Schick B, Edwards TC, Skalicky AM, Patrick DL. Mode of communication, perceived level of understanding, and perceived quality of life in youth who are deaf or hard of hearing. J Deaf Stud Deaf Educ. 2011;16(4):512–23.
Stokoe WCJ. Sign language structure: an outline of the visual communication system for the deaf. Stud Linguist. 1960;8:1–78.
Jones EG, Mallinson RK, Phillips L, Kang Y. Challenges in language, culture, and modality: translating English measures into American sign language. Nurs Res. 2006;55(2):75–81.
Mason TC. Cross-cultural instrument translation: assessment, translation, and statistical applications. Am Ann Deaf. 2005;150(1):67–72.
Maxwell-McCaw D, Zea MC. The Deaf Acculturation Scale (DAS): development and validation of a 58-item measure. J Deaf Stud Deaf Educ. 2011;16(3):325–42.
Meadow-Orlans K, Erting C. Deaf people in society. In: Hindley P, Kitson N, editors. Mental health and deafness. London: Whurr Publishers; 2000. p. 3–24.
Harris M, Terlektsi E, Kyle FE. Concurrent and longitudinal predictors of reading for deaf and hearing children in primary school. J Deaf Stud Deaf Educ. 2017;22(2):233–42.
Marschark M, Rhoten C, Fabich M. Effects of cochlear implants on children’s reading and academic achievement. J Deaf Stud Deaf Educ. 2007;12(3):269–82.
Marschark M, Sapere P, Convertino CM, Mayer C, Wauters L, Sarchet T. Are deaf students’ reading challenges really about reading? Am Ann Deaf. 2009;154(4):357–70.
Cornes AJ, Rohan MJ, Napier J, Rey JM. Reading the signs: Impact of signed versus written questionnaires on the prevalence of psychopathology among deaf adolescents. Aust NZ J Psychiatry. 2006;40(8):665–73.
Cornes AJ, Brown PM. Mental health of Australian deaf adolescents: an investigation using an Auslan version of the Strengths and Difficulties Questionnaire. Deaf Educ Int. 2012;14(3):161–75.
Roberts S, Wright B, Moore K, Smith S, Allgar V, Tennant A, et al. Translation into British Sign Language and validation of the Strengths and Difficulties Questionnaire. Health Serv Del Res. 2015;3(2):66.
Patrick DL, Edwards TC, Skalicky AM, Schick B, Topolski TD, Kushalnagar P, et al. Validation of a quality-of-life measure for deaf or hard of hearing youth. Otolaryngol Head Neck Surg. 2011;145(1):137–45.
Fellinger J, Holzinger D, Dobner U, Gerich J, Lehner R, Lenz G, et al. An innovative and reliable way of measuring health-related quality of life and mental distress in the deaf community. Soc Psychiatry Psychiatr Epidemiol. 2005;40(3):245–50.
Achenbach TM, McConaughy SH, Howell CT. Child/adolescent behavioral and emotional problems: implications of cross-informant correlations for situational specificity. Psychol Bull. 1987;101(2):56.
Kristensen H, Hove P. Måleegenskaper ved den norske versjonen av Inventory of Life Quality in Children and Adolescents. PsykTestBarn. 2013;1(5):56.
Caluraud S, Marcolla-Bouchetemblé A, de Barros A, Moreau-Lenoir F, de Sevin E, Rerolle S, et al. Newborn hearing screening: analysis and outcomes after 100,000 births in Upper-Normandy French region. Int J Pediatr Otorhinolaryngol. 2015;79(6):829–33.
Aanondsen CM, Jozefiak T, Heiling K, Rimehaug T. Validation of the strengths and difficulties self-report in Norwegian Sign Language. J Deaf Stud Deaf Educ. 2020;25(1):91–104.
Archbold S, Lutman ME, Marshall DH. Categories of auditory performance. Ann Otol Rhinol Laryngol Suppl. 1995;166:312–4.
Allen C, Nikolopoulos TP, Dyar D, O’Donoghue GM. Reliability of a rating scale for measuring speech intelligibility after pediatric cochlear implantation. Otol Neurotol. 2001;22(5):631–3.
Dammeyer J. Psychosocial development in a Danish population of children with cochlear implants and deaf and hard-of-hearing children. J Deaf Stud Deaf Educ. 2010;15(1):50–8.
Seiler AF, Larsen TB. Vurdering af børns tilegnelse af dansk tegnsprog. Forståelsestest [Assessing Danish Sign Language development]. Aalborg: Døveskolernes Materialecenter; 2005.
Herman R, Holmes S, Woll B. Assessing British Sign Language development: receptive skills test. Coleford: Forest Book; 1999.
Dammeyer J. Congenital rubella syndrome and delayed manifestations. Int J Pediatr Otorhinolaryngol. 2010;74(9):1067–70.
Roid GH, Miller LJ, Pomplun M, Koch C. Leiter International Performance Scale manual. 3rd ed. Wood Dale: Stoelting; 2013.
Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2000;25(24):3186–91.
Dempster AP, Laird NM, Rubin DB. Maximum likelihood from incomplete data via the EM Algorithm. J Roy Stat Soc Ser B (Methodol). 1977;39(1):1–38.
Yanyun Y, Green SB. Coefficient alpha: a reliability coefficient for the 21st century? J Psychoeduc Assess. 2011;29(4):377–92.
Hair JF, Hult GTM, Ringle CM, Sarstedt M. A primer on partial least squares structural equation modeling. 2nd ed. Thousand Oaks: Sage; 2016.
Mehmetoglu M, Jakobsen TG. Applied statistics using stata. London: Sage; 2017.
Fornell C, Larcker DF. Structural equation models with unobservable variables and measurement error: algebra and statistics. J Mark Res. 1981;18(3):382–8.
Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model. 1999;6(1):1–55.
Hooper D, Coughlan J, Mullen MR, editors. Evaluating model fit: a synthesis of the structural equation modelling literature. In: 7th European conference on research methodology for business and management studies; 2008; Regent’s College, London.
Li C-H. Confirmatory factor analysis with ordinal data: comparing robust maximum likelihood and diagonally weighted least squares. Behav Res Methods. 2016;48(3):936–49.
Venturini S, Mehmetoglu M. PLSSEM: Stata module to implement partial least squares structural equation modelling (PLS-SEM). 2017. https://econpapers.repec.org/software/bocbocode/s458291.htm.
Fellinger J, Holzinger D, Dobner U, Gerich J, Lehner R, Lenz G, et al. Mental distress and quality of life in a deaf population. Soc Psychiatry Psychiatr Epidemiol. 2005;40(9):737–42.
Barnett S, Klein JD, Pollard RQ, Samar V, Schlehofer D, Starr M, et al. Community participatory research with deaf sign language users to identify health inequities. Am J Public Health. 2011;101(12):2235–8.
Achenbach TM, McConaughy SH, Howell CT. Child/adolescent behavioral and emotional problems: implications of cross-informant correlations for situational specificity. Psychol Bull. 1987;101(2):213–32.
Holte A, Barry MM, Bekkhus M, Borge AIH, Bowes L, Casas F, et al. Psychology of child well-being. In: Ben-Arieh A, Casas F, Frønes I, Korbin JE, editors. Handbook of child well-being: theories, methods and policies in global perspective. Dordrecht: Springer; 2014. p. 555–631.
Marschark M, Convertino CM, Macias G, Monikowski CM, Sapere P, Seewagen R. Understanding communication among deaf students who sign and speak: a trivial pursuit? Am Ann Deaf. 2007;152(4):415–24.
This study was a collaboration between the Department of Child and Adolescent Psychiatry at St. Olav’s University Hospital and the Regional Centre for Child and Youth Mental Health and Child Welfare (RKBU), Faculty of Medicine and Health Sciences, Norwegian University of Science and Technology, Trondheim. We would like to thank STATPED and Tiller upper secondary School for allowing us to recruit the participants and all the children, adolescents, and parents participating in this study. We would also like to thank Dr. Maria Gascon Ramos for her useful feedback
This work was supported by grants from the Regional Hospital Trust in Central Norway; the Department of Child and Adolescent Psychiatry at St. Olavs University Hospital; the Research Department at St. Olavs University Hospital (Grant No. 17/10533-120/NISLIN); Gidske and Peter Jacob Sørensens Research Foundation; and the Helse Midt-Norge (Grant No. 10/4321-105/VIVSTE). The funding bodies did not have any role in the design of the study, collection, analysis, and interpretation of data or in the writing of the manuscript.
Ethics approval and consent to participate
Study approval was given by the Regional Committees for Medical and Health Research Ethics (reference number: 2015/1739/REK midt). Written informed consent was obtained from all participants.
Consent for Publication
On behalf of the authors, the corresponding author states that there are no competing interests. CAA was involved in the translation of the ILC-NSL but has not gained any economic benefits from it or retained any financial interests in the ILC-NSL. TJ receives royalties from publisher Hogrefe/Psykologiförlag Stockholm for authorship of the “Norwegian Manual—ILC QoL measure, 2012” (ILC-NOR) which is used in this study.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Aanondsen, C.M., Jozefiak, T., Heiling, K. et al. Psychometric properties of the Inventory of Life Quality in children and adolescents in Norwegian Sign Language. BMC Psychol 9, 89 (2021). https://doi.org/10.1186/s40359-021-00590-x
- Quality of life
- DHH children
- Psychometric properties
- Sign language