- Research article
- Open Access
Development of the Japanese version of the three-item loneliness scale
BMC Psychology volume 7, Article number: 20 (2019)
Loneliness is a major risk factor for mental and physical health worldwide. The Three-Item Loneliness Scale (TIL Scale; Hughes et al., 2004) has been widely applied to measure loneliness in a simplified format, but no validated Japanese version has been developed. This study adapted the TIL Scale into Japanese and tested its reliability and validity.
The original English version of the TIL Scale was translated into Japanese, and the expressions of the Japanese version were confirmed by a back translation procedure. The translated scale was then administered to Japanese respondents recruited from an online research panel (N = 1020) and an online crowdsourcing service (N = 500). To analyze the data containing polytomous responses to the items in the scale, this study used categorical Confirmatory Factor Analysis and the Generalized Partial Credit Model based on the Item Response Theory. To evaluate the psychometric properties of the scale, this study examined factorial validity, reliability, information curves, and the associations of the scale score with demographic variables (age, gender, marital status, and living arrangements), the scores of the Revised UCLA Loneliness Scale (R-UCLA), the Big Five scale of personality traits, and the sizes of personal networks.
The translated TIL Scale showed essential unidimensionality and characteristics to differentiate among respondents at different levels of loneliness. The scale score was related positively with the scores of R-UCLA and neuroticism and negatively with the scores of extraversion, conscientiousness, openness, agreeableness, and the sizes of overall and support networks. Those who were unmarried and alone recorded a higher score on the scale than those who were married and living with someone. Age showed a negative correlation with the scale score only in Sample 1, in which the equal allocation procedure was introduced for the age stratum.
The results indicate that the Japanese version of the TIL Scale demonstrates adequate reliability and validity for the assessment of loneliness.
Loneliness has become a pervasive social phenomenon around the world. Conceptualized as a subjective negative feeling arising from the perception of a discrepancy between one’s actual and ideal states of interpersonal relationships , loneliness is known not only to harm physical and mental health , but also to relate to poor structural social relationships, including single marital status and living alone, both of which could increase mortality risks . Although social isolation and loneliness are distinct concepts, deficits of social supports with close others increase loneliness . Reliance on online social relationships could also increase loneliness if people use them to compensate for their insufficient face-to-face relationships . In 2018, the United Kingdom appointed a minister to address the problem of loneliness as a national policy . Understanding the nature of loneliness is an issue that calls for urgent attention to improve the well-being of individuals and the vitality of societies.
Previous studies have mainly used the 20-item Revised UCLA Loneliness Scale (R-UCLA) to assess loneliness . Although R-UCLA is a well-established and standard measure of loneliness and has been utilized since it was developed in 1980, there is a growing concern on a short-form psychological scale to reduce questionnaire length to increase response rate in particular circumstances, such as clinical practice, longitudinal surveys, and pre-screenings [8, 9]. The Three-Item Loneliness Scale (TIL) was established based on R-UCLA to mitigate the response burden and was validated by the associations with several indicators, such as R-UCLA scores, depressive symptoms, marital status, and living arrangements . A recent study found associations between scores on the TIL Scale and the Big Five personality traits, in which neuroticism is found to be a major determinant of loneliness based on genetic analysis . Since its first development for a telephone survey to old adults in the U.S., the scale has been applied in various settings, including undergraduate studies , large-scale longitudinal panel studies , and online surveys .
This study aims to develop a Japanese version of the TIL Scale. As in the West, loneliness has become a significant social issue in Japan, where the number of single-occupancy households has been increasing among old adults, and solitary deaths are not uncommon, even among the youth and the middle-aged . Systematic comparisons of scientific evidence in loneliness across different cultures are important to fully understand the nature of the psychological concept. Although the Japanese version of R-UCLA has been utilized since its development in 1983 , there is no doubt about the need for a short-form loneliness scale in Japanese for both practical and academic purposes.
Whereas loneliness has been regarded as a major problem among older adults , recent research has also shown high levels of loneliness among youth who typically face several developmental tasks such as socialization, friendship reconstruction, and emotion regulation . In terms of gender differences in loneliness, past research has yielded mixed results. Some studies reported higher levels of loneliness among females than males , while others reported no gender difference [18, 19]. Also, living alone is found to be a significant predictor of loneliness . This study translated the original TIL scale into Japanese and evaluated its psychometric properties in consideration with age, gender, and living arrangements as possible determinants of loneliness.
Data were collected in Japan from two different samples, for a form of cross-validation in which one sample is used for model construction and the other sample is used for confirmation and validation of the model. Sample 1 consisted of 1020 respondents (510 males and 510 females aged 13 to 80; mean age =36.1 (SD = 14.5)) recruited through an online research panel. The panel was provided by Goo Research, a major online research service in Japan managed by NTTCom Online Marketing Solutions Corporation. The service provides an online research panel of over three million Japanese people and is able to contact potential participants via email if researchers request the collection of survey data from specific strata. Participants in Sample 1 agreed to join the study after receiving an email notification about the survey from Goo Research (https://research.nttcoms.com/), which described the study, and subsequently deciding to opt-in. Informed consent was obtained online prior to taking part in the study. For the participants under the age of 18, Goo Research confirms that they obtained permission from a person with parental authority to register for the service and take part in any surveys on the service. Sample 2 consisted of 500 respondents (195 males and 305 females aged 18 to 73; mean age = 37.9 (SD = 9.9)) recruited through an online service. This service was provided by Lancers (https://www.lancers.jp/), a major crowdsourcing service in Japan managed by Lancers, Inc. The online service coordinates requests from clients with crowdsourcing workers. The current research was posted by the author as a psychology research project in the "research" category on the Lancers information board. The participants read the descriptions of the study and agreed to take part in it by opting into the study themselves.
To examine the impacts of these demographic variables on loneliness, the study used an equal size allocation procedure for age, gender, and living arrangements strata in Sample 1, which sampled approximately equal numbers of respondents from the teens (N = 204), twenties (N = 204), thirties (N = 204), forties (N = 205), fifties and above (N = 203), males and females (N = 510, respectively), and those living alone and living with someone (N = 510, respectively).
Japanese version of the TIL scale
To develop the Japanese version of the TIL Scale, the study used a back translation procedure. With permission from a member of the research team who developed the original TIL Scale, the author of this article (TI), a native Japanese speaker who had spent 2 years as a postdoctoral researcher in an English-speaking country, initially translated the original instruction and items into Japanese. The original English version is intended to be used in phone interviews, but the translated version is intended to be used in pen-and-pencil/online surveys. Therefore, expressions in the translated version were altered slightly from the original to fit the purpose (e.g., interrogative sentences were changed to active sentences). Then, an international graduate student, a native speaker of English who obtained a master’s degree in psychology in Japan, independently conducted a back translation from Japanese to English with no knowledge of the concept of the scale. Discrepancies between the expressions in the two initial and back translations were discussed in detail and carefully resolved until the initial and back translations were closely matched. The final version of the Japanese version of the TIL Scale is shown in Additional file 1: Table S1. Each item is rated on a 3-point Likert scale (1: Hardly ever, 2: Some of the time, and 3: Often), and the scale score ranged from 3 to 9.
Other measures for scale validation
The revised UCLA loneliness scale (R-UCLA) (sample 2)
The R-UCLA  is the original version of the TIL Scale and one of the most widely used scales in Japan  to measure subjective feelings of chronic loneliness. The scale consists of 20 items, and respondents rated the degree of loneliness on a 4-point Likert scale (1: Never to 4: Often; the scale score ranged from 20 to 80).
The big five scale of personality traits (sample 2)
The Big Five scale of personality traits  is commonly used in Japan to assess personality traits based on the five-factor model of personality. This study used a short version of the scale , which consists of 29 adjectives rated on a 7-point Likert scale (1: Strongly disagree to 7: Strongly agree) to measure extraversion (five items; the scale score ranged from 5 to 35), neuroticism (five items; ranged from 5 to 35), conscientiousness (seven items; ranged from 7 to 49), openness (six items; ranged from 6 to 42), and agreeableness (six items; ranged from 6 to 42).
Personal networks (sample 1)
This study assessed the sizes of four different personal networksFootnote 1: overall networks (number of people listed in respondent’s cellphone/smartphone address book), support networks (number of family members/friends/acquaintances with whom personal matters can be discussed), online networks (number of acquaintances met and communicated with only online), and new-acquaintance networks (number of acquaintances newly met in the last month). Each network was measured by one item.
Analyses on the translated TIL Scale were conducted in the following way: First, I analyzed the data obtained from Sample 1 to check the descriptive statistics of each item in the scale and test the unidimensionality and factor structure of the scale. Second, I analyzed the data obtained from Sample 1 to examine the characteristics of the items in the scale based on the Item Response Theory. Finally, I analyzed the data obtained from Sample 2 and part of the data obtained from Sample 1 to confirm the validity of the scale by checking its associations with theoretically-related variables.
Table 1 shows descriptive statistics of the items in the translated TIL Scale (Sample 1). Most respondents chose the middle point of the ratings (2), and the distribution of the item scores was not strongly skewed (all skewness < 1). All items showed moderate to strong positive correlations with each other.
To confirm unidimensionality of the translated TIL Scale, I conducted a categorical confirmatory factor analysis using the weighted least squares with mean and variance adjustment method based on polychoric correlations of the items (Sample 1). The model included a single latent variable having three items of the translated TIL Scale as observed variables (i.e. a saturated model). All items had factor loadings of more than .70 for the first factor (see Table 1). Eigenvalues (calculated based on polychoric correlations) were 2.44, 0.40, and 0.16, indicating that the first factor explains 81% of the total variance. Cronbach’s alpha coefficient of the scale was .81. These results clearly revealed the unidimensionality of the scale, which satisfies the assumption of IRT.
The translated TIL Scale was analyzed using Muraki’s Generalized Partial Credited Model (GPCM) . PARSCALE 4.1  was used to estimate parameters. GPCM can be applied to polytomous items with multiple-ordered response categories and specify slope, location, and category parameters for each item.Footnote 2 The slope (discrimination) parameter indicates the degree to which an item can discriminate a latent trait (θ; e.g., loneliness) among respondents. The mean of θ is set as zero and the standard deviation as one. The location (difficulty) parameter indicates the degree to which an item (e.g., “I feel left out.”) involves a difficulty for respondents to give higher ratings (e.g., 3: Often) regardless of the level of a latent trait (e.g., loneliness). The category parameter is related to points of intersection between Item Response Category Characteristics Curves (IRCCC) for each item depicted based on the slope and location parameters. IRCCCs represent the probability that those with a particular level of a latent trait (e.g., high in loneliness) choose a particular response category (e.g., 3: Often) for an item (e.g., “I feel left out.”). An Item Information Curve (IIC) is obtained from the summation of the IRCCCs at each value of θ for an item and indicates how accurate (e.g., rich in information) the item (e.g., “I feel left out.”) is to measure a certain level of a latent trait (e.g., high in loneliness). A Test Information Curve (TIC) is depicted as the summation of the IICs at each value of θ for all items in the scale and provides information about a discriminative power of the whole scale (e.g., TIL) for a latent trait (e.g., loneliness).
Table 2 shows estimates of slope, location, and category parameters for each item of translated TIL Scale (Sample 1), and Fig. 1 shows the IRCCC of each item. The slope parameters of Items 2 and 3 were relatively large, indicating a discriminative characteristic of the items for those high and low in loneliness. The location parameter of Item 2 was positive and relatively large, indicating a difficulty for respondents to rate themselves as “left out.” Meanwhile, both the slope and location parameters of Item 1 were relatively low, showing a poorer discriminative characteristic of the item than the other items for those high and low in loneliness. In other words, those low in loneliness did not have difficulty in rating themselves as having the characteristic described in the item (i.e., lacking companionship).
Figure 2 shows the IIC of each item and the TIC of the translated TIL Scale. The IICs of Items 2 and 3 and the TIC of the scale were bimodal with two peaks. The TIC produced maximal information at about θs = − 0.4 and 1.0, corresponding to 4 to 5 and 7 to 8 on the 7-point rating (range: 3–9) of TIL, respectively.
Local independence is a basic assumption of IRT that item responses should be conditionally independent of each other and related only via a latent trait. To assess local independence of the items in the TIL scale, Q3 statistics were calculated. Item 3 showed slight tendencies of local dependence (> .20) with Items 1 and 2 (Q3 = .22 and .26, respectively).
Test for convergent validity
Table 3 represents the correlation coefficients of the score on the translated TIL Scale (i.e., the loneliness score) with relevant variables in Samples 1 and 2. The correlation of the loneliness score with the original R-UCLA score was strong and positive. No gender difference was found in the loneliness score in both samples. In terms of age, younger respondents reported a higher level of loneliness in Sample 1, but this pattern was not observed in Sample 2. Supplementary regression analysis on the loneliness score by using dummy variables of age (baseline = teens) revealed that the teens showed higher loneliness scores than those in their thirties and above, while no difference was found between the teens and twenties [see Additional file 1: Table S2]. Unmarried respondents in Sample 1 reported a higher level of loneliness than married respondents, and those who lived alone in Sample 1 reported a higher level of loneliness than those who lived with someone.
Regarding personal networks, the sizes of overall and support networks were negatively correlated with the loneliness score in Sample 1, whereas those with online and new-acquaintance networks were not. All dimensions of Big Five personality traits showed significant associations with the loneliness score in Sample 2, with which neuroticism was positively correlated; and extraversion, conscientiousness, openness, and agreeableness were negatively correlated, respectively.
This study developed the Japanese version of the TIL Scale. The factor analysis and reliability analysis confirmed the unidimensionality of the scale. The IRT analysis showed the discriminative characteristics of the scale for those high and low in loneliness. The patterns of correlations of the scale with other variables provide ample evidence of the convergent validity of the scale.
Bimodality of the Test Information Curve (TIC) is the most important characteristic of the translated TIL Scale. The TIC has two distinct peaks for the latent trait (i.e. loneliness) over the desired range of the trait, implying that the short scale score is sufficiently informative to identify who the lonely or the non-lonely are. However, care should be exercised in interpreting the finding that Item 3 in the scale showed slight local dependence with the other two items, probably because of redundancy-dependency of the item contents (i.e., similar items are included in the same scale). Although the degree of overlap is not so large and should be interpreted in accordance with the number of items in the scale, this may produce overestimation of the scale parameter and underestimation of the location parameter of the item  and may result in overestimation of scale reliability . Another point to mention is that the Item Information Curve (IIC) reveals that the item “I feel that I lack companionship” may not be effective for the discrimination of loneliness. The TIC and IICs of the items in the original English scale have not been reported yet, but future research is needed to analyze the characteristics of the original items based on large-scale responses obtained from English-speaking samples. The appropriateness of the Japanese language of the items should also be further examined.
The score of the translated TIL Scale was correlated with different indicators of loneliness, each of which theoretically explains the psychological concept from different perspectives. R-UCLA is the original of the TIL Scale, so the strong and positive correlation between R-UCLA and the translated TIL Scale is expected . The small but significant associations of marital status and living arrangements with loneliness are consistent with the previous literature . There was no gender difference in the loneliness score in the current samples.
In terms of age, the teens and twenties reported higher loneliness scores in the translated TIL Scale than older respondents in Sample 1, but not in Sample 2. A possible reason for the inconsistency of the findings between the samples is the difference in the proportion of youth to the whole sample. Sample 1 was drawn from an online research panel by using the equal allocation procedure for the age stratum, which could maximize the efficiency with which the mean and variance are estimated in each age group. Sample 2 was recruited through an online crowdsourcing service without controlling for demographic factors of the respondents, which may result in a relatively smaller number of teens and twenties than those in Sample 1. In addition, the respondents participated in the current surveys by registering themselves as an online research panel or crowdsourcing workers. This means that the older respondents in the current samples may be more active and familiar with communication technology, and thus less lonely , than ordinary samples of the same age drawn from the general population. On the other hand, the youth sample may be more lonely than ordinary samples in the same age group because they spent time on the internet to earn money, rather than socializing, by participating in the surveys. In sum, the age difference in loneliness found in Sample 1 may be a result of the comparison between the early adulthood group, who are generally high in loneliness due to their apprehensions about developmental tasks such as socialization, and old adults, who are relatively low in loneliness due to their skilled online activities.
The size of personal networks for social support was negatively related with the score of the translated TIL Scale, along with the total network size. This indicates a relationship between social isolation and loneliness . Having an online network showed neither an incremental nor a decremental effect on loneliness, which could be the case when an overlap between offline and online personal networks is not considered [28, 29]. All the Big Five personality traits showed significant associations with loneliness, but, consistent with the previous literature , extraversion and neuroticism were the two main personality traits that explain the variance of loneliness. These findings suggest the sufficient validity of the scale.
Since this is an initial step in developing the short-form loneliness scale in Japan, there are still several limitations. First, the Japanese version of the TIL Scale was tested only among the online samples. Although the samples were large and diverse, additional research on a representative sample of the Japanese population is needed to examine the generalizability of the current factor structure and scale validity. Second, it is important to clarify if the loneliness chronicity measured by the scale is related to the functional impairment of psychobiological systems among the Japanese. There is strong relevance between the loneliness score obtained from the original TIL Scale and physiological functions, such as cardiovascular activation, cortisol levels, and immune responses . Finding the link between subjective ratings and objective indicators of the negative feeling among the Japanese would give significant understandings of the roots of loneliness in a framework of cultural neuroscience .
All in all, the above evidence demonstrates that the translated TIL Scale has sufficient characteristics for its factor structure and convergent validity to measure loneliness among Japanese people in a simplified format. Administration of the scale could be a plausible option, especially when respondents’ time and effort are major concerns of the research.
Social network researchers distinguish the term “social networks” from “personal networks.” The former focuses on the “sociocentric” aspect of networks, referring to patterns of communications in a bounded group or organization as a whole, while the latter focuses on the “egocentric” aspect of networks, referring to the social ties each person holds .
GPCM is developed to analyze partially ordered categorical responses as an extension of 2-parameter logistic models. Although it is possible to apply the 1-parameter Partial Credit Model (PCM), in which the slope parameter is set as 1 across items, GPCM (AIC = 4973.7) showed a better fit to the data than PCM (AIC = 5045.0).
Akaike’s information criterion
Generalized partial credited model
Item information curve
Item response category characteristics curve
Item response theory
Partial credited model
The Revised UCLA (University of California, Los Angeles) Loneliness Scale
Test information curve
- TIL Scale:
The Three-Item Loneliness Scale
Peplau L, Perlman D. Perspectives on loneliness. In: Loneliness: A sourcebook of current theory, research and therapy. Edn. New York: John Wiley & Sons; 1982. p. 291–309.
Cacioppo JT, Hawkley LC, Berntson GG. The anatomy of loneliness. Curr Dir Psychol Sci. 2003;12:71–4.
Rico-Uribe LA, Caballero FF, Martin-Maria N, Cabello M, Ayuso-Mateos JL, Miret M. Association of loneliness with all-cause mortality: a meta-analysis. PLoS One. 2018;13:e0190033.
Steptoe A, Shankar A, Demakakos P, Wardle J. Social isolation, loneliness, and all-cause mortality in older men and women. Proc Natl Acad Sci U S A. 2013;110:5797–801.
Clark JL, Algoe SB, Green MC. Social network sites and well-being: the role of social connection. Curr Dir Psychol Sci. 2017;27:32–7.
Government United Kingdom: PM commits to government-wide drive to tackle loneliness. 2018. https://www.gov.uk/government/news/pm-commits-to-government-wide-drive-to-tackle-loneliness; Accessed 18 Sep 2018.
Russell D, Peplau LA, Cutrona CE. The revised UCLA loneliness scale: concurrent and discriminant validity evidence. J Pers Soc Psychol. 1980;39:472–80.
Gosling SD, Rentfrow PJ, Swann WB. A very brief measure of the big-five personality domains. J Res Pers. 2003;37:504–28.
Rolstad S, Adler J, Ryden A. Response burden and questionnaire length: is shorter better? A review and meta-analysis. Value Health. 2011;14:1101–8.
Hughes ME, Waite LJ, Hawkley LC, Cacioppo JT. A short scale for measuring loneliness in large surveys: results from two population-based studies. Res Aging. 2004;26:655–72.
Abdellaoui A, Chen HY, Willemsen G, Ehli EA, Davies GE, Verweij KJH, Nivard MG, de Geus EJC, Boomsma DI, Cacioppo JT. Associations between loneliness and personality are mostly driven by a genetic association with neuroticism. J Pers. 2018. https://onlinelibrary.wiley.com/doi/full/10.1111/jopy.12397
Pittman M, Reich B. Social media and loneliness: why an Instagram picture may be worth more than a thousand twitter words. Comput Human Behav. 2016;62:155–67.
Leary MR, Kelly KM, Cottrell CA, Schreindorfer LS. Construct validity of the need to belong scale: mapping the nomological network. J Pers Assess. 2013;95:610–24.
Solitary Death Task Force of the Small Amount and Short Term Insurance Association of Japan: The third report on the present state in solitude deaths. 2018. http://www.shougakutanki.jp/general/info/2018/news20180306.pdf; Accessed 18 Sep 2018.
Kudoh T, Nishikawa M. A study of the feeling of loneliness (I). Jpn J Exp Soc Psychol. 1983;22:99–108.
Cattan M, White M, Bond J, Learmouth A. Preventing social isolation and loneliness among older people: a systematic review of health promotion interventions. Ageing Soc. 2005;25:41–67.
Goosby BJ, Bellatorre A, Walsemann KM, Cheadle JE. Adolescent loneliness and health in early adulthood. Sociol Inq. 2013;83:505–36.
Masuda Y, Tadaka E, Dai Y. Reliability and validity of the Japanese version of the UCLA loneliness scale version 3 among the older population. J Jpn Acad Community Health Nurs. 2012;15:25–32.
Matsumoto M. Group solidarity and peace of mind mediate effects of social situation and work environment on loneliness and job satisfaction from the data of JGSS-2010. JGSS Res Ser No. 2012;9:29–39.
Beutel ME, Klein EM, Brahler E, Reiner I, Junger C, Michal M, Wiltink J, Wild PS, Munzel T, Lackner KJ, et al. Loneliness in the general population: prevalence, determinants and relations to mental health. BMC Psychiatry. 2017;17:97.
Wada S. Construction of the big five scales of personality trait terms and concurrent validity with NPI. Jpn J Psychol. 1996;67:61–7.
Namikawa T, Tani I, Wakita T, Kumagai R, Nakane A, Noguchi H. Development of a short form of the Japanese big-five scale, and a test of its reliability and validity. Jpn J Psychol. 2012;83:91–9.
Muraki E. A generalized partial credit model: application of an EM algorithm. ETS Res Rep Ser. 1992;1992:i–30.
Muraki E, Bock RD: PARSCALE 4: IRT item analysis and test scoring for rating-scale data (Computer program). In. Lincolnwood, IL: Scientific Software; 2003.
Todo N. The effect of local dependence on item parameter estimation: a comparison based on comparable item parameters. Jpn J Behaviorm. 2012;39:81–91.
Christensen KB, Makransky G, Horton M. Critical values for Yen's Q3: identification of local dependence in the rasch model using residual correlations. Appl Psychol Meas. 2017;41:178–94.
Cotten SR, Anderson WA, McCullough BM. Impact of internet use on loneliness and contact with others among older adults: cross-sectional analysis. J Med Internet Res. 2013;15:e39.
Nowland R, Necka EA, Cacioppo JT. Loneliness and social internet use: pathways to reconnection in a digital world? Perspect Psychol Sci. 2018;13:70–87.
Igarashi T. The effect of social skills on loneliness through mediation of CMC social networks. Jpn J Soc Psychol. 2002;17:97–108.
Kim HS, Sasaki JY. Cultural neuroscience: biology of the mind in cultural contexts. Annu Rev Psychol. 2014;65:487–514.
Robins G. Doing social network research: network-based research design for social scientists. London: Sage; 2015.
The author thanks Claudia Gherghel for her support during the process of back translation.
The research was supported by JSPS Grant-in-Aid for Young Scientists (B) (22730483) and a research grant from the Telecommunications Advancement Foundation (09-01010). Both funding bodies had no role in the study design, collection, analysis, and interpretation of the data and in writing the manuscript.
Availability of data and materials
Data and materials are available upon request.
Ethics approval and consent to participate
The study was approved by the Ethical Review Board of the Graduate School of Education and Human Development, Nagoya University (18-1162). Participants provided informed consent online prior to taking part in the study. For participants under the age of 18, Goo Research confirms that they have obtained permission from a person with parental authority to register for the service and to take part in any surveys on the service.
Consent for publication
The author declares that he has no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Igarashi, T. Development of the Japanese version of the three-item loneliness scale. BMC Psychol 7, 20 (2019). https://doi.org/10.1186/s40359-019-0285-0
- Short-form scale
- Japanese version
- Item response theory