Persian version of the work design questionnaire: measurement of its psychometric characteristics

Abstract

Background

Work design questionnaire (WDQ), as a comprehensive and integrative tool, is one of the most important instruments frequently used to assess work characteristics. The aim of this study was to measure the psychometric characteristics of the Persian version of WDQ.

Methods

Translation and cross-cultural adaptation procedures were applied in translating the original WDQ into Persian. A total of 270 participants participated in this study. The validity of the questionnaire were measured using face validity, content validity, convergent validity, and construct validity based on confirmatory factor analysis (CFA). Reliability was assessed through internal consistency.

Results

Mean content validity index was 0.95. The CFA results indicated support for a 21-factor solution. There were significant correlations between dimensions of WDQ and both job satisfaction and perceived stress. Cronbach's alpha of all items was 0.87.

Conclusion

Results indicated that the WDQ exhibited very good psychometric properties and can be applied as a useful tool to assess work characteristics among Iranian employees. Accordingly, the authors recommend its administration in future studies. The work characteristics was significantly associated with job satisfaction and job stress. Therefore, improved work design would reduce negative consequences, such as job stress, and increase positive behaviors, such as job satisfaction.

Background

Work design is a major controversial topic in organizational science studies. Besides describing how to structure, approve, and revise the work requirements, tasks, and roles, it explains their impact on individuals, groups, and organizational outcomes [1]. Work design affects behavioral outcomes, such as performance, efficiency, and work-related absence, psychological outcomes (such as job satisfaction, motivation, stress, and burnout), and physical consequences (such as hypertension, cardiovascular diseases, and even death) [2–6].

Smith [7] and Babbage [8] first introduced the principles of work design by describing the concept of division of labor and its effect on productivity and efficiency [9]. Herzberg’s 2-factor theory (1959) was another step that played a significant role in work design [10]. According to this theory, two sets of factors (hygiene and motivation) affect performance. The idea is that the absence of hygiene factors will result in a lack of job satisfaction. On the other hand, motivation factors provide job satisfaction and motivation. Both factors are important in supporting best work design. Several other theories on work design have also been introduced in the past four decades, indicating a wide spectrum of personal, group, and organizational outcomes that they can affect [11, 12]. Nevertheless, despite extensive research investigating the importance of work design, relatively few studies have evaluated job characteristics and factors that contribute to workplace design.

Self-report questionnaires are among the most important and widely applied tools in work design. One of the most applied tools is the Job Diagnostic Survey (JDS). Developed in 1975, this contains five dimensions of motivational job characteristics, but ignoring multiple job characteristics is one of the major pitfalls of the JDS [12, 13]. To address this, Campion [14] introduced the Multimethod Job Design Questionnaire (MJDQ) [14]. Although this tool covers a broader range of job characteristics, the MJDQ has structural problems [14]. For instance, Edward et al. [15] found that a 10-factor structure is more appropriate than the 4-factor structure proposed by Campion. They also noted some conceptual problems regarding its keywords [15].

Ignoring technological developments and modern aspects of work is a common problem of work design questionnaires [12]. In response to previous problems, Morgeson and Humphrey [9] proposed the Work Design Questionnaire (WDQ), which is a comprehensive, integrative tool. According to its authors, the WDQ is needed for 3 reasons: (1) it consists of both task-oriented and attribute-oriented measures, (2) it covers a comprehensive and balanced set of job characteristics, and (3) it is able to integrate different perspectives. The WDQ contains 77 items categorized into three dimensions of work: motivational, social, and context. These dimensions cover 20 different fields, such as independence at work, importance and identity of duty, complexity, job skills, physical needs, and ergonomics [16]. As a powerful tool to measure work design, WDQ is compatible with new concepts and covers a wide range of variables related to job characteristics.

The WDQ has been successfully translated into several different languages, such as German, Chinese, Polish, and Spanish [17–20]. To the best of our knowledge, WDQ has not been formally translated into Persian. Hence, its psychometric properties have not yet been evaluated in Iran. Accordingly, this study aimed to assess the psychometric characteristics of our Persian version of WDQ. The aim of this study was to measure the psychometric characteristics of the Persian version of WDQ.

Methods

Design and study population

This cross-sectional study was conducted using employees working in an industrial estate during the summer and fall of 2021. All workers with at least 1 year of work experience were initially invited and a total of 286 out of the 462 workers (response rate: 61.9%) participated in the study. In the initial stage, 16 questionnaires were removed from the study due to missing data, misleading responses and authentication responses. Therefore, 270 questionnaires were statistically analyzed. The participants completed the survey anonymously after providing informed consent. Participants were aware of the purposes and hypotheses of the study. The study was conducted in 2021, according to the principles of the Declaration of Helsinki, and was approved by the Research Ethics Committee of Shiraz University of Medical Sciences (IR.SUMS.REC.1398.537).

The purpose of the study, how to answer the questions, and the ethical obligations of the researchers regarding the completed questionnaires was explained to the employees. Then, a questionnaire was distributed to each consenting participant with information on how to return it to the researchers after completing it. Participation in this research was entirely voluntary, the questionnaires were anonymous, and the results were analyzed in terms of the information of all respondents.

Translation and cross-cultural adaptation

To respect the intellectual property rights of the instrument, first, the approval of the original authors was obtained for translation into Persian. Based on the process proposed by Beaton et al. [21] for translation and cross-cultural adaptation, forward translation was performed by two ergonomics experts fluent in the English language. The research team then compared the translated Persian versions, and differences and ambiguities were discussed. Afterward, translated items were reviewed in terms of semantics, cultural adaptation, and terminology. Eventually, a single Persian provisional version was developed. The next step was the backward translation of the Persian provisional version by two language experts fluent in English unaware of the original English version. The research team revised the translated versions, and a single English provisional version was obtained by combining them. Afterward, this version, along with ambiguities and inconsistencies, was sent to the developers of the WDQ for clarification and conditions of acceptability. The proposed revisions were made, and the final version was prepared for psychometric evaluations. The Persian version is available on the developer Prof. Morgeson’s questionnaire website (http://www.morgeson.com/wdq.html).

Measuring validity and reliability

Face and content validity

Face validity is the extent to which a test can cover the concept it intends to measure [22]. In this study, to achieve face validity we sought the opinions of 10 university professors (ergonomics and industrial and organizational psychology). That is, the professors were asked to evaluate each of the items in terms of comprehensibility, wording, interpretations, cultural issues, and clarification. In addition, a sample of 15 employees from the participant pool was selected to assess the questionnaire in terms of potential ambiguities and understandability of items. After minor revisions, content validity was evaluated using the content validity index (CVI). Ten experts in ergonomics, occupational health, and industrial and organizational psychology were asked to comment on each item separately [22]. For CVI, a score higher than 0.79 is favorable, 0.7–0.79 indicates the need for revision, and less than 0.7 is unacceptable [23].

Construct validity

Construct validity of the questionnaire was assessed using confirmatory factor analysis (CFA) based the maximum likelihood estimation (MLE) method. The model fit was assessed using the root mean square error of approximation (RMSEA), the comparative fit index (CFI), the incremental fit index (IFI) and the chi-square/degrees of freedom ratio (χ²/df). If the RMSEA is less than 0.08, CFI value is 0.9 or higher, the IFI value is 0.8 or 0.9, and the χ²/df is less than 3, then the fit of the model is appropriate [24].

Based on previous studies, five models of 4, 18, 19, 20, and 21 factors were examined in this study. The 4-factor model contains 4 wide categories of work characteristics, including those related to task, knowledge, social, and work context. The 18-factor model covers the work characteristics without any divisions, including autonomy and interdependence, each as a unique factor. The 19-factor model divides interdependence into 2 components of received and initiated. The 20-factor model contains 3 elements of autonomy, including work scheduling, decision making, and work methods. The 21-factor model also includes identified components containing interdependence and autonomy.

Incremental validity

Incremental validity of the WDQ was assessed using Perceived Stress Scale (PSS-10) and Michigan Organizational Assessment Questionnaire Job Satisfaction Subscale (MOAQ-JSS). The PSS measure the degree to which situations are appraised as stressful during the past month [25]. It uses a 5-point Likert scale, ranging from 0 (never) to 4 (always). Three versions of PSS are available that comprise 4, 10, and 14 items. Most prior studies have used the 10-item version, as it has fewer items than the original 14-item version, with similar psychological properties [26, 27]. The MOAQ-JSS measures job satisfaction using three items using a 7-point Likert scale [28].

Convergent/discriminant validity

The average variance extracted (AVE) and the maximum shared squared variance (MSV) were used to assess convergent validity and discriminant validity, respectively. The AVE is “the average variance extracted is calculated as the mean variance extracted for the item loading on a [factor] and is a summary indicator of convergence” and values ≥ 0.5 confirms the convergent validity [29]. On the other hand, discriminant validity is confirmed when the AVE is greater than the MSV [29].

Reliability

Cronbach’s alpha coefficient and composite reliability (CR) were used to assess the internal consistency of the WDQ. A Cronbach’s alpha and CR value of 0.70 or higher is considered acceptable [30]. In addition, the item-to-total correlation and Cronbach’s alpha if item deleted were also calculated separately. For each item, the item-to-total correlation should be higher than 0.3 to be considered acceptable [31].

Statistical analysis

Data analysis was conducted using SPSS version 23 and AMOS version 23 (SPSS Inc, Chicago, Ill, USA). The Kolmogorov–Smirnov test was applied to test for normal distribution. Also, Mardia’s coefficient (based on critical ratio) was used to determine multivariate normality. Critical ratio values were significantly < 5, which indicated that the data met assumptions of normal distribution [32]. A P value < 0.05 was considered statistically significant.

Results

Participants’ mean age and work experiences were 35.18 ± 7.5 years (ranging from 21 to 61 years) and 10.38 ± 8.5 years (ranging from 1 to 35 years), respectively. Also, 83.5% were married. In addition, 52% were educated up to diploma, 35.5% up to bachelor’s degree, and 9.5% up to master’s degree or higher.

The mean and SD of various dimensions of WDQ are presented in Table 1. There were no floor and ceiling effects for any dimension. The CVI score of the whole scale was 0.95. Based on this score, content validity was excellent from the experts’ viewpoint.

Table 1 Means, standard deviations, and reliability of the WDQ (n = 270)

Construct validity

The fit indices of developed models are presented in Table 2. The 4-factor model presented a poor fit as its fitness indices were lower than the desired level. The 18-, 19-, and 20-factor models all showed adequate fits. The goodness-of-fit indices of χ²/df, RMSEA, and IFI were acceptable, and only CFI was lower than the desired level (i.e., 0.90). Finally, the 21-factor model was the best fit model, with all goodness-of-fit indicators acceptable.

Table 2 Result of confirmatory factor analyses (N = 270)

Incremental validity

Characteristics of task, knowledge and social characteristics were positively associated with job satisfaction. Fourteen (out of 21) dimensions of work design were significantly positive associated with job satisfaction, except for physical demands that had a significant negative association. On the other hand, task, knowledge, and social characteristics were negatively associated with job stress. Fifteen (out of 21) dimensions of work design showed a significant negative association with job stress, except for physical demands that presented a significant positive association. Also, job satisfaction and job stress were strongly associated (Table 3).

Table 3 Inter-item correlations for items of the Persian Version of WDQ questionnaire

Convergent/discriminant validity

The results of AVE and MSV are presented in Table 1. Fifteen factors showed adequate levels of divergent validity. The AVE values of 4 out of 21 factors including feedback from job, problem solving, social support, and ergonomics were below 0.50. The MSV values of 3 out of 21 factors including decision-making autonomy, work methods autonomy, and problem solving MSV were above the AVE values. As a set, the questionnaire factors demonstrated good convergent and discriminant validity.

Reliability

WDQ had an acceptable internal consistency, with a Cronbach’s alpha coefficient ranging from 0.62 to 0.93. Dimensions of ergonomics and skill variety obtained the highest and lowest coefficients, respectively. Corrected item-total correlations were also calculated, which all items presented a significant association with the total score (P < 0.001), indicating required consistency. Mean, corrected item-total correlation, Cronbach's alpha, CR, and Cronbach's alpha if item deleted for all items of WDQ are presented in Table 1.

Discussion

This study evaluated the psychometric characteristics of the Persian version of WDQ using a sample of 270 employers working in different jobs on an industrial estate. A valid, standard method was used for translation and cultural adaptation of the questionnaire. Psychometric properties of the instrument were evaluated using face and content validity, construct validity, concurrent validity, and internal consistency. Face and content validity assess whether or not the instrument measures what it claims and our evaluations used the comments of workers and experts in the fields of ergonomics, occupational health, and industrial and organizational psychologists. Then, where necessary, revisions were made to achieve validity. In addition, quantitative content validity was evaluated using CVI, indicating excellent content validity of all items. Similar results have been reported by studies performed in the USA, Spain, and Brazil [16, 20, 33]. Similar to the original version [16], the Persian version of WDQ could identify expected differences in job characteristics in various job categories.

Consistent with previous studies in the USA, Spain, and Brazil [16, 20, 33], the CFA results indicated that the 21-factor model had the highest fit. While 18-, 19-, and 20-factor models were also confirmed, the 21-factor model presented the best-fit indicators, which is consistent with previous studies in other countries [16, 20, 33, 34]. Regarding the profound changes in psychological-social indicators of Iranian workers and observed changes in industries and job positions of the organizations, these results were not unexpected. In the past 4 decades (since the 1979 revolution), Iranian workers’ education and skill levels have considerably increased, leading to changes at managerial levels, particularly social characteristics and knowledge of managers.

Desirable reliability of the Persian version of the WDQ was confirmed by the Cronbach’s alpha (0.87), which was consistent with the coefficient reported for the original version (0.87) [16], and similar to other studies performed in Spain [20] and Brazil [33]. Of all 21 job characteristics, only ergonomics and feedback from the job obtained a coefficient lower than 0.7. Although a Cronbach’s alpha from 0.6 to 0.7 is the acceptable level of reliability [35, 36]. Regarding internal consistency, the item-total correlation was used for all 21 job characteristics. With the exception of items 24 (from Feedback from Job) and 66 (from Ergonomics), the item-total correlation all the items of WDQ were acceptable. Similarly, the Cronbach's alpha has been not appropriate for the Ergonomics dimension in other studies [16, 37, 38]. Some insight into this can be gained from considering the three items that make up the Ergonomics dimension. Two items are positively worded and one is negative (i.e. “The job involves excessive reaching”). The item in particular, can be effective in reducing the Cronbach's alpha of the Ergonomics dimension. It asks about the level of reaching, and its meaning has the potential to vary from one person to another, leading to ambiguities.

This study demonstrated a significant association between the scales of WDQ with job satisfaction and job stress, indicating appropriate concurrent validity of the Persian version of WDQ. Bayona et al. [38] also reported similar results. According to Hackman and Oldham’s [13] job characteristics theory, emphasizing job characteristics can increase job satisfaction and decrease stress among staff [13]. In this study, stress and job satisfaction variables showed a negative and positive association with WDQ dimensions, respectively.

Limitations

It is necessary to mention some limitations of our study. Self-report instruments are prone to bias, even we removed items related to department and job title to minimize the bias. Another limitation was the cross-sectional design of the study, with its limitations in investigating cause-and-effect relationships. In addition, this study was conducted only in one city, and because of the culture of Iranian society, women’s employment is limited, and few women participated in this study. The consequence of this is not great, as the purpose of the study was to develop a tool for use in Iranian society.

Conclusion

This study demonstrated the appropriate psychometric characteristics of the Persian version of WDQ. Hence, WDQ is a valid and reliable instrument to assess work characteristics among Iranian employees. Similar to other studies which have looked at the psychometric characteristics of the WDQ, the 21-factor version showed better-fit indicators. Accordingly, the authors recommend its administration in future studies in Iran. The work characteristics were significantly associated with job satisfaction and job stress. Therefore, improved work design would reduce negative consequences, such as job stress, and increase positive behaviors, such as job satisfaction.