- Research article
- Open Access
- Open Peer Review
Applying the revised Chinese Job Content Questionnaire to assess psychosocial work conditions among Taiwan's hospital workers
BMC Public Health volume 11, Article number: 478 (2011)
For hospital accreditation and health promotion reasons, we examined whether the 22-item Job Content Questionnaire (JCQ) could be applied to evaluate job strain of individual hospital employees and to determine the number of factors extracted from JCQ. Additionally, we developed an Excel module of self-evaluation diagnostic system for consultation with experts.
To develop an Excel-based self-evaluation diagnostic system for consultation to experts to make job strain assessment easier and quicker than ever, Rasch rating scale model was used to analyze data from 1,644 hospital employees who enrolled in 2008 for a job strain survey. We determined whether the 22-item Job Content Questionnaire (JCQ) could evaluate job strain of individual employees in work sites. The respective item responding to specific groups' occupational hazards causing job stress was investigated by using skewness coefficient with its 95% CI through item-by-item analyses.
Each of those 22 items on the questionnaire was examined to have five factors. The prevalence rate of Chinese hospital workers with high job strain was 16.5%.
Graphical representations of four quadrants, item-by-item bar chart plots and skewness 95% CI comparison generated in Excel can help employers and consultants of an organization focusing on a small number of key areas of concern for each worker in job strain.
With the increasing concern about job strain, many researchers have addressed psychosocial job strain and its adverse effects on health [1–3]. The topic of occupational strain receives considerable research attention and is an important occupational safety and health issue. Research evidence shows that perceived stress overtime and quantitative job overload negatively impact worker mental health. The prevalence of workers reporting mental stress due to job overload increased from 51% in 1982 to 63% in 1997 among Japanese workers and job stressors causing 60% to 80% of occupational accidents and absenteeism in Taiwan [2, 4].
Job Content Questionnaire (JCQ)
The Job Content Questionnaire (JCQ) based on Karasek's Demand-Control Model, i.e., subscales of job control and psychological demands, is the most popular[1, 5], among many instruments designed for the assessment of psychosocial work environment. Karasek and Theorell later incorporated this questionnaire with work-related social support (i.e., subscales of supervisor support and co-worker support) as the Demand-Control-Support Model . Most of the epidemiological studies utilize the JCQ to measure the 'content' of a respondent's work tasks in a general manner, which is applicable to all jobs and workers for predicting job related stress and coronary heart disease in many countries[6–11], and also they are used for studying worker motivation, job satisfaction, absenteeism, and labor turnover [5, 8]. The 22-item core JCQ Chinese version (C-JCL) was verified and published in an international journal . However, few papers illustrated a graphical presentation of job strain interpretation for workers, especially in friendly used Excel, to help mental health experts focussing on a small number of key areas of concern.
Four exposure groups classified by JCQ
Job Demand-Control (or Job Strain) Model involves four quadrants displaying psychological job demands (PD), namely high and low strain and active and passive jobs [13, 14], those are jointly separated by another subscale of decision latitude (DL). High strain jobs with low DL and high PD are particularly perceived to cause the most adverse psychological reactions . Many prospective studies have supported this hypothesis. Four exposure groups including (i) high strain (exposed to low DL and high PD); (ii) low strain (high DL and low PD); (iii) passive (low DL and low PD); and (iv) active (high DL and high PD) could be graphically illustrated for identifying examinee's high or low job strain.
Calculating a sum of weighted item scores for each subscale of those 22 items by the specific calculation formulas of the originators is subjective and cumbersome [1, 12]. None study, until now, was conducted using the 22-item C-JCL to generate diagnostic reports for workers by a graphical representation to identify their job stresses.
For the graphical representations, it is worthy of (1) depicting a four-quadrant diagram reporting individual job stressors and strains; (2) developing item-by-item bar chart plots to examine person's response on items which can help consultants focusing on a small number of key areas of concern; and (3) make a comparison of the inter-group and inter-occupation differences by item-by-item box plots of disclosure for a sample using skewness coefficients and 95% confidence intervals (CIs) to justify occupational job stress whether it is positive or negative skew to an issue (i.e., item or question).
The setting was a 1,200-bed hospital located in southern Taiwan in which 2,791 workers participated in a job perception examination in August of 2008. Self-administered questionnaires were distributed to all the employees of the hospital, and 1,863 employees responded (return rate, 66.75%). We further excluded 219 participants who had incomplete information on age, gender, and those with work tenure of three months or less, and part-time workers. As a result, 1,644 workers (or 58.9% of 2,791) were available for this study (Table 1).
Steps of instrument selection
With permission from the author of the Chinese Version of the JCQ (C-JCL) , 22 core items were selected, including the four subscales such as DL measured by nine items, i.e., skill job discretion (6 items) and decision authority (3 items), PD measured by five items, and supervisor and co-worker support, both measured by four items. For each item, the response was recorded using a four-point Likert scale ranging from 1 (strongly disagree) to 4 (strongly agree). We used the WINSTEPS software  to estimate each person's psychometric characteristics by combining all 22 items and separating items for respective subscales.
2. Validation Procedure
(1). Rasch modeling analysis
We programmed an Excel module helping workers examine their job strain. The 22 core items are required to identify number of factors extracting from data. Rasch  model was applied to analyze data in Excel for the assessment of job strain for workers. The great advantage of using a Rasch model is that it is an explicit empirical model of the latent trait, which allows for the testing of data fit to the model while dealing with missing response values and transforming raw scores into a linear interval score in a logit (log odd) unit [18–21].
(2) Dimensional checking for C-JCQ
We detected the number of factors for C-JCQ using parallel analysis , one of the most recommended methods for dealing with the number-of-factors-to-retain problem [23, 24] to observe C-JCQ dimensionality. ViSta version 22.214.171.124 (2010, April)  was performed to plot the graphical parallel analysis with 95% confidence intervals.
Prevalence rate of high strain in hospital workers
We used formula (1) to calculate the prevalence rate to uncover participants with work-related stress compared to the total population at risk of contracting that stress.
Excel module combined with WINSTEPS estimating measures
Rasch transformed scores in each domain will be generated by separately estimating person measures using the Excel module which was incorporated with WINSTEPS software to easily estimate the individual measures. The diagram of four quadrants in Excel were plotted to classify workers by DL and SD subscales for individual examinees. Item-by-item bar chart plots to examine person's placement will be developed in Excel. Those two graphical representations are expected to help consultants to easily, quickly and clearly identify job strain for each worker.
Job stress monitored by skewness analyses
Skewness coefficient was suggested to report in evaluating dissimilarity of examinee group . In a skewed (unbalanced, lopsided) distribution, the mean is farther out in the long tail than is the median. If there is no skewness (i.e., the distribution is symmetric) then the mean = the median = the mode. It can be applied to workplace for graphical health performance reports as an indicator of examinee group discrimination on a single item regarding job stress.
If we are concerned with the occupational (or demographic) group which is ascribed to the job stress with positively skewed population which indicates that most of them perform worse (i.e., most persons with lower responding score) on the single item. It is required using computer efficiently to screen them for further assessment. The skewness coefficient and its 95% CI yielded by Bootstrap  for all types of occupational group on items are estimated by author programmed Excel-VBA module.
Ethics Review Board Approval
The protocol of this study was approved by the Research and Ethics Review Board of Chi-Mei Medical Center. All authors certify that there are no known conflicts of interest with any third party.
Table 1 summarizes the demographic characteristics of the study population. The average age of the men and women were 38 and 33 years, respectively, and the mean duration of work tenure was about 4.8 years for both men and women. The majority of respondents were nurses (56%), whereas only 10% were physicians.
Checking dimensions of C-JCQ
All the 22 items fit the expectations for the Rasch model fairly well, with infit and outfit MNSQs between 0.60 and 1.40, respectively (Table 2). The most difficult (i.e., the least occurrence) item to appear was conflicting work (item 14; 2.76 logits; SE = 0.04). The easiest (i.e., the most frequent) to present was learning new things (item 1; -2.18 logits; SE = 0.05). Cronbach's alpha coefficient is 0.8 similar to the previous study (Cheng, Luh, Guo, 2003) .
Tennant and Pallant suggested  that exploratory factor analysis (EFA), especially using parallel analysis (PA), should be undertaken to ensure the dimensionality of study data before conducting a Rasch analysis. Parallel analysis was performed to identify that C-JCQ has five factors extracted from those 22 items (Figure 1).
Excel module plotting graphical representations of four exposure groups
In order to develop a self-administered assessment to help workers diagnose their job strain, we illustrate a worker corresponding to the relationship between four exposure groups in Figure 2. They were 281 (16.5%), 136 (7.99%), 1228 (72.11%) and 58 (3.41%) for high and low strain, and active and passive jobs, respectively. In the diagram, we see that the number that occurred in each group is shown in different color (the darker the color, the greater the number). The worker's scores displayed in the diagram showing high strain in the VI quadrant (symbolized by an asterisk) and low scores of SSs (supervisor support) and CSs (co-worker support) in the III quadrant (symbolized by a square), indicating that the worker should be paid more concern for an obviously depressive disorder on job environment without satisfying social support in the workplace. The graphical representation in Excel can help consultants examine the relation of worker's job strain and support from supervisor and co-worker so that they can be easily, quickly and clearly identified.
Excel module plotting item-by-item bar charts for individual workers
Figure 3 shows item-by-item box plots for a particular worker. On the right-hand side of the figure, the outlier residual Z-score (2.609 on item 2) is shown, indicating that such items responding to this worker violating model's expectation are required for a further discussion, indicating that the observed score is greatly far apart from the expected response beyond the criterion of 1.96 (p < .05) when Rasch model is well fitted. Examining these residual Z-scores can help consultants focusing on a small number of key areas of concern for each worker in job strain.
Graphical skewness analyses to screen out what groups we concern
If we are concerned with the occupational (or demographic) group which is with tremendous amount of job strains and stressors, those with positively skewed population would be selected. All of groups in the present study show less job stress with negatively skewed pattern in Figure 4. The skewness 95% CIs for each item showed can list such a juxtaposed comparison within (or between) group-by-group, item-by-item and year-by-year so as to see any difference or change occurred in sample dissimilarity of distribution in job stress suffered.
We found the prevalence rate of Chinese hospital workers with high job strain to be 16.5%. It is easy to make comparisons with the prevalence of job stress in other workplaces if the job strain derived from the C-JCQ is measured by Rasch analysis [29, 30].
What this adds to what was already known
We confirmed the C-JCQ with five dominant factors and ensured that Rasch analysis is an objective tool that can create linear and interval scores measuring job strain .
What is the implication and what should be changed
Using Excel graphical representations of C-JCQ scores combined with WINSTEPS as a tool can help consultants focusing on a relatively small number of key areas of concern and allows for an easy, quick, and clear comparison of job strain, especially for those who are unfamiliar with a professional statistical package. Interested readers can download this feature in Additional files 1.
The studied workplace verified as a symphony organization
The least satisfied scoring item was "I am free of conflicting demands that others make (shown in Table 2), indicating hospital employees commonly and frequently violate one of the Henri Fayol's 14 Principles of Management, Unity of Command (i.e., each worker should have only one boss with no other conflicting lines of command). Drucker stated that hospital organization is very similar to that of a music symphony orchestra (e.g., a conductor in orchestra like a surgeon in operation room not familiar with other instruments leads co-workers of a team to attain their goal) . The most satisfied item was "My job requires that I learn new things" (shown in Table 2), indicating that the hospital is changing and improving frequently and the employees are satisfied with new thing to learn from their jobs.
Strengths of the study
1. Excel with Winsteps to implement Rasch analysis
The finding of Chinese hospital workers with a prevalence rate of high job strain at 16.5% can be compared with other studies based on the Job Strain Model paradigm. An Excel module (see addition file 1) combined with Winsteps as a tool which was never published before that so convenient and easy to use although Winsteps has been one of the most widely used programs for Rasch analysis in recent years . It can do the following: 1) easily generate person measures with item anchored difficulties revealed in this study in comparison with other study using a C-JCQ scale; and 2) understandably depict C-JCQ results, showing the worker's strain level in a diagram that can compare studied samples scattered in the four quadrants (Figure 2) as well as item-by-item bar chart plots helping consultants focusing on job strain for each worker to be easily, quickly and clearly compared (Figure 3). Accordingly, the Excel module could be easier than that calculating a sum of weighted item scores for each subscale of those 22 items by the specific calculation formulas of the originators [1, 12].
2. Using skewness and its 95% CI to differentiate between groups on items
From management prospective, labor health protection and promotion have been recently emerged as an important issue [35, 36]. Every workplace conducts enormous numbers of diverse mental examination for their employees. Using data to examinee differences of individual groups within or between groups, items and years becomes easy and possible if applying skewness coefficient and its 95% CI, which is shown in Figure 4.
3. Allowing missing values in responses
Classic test theory (CTT) requires all items on a questionnaire to be completed in order to obtain a final score and evaluate the job stress resistant ability of the respondent. Rasch model is based on item response theory (IRT) and it allows missing data estimate examinee' stress resistant ability [37, 38]. Readers who are interested can click it onto the website (http://www.webcitation.org/5akD0HfXm) with incompletely answered missing data to test the effects. The visual representation diagram on Internet for employee stress evaluation can be plotted. Individual job strain can be estimated even if missing data are in existence.
Limitations and weaknesses of the study
High quality examinee feedback is important, so more work is needed to enable the administration of an effective examinee feedback tool in work site settings. In this study, we consider the questionnaire as a tool to collect individual's perception of job stress through a graphical representation. However, users may need some training to interpret four-quadrant diagram, item-by-item plots and skewness 95% CI comparison of job strain properly. The results imply that it is just useful for examining job stress in Chinese hospital work sites, thought the procedure and approach applied in this study can be repeated and carried out onto other cultures or onto other any population of people by promising researchers. The results regarding the job strain prevalence cannot be generalized to other workplaces in different cultures, although many translations of the JCQ translations have been used (http://www.jcqcenter.org/Translations.html).
The DL is constructed by two subscales of skill job discretion (6 items) and decision authority (3 items) although PA identified it composing two factors (correlation coefficient = 0.45). We averaged those two composed scores to yield the DL for plotting the four quadrant diagram (Figure 2) according to previous papers [1, 12–14]. However, SD and DA are not conceptually the same construct so that they should not be used jointly to represent DL. It is worthy of additional study regarding JCQ to verify its proper application.
The author-programmed Excel module is for application that is simple, understandable and easily used in the workplaces. All of the C-JCQ difficulties for items in each subscale have been anchored with WINSTEPS commands in the downloadable Excel module so that the results of job strain prevalence can be compared in the future. C-JCQ results for each worker can be reported in the four quadrants and item-by-item bar chart plots to show the job strain compared with the studied samples. Those two plots in Excel provide mental health consultants with information different from traditional approaches that cannot facilitate C-JCQ for emphasizing key areas of JCQ subscales to be easily, quickly and clearly compared and interpreted. Readers who are interested in assessing employees' job strain with the Rasch model can download it from Additional files 1 for practice. It must be noted that the Excel module must be placed in the same folder as the examples for WINSTEPS and the Excel application must be activated before activating the Excel module.
Further Studies and Suggestions
Job strain conditions may be associated with the co-occurrence of adverse health behaviours that contribute to preventable chronic diseases . Researchers and practitioners could put more emphases on the issues of self-evaluation for the public. The identification of occupational hazards that contribute to perceived workplace stress can better inform the development of interventions to reduce worker stress in acute care organizations in Taiwan. Future interventional research is needed to test interventions that are effective in the reduction of workplace stress related to occupational hazards, in order to promote improved workplace mental health. Research is needed to test interventions focused on 1) organizational climate change (i.e., changes in organizational structures and processes) for high risk groups and 2) improve worker's resistance to workplace stress to improve worker and patient outcomes.
In practice, there may be more than one scaling questionnaire for job stress to be analyzed. We just studied the Job Content Questionnaire (JCQ) based on Karasek's Demand-Control-Support Model. In this study, IRT-based Rasch model was used to illustrate both four quadrants and item-by-item bar chart plots to examine worker's job strain. Future studies are encouraged to compare the prevalence rate of high job strain with other workplaces using this Excel module (in additional file 1). It is desirable to implement these procedures to evaluate data on both bases of individual and population. Future studies can carry out C-JCQ questionnaire with the Excel module with graphical representations to investigate workers' job strain in workplace settings.
classic test theory
item response theory
job content questionnaire
principle component analysis
psychological job demand
visual basic for application
Karasek R, Theorell T: The psychosocial work environment. Healthy work-stress, productivity, and the reconstruction of working life. 1990, New York: Basic Books, 1-82.
Kawakami N, Haratani T: Epidemiology of job stress and health in Japan: Review of current evidence and future direction. Industrial Health. 1999, 37 (2): 174-186. 10.2486/indhealth.37.174.
Schnall PL, Schwartz JE, Landsbergis PA, et al: Relation between job strain, alcohol, and ambulatory blood pressure. Hypertension. 1992, 19: 488-494.
Hurrell JJ, Murphy LR: Occupational strss intervention. Am J Ind Med. 1996, 29: 338-41. 10.1002/(SICI)1097-0274(199604)29:4<338::AID-AJIM11>3.0.CO;2-2.
Hurrell JJ, Nelson DL, Simmons BL: Measuring job stressors and strains: Where we have been, where we are, and where we need to go. Journal of Occupational Health Psychology. 1998, 3: 368-389.
Cheng Y, Kawachi I, Coakley EH, et al: Association between psychosocial work characteristics and health functioning in American women: prospective study. BMJ. 2000, 320 (7247): 1432-6. 10.1136/bmj.320.7247.1432.
Fenster L, Schaefer C, Mathur A, et al: Psychologic stress in the workplace and spontaneous abortion. Am J Epidemiol. 1995, 142 (11): 1176-83.
Karasek RA, Theorell T, Schwartz JE, et al: Job characteristics in relation to the prevalence of myocardial infarction in the US Health Examination Survey (HES) and the Health and Nutrition Examination Survey (HANES). American Journal of Public Health. 1988, 78: 910-918. 10.2105/AJPH.78.8.910.
Kouvonen A, Kivimäki M, Väänänen A, Heponiemi T, Elovainio M, et al: Job strain and adverse health behaviors: the Finnish Public Sector Study. J Occup Environ Med. 2007, 49 (1): 68-74. 10.1097/JOM.0b013e31802db54a.
Mohan GM, Elangovan S, Prasad PS, Krishna PR, Mokkapati AK: Prevalence of job strain among Indian foundry shop floor workers. Work. 2008, 30 (4): 353-7.
Schnall PL, Landsbergis PA, Baker D: Job strain and cardiovascular disease. Annual Review of Public Health. 1994, 15: 381-411. 10.1146/annurev.pu.15.050194.002121.
Cheng Y, Luh WM, Guo YL: Reliability and Validity of the Chinese Version of the Job Content Questionnaire (C-JCQ) in Taiwanese Workers. International Journal of Behavioral Medicine. 2003, 10 (1): 15-30. 10.1207/S15327558IJBM1001_02.
Maizura H, Retneswari M, Moe H, Hoe VC, Bulgiba A: Job strain among Malaysian office workers of a multinational company. Occup Med (Lond). 2010, 60 (3): 219-24. 10.1093/occmed/kqq001.
Karasek R, Brisson C: The Job Content Questionnaire (JCQ): an instrument for internationally comparative assessments of psychosocial job characteristics. Journal of Occupational Health Psychology. 1998, 3 (4): 322-355.
Garcia AM, Checkoway H: A glossary for research in occupational health. JEpidemiolCommunity Health. 2003, 57: 7-10.
Linacre JM: WINSTEPS [computer program]. 2008, Chicago, IL, [http://www.winsteps.com]
Rasch G: Probabilistic Models for Some Intelligent and Attainment Tests. 1960, Copenhagen, Denmark: Institute of Educational Research
Hsueh IP, Wang WC, Sheu CF, Hsieh CL: Rasch analysis of combining two indices to assess comprehensive ADL function in stroke patients. Stroke. 2004, 35: 721-726. 10.1161/01.STR.0000117569.34232.76.
Smith AB, Wright P, Selby PJ, Velikova G: A Rasch and factor analysis of the Functional Assessment of Cancer Therapy-General (FACT-G). Health Qual Life Outcomes. 2007, 20: 5-19.
Chien TW, Lin SJ, Wang WC, Leung HW, Lai WP, Chan AL: Reliability of 95% confidence interval revealed by expected quality-of-life scores: an example of nasopharyngeal carcinoma patients after radiotherapy using EORTC QLQ-C 30. Health Qual Life Outcomes. 2010, 13: 8-68.
Olsen RV, Garratt AM, Iversen HH, Bjertnaes OA: Rasch analysis of the Psychiatric Out-Patient Experiences Questionnaire (POPEQ). BMC Health Serv Res. 2010, 10 (1): 282-10.1186/1472-6963-10-282.
Horn JL: A rationale and test for the number of factors in factor analysis. Psychometrika. 1965, 30: 179-185. 10.1007/BF02289447.
Humphreys LG, Montanelli RG: An examination of the parallel analysis criterion for determining the number of common factors. Multivariate Behavioral Research. 1975, 10: 193-206. 10.1207/s15327906mbr1002_5.
Silverstein AB: Note on the parallel analysis criterion for determining the number of common factors or principal components. Psychological Reports. 1987, 61: 351-354.
Young FW, Valero-Mora PM, Friendly M: Visual statistics: seeing data with dynamic interactive graphics. Wiley Inc. 2006
Chien TW, Lin SJ, Wang WC, Leung HW, Lai WP, Chan AL: Reliability of 95% confidence interval revealed by expected quality-of-life scores: an example of nasopharyngeal carcinoma patients after radiotherapy using EORTC QLQ-C 30. Health Qual Life Outcomes. 2010, 13: 8-68.
Efron B, Tibshirani R: An introduction to the bootstrap. Chapman & Hall/CRC. 1994
Tennant A, Pallant J: Unidimensionality matters. Rasch Measurement Transactions. 2006, 20: 1048-1051.
Stenner AJ: Objectivity, Units of Measurement and Zeroes. Rasch Measurement Transactions. 1997, 11 (2): 560-561.
Smith AB, Rush R, Fallowfield LJ, Velikova G, Sharpe M: Rasch fit statistics and sample size considerations for polytomous data. BMC Medical Research Methodology. 2008, 8: 33-10.1186/1471-2288-8-33.
Salzberger T: Does the Rasch Model Convert an Ordinal Scale into an Interval Scale?. Rasch Measurement Transactions. 2010, 24: 1273-5.
Rodrigues CA: Fayol's 14 principles of management then and now:a framework for managing today's organizations effectively. Management Decision. 2001, 39 (10): 880-889. 10.1108/EUM0000000006527.
Drucker PF: Management Challenges for the 21st Century. 1999, Harper-Collins Publishers
Wang WC, Chen CT: Item parameter recovery, standard error estimate and fit statistics of the WINSTEPS program for the family of Rasch models. Educational and Psychological Measurement. 2005, 65: 376-404. 10.1177/0013164404268673.
Kawachi I: Globalization and workers' health. Ind Health. 2008, 46 (5): 421-3. 10.2486/indhealth.46.421.
Doig B: Rasch down down. Rasch Meas Trans. 1990, 4 (1): 96-100.
Wright BD, Masters GN: Rating Scale Analysis. 1982, Chicago, Ill: MESAPress
Wright BD, Mok M: Understanding Rasch Measurement: Rasch Models Overview. J Appl Meas. 2000, 83-106. 1
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/11/478/prepub
This work was supported by Chi-Mei Medical Center (Grant No. CMFHR 9820). We would like to thank Dr. Wei-Chih Kan and Dr. Chih-Chiang Chien at the Department of Nephrology for their assistance in conducting this study.
1. Authors' declaration of personal interests: None.
2. Declaration of funding interests: This study was funded in full by Chi-Mei Medical Center (Grant No. CMFHR 9820).
TWC, WPL and SBS provided concepts and ideas for research design, writing, data analysis, facilities and equipment and fund procurement. SYH, HYW and SCC provided institutional liaison and project management. HRG and RVC provided consultation (including English revision and review of manuscript before submission) All authors read and approved the final manuscript.
Tsair-Wei Chien, Wen-Pin Lai contributed equally to this work.