This article has Open Peer Review reports available.
Computer-associated health complaints and sources of ergonomic instructions in computer-related issues among Finnish adolescents: A cross-sectional study
© Hakala et al; licensee BioMed Central Ltd. 2010
Received: 12 September 2008
Accepted: 11 January 2010
Published: 11 January 2010
The use of computers has increased among adolescents, as have musculoskeletal symptoms. There is evidence that these symptoms can be reduced through an ergonomics approach and through education. The purpose of this study was to examine where adolescents had received ergonomic instructions related to computer use, and whether receiving these instructions was associated with a reduced prevalence of computer-associated health complaints.
Mailed survey with nationally representative sample of 12 to 18-year-old Finns in 2001 (n = 7292, response rate 70%). In total, 6961 youths reported using a computer. We tested the associations of computer use time and received ergonomic instructions (predictor variables) with computer-associated health complaints (outcome variables) using logistic regression analysis.
To prevent computer-associated complaints, 61.2% reported having been instructed to arrange their desk/chair/screen in the right position, 71.5% to take rest breaks. The older age group (16-18 years) reported receiving instructions or being self-instructed more often than the 12- to 14-year-olds (p < 0.001). Among both age groups the sources of instructions included school (33.1%), family (28.6%), self (self-instructed) (12.5%), ICT-related (8.6%), friends (1.5%) and health professionals (0.8%). Receiving instructions was not related to lower prevalence of computer-associated health complaints.
This report shows that ergonomic instructions on how to prevent computer-related musculoskeletal problems fail to reach a substantial number of children. Furthermore, the reported sources of instructions vary greatly in terms of reliability.
Pain symptoms in the neck and lower back increased among Finnish adolescents in the 1990s and this trend has continued in the 2000s . At the same time there has been a remarkable increase in the use of computers , as in the risk of several musculoskeletal health complaints [3–5].
Pain symptoms have been measured using separate questions, for e.g. headache [3, 4], neck-shoulder pain [3, 5] and low back pain [5–7], which have been observed as more common among computer users than among non-users. A dose-response relationship between computer use time and the occurrence of symptoms has been noted in a previous study . Young computer users' own perceptions on whether computer use has induced these symptoms have also been investigated. Results have suggested that computer use is associated with neck-shoulder or back pain [8–14] but also pain in the hands, fingers or wrists [8, 10, 11, 13, 15] and eyes [8, 10]. Most of the studies have been cross-sectional with unrepresentative, small samples that cannot be relied upon to draw conclusions on causality.
There is evidence that musculoskeletal symptoms can be reduced through an ergonomics approach and through education. In a study by Henning et al. , frequent short breaks from computer work reduced musculoskeletal discomfort and other computer-related complaints among adults. In a randomized trial, Ketola et al.  investigated the impact of an intensive ergonomics approach and education on workstation changes and musculoskeletal disorders among adult visual display unit users, and found that after two months, both the intensive ergonomics and the education groups had less musculoskeletal discomfort than the reference group. Among young people and adolescents, 6th grade children who reported not having furniture specifically designed for computer use were more likely to have musculoskeletal discomfort than those who had . Educational programmes with a focus on overall postural health, body mechanics and environmental ergonomics have enhanced the knowledge regarding computer habits among students, including a non-stressful body position while working at the computer [18, 19].
Based on research and best practice evidence to avoid musculoskeletal complaints induced by computer work, professional bodies such as the Finnish Institute of Occupational Health http://www.ttl.fi advise appropriate ergonomics as well as sufficient resting breaks among adults. Computer users need to know how to create good ergonomic working arrangements for computer workstations, including placement of the screen, keyboard, mouse and lighting. Furthermore, they need to be aware of the importance of short breaks to decrease the stress in soft tissues, discs and nerves caused by the static postures and prolonged sitting frequently involved in computer use. Digital computers designed for the use of the general public are still newcomers to our society. The fact that their appropriate use, with respect to personal health, requires specific learning and instructions has not necessarily been recognized by either schools or parents. There is a lack of studies as to whether children receive instructions on how to prevent e.g. musculoskeletal problems, and whether receiving these instructions is related to a decreased prevalence of health complaints.
The primary aim of this study was to examine a large population sample of 12 to 18-year-old adolescents to find out where they had received ergonomic instructions regarding computer workstation set-up and work practices, and secondly whether receiving these instructions was associated with a reduced prevalence of computer-associated health complaints.
We used data from the Adolescent Health and Lifestyle Survey of 2001, a nationwide monitoring system of Finnish adolescents conducted biennially since 1977. The survey sample was drawn from the Population Register Centre by selecting all 12-, 14-, 16- and 18-year-old Finns born on certain adjacent dates in July. The Adolescent Health and Lifestyle Survey has been approved by the Ethical Committee of the Department of Public Health of the University of Helsinki. Self-administered questionnaires were mailed in February and followed by two reminder letters and questionnaires to non-respondents. The sample size was 10 360 (7292 responded, response rate 70%). The number of respondents and response rates among boys by age were: 351 (72%) 12-year-olds, 1251 (66%) 14-year-olds, 892 (62%) 16-year-olds and 774 (53%) 18-year-olds. Among girls, the corresponding figures were: 452 (82%) 12-year-olds, 1485 (79%) 14-year-olds, 1138 (82%) 16-year-olds and 976 (76%) 18-year-olds.
Computer-related health complaints
The symptoms caused by excessive computer use were elicited for five different anatomical sites as follows: "Using a computer may cause health complaints (pains, aches, discomfort). Have you experienced any of these when using a computer?" The anatomical locations were: a) neck or shoulders, b) hands, fingers, wrists, c) lower back, d) head and e) eyes. The response alternatives for each item were a) not at all, b) sometimes and c) often. A summary variable was formed based on the number of locations where the respondents reported health complaints: a) none, b) 1, c) 2 to 3 or d) 4 to 5 anatomical sites. The reliability of different perceived symptoms in the previous surveys of the Adolescent Health and Lifestyle Survey have been tested and shown to be fair to good  when measured by kappa coefficients (0.47 for headache, 0.51 for abdominal pains, 0.42 for fatigue or weakness) .
Computer use time
Computer use time was measured as follows: "How much time do you spend, on average, daily on a computer for e-mail, writing and searching for information?" The response alternatives in this structured question were: a) not at all, b) occasionally, c) <1 hour, d) 1-3 hours, e) 4-5 hours and f) >5 hours. A computer user was defined as an adolescent who used a computer at least occasionally (N = 6,961). Because of the small number of adolescents reporting computer use of over 4 hours daily, categories e) and f) were merged for analysis. In our previous paper based on the 2003 survey, we showed the reliability of the questions on computer time was fair to good when measured with kappa coefficients (0.45 for weekly use of computers, 0.65 for weekly use of the internet, 0.45 for daily use of computers) .
Sources of ergonomic instructions
The type of ergonomic instructions received related to computer use was elicited using the question: "Were you ever instructed, or did you instruct yourself on how to avoid these health complaints?" Two alternatives, with response options No/Yes, were given: 1) I was instructed to arrange the desk, chair and screen in the correct position and 2) I was instructed to take a rest break and do something else for a while. Those (N = 238; 3.0%) who did not answer the question at all were excluded from the analysis. We used one additional question: "What was the source of these instructions?" To this open-ended question the respondents had provided between one and three answers, which were categorized into seven variables describing the sources of instructions: school (e.g. lessons related to health education, ergonomics, automatic data processing, physical education or work safety), family (parent, guardian, sibling, grandparent, relative), friends (friends, mates), myself (self-instructed, instructed through experience, realization or understanding), information and communication technology (ICT) related (computer literature, ICT professionals, instant messaging and programmes, television, radio), health care professionals (public health nurse, physiotherapist, doctor, eye specialist, other health care professional), other sources or cannot say (hobby, course, job, apprenticeship).
Data were analysed using SPSS for Windows (version 11.0.; SPSS Inc, Chicago, Illinois). Using logistic regression analysis, the computer-associated health complaint variables were dichotomised into "often" and "never or sometimes". In the first analysis the association between health complaints (outcome variables) and computer use time (predictor variable) was tested, adjusting for age, sex and parents' education (primary school, vocational school, comprehensive school, matriculation examination, college or university). The second analysis tested the associations between computer-associated health complaints (outcome variables) and received ergonomic instructions (predictor variables). After first examining each health complaint in the model adjusted for age and sex, computer use time was included. Age, sex and computer use time variables were considered potential confounders and treated as covariate, because the response alternatives were categorical and the scale has irregular intervals. We calculated the odds ratios and 95% confidence intervals (Cl), and used P-values to show the differences between the age and sex groups. Analysis of non-respondents was tested by dividing the data into three categories according to the return date of the questionnaire. The statistical differences between the three respondent groups were tested using the chi-square test.
Prevalence of computer-related health complaints
Percentages of adolescents that reported computer-associated health complaints often or sometimes, by anatomical site, sex and age among computer users.
Hands, fingers, wrist
Association between computer use time and health complaints
Odds ratios (OR) and their 95% confidence interval (Cl) for frequent computer-associated health complaints by time (hours) spent daily on a computer, among 12- to 18-year-old computer users, adjusted for age, sex and parents' education.
Computer use time
Health complaints often
Hands, fingers, wrists
< 1 hour daily
1-3 hours daily
≥4 hours daily
Received ergonomic instructions
Proportion (%) of 12- to 18-year-olds who reported having received instructions or being breaks in order to prevent computer-associated health complaints, by sex and age.
To arrange desk, chair and screen in the right position
To take rest breaks
Sources of ergonomic instructions
Reported sources of ergonomic instructions to prevent computer-associated health complaints.
Health care professionals
Other or not defined
Association between ergonomic instructions and occurrence of health complaints
Odds ratios (OR) and their 95% confidence interval (Cl) for frequent computer-associated health complaints among 12- to 18-year-old computer users who received ergonomic instructions, adjusted for age, sex and computer use time, by type of instructions.
Health complaints often
Hands, fingers, wrists
To arrange desk, chair and screen in the right position
To take rest breaks
Analysis of non-respondents
The data were divided into three categories according to the return date of the questionnaire (original questionnaire N = 4988, first reminder N = 1840, second reminder N = 464). It was assumed that the later the person answered the more he or she resembled a non-respondent. The prevalence of computer-associated health complaints declined but none of them reached a statistical significance. The prevalence among the respondent groups were 46.1% to the original questionnaire, 44.2% to the first reminder and 39.5% to the second reminder for the neck or shoulders; 29.2%, 27.2%, 26.8% for hands, fingers and wrists; 19.6%, 20.3%, 20.6% for lower back; 37.7%, 36.5%, 33.7% for head, and 51.9%, 48.0%, 45.5% for eyes, respectively.
Computer-associated health complaints were common in this study based on a large, nationwide survey of 12-18-year-old adolescents. The most frequently reported symptoms were in the eyes, neck or shoulders. Using a computer daily for one hour or more was associated with increased health symptoms in the upper extremities (neck or shoulders, hands, fingers and wrists), and the use of four hours or more was related to symptoms in all anatomical sites including the eyes, the head and the lower back. Approximately two thirds of the adolescents reported having received ergonomic instructions to arrange their work desk, chair and screen into the right position or to take rest breaks in order to prevent computer-associated health complaints. There were several sources of instructions, school and family being the most common, followed by self-instruction and ICT-related sources (e.g. the Internet). After adjusting for age, sex and computer use time, which influence the relationship between computer use and symptomatology, we did not find a statistically significant association between prior receipt of ergonomic instructions and decreased levels of reported symptoms.
In the current study, health complaints were more frequent among girls than boys and the prevalence increased with age. Our results are parallel with previous findings concerning sex or age differences [3, 5, 7, 12, 14, 15].
Our study confirmed the results of previous, smaller studies in a large nationwide survey which found that the occurrence of physical discomforts in locations such as the eyes and the neck-shoulders were related to computer use [8, 10]. Some previous studies have also shown that the risk for symptoms rises with increasing computer use exposure time for neck-shoulder pain , and overall musculoskeletal pain or discomfort [9, 22]. This relationship was likewise confirmed in our current study with respect to symptoms in the neck or shoulder region and the upper extremities.
This study is the first to examine whether adolescents had received instructions in computer-related ergonomic issues, and look into the sources of these instructions, on the basis of self-reports. Nearly 40% of the respondents reported not having received instructions or being self-instructed on how to arrange the work desk, chair and screen into the right position, and nearly 30% on how to take rest breaks during computer use. Considering that today's children and adolescents in all age groups are frequent computer users, they could be expected to be familiar with these two ergonomic aspects and capable of applying them to their everyday life. Our findings indicate that a remarkable proportion of adolescents are not aware of computer-related ergonomic instructions, even if in survey questions like ours there could be a memory bias, decreasing the proportion of those who reported receiving instructions.
Based on the existing research evidence, the source of ergonomic instructions for computer work can be considered important from the point of view of the quality of such instructions. Although school emerged as the primary source of reported instructions in slightly over 30% of all respondents, the proportion was lower among 12- to 14-year-old boys. Given the comprehensive school system in the study country, computer-related ergonomic instructions should have been available to the entire study population. However, in 2001 when this study was carried out, health education had not yet been adopted by all schools as the separate subject it is today. Inclusion of ergonomic instructions for computer use in the school curriculum would ensure that all school-aged children receive basic ergonomic knowledge and skills.
Family was also reported by every third respondent as a source of computer-related ergonomic instructions. However, we do not know whether parents' own knowledge on computer ergonomics is appropriate, nor how intensively they control their children's computer habits. Adolescents seemed to be fairly active in finding out knowledge by experience: every eighth respondent reported being self-instructed, and the variety in the instruction methods was expressed in responses such as "self-instructed through experience", "I realized", or "I have trained myself". Self-instruction in computer ergonomics includes an element of doubt because of the risk that the self-sought information is less valid or can be misinterpreted by the adolescent.
The number of adolescents reporting ICT-related sources, e.g. television, radio and the internet, as a source of ergonomic instructions was surprisingly low (9%). Other studies have shown that adolescents often use the internet to find health information. In a study by Borzekowski and Rickert  on suburban tenth graders in the state of New York, about 50% had used the internet to obtain health information on diet, fitness, exercise etc. and considered such information valuable. Together with other media resources, the internet can also serve as an important tool for ergonomic information, because it provides easy access and a way of acquiring specific information that might otherwise be difficult to obtain.
Given the common occurrence of neck-shoulder and low back pain among adolescents, it is surprising that so few in our study, just 1%, had been trained in ergonomic issues by health care professionals. Usually, young people are willing to discuss a variety of health-related issues with school health care staff. Finland has comprehensive school health services with access to well-trained school health nurses. In a previous study from the United States, doctors, nurses or school nurses were frequently identified as the first persons consulted about health issues among fifth to twelfth grade students . Computer-related ergonomics may have been a new subject for many doctors and nurses at the beginning of the 2000s, and unlike nutrition, exercise or growth, ergonomics was not a traditional issue for health counselling.
Overall, no relationship was found between ergonomic instructions and occurrence of health complaints, except that there were more eye-related complaints among adolescents who reported having received ergonomic instructions or being ergonomically self-instructed. Ergonomic instructions to arrange desks, chairs and screens in the right position or to take rest breaks were not statistically significantly associated with decreased levels of reported symptoms after adjusting for age, sex and computer use time. It is possible that adolescents with symptoms are more likely to seek instructions or remember receiving instructions. On the other hand, education does not necessarily result in actual changes in the workstation set-up. Our study cannot answer whether ergonomic instructions are effective for preventing computer-associated symptoms, but it showed that the adolescents who reported symptoms were not, in general, more informed than those who reported no symptoms.
Compared to earlier publications, the strength of this study was the large, nationwide sample size, depicting adolescents living in different conditions and locations. Furthermore, we examined several different health outcomes known to be related to adolescent computer use. Adolescents reported a wide selection of ergonomic sources to prevent computer-associated health complaints. The overall response rate was fairly good and the indirect analysis of non-respondents indicated no bias in the reported health complaints, computer use time or ergonomic instructions.
Some limitations of the study, however, require attention. This study was cross-sectional and causal inference on the relationship between computer time and computer-associated symptoms cannot be drawn from it. As the question used in the study measured respondents' perception of the causality of the relationship, it was a subjective measure: "Using a computer may cause health complaints (pains, aches, discomfort). Have you experienced any of these when using a computer?" Thus it was left to the respondents themselves to perceive whether any health complaints they may have are caused by specifically by computer use. Being a questionnaire survey, the rate of occurrence of symptoms and receiving instructions were based on self-reports, implying that memory bias is possible and differences between individuals' interpretations cannot be ruled out. Our questions on health complaints were measured with a simple three-point scale, including the alternatives "sometimes" and "often" which are not accurate measures of the frequency of symptoms. However, at group level, comparisons are valid. In our study, we used two separate questions to elicit the hours spent daily on a computer for e-mails, writing and information search, and the hours spent daily on playing digital games on computer, TV or console. Because it was difficult to distinguish between playing on computers versus console, the latter question was considered invalid and excluded from this study.
In the statistical analysis, we used logistic regression analysis to test the association between computer-associated health complaints and computer use time, adjusting for age, sex and parents' education. Other possible confounders, such as physical activity or school success, were not controlled. In the second analysis, we tested the associations between computer-associated health complaints and received ergonomic instructions. After first examining each health complaint in the model adjusted for age and sex, computer use time was included. This variable was considered a potential confounder and treated as a covariate, because it was a significant independent variable.
In this study, we explored a new aspect of computer-related adolescent lifestyle by asking where 12- to 18-year-old Finnish adolescents had received instructions in computer-related ergonomic issues and whether receiving instructions resulted in reduced symptoms. Further research is required to investigate the content and frequency of such instructions.
Today's children and adolescents are the first generation to have grown up with information communication technology, and the use of computers in their everyday lives. With the increasing popularity of computers, the concern over potential computer-associated health complaints has increased. These complaints affect various anatomical sites, are common in this age group, increase with age, and increase with the longer time spent on a computer. This report shows that ergonomic instructions have so far failed to reach a substantial proportion of the Finnish school-age population, and furthermore that such instructions may not be associated with reduced levels of computer-associated symptoms. In addition, the reported sources of instructions vary greatly in terms of reliability.
We wish to thank Lasse Pere for data management, Marja Vajaranta and Alice Lehtinen for revising the language. This study was supported by the Ministry of Social Affairs and Health, Health Promotion Research Programme of the Academy of Finland, Competitive Research Funding of Pirkanmaa Hospital District, City of Helsinki Health Centre, and Information Society Institute of the University of Tampere.
- Hakala P, Rimpelä A, Salminen JJ, Virtanen SM, Rimpelä M: Back, neck, and shoulder pain in Finnish adolescents: national cross sectional surveys. British Medical Journal. 2002, 325: 743-5. 10.1136/bmj.325.7367.743.View ArticlePubMedPubMed CentralGoogle Scholar
- Nurmela J, Ylitalo M: Tietoyhteiskunnan kehkeytyminen. Suomalaisten tietoyhteiskuntavalmiuksien ja -asenteiden muutokset 1996-2002. [Development of an information society. Changes in readiness and attitudes toward information society in Finland from 1996 to 2002.]. 1996, Katsauksia 3/2003, Tilastokeskus, Helsinki, (In Finnish), -2002. [Development of an information society. Changes in readiness and attitudes toward information society in Finland from 1996 to 2002.]Google Scholar
- Alexander LM, Currie C: Young people's computer use: implications for health education. Health Education. 2004, 4: 254-61. 10.1108/09654280410546745.View ArticleGoogle Scholar
- Oksanen A, Metsähonkala L, Anttila P, Aromaa M, Jäppilä E, Viander S, Salminen J, Helenius H, Sillanpää M: Leisure activities in adolescents with headache. Acta Paediatrica. 2005, 94: 609-15. 10.1080/08035250410023331.View ArticlePubMedGoogle Scholar
- Hakala PT, Rimpelä AH, Saarni LA, Salminen JJ: Frequent computer-related activities increase the risk of neck-shoulder and low back pain in adolescents. European Journal of Public Health. 2006, 16: 536-41. 10.1093/eurpub/ckl025.View ArticlePubMedGoogle Scholar
- Sjolie AN: Associations between activities and low back pain in adolescence. Scandinavian Journal of Medicine & Science in Sports. 2004, 14: 352-9. 10.1111/j.1600-0838.2004.377.x.View ArticleGoogle Scholar
- Zapata AL, Moraes AJP, Leone C, Doria-Filho U, Silva CAA: Pain and musculoskeletal pain syndromes related to computer and video game use in adolescents. European Journal of Pediatrics. 2006, 165: 408-14. 10.1007/s00431-005-0018-7.View ArticlePubMedGoogle Scholar
- Burke A, Peper E: Cumulative trauma disorder risk for children using computer products: Results of a pilot investigation with a student convenience sample. Public Health Reports. 2002, 117: 350-7.View ArticlePubMedPubMed CentralGoogle Scholar
- Jacobs K, Baker NA: The association between children's computer use and musculoskeletal discomfort. Work. 2002, 18: 221-6.PubMedGoogle Scholar
- Szeto GPY, Lau JCC, Siu AYK, Tang AMY, Tang TWY, Yiu AOY: A study of physical discomfort associated with computer use in secondary school student. Proceedings of Cyberg. 2002, [http://cyberg.wits.ac.za/]Google Scholar
- Schlossberg EB, Morrow S, Llosa AE, Mamary E, Dietrich P, Rempel DM: Upper extremity pain and computer use among engineering graduate students. American Journal of Industrial Medicine. 2004, 46: 297-303. 10.1002/ajim.20071.View ArticlePubMedGoogle Scholar
- Hupert N, Amick BJ, Fossel AH, Coley CM, Robertson MM, Katz JN: Upper extremity musculoskeletal symptoms and functional impairment associated with computer use among college students. Work. 2004, 23: 85-93.PubMedGoogle Scholar
- Hamilton AG, Jacobs K, Orsmond G: The prevalence of computer-related musculoskeletal complaints in female college students. Work. 2005, 24: 387-94.PubMedGoogle Scholar
- Jenkins M, Menéndez CC, Amick BC, Tullar J, Hupert N, Robertson MM, Katz JN: Undergraduate college students' upper extremity symptoms and functional limitations related to computer use: A replication study. Work. 2007, 28: 231-38.PubMedGoogle Scholar
- Katz JN, Amick BC, Carroll BB, Hollis C, Fossel AH, Coley CM: Prevalence of upper extremity musculoskeletal disorders in college students. American Journal of Medicine. 2000, 109: 586-8. 10.1016/S0002-9343(00)00538-6.View ArticlePubMedGoogle Scholar
- Henning RA, Jacques P, Kissel GV, Sullivan AB, Alteras-Webb SM: Frequent short rest breaks from computer work: effects on productivity and well-being at two field sites. Ergonomics. 1997, 40: 78-91. 10.1080/001401397188396.View ArticlePubMedGoogle Scholar
- Ketola R, Toivonen R, Häkkänen M, Luukkonen R, Takala E-P, Viikari-Juntura E: Effects of ergonomic intervention in work with video display units. Scandinavian Journal of Work, Environment & Health. 2002, 28: 18-24.View ArticleGoogle Scholar
- Rowe G, Jacobs K: Efficacy of body mechanics education on posture while computing in middle school children. Work. 2002, 18: 295-303.PubMedGoogle Scholar
- Shinn J, Romaine KA, Casimano T, Jacobs K: The effectiveness of ergonomic intervention in the classroom. Work. 2002, 18: 67-73.PubMedGoogle Scholar
- Fleiss JL: Statistical Methods for Rates and Proportions. 1981, New York: John Wiley & Sons, IncGoogle Scholar
- Koivusilta L: Health-related selection into educational tracks. A mechanism producing socio-economic health differences. 2000, Annales Universitatis Turkuensis 394. Painosalama Oy, TurkuGoogle Scholar
- Harris C, Straker L: Survey of physical ergonomics issues associated with school children's use of laptop computers. International Journal of Industrial Ergonomics. 2000, 26: 337-46. 10.1016/S0169-8141(00)00009-3.View ArticleGoogle Scholar
- Borzekowski DL, Rickert VI: Adolescent Cybersurfing for Health Information: A New Resource That Crosses Barriers. Archives of Pediatrics & Adolescent Medicine. 2001, 155: 813-7.View ArticleGoogle Scholar
- Ackard DM, Neumark-Sztainer D: Health care information sources for adolescents: Age and gender differences on use, concerns, and needs. Journal of Adolescent Health. 2001, 29: 170-6. 10.1016/S1054-139X(01)00253-1.View ArticlePubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/10/11/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.