- Research article
- Open Access
Development and psychometric validation of a scoring questionnaire to assess healthy lifestyles among adolescents in Catalonia
BMC Public Health volume 16, Article number: 89 (2015)
Lifestyle is intimately related to health. A questionnaire that specifically scores the healthiness of lifestyle of Catalan adolescents is needed. The objective of this study was to develop and validate a scoring questionnaire called VISA-TEEN to assess the healthy lifestyle of young Catalans that can be answered quickly and user-friendly.
A lifestyle questionnaire was developed based on the analysis of contributions from two focus groups, one with adolescents and the other with people who work with them (teachers and doctors). A panel of experts validated the content of items that were ultimately selected for the VISA-TEEN questionnaire. Three hundred ninety-six adolescents (215 boys and 181 girls, age = 13–19 years) completed the VISA-TEEN. Internal consistency was assessed using Cronbach's alpha (α) reliability coefficient. Test-retest reliability, using an intraclass correlation coefficient (ICC), was calculated based on scores attained two weeks apart. Construct validity was assessed by the extraction of components with an exploratory factor analysis. The relationship between the scores was measured using the health-related quality of life (HRQoL) KIDSCREEN-10 Index (the relationship was assessed by calculating Pearson’s r correlation coefficient). The association of scores in the VISA-TEEN for self-rated health (SRH) was also examined by executing an analysis of variance (ANOVA) between the different categories of this variable. We also calculated the index of fit for factor scales (IFFS) for each component, as well as the discriminatory power of the instrument using Ferguson’s δ (delta) coefficient.
The VISA-TEEN questionnaire showed acceptable reliability (α = 0.66, αest = 0.77) and a very good test-retest agreement (ICC = 0.860). It could be broken down into the following five components, all with an acceptable or very good IFFS (0.7–0.96): diet, substance abuse, physical activity, Rational Use of Technological Leisure (RUTL), and hygiene. Scores on the VISA-TEEN showed significant correlation with the KIDSCREEN index (r = 0.21, p < 0.001) and were associated with SRH (p < 0.001). The discriminatory power was found to be δ = 0.97.
The VISA-TEEN questionnaire developed to study the lifestyle of Catalan adolescents is a valid instrument to apply in this population as it is shown in the present psychometric tests to understand the role of lifestyle in the health of teenagers or to test the efficacy of health campaigns intended to improve teenagers' lifestyle.
There is a clear relationship between the way people live and their health, which is why we speak of healthy and unhealthy lifestyles. The World Health Organization (WHO) defines lifestyle as the way of living based on identifiable patterns or behaviours, which are determined by the interaction between individual and personal characteristics, social relations, and socioeconomic and environmental living conditions . Regarding adolescents, the WHO survey of Health Behaviour in School-aged Children (HBSC) is an instrument of analysis of lifestyle behaviours related to nutrition, physical activity, relaxation, addiction, injuries, hygiene, and sexuality .
There is evidence concerning to what extent and in what ways the behaviours assessed in the HBSC influence adolescent health in the areas of nutrition [3–11], physical activity [12–18], relaxation [19–26], addictions [27–39], and personal hygiene [40–43]. That is why creating questionnaires that assess lifestyle at this age is crucial to study all the dimensions of public Health in this population.
There are currently several tools to assess and rate the healthiness of lifestyle, including FANTASTIC [44–46], Health Promoting Lifestyle Profile II (HPLP II) , and Personal Lifestyle Questionnaire (PLQ) . All of these tools are validated but either are not specific for adolescents or are antiquated and do not include certain lifestyles of today's teens (for example those habits related to the use of new technologies and online contacts through social networking). Moreover, some were developed on the basis of different Spanish cultures , or are long and require an excessive time burden on the respondent. Other studies use questionnaires prepared ad hoc, evaluating only certain dimensions related to lifestyle, most of them related to nutrition and physical activity issues [50, 51]. In all cases, it was concluded that lifestyle significantly affects the health of adolescents [52–55].
The use of questionnaires as an evaluation tool in the field of health is widespread but it is necessary to have adequate criteria in order to obtain good quality of the information assessed. The Scientific Advisory Committee (SAC) of the Medical Outcomes Trust proposed a several useful criteria  as the basis to develop standardised assessment tools for measurements from patient reports, which are known as Patient-Reported Outcome Measures (PROMs). These criteria include the assessment of the psychometric qualities of the instrument, the need for participation of the target population in the conceptualisation phase, and taking into account the effects of the administration, both for those who administer and those who respond to the questionnaire. In 2008, Valderas et al. publish a study was aimed to develop a tool for the standardized assessment of patient-reported outcomes (PROs) to assist the choice of instruments .
Because lifestyle is largely conditioned by the environment, an instrument to assess lifestyle in adolescents in Catalonia (Spain) should be developed taking into account the characteristics of this age group and the cultural characteristics of the society in which they reside.
The objective of this study was to develop and validate a scoring questionnaire to assess the healthy lifestyle of Catalan adolescents (VISA-TEEN) that is also user-friendly and can be answered quickly. The questionnaire was called VISA-TEEN, an acronym from Spanish language (VIda SAludable = Healthy Life) and Teen, as the participants were adolescents.
Ethics approval was obtained from the Research Ethics Committee (Faculty of Psychology, Education and Sport Sciences, University Ramon Llull). The study was conducted in accordance with the tenets of the Declaration of Helsinki. This study was a self-administrated questionnaire, and at the end, the decision to answer it was from the own students. The school accepted to participate in the project, and the Head of the institution signed the consent. The questionnaire was anonymous, and we guaranteed that the data and the results were going to be totally confidential, and they would only be used globally (the sample of all the schools), not to evaluate particularly each student. The confidentiality was also maintained during data analysis by delinking questionnaire data from any personal identification information. For those under 16, the principal's written agreement was first obtained. The regional regulations state that Catalonia school boards and principals should inform parents and collect their consent regarding any extracurricular activity. The research ethics committee also confirmed that the Head’s signature covered the permission to analyse the data of each class group.
Development of VISA-TEEN
The project was developed in two phases. The questionnaire was developed in the first phase and validated in the second phase. Previously, a review of the definitions of "lifestyle" and its relation to health was conducted. The focus of the search was on those investigations that limited the study to the field of adolescence. For this purpose, the PubMed, PsycINFO, SPORTDiscus, and SciELO databases were consulted, and two focus groups were subsequently organised. The literature review yielded information on the types of questions from existing questionnaires. Evidence of the influence of several indicators on the health of adolescents was also obtained from literature, as well as recommendations provided by various institutions regarding this.
The participation of the population under study was effective based on the results of two focus groups. One group consisted of eight adolescents from four schools in the city of Barcelona. The criteria to select the adolescent participants were based to obtain the highest representation. The other group was made up of five professionals in the following fields: adolescent medicine, adolescent eating behaviour disorders, psychology, information technology and communication, and a teacher specialising in high-risk adolescents. In both groups, the discussion began with the moderator prompting them to describe the day of an adolescent from rising until going to sleep. The two sessions were recorded and transcribed. Contents analysis was the one we applied. Through a process of segmentation and codification, we got a list of indicators. Using TextSTAT© 2.8.g software by Matthias Hüning, a list of frequently used words was extracted. These words were then analysed in context using ATLAS.ti© Version 6.0 software developed by ATLAS.ti© Scientific Software Development GmbH, and a first list of lifestyle indicators for adolescents was developed. This first list was submitted for the judgement of a panel of six experts in health, anthropology, and education and health care. The experts were asked to point out which of the indicators could be used to value the adolescents' lifestyle. A second list of the most common indicators obtained according to those experts' opinions was made, and later the process was repeated with this second list to get a final list of indicators that should be included in the questionnaire.
With this information, we proceeded to the development of the questions. Mixed responses were chosen (some ranking, others numerical, and others closed-response multiple choice). Some questions could contain more than one item. A score rating between 0 and 3 was assigned to each item depending on the response and based on the influence on health as evidenced in the literature review as follows: 0 points for the least healthy response, not suited to the recommendations; and 3 points for the healthiest response, exactly suited to the recommendations. If the answer was not at either of these two extremes, it was scored with 2 points if it promoted health or 1 point if it could be harmful. The questionnaire was completed with a number of socio-demographic variables (month and year of birth, country of birth of the adolescent and their parents, sex, height, and weight) that were subsequently used to analyse possible relationships with these lifestyle factors.
The instrument was developed with the aim of being appealing to the target population and with a design such that it could be answered quickly. The layout was designed as a DIN-A5 booklet format with colour front and back covers and a white interior. One or two questions were included on each page, and it was illustrated with drawings to make the instrument more user-friendly.
The questionnaire was distributed to 67 adolescents at a secondary school in Barcelona. They were asked to give each item a quantitative and qualitative assessment of comprehensibility. Using the information collected, we proceeded to reformulate some statements, and questions were reordered following the proposals made by some of the adolescents. Likewise, the number of possible responses to the closed-response questions was reduced. The resulting questionnaire consisted of 11 questions drawn from 15 scoring items. This was the questionnaire that was used in the second phase.
Validation of the VISA-TEEN questionnaire
The second phase was the psychometric validation of the questionnaire. It was given to a sample of 419 adolescents on two occasions, 15 days apart. The participants were from five institutions in Catalonia, three of which were public and two of which were privately owned. Three institutions were classified as urban, one was suburban, and one was rural. Participating students were 13 to 19 years of age. Of the first set of questionnaires, 396 were returned, and 253 were returned from the second set. Questionnaires were identified with a code to ensure anonymity. On the first occasion, the KIDSCREEN-10 questionnaire , which assesses HRQoL in adolescents, and the SRH [59, 60], which provides information on perceived health status, were also administered.
Reliability: internal consistency and temporal stability
To assess reliability, temporal stability was analysed by calculating the ICC between scores from the first and second occasions, internal consistency was analysed using Cronbach's α coefficient and stratified α (indicated when the scales have more than one dimension) [61–63], and individual item analysis was analysed by calculating the corrected item-total correlations and α, if the item was removed. Reference values for assessing the ICC were proposed by Domenech , where values above 0.41 were considered moderately good, and values above 0.75 were very good. To assess internal consistency, we used reference values for α proposed by Morales , who considered values greater than 0.6 as acceptable in descriptive population studies.
Content validity, criterion, and construct
Content validity was confirmed from the analysis of the indicators executed by the panel of experts in the development phase of the questionnaire. Construct validity was assessed by testing the factorial structure with exploratory factor analysis (EFA). The principal components method was used, and the rotated matrix was extracted with varimax orthogonal rotation. In addition, once the components were obtained, the IFFS was calculated for each component. This index can replace the coefficient α of each factor when the factors are composed of a small number of items . Values greater than 0.60 are considered acceptable IFFS, and values greater than 0.80 are considered “very good” .
The correlation between the score on the questionnaire and that obtained in the KIDSCREEN-10 was studied with Pearson’s linear correlation coefficient. The association of the scores with the SRH was assessed in order to analyse the differences between the various categories of this indicator. Higher scores were expected in those adolescents who showed better health. The analysis of these differences was performed using a one-way ANOVA with post hoc contrasts. Scores from each component (factor scores) were calculated as the mean scores of the elements that composed it. The association of scores on the various components of the questionnaire with sex, age, and purchasing power, measured with the Family Affluence Scale (FAS), was also analysed. To avoid potential interactions, these associations were assessed based on a multiple linear regression analysis. Additionally, the provenance of the adolescent was introduced into the equation to assess potential confounding effects. The accepted level of significance for all tests was 0.05.
Criterion validity had to be reaffirmed from content validity and construct  due to the lack of an error-free “Gold Standard” that assesses the healthy lifestyle of adolescents. The discriminatory power of the questionnaire was evaluated by calculating Ferguson’s δ coefficient modified for the total score of the questionnaire.
The results of changing the scores or eliminating any of the items were assessed, and the definitive version of the instrument was obtained.
The calculation of the scores and the analyses of different parameters were performed using IBM SPSS Statistics 20.0 software.
Characteristics of participants
Table 1 summarises the characteristics of the participants (sample size, descriptions of age and sex) in each of the phases of development and validation of the questionnaire.
Development of VISA-TEEN questionnaire
From the literature review, it was found that lifestyle, when framed in the field of health and youth, identifies with eating habits, physical activity, addiction, relaxation, hygiene, sexuality, and injury.
Textual analysis of the transcripts of the focus group extracted a list of 37 concepts, of which the most prevalent were "parents" (frequency of appearance (fap) = 48), followed by "friends" (fap = 33), "Messenger/Facebook/mobile/talk (on-line)" (fap = 26), and "sport" (fap = 22). For the concepts of "play/game (computer, consoles)", "eat", "sleep", and "smoking", the frequencies were 13, 12, 9, and 5, respectively.
The analysis of the 37 concepts in context resulted in a total of 31 identifiable codes that, once subjected to the judgement of the experts, were made specific to the indicators that would be contained in the questionnaire. Table 2 displays these indicators.
The questionnaire, which was developed after analysing the types of habits that influenced each indicator in an obvious way, comprised 10 questions (some of the indicators included more than one question). The information collected to assess the different indicators is shown below:
Diet: Questions were formulated referring to the frequency of ingestion of the different food groups, the amount of liquid, and the amount of soft drinks.
Physical activity: Questions were asked regarding the hours of physical activity undertaken each day, in reference to recollections of the previous week. To discriminate the intensity, an indicative reference proposed in the Talk Test was used [69–72].
Substance abuse: Questions focused on the consumption of alcohol, tobacco, cannabis, and other illegal drugs.
Relaxation: A question was developed regarding the hours of sleep on school nights.
Hygiene: The indicator included a question referring to the daily frequency of hand-washing and another referred to the daily frequency of tooth-brushing.
Social networks and electronic games: The question asks to quantify numerically (in hours) the time spent each day communicating online with other people and playing electronic games, and school days and the weekend were differentiated.
Having assessed the comprehensibility of the questions in a sample of 67 adolescents, the final questionnaire was drafted, which consisted of 11 questions with 15 scoring items.
Reliability: internal consistency and temporal stability
To assess reliability (internal consistency and temporal stability), a total of 419 questionnaires were administered, of which 396 were valid. The values of α and stratified α were 0.66 and 0.77, respectively. The value of α did not vary significantly with the elimination of any item. A detailed analysis of each item is shown in Table 3.
The second round of questionnaires yielded 253 responses, of which 228 were valid and could be correlated with the first round. The ICC for the total scores was 0.860 (95 % confidence interval, 95 % CI; 0.82–0.89). Calculated values for each item are presented in Table 4.
Content validity, criterion, and construct
The Kaiser-Meyer-Olkin (KMO) measure of the sampling adequacy was found to be 0.693, and Bartlett’s test concluded that the hypothesis of sphericity could be rejected (p < 0.001). These two values confirmed the appropriateness of performing an exploratory factor analysis (EFA). Five components with eigenvalues greater than 1, explaining 59.55 % of the variance, were extracted. The first component included items that questioned the amount of moderate-intensity physical activity performed every day of the week and was designated as physical activity. The second component included items that asked about the consumption of tobacco, alcohol, and other drugs and was designated as substance abuse. The third component, which included two elements related to the use of the Internet and electronic games and to hours of sleep, was designated as Rational Use of Technological Leisure (RUTL). The fourth component, containing questions related to the frequency of hand-washing and tooth-brushing, was designated as hygiene. The last component contained a question about the order of consumption of different types of nutrients and the frequency of intake of fluids and non-alcoholic beverages. This last component was designated diet. Table 5 summarises this analysis. The weight of each element in the corresponding factor is shown, as is the IFFS of each component.
The correlation between the total score on the questionnaire and that obtained in KIDSCREEN-10 was 0.21 (p < 0.001). With respect to the association of questionnaire scores with SRH, it was found that the total scores of the VISA-TEEN questionnaire were significantly different depending on the category manifested in the perceived health status. Figure 1 shows these results, and Tables 6 and 7 show the results of the ANOVA and post hoc tests, respectively.
After analysing the association between the scores of the different components of the VISA-TEEN and the variables sex, age, and FAS II, it was concluded that age was negatively associated with all components except hygiene, which is associated with sex. Physical activity is associated with both age and sex. None of the components showed significant association with purchasing power (FAS II). The provenance of the adolescent was determined to not be a confounder, and therefore, it was not necessary to adjust the results based on this variable. Table 8 summarises these results.
The discriminatory power of the instrument, assessed from the modified Ferguson’s δ coefficient, was 0.972.
The analysis of the different instruments and questionnaires used to assess the lifestyles of adolescents, both globally and nationally or locally, has been shown that there are few instruments that assess lifestyle healthiness using a summary score that takes into account all components of this study. Moreover, few are validated in Spanish, and there are none for the adolescent population. The VISA-TEEN rates adolescents’ lifestyle quantitatively and includes 5 components: Physical activity, Substance abuse, RUTL, Hygiene and Diet. These components can be assessed separately with other validated questionnaires [51, 73, 74] and are also mentioned in other questionnaires [2, 50, 75]. Unfortunately these last tests are not rated.
Questionnaire development phase
After the Focus Group transcription were analysed, the relevant variables to evaluate adolescents’ were: nutrition, physical activity, substance abuse, relaxation, hygiene, and the use of technology for communication or for leisure. No questions related to sexuality were considered because the data on the initiation of sexual intercourse in Catalonia indicate that adolescents initiate sexual activity at 15.8 years of age for girls and 15.7 years of age for boys . In secondary school, 65.3 % of boys and 72 % of girls had not engaged in sexual intercourse , and thus, this component was not included because it would be irrelevant to a large group of adolescents.
In the past five years, there are not published validations of questionnaires that have scored using all of these variables. However, there are some who value certain variables separately. In 2011, Wright et al.  validated the HABITS questionnaire to assess lifestyle in children 7–16 years of age. It consists of 19 items with closed-response questions related to diet (frequency of consumption of different types of food and drinks) and the time spent watching television and playing electronic games. In 2012, Muchotrigo validated the Healthy Lifestyle Questionnaire (Cuestionario de Estilo de Vida Saludable, in Spanish)  for university students. In this case, 26 items with Likert-type responses are grouped into the following three components: sports activities, diet, and relaxation/sleep. Other studies have not validated instruments to assess lifestyle but may include this variable in some of analyses based on other questionnaires. In 2009, Vereecken et al.  studied the relationship between breakfast habits and lifestyle in adolescents 11 to 15 years of age from 45 countries. To assess lifestyles, questions were based on issues relating to substance abuse (alcohol and tobacco), physical activity, hours watching television, and eating habits (consumption of vegetables, fruit, and soft drinks) that appear in the HBSC.
Furthermore, other questionnaires that assess lifestyle include other variables. In 2012, Taymoori et al. published the validation of the Healthy Lifestyle Questionnaire (HLQ) for Iranian adolescents . The final version consisted of 36 items drawn from different questionnaires on lifestyle of adolescents that are grouped into the following six factors: life appreciation, health responsibility, nutrition, social support, physical activity, and stress management. In 2013, Dinzeo et al. validated an abridged version of the Lifestyle and Habits Questionnaire (LHQ) for young (18–25 years of age) university students in the United States. The original version of LHQ consisted of 80 items, and its validation was published in 1998 . The new version contains 42 items grouped into the following eight factors: physical health and fitness, psychological health, substance abuse, nutrition, environmental awareness, social awareness, accident prevention, and the meaning of life. Despite their multidimensional approach, both of the questionnaires were noted to be missing questions related to topics that are important for teens, such as the use of the Internet to interact and communicate. Both questionnaires (HLQ and LHQ) use Likert-type responses.
In the four questionnaires mentioned above, questions always have closed responses. The VISA-TEEN also contains closed-response questions but includes open-response quantitative questions and one ordered-choice question as well. Open-response questions of a quantitative type permit more accurate information to be obtained about variables for which it is more important to know a number (hours, cups) rather than an approximate interval or a qualitative assessment of frequency of performance or consumption. Other questionnaires that also use open-response questions are of a quantitative type. Some examples include the International Physical Activity Questionnaire (IPAQ), which poses questions concerning time in hours and minutes devoted to performing different types of physical activity during the past seven days , and Systematic Interrogation of Alcohol Consumption (Interrogatorio Sistematizado de Consumos Alcohólicos, in Spanish) (SALGA), Department of Health of the Government of Catalonia , which poses questions related to the number of standard drink units (SDUs) consumed in one week.
The analysis of the items in this study showed that all had good comprehensibility. The item that was rated as the most difficult was item number 4, concerning moderate and intense physical activity performed each day in reference to the previous week. The mean and median difficulty of this item were 3.11 and 3 points, respectively, based on a scale ranging from 0 to 10 (10 is the maximum difficulty). Qualitative inputs made by some of the subjects about this item suggested it should be divided into two parts. Additionally, examples of each type of activity were added to the final version of the questionnaire, thus facilitating the response process. All other items showed an average difficulty from 0.29 (question 9 concerning hand-washing and tooth-brushing) to 0.93 (question 1 related to food intake). In the latter case, it was considered especially important for this question to present a low difficulty, as ordered response questions tend to be difficult to answer . In this item, this type of question was considered most suitable for assessing the adequacy of consumption of different types of food reported by adolescents with respect to the food pyramid. The pyramid, in its latest version (2012), does not specify the portions of different types of foods to consume but rather establishes an order of consumption (daily, weekly, and occasional) .
The average response time was 19.2 min. This duration is less than the maximum of 30 min recommended for studies where an interviewer applies the questionnaire . It is similar to other questionnaires presented to school groups in European studies, such as KIDSCREEN-52, which requires 15 to 20 min to complete .
The diversity in the types of questions could complicate the comprehensibility and the response process by adolescents. To avoid these errors in the response process, and responding to suggestions made by some subjects who participated in the evaluation of comprehensibility, questions were ordered by type of response (ordered-choice followed by quantitative-response followed by closed-response) and instructions for answering each type were provided.
Validation phase of the questionnaire
The sex distribution (45.6 % girls/54.4 % boys) did not differ significantly from that of the general population (48.4 % girls/51.6 % boys) , and this age distribution was expected because after 16 years, the age of completion for compulsory education, the number of adolescent students decreases.
The distribution of the different spending levels according to the categorisation made using FAS II showed that more than three-quarters of the adolescents were classified in the "high" group. This apparent imbalance is because the proposed break points date from 2002, and there are indicators in FAS II that have changed substantially since then. The number of computers, for example, has increased in every household. This imbalance can be a source of bias that must be kept in mind when interpreting results where purchasing power is a factor. A study on the relationship between dietary habits of adolescents and purchasing power reaches the same conclusion and states the need to develop new, appropriate, and specific indicators to assess the socioeconomic status of adolescents .
Reliability: internal consistency
Regarding reliability, the value of both α and stratified α is above 0.65, thus demonstrating acceptable internal consistency that permits the use of the questionnaire in descriptive population studies, the objective for which the questionnaire was developed. The analysis of the characteristics of each item helped to confirm that there were none that needed to be removed to significantly increase the value of α. The corrected item-total correlations ranged between 0.138 and 0.423. Because the correlation was significant in all cases, and after verifying that the removal of any item did not improve the value of α, it was decided to retain all items for the final version. Even items that had less than a 0.20 (but significant) correlation remained in the questionnaire because it was decided that they provided interesting and necessary lifestyle information about adolescents.
The reliability (temporal stability) studied using the ICC obtained for the lifestyle total score demonstrated a very good agreement between the two occasions. In the individual analysis of each item, values ranged from 0.54 (good agreement) to 0.95 (very good agreement). Therefore, the items studied were accepted. Content validity was validated by the theoretical analysis, the involvement of stakeholders, and the classification conducted by the experts in the development phase of the questionnaire.
In terms of construct validity (EFA and IFFS), from the assessment of exploratory factor analysis, five components were extracted. Four were expected, and each contained items that were conceptually related (physical activity, substance abuse, hygiene, and diet). A fifth component, which was designated as RUTL, contained items related to entertainment technology and sleep. The relationship between these two variables and confirmation that they can be studied within a single component is supported by studies demonstrating the relationship between these variables. In 2013, Spies, Shapiro and Margolin analysed the existing evidence on the relationship between the use of social networking and psychosocial development of adolescents. Among other consequences, the authors found a relationship between intensive computer use, including online communications, and hours and quality of sleep . The same year, Wolniczak et al. found a dependent relationship between Facebook and sleep quality . Also in 2013, Don et al. concluded that excessive Internet use negatively influences health because of its relationship with few hours of sleep .
The IFFS values were acceptable for the RUTL and hygiene components and very good for physical activity, substance abuse, and diet. Therefore, the items assigned to each component are adequate, and the components are sufficiently independent from each other to allow for separate analysis.
For construct validity (hypothesis testing), first, the relationship between the total score for VISA-TEEN and that obtained for KIDSCREEN-10 was assessed. The correlation coefficient between the scores on the two questionnaires was r = 0.21 (p < 0.001). This correlation, though weak, is significantly different from 0 and is positive. Additionally, it is superior to the one that presents the same KIDSCREEN with physical health measurement offered by the Child Health Questionnaire (CHQ), which is r = 0.15 .
Second, the association between the total score on the VISA-TEEN and the assessment of perceived health was checked using the SRH. Scores were found to be significantly different when they were ordered by group, observing that the best scores for lifestyle corresponded to adolescents who reported excellent health, and the worst scores were for those who reported having poor health. In the intermediate group, scores for VISA-TEEN diminished when perceived health worsened. Post hoc tests showed that there were differences between all groups except between "Excellent" and "Very Good" and between "Fair" and "Poor". A relationship between some of the components of lifestyle and SRH was also found in the study conducted in Spain by Giron in 2012 , which concluded that diet and substance abuse influence the perception of health in young people, and in the study conducted in Greece in 2011 by Darviri et al. , which concluded that the factor most correlated with low SRH in adolescents is little physical activity.
Finally, the relationship of the various components of lifestyle with age, sex, and purchasing power was demonstrated. All components except hygiene were negatively associated with age (older, lower score). This tendency for declining health with age coincides with that found in other studies. Thus, in the case of physical activity, the HELENA study conducted throughout Europe shows how the average hours of daily physical activity diminishes with age (2 h at 13 years of age, 1.4 h at 17) . With respect to substance abuse, increased risk behaviour with age can be found in both the HBSC-2010 worldwide  and in the local-level FRESC-2012 . As for diet, Diaz and Trave found that the KidMed rate of adherence to the Mediterranean diet diminishes with age . Additionally, both the HBSC-2010 and the FRESC-2012 show that consumption of fruit and the percentage of adolescents who eat lunch daily decreases with age. As for entertainment technology, results from FRESC-2012 show that the time spent chatting increases from 13 to 16 years of age, and then decreases slightly. The relationship with purchasing power was not significant for any component. This is inconsistent with other studies, such as HBSC-2010 , which did find an association between some of the components studying lifestyle and purchasing power. This fact could be due to the statement previously mentioned above, namely, an update of the criteria used to establish the socio-economic levels may be necessary because such an update has not been performed since 2002.
According to the way that EMPRO specifies assessing the quality of questionnaires results perceived by patients , criterion validity must be evaluated when there are shortened versions of existing validated questionnaires. This is not a prerequisite for new questionnaires, as it often happens that other validated measures assessing the same construct (gold standard) do not exist in order to make the comparison. In our case, we did not have a validated instrument that we could use as a criterion, and therefore, the criterion validity was assumed to be reaffirmed by the construct and content.
With respect to discriminatory power, the value of δ = 0.972 indicates that the questionnaire provides good discrimination. The KIDSCREEN questionnaire, which assesses HRQoL, provides discriminatory power between 0.94 and 0.98 in different versions of 52, 27, or 10-items .
The VISA-TEEN questionnaire developed in this study to assess the lifestyle of Catalan adolescents can be considered valid for its application in this population group (Additional files 1 and 2). It includes the following five components: diet, substance abuse, RUTL, hygiene, and physical activity. In addition, it has been shown to be quick and easy to answer, which bodes well for applicability.
Validity and reliability results show that this can be a good instrument to evaluate adolescents’ lifestyle, and can also be used to understand the role of how lifestyle influences adolescents. Moreover, it will also be useful to evaluate the efficacy of campaigns specifically designed to improve their lifestyle.
The World Health Organization
Health behaviour in school-aged children
- HPLP II:
Health promoting lifestyle profile II
Personal lifestyle questionnaire
Scientific advisory committee
Patient-reported outcome measures
Family affluence scale
Rational use of leisure technology
Healthy lifestyle questionnaire
Lifestyle and habits questionnaire
Standard drink units
Child health questionnaire
WHO. Health Promotion Glossary. Geneva: World Health Organitation; 1997.
Moreno C, Ramos P, Rivera F, Jimenez-Iglesias A, García A. Las conductas relacionadas con la salud y el desarrollo de los adolescentes españoles. Resumen del estudio Health Behaviour in School Aged Clidren (HBSC-2010). Madrid: Ministerio de Sanidad, servicios sociales e igualdad; 2012.
Maynard M, Gunnell D, Emmett P, Frankel S, Davey SG. Fruit, vegetables, and antioxidants in childhood and risk of adult cancer: the Boyd Orr cohort. J Epidemiol Community Health. 2003;57(3):218–25.
McGartland C, Robson PJ, Murray L, Cran G, Savage MJ, Watkins D, et al. Carbonated soft drink consumption and bone mineral density in adolescence: the Northern Ireland Young Hearts project. J Bone Miner Res Off J Am Soc Bone Miner Res. 2003;18(9):1563–9.
Gonzalez-Gross M, Gomez-Lorente JJ, Valtuena J, Ortiz JC, Melendez A. The “healthy lifestyle guide pyramid” for children and adolescents. Nutr Hosp. 2008;23(2):159–68.
Libuda L, Alexy U, Remer T, Stehle P, Schoenau E, Kersting M. Association between long-term consumption of soft drinks and variables of bone modeling and remodeling in a sample of healthy German children and adolescents. Am J Clin Nutr. 2008;88(6):1670–7.
Verzeletti C, Maes L, Santinello M, Vereecken CA. Soft drink consumption in adolescence: associations with food-related lifestyles and family rules in Belgium Flanders and the Veneto Region of Italy. Eur J Public Health. 2010;20(3):312–7. Available from.
Malik VS, Popkin BM, Bray GA, Despres JP, Willett WC, Hu FB. Sugar-sweetened beverages and risk of metabolic syndrome and type 2 diabetes: a meta-analysis. Diabetes Care. 2010;33(11):2477–83.
Park S, Sherry B, O’Toole T, Huang Y. Factors associated with low drinking water intake among adolescents: the Florida Youth Physical Activity and Nutrition Survey, 2007. J Am Diet Assoc. 2011;111(8):1211–7.
Rey-Lopez JP, Vicente-Rodriguez G, Repasy J, Mesana MI, Ruiz JR, Ortega FB, et al. Food and drink intake during television viewing in adolescents: the Healthy Lifestyle in Europe by Nutrition in Adolescence (HELENA) study. Public Health Nutr. 2011;14(9):1563–9.
Diethelm K, Jankovic N, Moreno LA, Huybrechts I, De Henauw S, De Vriendt T, et al. Food intake of European adolescents in the light of different food-based dietary guidelines: results of the HELENA (Healthy Lifestyle in Europe by Nutrition in Adolescence) Study. Public Health Nutr. 2012;15(3):386–98.
Menschik D, Ahmed S, Alexander MH, Blum RW. Adolescent physical activities as predictors of young adult weight. Arch Pediatr Adolesc Med. 2008;162(1):29–33.
US Department of Health and Human Services. 2008 physical activity guidelines for Americans. Washington, DC: Department of Health and Human Services; 2008.
Manonelles P, Alcaraz J, Álvarez J, Jimenez F, Luengo E, Manuz B, et al. La utilidad de la actividad física y de los hábitos adecuados de nutrición como medio de prevención de la obesidad en niños y adolescentes. Documento de consenso de la Federación Española de Medicina del Deporte (FEMEDE). Arch Med del Deport. 2008;XXV(5):333–53.
WHO. Recomendaciones mundiales sobre actividad física para la salud. Geneve: Organización Mundial de la Salud; 2010.
Wen CP, Wai JP, Tsai MK, Yang YC, Cheng TY, Lee MC, et al. Minimum amount of physical activity for reduced mortality and extended life expectancy: a prospective cohort study. Lancet. 2011;378(9798):1244–53.
World Health Organization regional office for Europe. Promoting sport and enhancing health in European Union countries: a policy content analysis to support action. Copenhagen: publications WHO regional office for Europe; 2011.
Moore SC, Patel AV, Matthews CE, Berrington de G, Park Y, Katki HA, et al. Leisure Time Physical Activity of Moderate to Vigorous Intensity and Mortality: A Large Pooled Cohort Analysis. PLoS Med. 2012;9(11):e1001335. Available from: http://dx.doi.org/10.1371/journal.pmed.1001335.
Goel N, Rao H, Durmer JS, Dinges DF. Neurocognitive consequences of sleep deprivation. Semin Neurol. 2009;29(4):320–39.
Lumeng JC. Future directions for research on sleep durations in pediatric populations. Sleep. 2010;33(10):1281–2.
Axelsson J, Sundelin T, Ingre M, Van Someren EJ, Olsson A, Lekander M. Beauty sleep: experimental study on the perceived health and attractiveness of sleep deprived people. BMJ. 2010;341:c6614.
Chien KL, Chen PC, Hsu HC, Su TC, Sung FC, Chen MF, et al. Habitual sleep duration and insomnia and the risk of cardiovascular events and all-cause death: report from a community-based cohort. Sleep. 2010;33(2):177–84.
Garaulet M, Ortega FB, Ruiz JR, Rey-Lopez JP, Beghin L, Manios Y, et al. Short sleep duration is associated with increased obesity markers in European adolescents: effect of physical activity and dietary habits. The HELENA study. Int J Obes. 2011;35(10):1308–17.
Buxton OM, Cain SW, O’Connor SP, Porter JH, Duffy JF, Wang W, et al. Adverse metabolic consequences in humans of prolonged sleep restriction combined with circadian disruption. Sci Transl Med. 2012;4(129):129ra43.
Morselli LL, Knutson KL, Mokhlesi B. Sleep and insulin resistance in adolescents. Sleep. 2012;35(10):1313–4.
Leger D, Beck F, Richard J-B, Godeau E. Total Sleep Time Severely Drops during Adolescence. PLoS One. 2012;7(10):e45204. doi:10.1371/journal.pone.0045204.
Frazier AL, Fisher L, Camargo CA, Tomeo C, Colditz G. Association of adolescent cigar use with other high-risk behaviors. Pediatrics. 2000;106(2):E26.
Salleras L, Taberner JL. Guia per a la prevenció i el control del tabaquisme des de l’àmbit pediàtric. Barcelona: Generalitat de Catalunya. Departament de Sanitat i Seguretat Social. Direcció General de Salut Pública; 2003.
Altarriba FX, Bascones A. Libro blanco sobre la relación entre adolescencia y alcohol en España. Madrid: Fund Alcohol y Sociedad; 2006.
García A. Guia de recomendaciones clínicas: Alcoholismo. Astúrias: Dirección General de Calidad e Innovación en Servicios Sanitarios. Govierno de Asturias; 2008.
Ochoa Mangado E, Madoz-Gúrpide A, Vicente MN. Diagnóstico y tratamiento de la dependencia de alcohol. Med Segur Trab. 2009;55(214):26–40.
Klempova D, Sánchez A, Vicente J, Barrio G, Domingo A, Suelves JM, et al. Consumo problemático de cannabis en estudiantes españoles de 14–18 años: validación de escalas. Madrid: Ministerio de Sanidad y Política Social; 2009.
Shapiro GK, Buckley-Hunter L. What every adolescent needs to know: cannabis can cause psychosis. J Psychosom Res. 2010;69(6):533–9.
Park SH. Smoking and adolescent health. Korean J Pediatr. 2011;54(10):401–4.
Casadio P, Fernandes C, Murray RM, Di Forti M. Cannabis use in young people: the risk for schizophrenia. Neurosci Biobehav Rev. 2011;35(8):1779–87.
Degenhardt L, Bucello C, Calabria B, Nelson P, Roberts A, Hall W, et al. What data are available on the extent of illicit drug use and dependence globally? Results of four systematic reviews. Drug Alcohol Depend. 2011;117(2–3):85–101.
Madruga CS, Laranjeira R, Caetano R, Pinsky I, Zaleski M, Ferri CP. Use of licit and illicit substances among adolescents in Brazil: a national survey. Addict Behav. 2012;37(10):1171–5.
Tsiligianni IG, Vardavas CI, Bouloukaki I, Kosmas E, Verigou E, Kiriakaki M, et al. The association between alcohol and tobacco use among elementary and high school students in Crete, Greece. Tob Induc Dis. 2012;10(1):15.
Puente D, Zabaleta-Del-Olmo E, Pueyo MJ, Salto E, Marsal JR, Bolibar B. Prevalencia y factores asociados al consumo de tabaco en alumnos de enseñanza secundaria de Cataluña. Aten Primaria. 2013;45(6):315–23.
Elena MV. Evaluación del estado de salud bucodental y su relación con estilos de vida saludables en la provincia de Salamanca. Salamanca: Universidad de salamanca, Facultad de Medicina; 2008.
Tagliaferro EP, Ambrosano GM, Meneghim Mde C, Pereira AC. Risk indicators and risk predictors of dental caries in schoolchildren. J Appl Oral Sci. 2008;16(6):408–13.
Lau CH, Springston EE, Sohn MW, Mason I, Gadola E, Damitz M, et al. Hand hygiene instruction decreases illness-related absenteeism in elementary schools: a prospective cohort study. BMC Pediatr. 2012;12:52.
Holmberg M, Public health and infections: Health in Sweden. The National Public Health Report 2012. Chapter 15. Scand J Public Health. 2012;40(9 Suppl):275–80.
Wilson DMC, Ciliska D. Lifestyle Assessment. Can Fam Physician. 1984;30:1527–32.
Lopez-Carmona JM, Rodríguez R, Munguí¬a C, Hernández JL, Casas E. Validez y fiabilidad del instrumento FANTASTIC para medir el estilo de vida en pacientes mexicanos con hipertensión arterial. Atención primaria. 2000;26(8):542–9.
Rodríguez-Moctezuma R, López JM, Munguí¬a C, Hernández JL, Martí¬nez M. Validez y consistencia del instrumento FANTASTIC para medir el estilo de vida en pacientes mexicanos con diabetes mellitus tipo 2. Rev Med. 2003;41(3):215–24.
Walker SN, Kerr MJ, Pender NJ, Sechrist KR. A spanish language version of the Health-Promoting Lifestyles Profile. Nurs Res. 1990;39(5):268–73.
Mahon NE, Yarcheski A, Yarcheski TJ. Psychometric evaluation of the Prsonal Lifestyle Questionnaire for adolescents. Res Nurs Heal. 2002;25(1):68–75.
Taymoori P, Moeini B, Lubans D, Bharami M. Development and psychometric testing of the Adolescent Healthy Lifestyle Questionnaire. J Educ Health Promot. 2012;1:20. doi:10.4103/2277-9531.99221.
Wärnberg J, Ruiz JR, Ortega FB, Romeo J, Gónzalez-Gross M, Moreno LA, et al. Estudio AVENA (Alimentación y valoración del estado nutricional en adolescentes). Resultados obtenidos 2003–2006. Pediatr Integral. 2006;Supl(1):50–5.
Serra-Majem L, Ribas L, Aranceta J, Pérez L, Saavedra P, Peña L. Obesidad infantil y juvenil en España. Resultados del Estudio enKid (1998–2000). Med Clin. 2003;121(19):725–32.
Moukhyer ME, Van Eijk JT, De Vries NK, Bosma H. Health-related behaviors of Sudanese adolescents. Educ Heal. 2008;21(1):1–10.
Sarrafzadegan N, Kelishadi R, Esmailzadeh A, Mohammadifard N, Rabiei K, Roohafza H, et al. Do lifestyle interventions work in developing countries? Finding from the Isfahan Healthy Heart Program in the Islamic Republic of Iran. Bull World Health Organ. 2009;87(1):39–50.
Ruiz-Risueño J. Hábitos deportivos y estilos de vida de los escolares de ESO en los municipios de la provincia de Almería. Retos. 2010;17:49–53.
Russse-Lachance E, Tremblay A, Drapeau V. Lifestyle factors and other health measures in a Canadian university community. Appl Physiol Nutr Metab. 2010;35(4):498–505.
Committee SA. Assessing health status and quality-of-life instruments: attributes and review criteria. Qual Life Res. 2002;11:193–205.
Valderas JM, Ferrer M, Mendivil J, Garin O, Rajmil L, Herdman M, et al. Development of EMPRO: a tool for the standardized assessment of patient-reported outcome measures. Value Health. 2008;11(4):700–8.
Ravens-Sieberer U, Kidscreen Group Europe. The Kidscreen Questionnaires: Quality of Life Questionnaires for Children and Adolescents; Handbook. Lengerich: Pabst Science Publ; 2006.
Idler EL, Angel RJ. Self-rated health and mortality in the NHANES-I Epidemiologic Follow-up Study. Am J Public Health. 1990;80(4):446–52.
Idler EL, Benyamini Y. Self-rated health and mortality: a review of twenty-seven community studies. J Health Soc Behav. 1997;38(1):21–37.
Cronbach LJ, Schönemann P, McKie D. Alpha coefficients for Stratified-Parallel Tests. Educ Psychol Meas. 1965;25(2):291–312.
Feldt LS, Brennan RL. Reliability. Washington DC: American Council on Education; 1989. p. 105–146.
Tenenbaum G, Eklund RC, Kamata A. Introduction to measurement in sport and exercise psychology. In: Tenenbaum G, Eklund RC, Kamata A, editors. Introduction to measurement in sport and exercise psychology. Champaign, IL, US: Human Kinetics; 2012. p. 3–7.
Domenech J. Fundamentos de diseño y estadística. UD14. Medida del cambio: Análisi de diseños con medidas intrasujeto. Barcelona: Signo; 2000.
Morales P. La fiabilidad de los tests i las escalas. Madrid: Publicaciones de la Universidad Pontificia Comillas; 2008.
Morales P. El Análisis Factorial en la construcción e interpretación de tests, escalas y cuestionarios [Internet]. Madrid: UP Comillas; 2013. Available from: http://web.upcomillas.es/personal/peter/investigacion/AnalisisFactorial.pdf.
Fleming JS. An index of fit for factor scales. Educ Psychol Meas. 1985;45(4):725–8.
Batista-Foguet JM, Coenders G, Alonso J. Análisis factorial confirmatorio. Su utilidad en la validación de cuestionarios relacionados con la salud. Med Clin. 2004;122(Supl 1):21–7.
Foster C, Porcari JP, Anderson J, Paulson M, Smaczny D, Webber H, et al. The talk test as a marker of exercise training intensity. J Cardiopulm Rehabil Prev. 2008;28(1):22–4.
Quinn TJ, Coons BA. The Talk Test and its relationship with the ventilatory and lactate thresholds. J Sports Sci. 2011;29(11):1175–82.
Loose BD, Christiansen AM, Smolczyk JE, Roberts KL, Budziszewska A, Hollatz CG, et al. Consistency of The Counting Talk Test For Exercise Prescription. J Strength Cond Res. 2012;26(6):1701–7.
Jeanes EM, Foster C, Porcari JP, Gibson M, Doberstein S. Translation of exercise testing to exercise prescription using the talk test. J Strength Cond Res. 2011;25(3):590–6.
IPAQ [Internet]. International Physical Activity Questionnaire; 2013. Available from: https://sites.google.com/site/theipaq/questionnaire_links.
Young K. Internet addiction: the emergence of a new clinical disorder. Cyberpsychol Behav. 1998;1(3):237–44.
Pérez A, García-Continente X, Grup col·laborador enquesta FRESC-2012. Informe FRESC 2012: 25 anys d'enquestes a adolescents escolaritzats de Barcelona. Barcelona: Agència de Salut Pública de Barcelona; 2013.
Equipo Daphne. Encuesta Bayer Schering Pharma: Sexualidad y anticoncepción en la juventud española [Internet]. Madrid: Grupo DAPHNE; 2009. [citat: 5/6/2013].Available from: http://grupodaphne.com/otrasencuestas.php?y=2009.
Nebot M, Pérez A, Garcia-Continente X, Ariza C, Espelt A, Pasarín M. Informe FRESC 2008. Resultats principals. Barcelona: Agència de Salut Pública de Barcelona; 2010.
Wright ND, Groisman-Perelstein AE, Wylie-Rosett J, Vernon N, Diamantis PM, Isasi CR. A lifestyle assessment and intervention tool for pediatric weight management: the HABITS questionnaire. J Hum Nutr Diet. 2011;24(1):96–100.
Muchotrigo MPG. Estilo de vida saludable en estudiantes de posgrado de Ciencias de la Salud. Psicol y Salud. 2012;22(1):75–87.
Vereecken C, Dupuy M, Rasmussen M, Kelly C, Nansel TR, Al Sabbah H, et al. Breakfast consumption and its socio-demographic and lifestyle correlates in schoolchildren in 41 countries participating in the HBSC study. Int J Public Health. 2009;54 Suppl 2:180–90.
Nevid J, Rathus S, Rubenstein H. Health in the New Millennium. New York: Worth Pub; 1998.
Departament de Salut de la Generalitat de Catalunya. Interrogatori Sistematitzat de Consums Alcohòlics (ISCA) [Internet]. Barcelona: Generalitat de Catalunya; 2013. Available from: http://canalsalut.gencat.cat/web/.content/home_canal_salut/professionals/temes_de_salut/alcohol/documents/arxius/isca.pdf.
Morales P. Medición de actitudes en psicología y educación: construcción de escalas y problemas metodológicos. Madrid: Universidad Pontificia Comillas; 2006.
Agència de Salut Pública de Catalunya. Nova piràmide de l'alimentació saludable 2012 [Internet]. Barcelona: ASPCAT; 2013. Available from: http://canalsalut.gencat.cat/web/.content/home_canal_salut/professionals/temes_de_salut/salut_alimentaria/documents/arxius/piramide2.pdf.
Tolonen H. EHES Manual. Part A. Planning and preparation of the survey [Internet]. Helsinki: National Institute for Health and Welfare; 2013. Available from: http://www.julkari.fi/bitstream/handle/10024/104393/URN_ISBN_978-952-245-842-1.pdf?sequence=1.
Generalitat de Catalunya. Estadístiques [Internet]. Available from: http://ensenyament.gencat.cat/web/.content/home/departament/estadistiques/informacio_estadistica_cursos_anteriors/curs-2011-2012/dades-rellevants/estadistica_2011-12.pdf.
Fismen AS, Samdal O, Torsheim T. Family affluence and cultural capital as indicators of social inequalities in adolescent’s eating behaviours: a population-based survey. BMC Public Health. 2012;12:1036.
Spies Shapiro LA, Margolin G. Growing Up Wired: Social Networking Sites and Adolescent Psychosocial Development. Clin Child Fam Psychol Rev. 2014;17(1):1–18.
Wolniczak I, Caceres-Delaguila JA, Palma-Ardiles G, Arroyo KJ, Solis-Visscher R, Paredes-Yauri S, et al. Association between Facebook Dependence and Poor Sleep Quality: A Study in a Sample of Undergraduate Students in Peru. PLoS One. 2013;8(3):e59087.
Do YK, Shin E, Bautista MA, Foo K. The associations between self-reported sleep duration and adolescent health outcomes: what is the role of time spent on Internet use? Sleep Med. 2013;14(2):195–200.
Giron P. Determinants of self-rated health in Spain: differences by age groups for adults. Eur J Public Health. 2012;22(1):36–40.
Darviri C, Artemiadis AK, Tigani X, Alexopoulos EC. Lifestyle and self-rated health: a cross-sectional study of 3,601 citizens of Athens, Greece. BMC Public Health. 2011;11:619.
De Cocker K, Ottevaere C, Sjostrom M, Moreno LA, Warnberg J, Valtuena J, et al. Self-reported physical activity in European adolescents: results from the HELENA (Healthy Lifestyle in Europe by Nutrition in Adolescence) study. Public Health Nutr. 2011;14(2):246–54.
HBSC España. Health Behaviour in School-aged Children. [Internet]. Available from: http://grupo.us.es/estudiohbsc/index.php/ca/.
Diaz AA, Trave DD. Quality of dietary habits (adherence to a Mediterranean diet) in pupils of compulsory secondary education. An Sist Navar. 2010;33(1):35–42.
We thank the students, teachers and principals of all schools who participated in the study as well as experts who have contributed to the validation of content and those who participated in the focus group at the beginning of the project. We thanks Juanjo Fernandez your help in the questionnaire design. This paper has been partially supported by Research Support Program 2014, Universitat Ramon Llull.
The authors declare that they have no competing interests
LC and MG were responsible for the study conception and design. LC were responsible for the data collection and data analyses and drafted the manuscript. Both authors read and approved the final manuscript.
About this article
Cite this article
Costa-Tutusaus, L., Guerra-Balic, M. Development and psychometric validation of a scoring questionnaire to assess healthy lifestyles among adolescents in Catalonia. BMC Public Health 16, 89 (2015). https://doi.org/10.1186/s12889-016-2778-6
- Scoring questionnaire