- Research article
- Open Access
- Open Peer Review
Sensitivity to change of the Beach Questionnaire to behaviour, attitudes and knowledge related to sun exposure: quasi-experimental before-after study
BMC Public Healthvolume 15, Article number: 60 (2015)
Health questionnaires must present accredited measurement properties such as validity, reliability and sensitivity to change, the latter being essential for interventions to be planned and for evaluating their effectiveness. The aim of this study was to evaluate the sensitivity to change of a Beach Questionnaire.
Quasi-experimental before-after study carried out in 2011, for a study population of adolescents attending schools in the Costa del Sol. First, the questionnaire was administered to the adolescents, after which a multicomponent educational intervention was carried out; finally, three months later, the same questionnaire was re-administered to the same adolescents. Changes were assessed in the categories of each item, using the McNemar test, and the changes in the scores, standardised to a range of 0–100, using the Student t test for paired samples, and including the mean of the differences and the 95% confidence interval. The level of statistical significance was set at p < 0.05.
228 adolescents, aged 14–17 years, and 55.3% were girls. Statistically significant changes were observed in sunburn experiences, exposure to the sun at mid-day and attitudes to sun exposure and suncreams. For the seven items related to knowledge about sun exposure, a higher rate of correct answers was observed. The analysis of changes, within the standardised range, revealed a significant improvement in the scores for sun exposure habits (MD 4.33; CI 95% 2.2-6.5), attitudes to sun exposure (MD 2.22; CI 95% 1.2-3.2) and knowledge (MD 9.10; CI 95% 7.1-11.1), but not in those for sun-protection practices (MD 0.23; CI 95% -1.2-1.7).
The Beach Questionnaire on behaviour, attitudes and knowledge related to sun exposure is the first such instrument in Spanish language to provide sufficient sensitivity to change. It constitutes a useful tool for epidemiologic research into photoprotection and for skin cancer prevention programmes.
The application and analysis of health questionnaires is the most widely used instrument in the study of sun exposure behaviour. The planning and development of interventions, the evaluation of their effects, and numerous epidemiological studies are based on the data obtained from such questionnaires. Nevertheless, on many occasions only limited time and effort are invested in their design [1,2]. To be effective, questionnaires should have accredited measurement properties, that is, validity (the capability to measure the concept for which they were designed), reliability (the capability to measure without error) and sensitivity to change (the capability to detect changes). This latter quality is essential if the questionnaire results are to be properly used to evaluate the effectiveness of an intervention . In recent decades, several countries have conducted skin cancer prevention campaigns and educational interventions in schools aimed at improving attitudes and behaviour regarding solar protection and at reinforcing knowledge in this respect [4-6]. To determine the real impact of such interventions, appropriate measuring instruments must be employed and their psychometric properties correctly evaluated.
In 2009, our research group published its first questionnaire on behaviour, attitudes and knowledge related to sun exposure, a questionnaire that was validated in its Spanish language version. The corresponding study of this questionnaire confirmed the validity and reliability of the scale used . The present study aims to assess the sensitivity to changes in questionnaire responses, for use in future interventions in the field of skin cancer prevention.
Quasi-experimental before-after study focused on evaluating sensitivity to changes in responses to the Questionnaire.
The study was conducted in three phases in 2011: 1) pre-intervention phase: the questionnaire was administered from January to March (the responses given at that time referred to the previous year, 2010); 2) a multicomponent educational intervention was carried out in May and June; 3) a post-intervention phase, in which the same questionnaire was administered to the same adolescents three months after completing the intervention (the responses given referred to the summer of 2011).
Western Costa del Sol (southern Spain) is a mainly tourist-oriented and residential area with a permanent population of 379,334 inhabitants , although the floating population exceeds one million inhabitants in the summer months. Sunbathing on the beach is one of the main attractions for Spanish and foreign tourists in this area.
Population and sample: 200 adolescents aged 14 to 18 years were recruited from secondary schools. To obtain a population size of over 200 individuals completing the questionnaire, pre-and post-intervention, a loss rate of 30% was assumed and an average class size of 25 students was estimated. Therefore, the initial sample size assumed was 300 subjects. Among the 42 secondary schools in the area, 12 classes were selected from simple random sampling of the total, using EPIDAT 3.1 software.
All research was conducted in strict compliance with the Declaration of Helsinki. The ethics committee of the Costa del Sol Hospital has declared that this study protocol is exempted from the requirement for a statement of ethical approval, due to the public health intervention nature of the study. The exemption was obtained before the study began.
To administer the questionnaire, an initial request for participation in the study was addressed to the directors and tutors of each of the classes in the participating schools; subsequently, the parents or guardians of the participating adolescents were informed and their consent was sought. In these classes, randomly selected, all students were invited to participate in the study. Adolescents who did not speak Spanish were excluded from the study population, as the questionnaire is validated exclusively for a Spanish-speaking population .
All the data compiled in this project were recorded anonymously, in strict accordance with the laws and rules on data protection currently in force under Spanish legislation (Act 41/2002 of 14 November; Act 15/1999 of 15 December).
The questionnaire was developed by a group of experts on the basis of studies of sun-related behaviour, and taking into account questionnaires examined in both English and Spanish-language studies. Subsequently, the psychometric properties of validity and reliability were tested, in the latter case with respect both to internal homogeneity and to test-retest stability. The validity of the concept was evaluated by an exploratory principal components factor analysis, from which we obtained two domains for the block of 6 items concerning protection practices, accounting for 55% of the variance, and 4 domains for the block of 14 items concerning attitudes, which accounted for 64% of the variance. The internal consistency of the items for each of the resulting factors was examined using Cronbach’s alpha coefficient, taking significant alpha values as those above 0.70. The stability of the items was estimated by test-retest, assessing the proportion of absolute agreement and intraclass correlation coefficient, for all sections except that of knowledge, for which the delta statistic was used; all items met these criteria .
The questionnaire contained the following sections: 1) Demographic data (3 items); 2) Colour of unexposed skin (1 item); 3) Fitzpatrick phototype (1 item); 4) Habits of sun exposure at the beach (3 items, number of days and number of hours/day [5 response categories] and number of hours/day in the middle of the day [4 response categories]; 5) Sunburn experiences on the beach (1 item), with five response categories (none, 1–2, 3–5, 6–10 or more); 6) Sunscreen practices at the beach (6 items, Likert response format in 5 categories - never, rarely, sometimes, usually, always); 7) Attitudes related to the sun (14 items, 5-category Likert response format, from totally disagree to totally agree); 8) Knowledge related to sun exposure (7 items) with dichotomous response (true or false).
To compare domains with different numbers of items, the following scales were standardised in the range 0–100 [9,10]: habits of sun exposure, sun protection practices, attitudes regarding the sun and knowledge related to sun exposure. Higher scores indicated low sun exposure, good sunscreen practices, positive attitudes to sun protection and good knowledge of sun exposure.
Multicomponent educational interventions of proven efficacy [11-14] were selected for analysis and adapted to the Spanish context, taking into account the results obtained from our prior baseline study . A multi-component intervention was conducted during school hours, with a duration of about 90 minutes and delivered by a dermatologist with experience in occupational training. During this intervention, a slide show provided information about sun exposure, its benefits and risks (such as skin cancer and photoaging), and protection measures, transmitting a positive message. Next, a workshop was held to examine sun-protection creams, the teenagers were familiarised with a dermatoscope  and with the ABCD rule for the early detection of melanoma, and educational videos were shown. At the end of the session, questions were answered and the adolescents contributed ideas or comments on photoprotection. As an additional motivating activity, each class prepared a collage setting out positive and negative messages on photoprotection.
A descriptive analysis was performed of the individuals who completed the questionnaire pre and post-intervention, with measures of central tendency and dispersion for the quantitative variables and of frequency distribution for the qualitative ones. Knowledge of the question was determined by reference to the number of correct answers given. For sun exposure habits, protection practices, attitudes and knowledge, changes were assessed in the categories of each item by reference to the results for the pre and post-intervention questionnaires, using the McNemar test, and the changes in the scores, standardised to a range of 0–100, using the Student t test for paired samples, including the mean of the differences and the 95% confidence interval. In all the analyses, the level of statistical significance was set at p < 0.05.
In the first phase of the study, 308 students were initially recruited, from eleven different schools, eight of which were public and three, private. In this first phase, 38 students were excluded because informed consent was not obtained. Thus, the pre-intervention was completed by 270 students, representing 87.6% of the initial group. After the educational intervention at the participating schools, the post-intervention questionnaire was completed by 228 students, i.e., 84.4% of the pre-intervention sample and 74% of the initial sample.
Among the population of 228 adolescents on which this study was based, 55.3% were girls, 46.9% were aged 14 years and 86.8% were Spanish. 54.3% had light or very light skin and 77.6% were phototype III or IV (Table 1).
In the analysis of change in sun-exposure habits after the intervention, statistically significant differences were observed in the number of hours the study subjects remained on the beach at mid-day (p = 0.049), and borderline significant differences were observed for cases of sunburn (p = 0.051).
Among the sun-protection practices considered, analysis revealed changes in the use of sunshades (p = 0.006) and in avoiding exposure on the beach at mid-day (borderline significant, p = 0.052) (Table 2).
Analysis of pre vs post-intervention change showed that in three of the 14 items in the questionnaire section on attitudes to sun exposure, there were statistically significant differences for the attitudes “I like the feeling of the sun when I’m lying on the beach” (p = 0.002), “I like to sunbathe” (p = 0.001) and “It’s worth using sun-protection creams in the future” (p = 0.025) while the change in the attitude “When I go to the beach I’m more comfortable in the shade” was of borderline statistical significance (p = 0.056) (Table 3).
For the seven items related to knowledge about sun exposure, a higher rate of correct answers was observed in the post-intervention assessment, with statistically significant differences (p < 0.001) for the following items: 1) “If I use sunblock cream I can sunbathe without risk” (68.7% pre-intervention and 92.1% post-intervention); 2) “Avoiding sun exposure at an early age decreases the risk of skin cancer by 80%” (51.6% vs. 70.2%); 3) “Once my skin is brown, I don’t need to continue using sunscreen” (87.7% vs. 96.9%) (Table 4).
The analysis of changes in the scores, standardised to a range of 0–100, revealed a significant improvement in the scores for three of the four sections: sun exposure habits, attitudes to sun exposure and knowledge about sun exposure (p < 0.001) (Table 5).
This study, of an educational intervention aimed at adolescents, highlights the sensitivity to change of the Beach Questionnaire, designed to assess behaviour related to sun exposure. Sensitivity to change is defined as the ability of the measuring instrument to detect changes when an intervention or treatment of known efficacy is performed .
In this study, a multi-component intervention based on previously-evaluated models was addressed at a target group of adolescents. Previous studies have concluded that this age group presents high risk behaviour and is most susceptible to persuasion to change [11-14]. Analysis of the pre and post-intervention results revealed changes had taken place in the answers given to different components of the questionnaire (habits of sun exposure, sunburn experience, sun protection practices, attitudes and knowledge). These changes were statistically significant for some items, with sensitivity being greatest for the questions related to sun exposure at mid-day (sun exposure habit and sun protection practice), sunburn episodes in the most recent summer, attitudes to sun and suncreams (“I like the feeling of the sun on my skin”, “I like sunbathing”, “It’s worth using sun protection creams”) and knowledge (“If I use sunblock cream I can sunbathe without risk”, “Avoiding sun exposure at an early age decreases the risk of skin cancer”, “Once my skin is brown, I don’t need to continue using sunscreen”). By contrast, the items related to photoprotection practices (the use of suncreams and long-sleeved clothes) presented low sensitivity values; this was also true for certain attitudes on suntans and some aspects of knowledge. Perhaps changes in these aspects can only be achieved by maintaining long-term behavioural interventions. With respect to the students’ knowledge of these questions, the results obtained can be attributed to the ceiling effect evident in some of the items, because the baseline level of knowledge was already good. The changes observed are not only consistent but also significant, as they resulted from just one educational intervention, performed over a short period of time.
Although questionnaires have been shown to be valid instruments for measuring sun-protection behaviour , they present considerable variability and comparison is not easy, whether in a single country, between different countries or between different age groups, and so the development of standardised questionnaires represents a great improvement [19,20].
The questionnaire analysis performed in this study will facilitate future epidemiological studies of conduct related to recreational sun exposure, which is the major risk factor for the development of skin cancer; moreover, it contributes to the planning and evaluation of interventions on photoprotection in the context of skin cancer prevention programmes, which is an area of special interest for application in schools.
Of recent studies that have assessed questionnaires regarding sun exposure, some present individual measurement properties that are valid and reliable [1,19,21-24] but to date none have described the sensitivity to change. Therefore, the present study describes the first questionnaire on habits, attitudes and knowledge related to sun exposure at the beach, with sufficient validity, reliability  and sensitivity to change, for use in the field of epidemiologic research and health promotion.
Among its limitations, this study may be affected by selection bias; however, the adolescents included in the study population attend various schools, both public and private, in the Costa del Sol area. Moreover, the measures analysed may be limited by memory errors by the subjects, by the difficulty of estimating the frequency of habits and by social influence; moreover, there have been a differential memory bias with respect to the previous summer in the subject’s responses to the first questionnaire (in the winter) and the second one (after the summer). Nevertheless, the approach adopted is probably the most common means of evaluating this and other areas of health care, such as diet, physical activity and smoking. Another possible limitation is the fact that the intervention took place over a relatively short period of time; even so, the questionnaire is sensitive to changes in some of the sections. In the future, we intend to assess the interventions that produced the greatest impact. Finally, it should be noted that the questionnaire refers to sun exposure at the beach; this environment could usefully be extended to include other areas when sun exposure takes place, such as pools, parks and other recreational areas.
In conclusion, we have developed the first questionnaire on behaviour, attitudes and knowledge related to sun exposure to provide sufficient validity, reliability and sensitivity to change. This questionnaire constitutes a useful tool for epidemiologic research and for skin cancer prevention programmes, as well as for evaluating educational interventions to implement prevention campaigns in Spain and other Spanish-speaking populations. Its use in other countries will require studies of transcultural adaptation and its validation for other languages, to ensure linguistic equivalence and similar psychometric properties in the new cultural environment .
Bränström R, Kristjansson S, Ullén H, Brandberg Y. Stability of questionnaire items measuring behaviours, attitudes and stages of change related to sun exposure. Melanoma Res. 2002;12:513–9.
Rojas Tejada AJ, Fernández Prados JS, Pérez Meléndez C. Investigar mediante encuestas: fundamentos teóricos y aspectos prácticos. Madrid: Síntesis; 1998. p. 155–68.
Carvajal A, Centeno C, Watson R, Martínez M, Rubiales AS. How is an instrument for measuring health to be validated? An Sist Sanit Navar. 2011;34:63–72.
Saridi MI, Rekleiti MD, Toska AG, Souliotis K. Assessing a sun protection program aimed at Greek elementary school students for malign melanoma prevention. Asian Pac J Cancer Prev. 2014;15(12):5009–18.
Livingston PM, White V, Hayman J, Dobbinson S. Australian adolescents’ sun protection behavior: who are we kidding? Prev Med. 2007;44:508–12.
Geller AC, Cantor M, Miller DR, Kenausis K, Rosseel K, Rutsch L, et al. The Environmental Protection Agency’s Nacional SunWise School Program: Sun protection education in US schools (1999–2000). J Am Acad Dermatol. 2002;46:683–9.
Troya-Martín M, Blázquez-Sánchez N, Rivas-Ruiz F, Fernández-Canedo I, Rupérez-Sandoval A, Pons-Palliser J, et al. Validación de un cuestionario en español sobre comportamientos, actitudes y conocimientos relacionados con el exposición solar: “Cuestionario a pie de playa”. Actas Dermatosifiliogr. 2009;100:586–95.
Municipal register of residents, as at 1 January 2010. Instituto Nacional de Estadística (Spanish National Institute of Statistics) www.ine.es. Accessed 8 September 2011.
Schmidt S, Garin O, Pardo Y, Valderas JM, Alonso J, Rebollo P, et al. Assessing quality of life in patients with prostate cancer: a systematic and standardized comparison of available instruments. Qual Life Res. 2014;23:2169–81.
Rhee JS, Matthews BA, Neuburg M, Logan BR, Burzynski M, Nattinger AB. The skin cancer index: clinical responsiveness and predictors of quality of life. Laryngoscope. 2007;117:399–405.
Mermelstein RJ, Riesenberg LA. Changing knowledge and attitudes about skin cancer risk factors in adolescents. Health Psychol. 1992;11:371–6.
Mahler HI, Fitzpatrick B, Parker P, Lapin A. The relative effects of a health-based versus an appearance-based intervention designed to increase sunscreen use. Am J Health Promot. 1997;11:426–9.
Katz RC, Jernigan S. Brief report: an empirically derived educational program for detecting and preventing skin cancer. J Behav Med. 1991;14:421–8.
Hughes BR, Altman DG, Newton JA. Melanoma and skin cancer: evaluation of a health education programme for secondary schools. Br J Dermatol. 1993;128(4):412–7.
Fernández-Morano T, De Troya-Martín M, Rivas-Ruiz F, Blázquez-Sánchez N, Del Boz-González J, Fernández-Peñas P, et al. Behaviour, attitudes and awareness concerning sun exposure in adolescents on the Costa del Sol. Eur J Dermatol. 2014;24:85–93.
Liebman TN, Goulart JM, Soriano R, Dusza SW, Halpern AC, Lee KK, et al. Effect of dermoscopy education on the ability of medical students to detect skin cancer. Arch Dermatol. 2012;148:1016–22.
Badia X, Salamero M, Alonso J. La medida de la salud. Guía de escalas de medición en español. 3ª edición, Barcelona; 2002.
Brandberg Y, Sjödén PO, Rosdahl I. Assessment of sun-related behaviour in individuals with dysplastic naevus syndrome: a comparison between diary recordings and questionnaire responses. Melanoma Res. 1997;7:347–51.
Glanz K, Yaroch AL, Dancel M, Saraiya M, Crane LA, Buller DB, et al. Measures of sun exposure and sun protection practices for behavioral and epidemiologic research. Arch Dermatol. 2008;144:217–22.
Shoveller JA, Lovato CY. Measuring self-report sunburn: challenges and recommendations. Chronic Dis Can. 2001;22:83–98.
Jennings L, Karia PS, Jambusaria-Pahlajani A, Whalen FM, Schmults D. The Sun Exposure and Behaviour Inventory (SEBI): validation of an instrument to assess sun exposure and sun protective practices. J Eur Acad Dermatol Venereol. 2013;27:706–15.
Rosso S, Zanetti R, Martinez C, Tormo MJ, Schraub S, Sancho-Garnier H, et al. The multicentre south European study ‘Helios’ II: Different sun exposure patterns in the aetiology of basal cell and squamous cell carcinomas of the skin. Br J Cancer. 1996;73:1447–54.
Dennis LK, Kim Y, Lowe JB. Consistency of reported tanning behaviors and sunburn history among sorority and fraternity students. Photodermatol Photoimmunol Photomed. 2008;24:191–8.
Beane Freeman LE, Dennis LK, Lynch CF, Lowe JB, Clarke WR. Test-retest of self-reported exposure to artificial tanning devices, self-tanning creams, and sun sensitivity showed consistency. J Clin Epidemiol. 2005;58:430–2.
Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2000;25:3186–91.
The authors thank the directors and teachers of the schools visited and all those students who answered the questionnaires. The authors would like to acknowledge support from the Research Department of the Costa del Sol Hospital.
The authors declare that they have no competing interests.
TFM, ABE, FRR and MTM conceived the study and designed the study protocol. TFM participated in data collection. TFM and FRR analysed and interpreted the data. TFM drafted the report. FRR, NBS and MTM critically reviewed the report. All authors approved the final version of the manuscript. The corresponding author has final responsibility for the decision to submit for publication.