Assessing knowledge of human papillomavirus and collecting data on sexual behavior: computer assisted telephone versus face to face interviews
BMC Public Health volume 9, Article number: 429 (2009)
Education campaigns seeking to raise awareness of human papillomavirus (HPV) and promoting HPV vaccination depend on accurate surveys of public awareness and knowledge of HPV and related sexual behavior. However, the most recent population-based studies have relied largely on computer-assisted telephone interviews (CATI) as opposed to face to face interviews (FTFI). It is currently unknown how these survey modes differ, and in particular whether they attract similar demographics and therefore lead to similar overall findings.
A comprehensive survey of HPV awareness and knowledge, including sexual behavior, was conducted among 3,045 Singaporean men and women, half of whom participated via CATI, the other half via FTFI.
Overall levels of awareness and knowledge of HPV differed between CATI and FTFI, attributable in part to demographic variations between these survey modes. Although disclosure of sexual behavior was greater when using CATI, few differences between survey modes were found in the actual information disclosed.
Although CATI is a cheaper, faster alternative to FTFI and people appear more willing to provide information about sexual behavior when surveyed using CATI, thorough assessments of HPV awareness and knowledge depend on multiple survey modes.
The human papillomavirus (HPV) is the most common sexually transmitted infection, and the aetiological agent of cervical, penile, and other anogenital cancers, yet public awareness and knowledge of the virus remains poor. With concerns about further spread of HPV, education campaigns, such as Healthy People 2010 in the U.S, are trying to change sexual behavior and promote the uptake of HPV vaccination.
To ensure these campaigns remain effective, recent population-based surveys conducted in a range of countries worldwide [3–9] have assessed public levels of HPV awareness and knowledge. Results vary considerably. For example, the percentage of women having heard of HPV ranged from 15% in a Canadian study to 51% in an Australian study, while those who were aware of HPV as a risk factor for cervical cancer ranged from 0.9% in the U.K to 34% in Iceland. Although differences in knowledge are likely from one country to another, these studies also varied according to survey mode. Some used mail out surveys[3, 5] and face to face interviews (FTFI), while the most recent studies used telephone or computer-assisted telephone interviews (CATI)[4, 6–8].
With regard to interviews, it is currently unknown whether CATI and FTFI lead to identical assessments of HPV knowledge and awareness. There are at least two reasons for suspecting differences. First, some subgroups may be less likely to participate depending on the survey mode. For example, mothers with young children may prefer to be interviewed face to face rather than over the telephone because this makes it easier to supervise young children. Those who are particularly busy may prefer CATI over FTFI as it takes less time. Meanwhile, there might be fewer landline telephone numbers for some groups, such as younger people relying entirely on mobile phones. In addition, some people might be more likely to screen their calls than others.
Second, the survey mode can affect how honest and accurate people are when disclosing information depending on the survey topic and the types of questions [10–14]. For example, telephone interviews often facilitate greater disclosure of sensitive information than interviews conducted face to face, due to a greater sense of anonymity, but do not always result in people answering honestly[10, 14, 15]. Of particular concern are questions about sexual behavior. Gauging sexual behavior is often necessary to formulate effective HPV education campaigns, however, due to the highly sensitive nature of these questions, it is essential to choose a survey mode that maximises disclosure but also enables high levels of honesty. Of relevance to assessing HPV knowledge, telephone interviews have also been shown to result in greater time pressure for interviewees than those conducted face to face, which can adversely affect their recall of knowledge.
To determine the optimum survey mode for assessing HPV knowledge and related sexual behaviors, a study comparing CATI and FTFI is required. This paper reports a population-based study, conducted in Singapore, where both survey modes were used to assess men's and women's HPV awareness and knowledge, and their related sexual behaviors. Because Singapore is a sexually conservative society, respondents may be particularly sensitive to the type of survey mode when answering questions.
A list of 9,000 households from Singapore's residential directory, which contains 915,090 households based on latest data, was generated using specially designed computer software that ensures every household an equal chance of selection. The first 4,500 households from this list were assigned to CATI. Letters introducing the study were then sent to these households before Singaporean interviewers contacted them by telephone up to three days later. The remaining 4,500 households were assigned to FTFI. Again, letters were sent to these households to introduce the study before interviewers visited their home up to three days later. Women were eligible to participate if aged between 18 and 49 years and men were eligible if aged between 18 and 54 years. Age was the only selection criterion and was used because parents in these groups are most likely to have children at an age for which HPV vaccination is recommended. Given these constraints and the likely situation that not all eligible participants would agree to be interviewed, we expected that contacting 9,000 households would produce a sample size of at least 3,000 women and men, which we determined as necessary for complex epidemiological analyses. In all, 2,145 women and 930 men agreed to participate.
The same questionnaire from a 2007 Australian study on women's understanding of HPV was used in this study, with only slight modifications to account for language and cultural differences. Of relevance to this paper were questions relating to two main themes: 1) awareness and knowledge of HPV (see Table 1) and sexual behavior (see Table 2 and Table 3). To determine whether the survey mode influenced participation from particular demographic groups, a range of other questions were asked relating to the respondents' age, ethnicity, language spoken at home, educational attainment, occupation, and whether they had children under age 16 living with them. A pilot study of 20 participants via CATI was carried out to test the questionnaire.
Ethics approval for this project was granted by La Trobe University Ethics Committee (07-48). Households were randomly assigned to either CATI or FTFI. When interviewers called or visited households, they gave a brief explanation of the study and then determined how many members fell within the target population (i.e., aged 18-49 years for women and 18-54 years for men) before randomly selecting a participant by asking for the person who last had a birthday. Those who agreed to participate had the study fully explained to them before they gave their verbal consent to be interviewed. Of all participants contacted, 43.6% of the FTFI group and 42.8% of the CATI group resulted in a completed interview. All interviews were conducted by female interviewers from a Singapore-based community and health research organization and participants were free to end the interview at any time. Due to the possibility of some respondents terminating the interview when asked sexual behavior questions, these were asked at the end. In addition, those surveyed through FTFI answered the sexual behavior questions in a written self-complete questionnaire to enable greater privacy. Both CATI and FTFI interviews were held between 11 am and 10 pm seven days a week from November, 2007 to January, 2008. Participants chose to be interviewed in English, Chinese, or Malay. In total, 1503 (1044 women, 459 men) interviews were conducted using CATI and 1572 (1101 women, 471 men) using FTFI.
We first examined the demographic profiles for each survey mode. A series of chi-square analyses were conducted to determine any statistically significant survey mode differences with regard to age, ethnicity, language spoken at home, educational attainment, occupation, and whether any respondents had children under age 16 years living at home with them.
We next examined the number and proportion of men and women in each survey mode who had heard of HPV. Where survey mode differences in levels of awareness were found, multinomial logistic regression was used to determine whether particular demographic variables were significantly associated with HPV awareness, particularly given that some variations were found in the demographic profiles between the survey modes.
Of those who had heard of HPV, we examined their level of knowledge, such as HPV symptoms and modes of transmission. Knowledge scores were calculated based on the number of correct answers to 13 questions (see Table 1). T-tests and analyses of variance (ANOVAs) were conducted to determine any significant differences in knowledge scores with respect to gender and survey mode. Where survey mode differences in HPV knowledge scores were found, multiple regression was used to determine whether particular demographic variables were significantly associated with these scores.
We next assessed the proportion of women and men who were willing to answer five sexual behavior questions and used a series of chi-square analyses to determine any significant survey mode differences in their willingness to answer. Of those who answered the questions, chi-square analyses were again used to assess whether women and men gave different responses depending on the survey mode. Differences between groups in all analyses in this study were treated as statistically significant at p < .05.
According to Singapore's 2000 census[12, 13], of female residents between 20 and 49 years, 12.8% were aged 20-24 years, 34.2% were 25-34 years; 37.7% were 35-44 years, and 15.5% were 45-49 years. Of male residents between 20 and 55 years, 11.4% were aged 20-24 years, 29.0% were 25-34 years; 34.2% were 35-44 years, and 25.3% were 45-54 years. More than three-quarters (76.8%) of residents were Chinese, 13.9% Malay, 7.9% Indian, and 1.4% had some other ethnic background. Mandarin (35.0%) was the most commonly spoken language at home, followed by a non-Mandarin Chinese language (23.8%), English (23.0%), Malay (14.1%), and Tamil (3.2%). Of those aged above 15 years, 20.0% had no education, 13.1% a primary education, 35.8% a secondary education, 5.0% a vocational qualification, 9.0% a pre-university education, 4.8% a professional diploma, and 12.3% a university degree. No census information about occupation was found that was comparable to data presented in our study.
The demographic profile for our sample was broken down by gender and survey mode and presented in Table 4. The mean age was 35.4 years for women and 34.8 years for men. In all, there were more survey mode differences in the demographic profiles for women than for men. Significantly more women in the CATI group were aged 18-24 years than in the FTFI group while the FTFI group had more women aged 25-34 years (χ2 [3, N = 2145] = 10.47, p < .05). Although both survey groups had approximately equal proportions of women with a Malay background, the CATI group had significantly more Chinese women and the FTFI group significantly more Indian women (χ2 [3, N = 2145] = 12.32, p < .01). There were no significant survey mode differences with regard to language spoken at home. Significantly more women in the FTFI group had lower levels of education compared to those in the CATI group (χ2 [5, N = 2145] = 45.83, p < .001). Meanwhile, the CATI group had significantly more students and white collar workers whereas the FTFI group had more women who reported their occupation as home duties (χ2 [8, N = 2145] = 49.76, p < .001). The FTFI group also had significantly more women with children younger than 16 years compared to the CATI group (χ2 [2, N = 2121] = 7.61, p < .01).
For men, educational attainment was the only demographic variable found to significantly vary between the surveys. In particular, more lower educated men were in the FTFI group and more higher educated men were in the CATI group (χ2 [5, N = 930] = 18.28, p < .01).
Awareness of human papillomavirus
Respondents were asked whether they had heard of HPV, to which they answered "yes', "no", or "don't know". Significantly more women in the FTFI group (21.3%) reported an awareness of HPV than in the CATI group (18.6%) (χ2 [2, N = 2145] = 9.01, p < .05). Although more men in the CATI group (17.9%) reported an awareness of HPV than in the FTFI group (14.2%), this difference was not significant.
Because the demographic composition varied between the survey modes, we used multinomial logistic regression to determine the demographic variables most associated with differences in women's HPV awareness. Educational attainment (F [5, 2094] = 8.65, p < .001) and occupation (F [8, 2094] = 2.05, p < .05) were the only two variables significantly associated with HPV awareness. Awareness tended to increase with greater education (primary = 15.6%; secondary = 15.0%; vocational qualification = 14.7%; pre-university = 22.9%; professional diploma = 23.8%; university degree = 32.2%). Meanwhile, women who were self-employed (29.0%), students (23.1%), or working in white collar occupations (23.8%) were more likely to have heard of HPV than those performing home duties full-time (17.3%) or working in blue collar occupations (11.4%). However, when differences in the demographic profiles between the survey modes were held constant, women in the FTFI group still displayed significantly greater HPV awareness (F [1, 2094] = 8.44, p < .01), therefore suggesting additional reasons for these differences in awareness.
Knowledge of human papillomavirus
Respondents who had heard of HPV were asked 13 questions to assess their overall knowledge, to which they answered "yes", "no", or "don't know". Table 1 displays the correct answers along with the proportion of women and men who gave these answers. An HPV knowledge score was then computed with one point awarded for each correct response. Out of a possible maximum score of 13, men (M = 6.76) scored slightly higher than women (M = 6.65), but this difference was not significant. Despite a number of significant survey mode differences in the proportion of women correctly answering each knowledge question (see Table 1), an ANOVA revealed no significant differences in women's mean knowledge scores. In contrast, men in the CATI group (M = 7.17) scored significantly higher than those in the FTFI group (M = 6.34)(F [1,146] = 5.81, p < .05).
Because the demographic profiles varied between the survey modes, multiple regression was used to determine the demographic variables most associated with men's knowledge scores. Language spoken at home was the only variable significantly associated with knowledge scores (F [5,122] = 3.25, p < .01), with English speakers (M = 7.46) displaying higher scores than Mandarin (M = 6.37), Malay (M = 6.33), Tamil (M = 6.38), and non-Mandarin Chinese (M = 6.30) speakers. However, even when differences in the demographic profiles between the survey modes were held constant, men in the CATI group still displayed better overall knowledge than those in the FTFI group (F [1,122] = 7.02, p <.01), therefore suggesting additional reasons for survey mode differences in men's knowledge scores.
Willingness to answer sexual behavior questions
Participants were asked five questions about their sexual behavior, including total number of sexual partners, number of sexual partners over the past 12 months, number of current regular sexual partners, whether they used contraception during first sexual intercourse, and their age when they first had sex. We examined whether their willingness to disclose information to these questions varied according to survey mode.
Turning first to the total number of sexual partners, despite answering sexual behavior questions in a self-complete questionnaire, significantly more women in the FTFI group refused to answer than in the CATI group (χ2 [2, N = 2145] = 30.01, p < .001)(see Table 2). However, this was not the case for men, who showed no significant survey mode differences in their willingness to answer this question.
For all remaining sexual behavior questions, both men and women in the FTFI group were more likely to refuse disclosure than those in the CATI group, although this tendency was greater for women than for men (see Table 2). Chi-square analyses indicated these differences between survey modes were statistically significant for both women (number of sexual partners over past 12 months: χ2 [2, N = 2145] = 68.79, p < .001; number of current regular sexual partners: χ2 [2, N = 2145] = 135.88, p < .001; use of contraception during first sexual intercourse: χ2 [2, N = 2145] = 103.23, p < .001; age when first had sex: χ2 [2, N = 2145] = 134.89, p < .001) and men (number of sexual partners over past 12 months: χ2 [2, N = 930] = 10.31, p < .01; number of current regular sexual partners: χ2 [2, N = 930] = 42.62, p < .001; use of contraception during first sexual intercourse: χ2 [2, N = 930] = 20.09, p < .001; age when first had sex: χ2 [2, N = 930] = 30.59, p < .001).
Information disclosed to sexual behavior questions
Regarding the total number of sexual partners, women in the FTFI group were significantly more likely to report having at least one sexual partner than those in the CATI group, who were more likely to report not having had a sexual partner (χ2 [8, N = 1867] = 27.36, p < .001)(see Table 3). No such differences were observed for men. Although there were slight variations in responses to the remaining questions between the FTFI and CATI groups, none of these were significant for either women or men.
Consistent with population-based studies conducted in other countries, Singaporean men and women displayed overall low levels of HPV awareness and knowledge. However, survey mode differences emerged with regard to women's HPV awareness, both men's and women's knowledge of specific HPV knowledge items, and men's overall HPV knowledge scores. Some of these differences were at least partly explained by variations in the demographic profiles between the survey modes, particularly with regard to education, occupation, and language spoken at home.
However, these differences alone were not sufficient for explaining survey mode differences in awareness and knowledge, particularly evident by the fact that more women in the FTFI group were aware of HPV than in the CATI group despite the FTFI group having fewer highly educated women. Although additional demographic variables not included in our survey may have played a role, it is also possible that some women in the FTFI group falsely reported an awareness of HPV as this survey mode is particularly susceptible to socially-desirable responding. Likewise for men, demographic variations could not fully explain survey mode differences in HPV knowledge scores. Again, demographic variables not included in our study may have been contributing factors, however, it is also possible that a greater sense of anonymity in CATI resulted in more men attempting to guess their answers.
These possibilities and the fact that the survey modes attracted somewhat different demographic profiles despite random sampling suggests that the practical benefits of CATI compared to FTFI, such as being cheaper and faster to administer, need to be weighed against the possibility that data may not be as representative of the population as it could be when combining both survey modes. On this note, differences in the demographic profiles between the survey modes were much greater for women than for men. The FTFI group, for example, had a larger number of women who performed home duties as their only occupation, perhaps because being surveyed face to face makes it easier to supervise young children, whereas full-time workers who have less flexibility may prefer the speed and convenience of CATI.
Also, given that neither survey mode produced a demographic profile that exactly matched the Singaporean 2000 census data, highly accurate assessments of HPV awareness and knowledge may not be possible using either mode without employing sample matching techniques or weighting the data. In particular, both survey modes were overrepresented by women and men with higher education levels, so future studies will need to at least find ways of increasing the representation of the poorer educated.
With regard to sexual behavior, lowered willingness to answer the sexual behavior questions among those surveyed via FTFI compared to CATI was consistent with past research. Even having respondents answering sensitive questions in a self-complete questionnaire still resulted in lower disclosure in FTFI than CATI, perhaps suggesting that any face to face component in a survey reduces a respondent's sense of anonymity. The fact that respondents appear more open to answering sexual behavior questions through CATI than FTFI may also lead to greater accuracy of data. Although we had the benefit of a large sample and therefore recorded few survey mode differences in the types of responses given by women and men, studies using smaller samples may find FTFI leads to such a low response rate when asking sensitive questions that it substantially weakens the reliability of their findings.
Of course, the results of this study are limited by the HPV and sexual behavior questions we chose to include. Had we examined additional HPV knowledge and sexual behavior questions, overall survey mode differences may have been different. The inclusion of additional demographic variables, such as socioeconomic status, family structure, or residential location, might have also enabled us to better account for survey mode differences in HPV awareness and knowledge.
It is also worth noting that less than half of those contacted were actually interviewed. Given the over-representation of highly educated women and men in our sample, it is possible that those with lower education were less willing to participate. Since HPV awareness appears to be greater with higher levels of education, it is therefore likely that Singaporean's overall awareness is substantially lower than our findings would indicate.
One further limitation of this study was the fact that more than twice as many women as men were interviewed, therefore giving much greater statistical power to the women's sample. This may at least partly explain why more significant survey mode differences were found between the HPV knowledge items for women than for men. Although men in our study still comprised a relatively large sample, being substantially smaller makes it more vulnerable to sampling bias. For example, there were more younger men than younger women, evidenced by a greater proportion of men in the 18-25 age group and an overall lower mean age despite including men up to the age of 54 years. Despite this, much of the research on HPV awareness and knowledge shows no age differences. Meanwhile, for many other demographic variables, differences in the proportions of men compared to the census data appeared no greater than those for women, which suggests that any tendency for the men's sample to be more vulnerable to sampling biases than the women's sample was limited.
Conducting research using CATI is less expensive and faster than FTFI, so a strong case can be made for favouring this survey mode, especially as it leads to higher disclosure for sexual behavior. However, although CATI has become the preferred method for assessing public HPV awareness and knowledge, the present study suggests the overall accuracy of data on this topic is potentially compromised by using a single survey mode. Campaigns aiming to reduce HPV transmission, and therefore cervical and other cancers, by educating the public about the virus require comprehensive and accurate assessments of knowledge items most lacking in the community. For this reason, future research in this field is likely to benefit from using mixed-mode surveys while ensuring all relevant demographics are fully represented. Future research should also explore the effect of additional survey modes on assessing HPV awareness and knowledge, including sexual behavior, such as mail out questionnaires, web-based surveys, computer-assisted self interviewing[15, 16], and automated telephonic data collection to further determine the optimum method.
Klug SJ, Hukelmann M, Blettner M: Knowledge about infection with human papillomavirus: a systematic review. Prev Med. 2008, 46 (2): 87-98. 10.1016/j.ypmed.2007.09.003.
US Department of Human and Health Services: Healthy People 2010: Understanding and Improving Health. 2000, U.S. Government Printing Office, Superintendent of Documents, Stock Number 017-001-001-00-550-9, 2
Gudmundsdottir T, Tryggvadottir L, Allende M, Mast TC, Briem H, Sigurdsson K: Eligibility and willingness of young Icelandic women to participate in a HPV vaccination trial. Acta Obstet Gynecol Scand. 2003, 82 (4): 345-350. 10.1034/j.1600-0412.2003.00086.x.
Hopenhayn C, Christian A, Christian WJ, Schoenberg NE: Human papillomavirus vaccine: knowledge and attitudes in two Appalachian Kentucky counties. Cancer Causes Control. 2007, 18 (6): 627-634. 10.1007/s10552-007-9007-7.
Klug SJ, Hetzer M, Blettner M: Screening for breast and cervical cancer in a large German city: participation, motivation and knowledge of risk factors. Eur J Public Health. 2005, 15 (1): 70-77. 10.1093/eurpub/cki118.
Marshall H, Ryan P, Roberton D, Baghurst P: A cross-sectional survey to assess community attitudes to introduction of Human papillomavirus vaccine. Aust N Z J Public Health. 2007, 31 (3): 235-242. 10.1111/j.1467-842X.2007.00054.x.
Pitts MK, Dyson SJ, Rosenthal DA, Garland SM: Knowledge and awareness of human papillomavirus (HPV): attitudes towards HPV vaccination among a representative sample of women in Victoria, Australia. Sex Health. 2007, 4 (3): 177-180. 10.1071/SH07023.
Sauvageau C, Duval B, Gilca V, Lavoie F, Ouakki M: Human papilloma virus vaccine and cervical cancer screening acceptability among adults in Quebec, Canada. BMC Public Health. 2007, 7: 304-10.1186/1471-2458-7-304.
Waller J, McCaffery K, Wardle J: Beliefs about the risk factors for cervical cancer in a British population sample. Prev Med. 2004, 38 (6): 745-753. 10.1016/j.ypmed.2004.01.003.
Schwarz N, Strack F, Hippler H-J, Bishop G: The impact of administration mode on response effects in survey measurement. Applied Cognitive Psychology. 1991, 5 (3): 193-212. 10.1002/acp.2350050304.
Leow BG: Census of Population 2000: Households and Housing, Statistical Release 5. 2001, Singapore Department of Statistics
Leow BG: Census of Population 2000: Demographic Characteristics, Statistical Release 1. 2001, Singapore Department of Statistics
Leow BG: Census of Population 2000: Economic Characteristics, Statistical Release 3. 2001, Singapore Department of Statistics
Anonymous: Analysis of sexual behaviour in France (ACSF). A comparison between two modes of investigation: telephone survey and face-to-face survey. ASCF principal investigators and their associates. Aids. 1992, 6 (3): 315-323.
Newman JC, Des Jarlais DC, Turner CF, Gribble J, Cooley P, Paone D: The differential effects of face-to-face and computer interview modes. Am J Public Health. 2002, 92 (2): 294-297. 10.2105/AJPH.92.2.294.
Tourangeau R, Smith TW: Asking sensitive questions: The impact of data collection mode, question format, and question context. Public Opinion Quarterly. 1996, 60 (2): 275-304. 10.1086/297751.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/9/429/prepub
This research was supported by GlaxoSmithKline (GSK) via an educational grant-in-aid to Suzanne Garland at the Department of Microbiology Infectious Diseases in the Royal Women's Hospital, Melbourne, Australia. Data collection was carried out by Joshua Research Consultants, a research organisation with experience in conducting community and health surveys in Singapore.
GlaxoSmithKline (GSK) awarded funds to Suzanne Garland to support this research in the interests of informing their commercial decisions regarding HPV vaccination. GSK, however, had no involvement with the design or data analysis of this study. All other authors declare that they have no competing interests.
AS, MP, SC, SG, MLW, and EHT designed the study. AS, MP, and SC supervised the project. AS, AL, MP, SC, and RR analysed and interpreted the data. AL wrote the manuscript and all authors contributed to the final draft. All authors approved this manuscript.
About this article
Cite this article
Smith, A., Lyons, A., Pitts, M. et al. Assessing knowledge of human papillomavirus and collecting data on sexual behavior: computer assisted telephone versus face to face interviews. BMC Public Health 9, 429 (2009). https://doi.org/10.1186/1471-2458-9-429
- Sexual Behavior
- Sexual Partner
- CATI Group
- Knowledge Score
- Demographic Profile