- Research article
- Open Access
Measuring participant rurality in Web-based interventions
BMC Public Health volume 7, Article number: 228 (2007)
Web-based health behavior change programs can reach large groups of disparate participants and thus they provide promise of becoming important public health tools. Data on participant rurality can complement other demographic measures to deepen our understanding of the success of these programs. Specifically, analysis of participant rurality can inform recruitment and social marketing efforts, and facilitate the targeting and tailoring of program content. Rurality analysis can also help evaluate the effectiveness of interventions across population groupings.
We describe how the RUCAs (Rural-Urban Commuting Area Codes) methodology can be used to examine results from two Randomized Controlled Trials of Web-based tobacco cessation programs: the ChewFree.com project for smokeless tobacco cessation and the Smokers' Health Improvement Program (SHIP) project for smoking cessation.
Using RUCAs methodology helped to highlight the extent to which both Web-based interventions reached a substantial percentage of rural participants. The ChewFree program was found to have more rural participation which is consistent with the greater prevalence of smokeless tobacco use in rural settings as well as ChewFree's multifaceted recruitment program that specifically targeted rural settings.
Researchers of Web-based health behavior change programs targeted to the US should routinely include RUCAs as a part of analyzing participant demographics. Researchers in other countries should examine rurality indices germane to their country.
One of the strengths characterizing Web-based health behavior change programs is the ability to reach participants based in disparate geographic locations. This is particularly important when a set of conditions obtains: (a) when individuals in rural settings are found to have serious modifiable health behaviors; (b) when rural individuals have more limited personal income to pay for personal care and/or transportation to care; and (c) when there are fewer per capita clinic-based health professionals . Although the rural use of the Internet still lags behind usage levels observed for urban areas, Internet usage nonetheless is increasing rapidly [2, 3]. In fact, recent data indicates that the adoption rate of broadband Internet services in rural settings is now on parity with urban areas . These trends are encouraging and support using Web-based delivered interventions as one viable approach to reach underserved rural Americans . When describing these interventions, it would be helpful to routinely describe participant rurality in addition to other demographic characteristics. This data can inform recruitment and social marketing efforts, and facilitate the targeting and tailoring of program content.
Fortunately, there is a convenient, empirically-based methodology called RUCAs (Rural-Urban Commuting Area Codes) that can help US researchers accomplish this goal. In this report, we examine the use of RUCAs in two exemplar randomized controlled trials of Web-based tobacco cessation programs: one for smokeless tobacco cessation and the other for smoking cessation to better understand the nature of the population of users for these two intervention trials. We also provide examples of how RUCAs can be used to better understand the reach of behavior change programs delivered via the Internet.
Measuring rurality using RUCAs
There is no one universally agreed upon definition of rurality [5, 6]. In their presentation of a handful of different taxonomies for rurality, Hart et al.  have recommended use of a flexible, non-monolithic approach to the measurement of rurality that seeks to capture those facets of the urban:rural continuum most relevant to the topic being considered. These researchers describe the development work supported by the University of Washington and the Economic Research Service (with additional funding through the federal Office of Rural Health Policy, Health Resources and Services Administration) that resulted in the development of the 33-category RUCA taxonomy that takes into account both the size of settlement (census-tract data) and the functional relationships between places (tract-level work-commuting data) [8, 9]. In an effort to be more usable and comprehensive, RUCA developers subsequently mapped census tract RUCAs onto the US Postal Service ZIP code areas. [10, 11] (see Table 1).
Because ZIP codes offer a finer-grained unit of analysis than counties, the ZIP code version of RUCAs is able to differentiate between rural portions of metropolitan counties and urban portions of non-metropolitan counties. RUCAs are now widely used for policy and research purposes [12–15]. Interested researchers can obtain freely-available downloadable copies of the ZIP code version of RUCAs from the University of Washington Rural Health Research Center  along with information about ways that RUCAs categories can be aggregated to best facilitate different rurality analyses . One online document on the website highlights the fact that because census-tract data and tract-level work-commuting data change over time – sometimes substantially – it is critical to use the RUCA version that relates to the time when participant ZIP code data was collected and program participation occurred . For example, RUCA version 1.11 is based on commuting patterns for 1990 and the 1998 ZIP code year whereas RUCA version 2.0 is based on commuting patterns for 2000 and the 2004 ZIP code year. The 2006 version of RUCA ZIP code data have recently been released for downloading on the University of Washington website .
We used a common aggregation of RUCA codes that describes locations as one of four types: urban, large rural/town, small rural/town, and isolated small rural/town (see Table 2). Using these groupings, the 2004 US population estimates show that the population is distributed as follows: 81.0% urban, 9.6% large rural, 5.2% small rural, and 4.2% isolated small rural . The three rural groupings can be combined into an aggregate rural group to yield the useful dichotomous description of locations as being either urban or rural. Alternative aggregations of RUCAs could also be considered to more narrowly define groups. For instance, only the 10.0 RUCAs codes could be used to define what might be called "very isolated and small" or the RUCAs could be used in combination with information on paved road travel time to the nearest city  to define what might be termed "isolated and remote small" (RUCAs codes 10.0 and 10.2–10.6 which describe 60 minutes or greater from a city).
Example 1: Using RUCAs in the ChewFree.com trial
The prevalence of chewing tobacco use is markedly higher in rural counties compared to metropolitan areas [16, 17]. Rural chewers wanting assistance to quit have relatively few local resources to help then quit using chewing tobacco [18, 19]. The ChewFree.com project, a randomized controlled trial of two Web-based smokeless tobacco cessation websites (an Enhanced condition and a Basic control condition), recruited 2325 participants from across the US during the years 2004–2005. Ethics approval for the research was obtained through the Committee for the Protection of Human Subjects/Institutional Review Board of Oregon Research Institute. All participants provided their informed consent online.
The recruitment methodology, participant exposure to program content, and outcome results are described elsewhere [20–22]. ChewFree participants (2507 of 2523) with valid ZIP codes included in the analysis were drawn from 49 states as well as one individual from the District of Columbia and another from the Armed Forces Pacific.
In addition to the advantages of being available 24×7, Web-based interventions can deliver video content as a way to model the use of behavioral strategies and to provide stories or testimonials that can help build participant motivation to effect a behavior change. In addition, selective use of video when combined with other forms of interactivity may well encourage longer and more frequent visits (building participant engagement and exposure to helpful program content) .
Participants who were randomized to the Enhanced Condition (N = 1260) of the ChewFree.com program had the option of reviewing online videos. The default setting for showing video or not was initially determined by an unobtrusive measure of the speed of each participant's Internet connection. In addition, each participant could subsequently override these default settings and change his/her program preferences about viewing the videos. Because successful delivery of video in Web-based programs requires broadband (high-speed) Internet access  and the prevalence of broadband use is less in rural settings, we examined the relationship between ChewFree.com participant rurality and their type of Internet access (broadband vs. dial-up). This analysis is limited to participants in the Enhanced condition for whom RUCA categories could be calculated and for whom data on the speed of Internet access was measured at baseline. For purposes of this analysis, we followed the recommendation of Danaher et al.  and operationally defined broadband as throughput speeds of at least 384 Kbps.
Example 2: Using RUCAs in the Smokers' Health Improvement Program (SHIP) trial
In their recent report describing smoking trend data based on the Behavioral Risk Factor Surveillance System (BRFSS), Doescher et al.  observed that "...rural residence itself is a risk factor for smoking and that many well-known risk factors for smoking, such as male gender and low socioeconomic status, are especially important among persons residing in rural locations" (p. 115). A growing number of Web-based interventions have focused on helping participants quit smoking [25–29]. The Smokers' Health Improvement Program (SHIP) project used online recruiting methods (Google and Yahoo ad campaigns) to enroll a total of 2318 smokers from the US and Canada to participate in the SHIP randomized controlled trial. Ethics approval for the research was obtained through the Committee for the Protection of Human Subjects/Institutional Review Board of Oregon Research Institute. All participants provided their informed consent online.
For purposes of this analysis, we excluded individuals from Canada and those individuals for whom ZIP code data were invalid or incomplete which yielded the final sample of 2263 smokers drawn from all 50 states and the District of Columbia. Participants were assigned to one of two Web-based programs: (a) the QSN treatment condition which offered a tailored, video-enriched program for preparing to quit, quitting, and maintaining nonsmoking that was derived from a previously-described pilot study ; and (b) the Active Lives control condition that provided a personalized physical activity program to help participants become more fit which, in turn, would help them quit smoking.
Illustrative example data on participant rurality in the Web-based smokeless tobacco cessation trial (ChewFree.com) and the Web-based smoking cessation trial (SHIP) are displayed in Table 3. Owing in large part to large sample sizes and successful randomization, there were no observed differences in rurality between conditions within the ChewFree.com trial (χ2(3, N = 2507) = 0.55, p = .91) and the SHIP trial (χ2(3, N = 2263) = 0.12, p = .99). When we collapsed data across conditions and aggregated RUCA categories to permit an examination of the rural:urban dichotomy, results in both trials indicated that participation differed significantly by rurality: the ChewFree.com trial (χ2(1, N = 2507) = 192.67, p < .001) and the SHIP trial (χ2(1, N = 2263) = 830.60, p < .001).
In Table 4 we consider participant rurality in each of the two trials using the broader context of the percentage of US population in the same RUCAs groupings . While the rurality of smokers in the SHIP trial closely mirrored the national population distribution, the rurality of smokeless tobacco users in the ChewFree.com trial differed significantly from the population distribution – both when examining all four RUCAs groups presented in Table 4 (χ2(3, N = 2507) = 511.80, p < .001) and also when the data were collapsed into a rural:urban dichotomy (χ2(1, N = 2507) = 478.50, p < .001) with almost twice as many rural participants than would be expected from the distribution of rurality in the US population (36.2% vs. 19.0%, respectively). These Chewfree.com results reflect both smokeless tobacco usage patterns and ChewFree.com's targeted marketing effort.
We also examined type of Internet access and rurality among participants in Enhanced condition in ChewFree.com program. Results (see Table 5) showed roughly equivalent dial-up vs. broadband access among urban participants. In contrast, among rural participants, there was a clear gradient such that dial-up access increased its relative percentage share as the home location became more rural, a result that underscores the importance of taking into consideration the bandwidth constraints of many rural Internet users.
Web-based health behavior change programs are well-suited to reach persons in many settings, including rural locations. Their potential public health impact is particularly important for rural locations wherein access to behavior change services (e.g., tobacco cessation services) is limited by relatively low income, lower rates of health insurance, and the poor availability of health care [24, 31]. If the target population is known to be segmented according to rural:urban settings, then describing the study sample according to its RUCA characteristics can facilitate our understanding of the extent to which interventions reached their intended audience [32, 33]. RUCAs can also provide valuable feedback to help refine marketing campaigns for Web-based interventions . For example, we found that recruitment to the ChewFree.com research project benefited from using a mixture of both Internet-based marketing and "earned-media" promotions through more traditional media channels (e.g., newspapers and radio) many of which were based in rural settings . In addition, RUCAs can be used to target as well as tailor program content and health messages .
Considering tobacco cessation, it is important to note that although Doescher et al.  recently reported the rural vs. urban distribution of smoking behavior by counties, to date we do not have finer-grained data that describes the number of smokers or smokeless tobacco users by ZIP codes. Thus, for tobacco cessation and very likely for many other important health behaviors, RUCAs do not yet provide us with the denominator to describe the percentage of eligible participants reached by Web-based tobacco cessation interventions . Nonetheless, ZIP code-based RUCAs datasets for age, race, sex, population, and income (planned), and travel distance time to cities with a population of 50,000 or more can also be used to fine-tune the research. Likewise, additional analyses could combine RUCAs with other geocoded datasets such as the ZIP code-based Consumer Health Profiles available through the Office of Cancer Communications of the National Cancer Institute [36, 37], proprietary market segmentation datasets from Claritas, Inc[38, 39], and US Census Bureau data on defined region, division, and state . Finally, it is helpful to consider ways that RUCAs can mesh with other geography-based tools such as spatial analysis .
One noteworthy limitation of the current report is that it uses a taxonomy that applies only to US locations. Not only do US-based Web interventions attract participation from other countries [e.g., ], but Web-based interventions obviously can be hosted in and marketed to participants in countries other than the US. In this regard, other countries have their own measures for categorizing rurality that could potentially be usefully employed to describe participation in their Web-based programs. Examples include the use of Rural and Small Town (RST) designations as a part of the Metropolitan Area and Census Agglomeration influenced Zones (MIZ) in Canada [42, 43], the Accessibility/Remoteness Index (ARIA+) in Australia , and the Carstairs area deprivation measures in the UK [45, 46].
Because RUCAs linked to ZIP code data can be downloaded at no cost, there appear to be few barriers to obtaining the considerable benefits associated with routinely reporting RUCA-measured rurality along with other key indices of participant demographics in reporting results of Web-based health behavior change programs targeted to US participants. Using data drawn from two Web-based RCTs we highlighted examples showing ways that RUCAs can be used as an integral evaluation component.
DeLeon PH, Wakefield M, Hagglund KJ: The behavioral health care needs of rural communities in the 21st century. Rural behavioral health care: An interdisciplinary guide. Edited by: Stamm BH. 2003, Washington, D.C., American Psychological Association, 23-31.
Horrigan JB: Home broadband adoption 2006. 2006, [http://www.pewinternet.org/pdfs/PIP_Broadband_trends2006.pdf]
Bell P, Reddy P, Rainie L: Rural areas and the Internet: Rural Americans' Internet use has grown, but they continue to lag behind others. 2004, [http://www.pewinternet.org/pdfs/PIP_Rural_Report.pdf]
Stamm BH: Bridging the rural-urban divide with telehealth and telemedicine . Rural behavioral health care: An interdisciplinary guide. Edited by: Stamm BH. 2003, Washington, D.C., American Psychological Association, 145-155.
Rickets TC, Johnson-Webb KD, Taylor P: Definitions of rural: A handbook for health policy makers and researchers. 1998, [http://www.shepscenter.unc.edu/research_programs/rural_program/ruralit.pdf]
Hewitt M: Defining rural areas: Impact on health care policy and research. 1989, [http://govinfo.library.unt.edu/ota/Ota_2/DATA/1989/8912.PDF]
Hart LG, Larson EH, Lishner DM: Rural definitions for health policy and research. Am J Public Health. 2005, 95: 1149-1155.
Morrill R, Cromartie J, Hart LG: Metropolitan, urban, and rural commuting areas: toward a better depiction of the US settlement system. Urban Geography. 1999, 20: 727-748.
Hart LG: Use of RUCAs in health services research. 2006, [http://depts.washington.edu/uwrhrc/uploads/AcadHeal06Y008.pdf]
RHRC: Rural-urban commuting area codes (version 2.0). 2006, [http://depts.washington.edu/uwruca/]
WSDOH: Guidelines for using rural-urban classification systems for public health assessment. 2006, [http://www.doh.wa.gov/Data/Guidelines/RuralUrban.htm]
Rosenblatt RA, Andrilla CH, Curtin T, Hart LG: Shortages of medical personnel at community health centers: implications for planned expansion. JAMA. 2006, 295: 1042-1049.
Baldwin LM, MacLehose RF, Hart LG, Beaver SK, Every N, Chan L: Quality of care for acute myocardial infarction in rural and urban US hospitals. J Rural Health. 2004, 20: 99-108.
Evans TC, Wick KH, Brock DM, Schaad DC, Ballweg R: Academic degrees and clinical practice characteristics: The University of Washington physician assistant program: 1969-2000. J Rural Health. 2006, 22: 212-219.
Chan L, Hart LG, Goodman DC: Geographic access to health care for rural Medicare beneficiaries. J Rural Health. 2006, 22: 140-146.
USDHHS: Results from the 2004 National Survey on Drug Use and Health. 2005, Rockville, MD, [https://ncadistore.samhsa.gov/catalog/productDetails.aspx?ProductID=17202]
Howard-Pitney B, Winkleby MA: Chewing tobacco: who uses and who quits? Findings from NHANES III, 1988-1994. National Health and Nutrition Examination Survey III. Am J Public Health. 2002, 92: 250-256.
Novotny TE, Pierce JP, Fiore MC, Davis RM: Smokeless tobacco use in the United States: The adult use of tobacco surveys. NCI Monogr. 1989, 25-28.
Severson HH, Eakin EG, Lichtenstein E, Stevens VJ: The inside scoop on the stuff called snuff: An interview study of 94 adult male smokeless tobacco users. J Subst Abuse. 1990, 2: 77-85.
Danaher BG, Boles SB, Akers L, Gordon JS, Severson HH: Defining participant exposure measures in Web-based health behavior change programs. J Med Internet Res. 2006, 8 (3): e15-[http://www.jmir.org/2006/3/e15]
Gordon JS, Akers L, Severson HH, Danaher BG, Boles SM: Successful participant recruitment strategies for an online smokeless tobacco cessation program. Nicotine Tob Res. 2006, 8: S35-S41.
Severson HH, Gordon JA, Danaher BG, Akers L: ChewFree.com: Evaluation of a Web-based cessation program for smokeless tobacco users. Nicotine Tob Res. 2007,
Danaher BG, Jazdzewski SA, McKay HG, Hudson CR: Bandwidth constraints to using video and other rich media in behavior change websites. J Med Internet Res. 2005, 7 (4): e49-[http://www.jmir.org/2005/4/e49/]
Doescher MP, Jackson JE, Jerant A, Hart LG: Prevalence and trends in smoking: A national rural study. J Rural Health. 2006, 22: 112-118.
Lenert L, Muñoz RF, Stoddard J, Delucchi K, Bansod A, Skoczen S, Perez-Stable EJ: Design and pilot evaluation of an internet smoking cessation program. J Am Med Inform Assoc. 2003, 10: 16-20.
Lenert L, Muñoz RF, Perez JE, Bansod A: Automated e-mail messaging as a tool for improving quit rates in an Internet smoking cessation intervention. J Am Med Inform Assoc. 2004, 11: 235-240.
Muñoz RF, Lenert LL, Delucchi K, Stoddard J, Perez JE, Penilla C, Perez-Stable EJ: Toward evidence-based Internet interventions: A Spanish/English Web site for international smoking cessation trials. Nicotine Tob Res. 2006, 8: 77-87.
Etter JF: The Internet and the industrial revolution in smoking cessation counselling. Drug Alcohol Rev. 2006, 25: 79-84.
Walters ST, Wright JA, Shegog R: A review of computer and Internet-based interventions for smoking behavior. Addict Behav. 2006, 31: 264-277.
Feil EG, Noell J, Lichtenstein E, Boles SM, McKay HG: Evaluation of an Internet-based smoking cessation program: Lessons learned from a pilot study. Nicotine Tob Res. 2003, 5 (2): 189-194. 10.1080/1462220031000073694.
CASA: No place to hide: Substance abuse in mid-size cities and rural America. 2000, [http://www.casacolumbia.org/absolutenm/articlefiles/379-no_place_to_hide_01-28-00.pdf]
Glasgow RE, Vogt TM, Boles SM: Evaluating the public health impact of health promotion interventions: The RE-AIM framework. Am J Public Health. 1999, 89: 1322-1327.
Maibach EW, Van Duyn MA, Bloodgood B: A marketing perspective on disseminating evidence-based approaches to disease prevention and health promotion. Prev Chronic Dis. 2006, 3: A97-[http://www.cdc.gov/pcd/issues/2006/jul/05_0154.htm]
Kreuter MW, Lukwago SN, Bucholtz RD, Clark EM, Sanders-Thompson V: Achieving cultural appropriateness in health promotion programs: targeted and tailored approaches. Health Educ Behav. 2003, 30: 133-146.
Glasgow RE, Klesges LM, Dzewaltowski DA, Bull SS, Estabrooks P: The future of health behavior change research: What is needed to improve translation of research into health promotion practice?. Ann Behav Med. 2004, 27: 3-12.
NCI: Consumer health profiles: A proprietary database of health behavior, demographic, lifestyle, and geographic data for audience segmentation. 2006, [http://cis.nci.nih.gov/research/CHP_FACT_SHEET.pdf]
Miner JW, White A, Lubenow AE, Palmer S: Geocoding and social marketing in Alabama's cancer prevention programs. Prev Chronic Dis. 2005, 2 Spec no: A17-
Claritas: PRIZM NE Profile Analysis: Widget Corporation. 2005, [http://www.claritas.com/collateral/segmentation/corp-col-2030-0605.pdf]
Claritas: PRIZN NE: The new evolution in segmentation. 2006, [http://www.claritas.com/claritas/Default.jsp?ci=3&si=4&pn=prizmne]
Bureau USC: Federal Information Processing Standards (FIPS) Codes. 2006, [http://www.census.gov/geo/www/fips/fips.html]
RHRC: Census Division Nine: Pacific. 2006, [http://depts.washington.edu/uwruca/Map_4_divisions.html]
CIHI: Canada's rural communities: An assessment of their health status and health determinants. 2006, [http://secure.cihi.ca/cihiweb/dispPage.jsp?cw_page=GR_1529_E]
du Plessis V, Beshiri R, Bollman RD: Definitions of rural. Rural Small Town Can Anal Bull. 2001, 3: 1-15. [http://www.statcan.ca/english/freepub/21-006-XIE/21-006-XIE2001003.pdf]
GISCA: About ARIA+ (Accessibility/Remoteness Index of Australia). 2006, [http://www.gisca.adelaide.edu.au/products_services/ariav2_about.html]
Walters K, Breeze E, Wilkinson P, Price GM, Bulpitt CJ, Fletcher A: Local area deprivation and urban-rural differences in anxiety and depression among people older than 75 years in Britain. Am J Public Health. 2004, 94: 1768-1774.
Levin KA, Leyland AH: Urban-rural inequalities in ischemic heart disease in Scotland, 1981-1999. Am J Public Health. 2006, 96: 145-151.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/7/228/prepub
The authors thank Edward Lichtenstein for his review of an earlier draft of this report. This project was supported by National Cancer Institute grants R01-CA84225 (ChewFree.com; Herbert H. Severson, PI) and R01-CA79946 (Smokers' Health Improvement Program; H. Garth McKay, PI).
The author(s) declare that they have no competing interests.
BGD conceived of the study, conceptualized ideas, supervised its conduct, and designed and coordinated the data collection phase. LGH, HGM, and HHS all helped to interpret findings and contributed to the text. All authors reviewed drafts of the manuscript and approved the version to be published.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
About this article
Cite this article
Danaher, B.G., Hart, L.G., McKay, H.G. et al. Measuring participant rurality in Web-based interventions. BMC Public Health 7, 228 (2007). https://doi.org/10.1186/1471-2458-7-228
- Smokeless Tobacco
- Tobacco Cessation
- Participant Rurality
- Smokeless Tobacco User
- Inform Consent Online