Validation of commercial business lists as a proxy for licensed alcohol outlets
BMC Public Health volume 17, Article number: 480 (2017)
Studies of retail alcohol outlets are restricted to regions due to lack of U.S. national data. Commercial business lists (BL) offer a possible solution, but no data exists to determine if BLs could serve as an adequate proxy for license data. This paper compares geospatial measures of alcohol outlets derived from a commercial BL with license data for a large US state.
We validated BL data as a measure of off-premise alcohol outlet density and proximity compared to license data for 5528 randomly selected California residential addresses. We calculated three proximity measures (Euclidean distance, road network travel time and distance) and two density measures (kernel density estimation and the count within a 2-mile radius) for each dataset. The data was acquired in 2015 and processed and analyzed in 2015 and 2016.
Correlations and reliabilities between density (correlation 0.98; Cronbach’s α 0.97–0.99) and proximity (correlations 0.77–0.86; α 0.87–0.92) measures were high. For proximity, BL data matched license in 55–57% of addresses, overstated distance in 19%, and understated in 24–26%.
BL data can serve as a reliable proxy for licensed alcohol outlets, thus extending the work that can be performed in studies on associations between retail alcohol outlets and drinking outcomes.
Retail alcohol outlets determine availability of alcohol for purchase, and availability is related to alcohol consumption. From a policy standpoint, retail alcohol outlets are of interest because community and state regulations may dictate aspects of the sale of alcohol [1, 2]. Limits on outlets could curtail excessive alcohol consumption by increasing cost and limiting opportunities for social aggregation, physical access, and exposure to alcohol marketing. One research summary found greater density of alcohol outlets was associated with increased alcohol consumption and related harms, and subsequently, The Task Force on Community Preventive Services “found sufficient evidence of a positive association between alcohol outlet density and excessive alcohol consumption and related harms to recommend limiting alcohol outlet density through the use of regulatory authority (e.g., licensing and zoning) as a means of reducing or controlling excessive alcohol consumption and related harms” [3, 4].
The notion that limits on retail alcohol density could affect drinking is not without controversy, as findings from density studies have varied. A more recent systematic review  applied a quality assessment tool to 26 publications that investigated associations between community availability of alcohol and alcohol use. Methodological heterogeneity precluded a meta-analysis; thirteen studies on outlet density and two on distance to nearest outlet included a range of exposure measures. Results from studies on the influence of availability of alcohol from commercial sources on drinking were also heterogeneous. For alcohol outlet density, authors found better evidence for associations with density of on-premise compared to off-premise outlets, and sparse evidence that proximity to alcohol outlets was important. Many studies had many participants in each cluster, with few or no individual-level covariates, raising concerns about the ecological fallacy . Authors of this review deemed the literature inconclusive.
Publications included in both reviews were conducted primarily in North America. Only 2 of the US publications [7, 8] were national in scope, and were limited to just 32 and 8 college campuses, respectively. Thus, regional differences in how retail alcohol outlets are regulated may also contribute to the heterogeneity of the findings.
The lack of U.S. national studies examining impacts of alcohol outlet density and proximity on alcohol consumption remains a clear gap in the literature. A primary research barrier is the lack of national data on the location of alcohol outlets, in part because alcohol outlets are regulated by state and local jurisdictions. Some areas make license data readily available, but no national database listing all alcohol outlets exists. Since alcohol sales are regulated, they tend to occur in similar types of establishments (liquor stores, grocery stores, etc.) and thus commercial business lists (BL) may be able to serve as a secondary data source for licensed outlets. To explore this possibility, we compared alcohol outlet proximity and density measures derived from BL and state license data for a random sample of California residential addresses.
We selected the state of California as our study site because of its large size, easy availability of licensed alcohol outlet data, and the diversity of both urban and rural areas.
Licensed alcohol outlets are classified as either on-premise or off-premise based on where the purchased alcohol is consumed. On-premise outlets are primarily restaurants and bars. Information from a BL is not sufficient to determine if a restaurant sells alcohol (even some Burger Kings sell beer), and, although bars are identified in a BL, there is not always clear distinction between bars and restaurants. Thus, we limited our study to off-premise alcohol outlets.
Commercial business list (BL) data was obtained from OneSource’s (now Avention) Global Business Browser during April 2015. Avention is a business information service which aggregates business lists from over 2500 data sources including primary research, regulatory filings, corporate web sites, company press statements, annual reports, news stories, and analyst research, and is considered one of the most comprehensive sources of national business list data. Probable alcohol retailers were identified using the North American Industry Classification System (NAICS) codes. NAICS is the standard used by Federal statistical agencies to classify businesses based on their primary activity . Business names and addresses were downloaded for the following NAICS codes: 44511 supermarkets and other grocery stores, 44512 convenience stores, 44531 beer, wine, and liquor stores, 44611 pharmacies and drug stores, 44711 gasoline stations with convenience stores, 44719 other gasoline stations, 452111 department stores, 452112 discount department stores.
For data quality control, we first queried (via website or phone call) all pharmacies with more than 15 locations in California (48% of all pharmacies) and department stores with 10 or more locations (81% of all stores) to determine if they sold alcohol and included/excluded them accordingly. Based on this analysis, we excluded all other department stores and pharmacies as not likely to sell alcohol. While many discount department stores are small stores that do not sell alcohol, nationally, we have seen warehouse stores that do sell alcohol included in this NAICS category. Therefore, we scanned the names of discount department stores with 2 or more locations (13% of all stores) for large retailer names. The BL data contained duplicate records for some businesses, such as a pharmacy in a grocery store or slight discrepancies in business names. We compared geocoded locations, business names and phone numbers and removed locations that appeared to be duplicates.
We downloaded 39,186 potential alcohol outlets from the BL. We identified 7886 establishments not likely to sell alcohol and 1088 that were duplicate listings, which resulted in 30,212 alcohol outlets identified from the BL.
Licensed alcohol retailers were obtained from the California Department of Alcohol Beverage Control (data was refreshed on April 1, 2015). We limited our license data to off-premise retail outlets with fixed locations. These license types included: 20 Off-Sale Beer and Wine, 21 Off-Sale General, and 85 Limited Off-Sale Retail Wine License. We then reviewed the status of each license and removed all that were not active or in good standing (status of Surend (surrender), RevPen (review pending) Suspen (suspend), and Pend (pending)).
For licensed outlets, there were 31,607 outlets with off-premise licenses; however 4103 of these were not active or in good standing, which left a total of 27,504 licensed alcohol outlets.
We purchased 6000 randomly selected California residential addresses from AccuData Integrated Marketing, a company that sources their address data from the United States Postal Service. Since there are likely difference in the distribution of alcohol outlets in urban and rural areas, we classified each address as urban/rural starting with a 4-tier scheme  derived from the Rural-Urban Commuting Area (RUCA) classification system . The RUCA system considers commuting patterns to nearby areas. A RUCA category (urban core, sub-urban, large rural town and small town/isolated rural) was assigned to each residential address based on their geocoded location. Given the paucity of residential addresses in the 2 rural categories (large rural town n = 77 and small town/isolated rural n = 36), we combined these into one “rural” category. To ensure that addresses were representative, we compared address counts by county and RUCA category to population distributions for all of California. Our sample of 6000 residential addresses covered 57 of California’s 58 counties and was reasonably proportionally representative of the population in these counties (e.g. Los Angeles County contains 26.2% of California’s population and our sample had 1526 or 25.4% of the 6000 addresses were located in that county).
Retail outlet addresses from BL and license data as well as the residential addresses were geocoded using 2013 StreetMap N.A  using ArcGIS v.10.3.1 (ESRI, Redlands, CA). Outlet addresses were first geocoded to the street address, and, if no match was found, they were geocoded to the ZIP code centroid. Residential addresses were geocoded to the street address; if no match was found, they were considered unmatched.
Both BL and licensed alcohol outlets had similar rates of geocoding, with only 0.3% and 1.2% of the outlets not matched, respectively. Over 97% of license and 98% of BL addresses were geocoded to their street address. The remaining ~1% of each dataset was geocoded to the ZIP code centroid.
Just 459 (7.7%) of the 6000 residential addresses were not matched to the street address, 8 were duplicates (e.g. different apartments at the same address) and 5 had network measures (see below) that could not be calculated, giving a final count of 5528 residential addresses.
We selected measures that are often used in studies involving individuals and proximity and density of outlets (alcohol, tobacco and food; e.g. [7, 13, 14]). We purposely excluded measures that used administrative boundaries (e.g. ZIP codes, Census tracts), as they impose constraints not observed by study subjects (people do not base daily travel on administrative boundaries and often lack awareness of where boundaries are). All measures were calculated using the geocoded Residential Address using ArcGIS v.10.3.1, and the same measures were calculated for both BL and license data.
Euclidean distance is the straight line distance from the residential address to the nearest alcohol outlet measured in miles.
Network measures minimize distance traveled along a street network (in this case StreetMap N.A. ) to the closest alcohol outlet. Both distance in miles (Network Distance) and the estimated driving time in minutes (Network Time) are reported.
Kernel density estimation  (KDE) fits a probability density function over each alcohol outlet such that the value is highest at the outlet and zero at a specified distance (5 miles in this case). Each pixel within the 5-mile radius is assigned a value based on this density function (outlets per square mile). The final value assigned to each pixel in the study area is the sum of the KDE values for each alcohol outlet within 5 miles of the pixel. Geocoded addresses are then overlain on the KDE raster, and the value of the KDE raster pixel that aligns with the residential address is the KDE value assigned to that address.
2 Mile Radius is a count of alcohol outlets within 2 miles (Euclidean distance) of the residential address.
We calculated correlation coefficients and the inter-correlation (Cronbach’s α reliability coefficients; a measure of internal consistency) between license and BL data for each measure for the entire set of residential addresses and across the 3 RUCA categories. Based on distributional properties of our measures (significant positive skew) we provided Pearson’s correlation coefficients to address limitations in Cronbach’s α when used with non-normally distributed data. In addition, for the proximity measures, we performed a Wilcoxon Signed-Rank Test to assess how measures differed and the direction of mismatch. This approach provided further information about the number of exact matches as well as how frequently BL data rankings overestimated versus underestimated license data rankings. Statistical analysis was performed using STATA v.12.1 (StataCorp LP, College Station, Texas) and results were visualized in ArcGIS v. 10.3.1 (ESRI, Redlands, CA) as needed.
Descriptive statistics are presented in Table 1. Medians and first and third quartiles (Q1 and Q3) were used as summary statistics, as variables were positively skewed. Medians and first and third quartiles were similar between BL and license data, particularly for proximity measures. For density, medians for BL were 10–20% higher than for license data. The majority (91.5%) of addresses were classified as urban core, which mirrors the population of California (89.7% urban). As expected, proximity values increased (addresses were further from alcohol outlets) as rurality increased, whereas density values were greatest in the urban core and lowest in rural settings.
Density and proximity measures for BL and license data were highly correlated (Table 2). Correlation coefficients ranged from 0.77–0.98 (Table 2), with the highest correlations found for the density measures. Correlations by RUCA category ranged from a low of 0.47 for rural network distance to a high of 0.98 in urban core KDE. Rural areas (n = 113) had the lowest correlation coefficients for proximity measures while sub-urban areas were slightly lower for density measures. Similar levels of reliability estimates were demonstrate across license and BL measures (Cronbach’s α = 0.97–0.99 for density measures and α = 0.87–0.92 for proximity measures). The range of coefficients reflects both the small sample size and variation in rural environments.
Wilcoxon Signed-Rank tests (Table 3) revealed that for proximity measures, BL data ranking provided an exact match for license data ranking 55–57% of the time. The BL data overestimated license measures 19% of the time and underestimated them 24–26% of the time. The actual values of overestimation and underestimation tended to be small, however, with median differences between datasets ranging from −0.10 to 0.13 miles (Euclidean and Network Distance) and −0.19 to 0.27 min for Network Time. As would be expected, median differences were smallest for urban core areas and slightly larger for sub-urban and rural addresses. In evaluation of ranking values, the distribution between BL tying and overestimating and underestimating the license measure was fairly consistent across RUCA categories.
The scatterplots in Fig. 1 provide a visual depiction of the association between BL and license data for the two density measures. Strong positive linear associations reveal consistency across measurement approaches. Figure 1a (KDE) and Fig. 1b (2 mile radius) highlight the density measures by RUCA category, showing that urban areas provide all of the points for any KDE density beyond 5 outlets per square mile. Fig. 1a (KDE) and Fig. 1d (2 mile radius) reveal differences in the association between license and BL for San Francisco and Vineyard Regions, compared to the rest of California.
The scatter plots in Fig. 1c, d show three distinct patterns. The trajectories of linear fit for BL vs. license data points for San Francisco and the Vineyard Region are visually different from the rest of the state, with both regions having higher slopes (greater density of licensed outlets for each additional BL outlet) compared to the rest of California. San Francisco had the greatest density of both licensed and BL outlets despite the boundary effect . San Francisco is on a peninsula and the alcohol outlets stop at the coast, yet the density calculations, which are based on 5 mile (KDE) and 2 mile (2 mile count) radii, do not consider this natural boundary.
The other geographic area that represented a potential outlier on the scatterplots in Fig. 1 was Napa Valley and surrounding areas in California’s wine country. Some vineyards have retail alcohol outlets located on site and these are not represented in the BL data. There is a NAICS code for vineyards, but there is no indication if the vineyard has a retail operation or, as in most cases, just represents the agricultural side of the business. Thus, in order to be more conservative, we did not include vineyards in the BL data. However, a search of the license data for “vineyard” in the business name showed 431 (out of 27,504 total licensed outlets), most of which were not represented in the BL data. The 15 residential addresses that are highlighted in Fig. 1c, d are addresses that have at least 20 vineyards within a 5 mile radius, and are all located in Napa County.
Because licensing data for alcohol outlets is not nationally available, we evaluated the utility and accuracy of commercial business list (BL) data as a proxy for licensed alcohol outlets. Correlations and inter-item reliability were strong for all measures, and values across BL and license data measures were largely similar. For density, BL returned results that were highly and linearly correlated but with values that were 10–20% higher compared to license data. That density is overstated should be considered when reporting density results, but high correlations between the two measures suggest that BL density can serve as a reliable proxy for licensed alcohol outlet density in correlational studies. With respect to proximity, BL returned the exact value for distance to the closest outlet more than half the time, and errors were equally distributed on either side of zero, suggesting that error was random. Thus, results from this study provide strong support for measurement equivalence and with particular strength for density measurement.
The scatterplots offer visual evidence of linear relations between BL and license outlet density. Slight differences in slope for data subsets may indicate possible regional variations in retail environments or boundary effects most notably in the urban core with some spill over to the sub-urban areas. The data categorized by RUCA reveal correlations and inter-item reliability estimates of the proximity and density measures were stronger in urban compared to rural areas. This is probably because rural areas have small, dispersed populations, so the licensed alcohol outlets were less numerous and errors of omission or substitution result in larger errors for density and proximity. Any national or large regional studies might consider stratifying analyses on urban/rural status, in part because there are such large differences in outlet density across these groups, and because estimates in rural areas seemed less reliable.
Our findings differ from studies of food food outlets [17,18,19,20,21,22,23] which have examined BL outlets by field verification and overwhelmingly found only modest levels of agreement. On the other hand, one study on tobacco outlets (in a non-licensing state) found the BL to be reasonably accurate . Our approach accepts from the outset that BL data will overstate the total number of alcohol outlets (not every grocery store will sell alcohol) while also missing some actual alcohol outlets (e.g. a store that has a different NAICS code). Since licensed alcohol outlets in the vicinity of a residence are the outcome of interest, we did not compare individual BL outlets to individual licensed outlets as one would when ground-truthing (verifying the location/validity of the outlet by direct observation). Based on the high correlations demonstrated across BL and licensed data in the present analyses, findings from this study suggest that BL data is a strong proxy for licensed alcohol outlets, even without using the extremely time-consuming approach of ground-truthing.
Our study was focused on off-premise alcohol outlets. Although the license data did contain on-premise establishments (primarily bars and restaurants), it is difficult to discern these establishments in the BL data. There is a NAICS code: 722,410 Drinking Places (alcoholic beverages) that would likely identify most bars. Restaurants, recreational facilities (bowling, golf courses) and social organizations (e.g., Elks) that do and do not serve alcohol, however, are not grouped separately.
Overall and across rural, sub-urban and urban cores, density measures had stronger correlations than proximity measures. This was expected since density measures usually include a number of alcohol outlets whereas proximity measures are calculated based on the closest one. If the BL data had an additional “false” outlet or did not include a licensed outlet, this mismatch may be very apparent in determining the closest outlet, but not necessarily in a density measure which might include many outlets.
The number of rural addresses explored in this study was small (just 113 out of 5528), reflecting the small size of rural populations. Moreover, rural addresses cover a wide range of rural environments with respect to outlet density (the Q1 to Q3 range for 2 mi Radius was a count of 1–16 licensed alcohol outlets). Care should be taken when studying alcohol access in rural settings.
As discussed above, we identified two regions – San Francisco and Napa County where the alcohol outlet environment differed from the rest of California. All these differences were small, Care should be taken in applying our methods to other states or nationally to explore the data for unusual local retail environments that deviate from the norm. For example, many states have dry (no alcohol sales permitted) or moist (sales are restricted to certain areas) counties, and the BL data will need to be adjusted accordingly for those geographic areas.
The purpose of this study was to evaluate use of BL data as a proxy for licensed alcohol outlets. This is of particular interest for areas where license data is not available or studies that cover large regions (several states or national) that may not have license data available. Our study in California suggests that BL data is a strong proxy for license data for alcohol outlets, especially in sub-urban and urban areas. This suggests that BL data could be used to study alcohol outlet geography and its correlation with drinking behaviors in national data sets. However, in order to use BL data in place of license data, care must be taken to understand and consider factors relevant for the retail alcohol environment throughout the study area.
Commercial business list
Kernel density estimation
North American Industry Classification System
Rural urban commuting area
Paschall MJ, Grube JW, Black C, Ringwalt CL. Is Commercial Alcohol Availability Related to Adolescent Alcohol Sources and Alcohol Use? Findings from a Multi-Level Study. J Adolesc Health. 2007;41(2):168–74.
Stockwell T, Gruenewald PJ. Controls on the physical availability of alcohol. In: Heather N, Peters TJ, Stockwell T, editors. International Handbook of Alcohol Dependence and Problems Part VI Prevention of Alcohol Problems. Chichester, John Wiley & Sons; 2001.
Task Force on Community Preventive S. Recommendations for reducing excessive alcohol consumption and alcohol-related harms by limiting alcohol outlet density. Am J Prev Med. 2009;37(6):570–1.
Campbell CA, Hahn RA, Elder R, Brewer R, Chattopadhyay S, Fielding J, Naimi TS, Toomey T, Lawrence B, Middleton JC, et al. The effectiveness of limiting alcohol outlet density as a means of reducing excessive alcohol consumption and alcohol-related harms. Am J Prev Med. 2009;37(6):556–69.
Bryden A, Roberts B, McKee M, Petticrew M. A systematic review of the influence on alcohol use of community level availability and marketing of alcohol. Health Place. 2012;18(2):349–57.
Piantadosi S, Byar DP, Green SB. The ecological fallacy. Am J Epidemiol. 1988;127(5):893–904.
Scribner R, Mason K, Theall K, Simonsen N, Schneider SK, Towvim LG, DeJong W. The Contextual Role of Alcohol Outlet Density in College Drinking. J Stud Alcohol Drugs. 2008;69(1):112–20.
Weitzman ER, Folkman A, Lemieux K, MPH F, Wechsler H. The relationship of alcohol outlet density to heavy and frequent drinking and drinking-related problems among college students at eight universities. Health & Place. 2003;9(1):1–6.
Introduction to NAICS [https://www.census.gov/eos/www/naics/index.html ]. Accessed 21 Apr 2015.
Guidelines for Using Rural-Urban Classification Systems for Public Health Assessment [http://www.doh.wa.gov/Portals/1/Documents/1500/RUCAGuide.pdf]. Accessed 17 May 2017.
Rural-Urban Commuting Area Codes [http://www.ers.usda.gov/data-products/rural-urban-commuting-area-codes.aspx]. Accessed 2 Mar 2016.
U.S. and Canada Detailed Streets. In: 2013 - StreetMap™ North America. Edited by TomTom North America, Inc. Redlands, California. USA: ESRI; 2013.
Pollack CE, Cubbin C, Ahn D, Winkleby M. Neighbourhood deprivation and alcohol consumption: does the availability of alcohol play a role? Int J Epidemiol. 2005;34(4):772–80.
Adachi-Mejia AM, Carlos HA, Berke EM, Tanski SE, Sargent JD: A comparison of individual versus community influences on youth smoking behaviours: a cross-sectional observational study. BBMJ Open 2012;2:e000767. doi: 10.1136/bmjopen-2011-000767.
Carlos HA, Shi X, Sargent J, Tanski S, Berke EM. Density estimation and adaptive bandwidths: a primer for public health practitioners. Int J Health Geogr. 2010;9:39.
Lawson AB, Biggeri A, Dreassi E. Edge Effects in Disease Mapping. In: Andrew L, Annabele B, Dankmar B, Emmanuel L, Jean-François V, Roberto B, editors. Disease Mapping and Risk Assessment for Public Health. West Sussex: John Wiley & Sons Ltd.; 1999. p. 85–98.
Caspi CE, Friebur R. Modified ground-truthing: an accurate and cost-effective food environment validation method for town and rural areas. Int J Behav Nutr Phys Act. 2016;13:37.
Fleischhacker SE, Rodriguez DA, Evenson KR, Henley A, Gizlice Z, Soto D, Ramachandran G. Evidence for validity of five secondary data sources for enumerating retail food outlets in seven American Indian communities in North Carolina. Int J Behav Nutr Phys Act. 2012;9:137.
Gustafson AA, Lewis S, Wilson C, Jilcott-Pitts S. Validation of food store environment secondary data source and the role of neighborhood deprivation in Appalachia, Kentucky. BMC Public Health. 2012;12:688.
Han E, Powell LM, Zenk SN, Rimkus L, Ohri-Vachaspati P, Chaloupka FJ. Classification bias in commercial business lists for retail food stores in the U.S. Int J Behav Nutr Phys Act. 2012;9:46.
Liese AD, Colabianchi N, Lamichhane AP, Barnes TL, Hibbert JD, Porter DE, Nichols MD, Lawson AB. Validation of 3 Food Outlet Databases: Completeness and Geospatial Accuracy in Rural and Urban Food Environments. Am J Epidemiol. 2010;172(11):1324–33.
Powell LM, Han E, Zenk SN, Khan T, Quinn CM, Gibbs KP, Pugach O, Barker DC, Resnick EA, Myllyluoma J, et al. Field validation of secondary commercial data sources on the retail food outlet environment in the U.S. Health Place. 2011;17(5):1122–31.
Seliske L, Pickett W, Bates R, Janssen I. Field validation of food service listings: a comparison of commercial and online geographic information system databases. Int J Environ Res Public Health. 2012;9(8):2601–7.
D'Angelo H, Fleischhacker S, Rose SW, Ribisl KM. Field validation of secondary data sources for enumerating retail tobacco outlets in a state without tobacco outlet licensing. Health Place. 2014;28:38–44.
Availability of data and materials
The data that support the findings of this study are available from Avention (www.avention.com) and AccuData Integrated Marketing (www.acculeads.com) but restrictions apply to the availability of these data, which were used under license for the current study, and so are not publicly available. Data are however available from the authors upon reasonable request and with permission of Avention and AccuData Integrated Marketing.
This work was supported by the National Institutes of Health [T32 DA037202, UL1TR001086, 1R01AA021347-01A1]. Funding was also provided by the GeoSpatial Resource, part of the Norris Cotton Cancer Center’s Biostatistics Shared Resource [5P30CA023108]. The funders had no involvement in the study design, collection, analysis, writing or interpretation.
HAC conceived of the study, performed the GIS analysis and drafted the manuscript. JG performed the statistical analysis and revised the manuscript, JDS oversaw the study and revised the manuscript. All authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
This study did not involve human subjects and thus was not under the oversight of an IRB.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Carlos, H.A., Gabrielli, J. & Sargent, J.D. Validation of commercial business lists as a proxy for licensed alcohol outlets. BMC Public Health 17, 480 (2017). https://doi.org/10.1186/s12889-017-4419-0