- Research article
- Open Access
- Open Peer Review
Pilot randomized controlled trial testing the influence of front-of-pack sugar warning labels on food demand
BMC Public Healthvolume 19, Article number: 164 (2019)
Front-of-pack (FOP) nutrition warning labels to identify potentially harmful foods/beverages have recently been considered in Singapore. The objective of this study was to pilot test two promising FOP warning labels intended to reduce purchases of products high in sugar to determine whether a full scale trial testing one or both these labels using actual purchases is warranted.
Five hundred twelve participants ≥21 years old and residing in Singapore completed all study elements online via the NUSMart Online Grocery Store study website. The study was designed as a Randomized Controlled Trial (RCT) where consumers were randomized and asked to hypothetically shop in one of three versions of an online grocery store; 1) no FOP label (control), 2) a graphical high-in-sugar label shaped like a stop sign, or 3) a text-based warning label. The proportion of labelled products purchased (primary outcome) and all secondary measures of diet quality were calculated using participants’ orders. Ordinary Least Squares (OLS) regression was used to compare purchasing behavior across the three study arms.
The proportion of high-in-sugar products selected (i.e., those targeted for labelling) was largest in the no label control arm at 20%. The proportion was a non-statistically significant 2 percentage points lower (P = 0.146) for the high-in-sugar stop-sign label arm and 4 percentage points lower (P < 0.05) in the warning label with deterrent text arm. We could not reject the hypothesis of equal effectiveness of the two warning labels (P = 0.231).
Results suggest that the two health warning labels have potential to reduce demand for high-in-sugar products in Singapore. Future studies should test the influence of these labels using actual purchases in efforts to identify whether either labelling strategy should be considered for adoption in the local setting.
The American Economic Association’s registry for randomized controlled trials; AEARCTR-0003800. Registered 18 January 2019.
The incidence of obesity, diabetes and other non-communicable diseases (NCDs) has risen rapidly in recent years. As diet is a key risk factor for the onset of NCDs [1,2,3,4], policy-makers have been looking to identify strategies aimed at discouraging unhealthy food consumption [5,6,7]. Most pre-packaged foods and beverages include a nutrition information panel (NIP) to help consumers make healthier purchases. However, the NIP is difficult to decipher for many shoppers and there is scant evidence that the panel has helped to curtail rising rates of obesity and NCDs [8,9,10].
Singapore, the country of focus for this effort, recognized the limitations of the NIP and supplemented it with a simple front-of-pack (FOP) label termed the Health Choice Symbol (HCS). The HCS symbol was first introduced in 2001 and although optional, is strongly encouraged by the Singapore government. It offers the Health Promotion Board’s endorsement for products that are healthier options within a food category, including options that are Lower in Sugar and Lower in Saturated Fat. Although this particular label has not been systematically evaluated, FOP nutrition labels appear to outperform other forms of nutritional labels in improving consumers’ ability to find and use nutritional information in purchasing decisions [11,12,13]. Therefore, the HCS logos may improve a shopper’s ability to identify the healthier products even when the NIP is available on the back of the label . However, these logos appear on only a small percentage of products (roughly 9%) and do not identify the worst offending foods and beverages when it comes to sugar or other harmful ingredients.
Research has shown that, compared with non-directive labels like the Nutrition Facts Panel, directive and semi-directive labels may improve consumers’ ability to find and understand nutritional information [14,15,16,17]. Consumers tend to prefer simple FOP labels and to appreciate interpretational aids like descriptors or color codes [11, 18]. However, there is some evidence that positive FOP labels targeting healthier foods may not be sufficient to discourage consumption of less healthy alternatives [14, 19]. As a result, health warning labels have recently been proposed as a complement or alternative to positive FOP food labels. Studies of text warnings for tobacco products showed improved consumer education, greater knowledge of health harms of tobacco use, and decreased purchases [20, 21]. One study showed reduced intention to purchase SSBs in the presence of SSB warning labels . These studies suggest that warning labels identifying harmful ingredients or adverse effects of certain food products have the potential to improve diet quality. Therefore, as motivated by several social psychological theories, including loss-framing  and theories of risk perception , providing a clearly identifiable and salient message to consumers on which foods are highest in harmful ingredients could effectively signal which foods to avoid and thus further positively alter food purchasing patterns even in the presence of the NIP and HCS logos . Several empirical studies showing the effectiveness of tobacco warning labels and warning labels on select foods provide additional support for testing such labels in Singapore [14, 20, 26,27,28].
In this study, we use an experimental web-based grocery store to pilot test two different theory- and evidence-based ‘FOP’ warning labels aimed to reduce purchases of high-in-sugar products, even in the presence of the HCS symbol and NIP. The first label we consider is an English language version similar to the one used in Chile (Fig. 1 Left Panel) that shows a black stop sign (Arm termed SS) with the words high-in-sugar in the center (Fig. 1 Left Panel) . The second label we consider is a text-based health warning label (Arm termed TW), which is similar to labels considered in several municipalities in the US (Fig. 1 Right Panel) and also resembles the warning label on cigarettes, but without the accompanying graphics (Fig. 1 Right Panel) .
Given the strongly worded language similar to tobacco warning labels that are used in the text-based health warning label, we hypothesized that the proportion of labelled (or targeted for labelling in Control Arm) products among respondents would be the largest in Control and smallest in the warning label condition. There are three reasons to assume the text based warning label will show greater effectiveness. First, it is likely to generate greater levels of loss framing through negative terminology including ‘warning’ and ‘tooth decay’. Second, because it mirrors tobacco warning labels, the negative association may lead to an implicit bias against purchasing. Finally, because of the requirement to include the full message in a readable format, it is larger than the stop sign label and therefore may be more salient to consumers. We hypothesized a similar ordering for secondary outcomes, including total sugar purchased, sugar (g) per dollar spent, and total spending.
Online grocery store
For this pilot and future research studies, an online grocery store (NUSMart Online Grocery Store) was developed. At the time of the pilot, NUSMart contained over 1800 non-fresh food and beverage products commonly purchased at local markets in Singapore (see Additional file 1). The web store was designed to mirror an actual web-based grocery store in look and feel. It contained products across major Food & Beverage categories, including:
Cooking & Baking
Frozen & Chilled Products
Cereals, Bakery & Spreads
All products include a picture of the item and current retail price. A subset of qualifying products also have the HCS logo displayed. The store operates similar to other on-line grocery stores, with a cart that fills as consumers shop on the store and the ability to review purchases before checkout.
We identified products to receive a warning label based on the percentage of sugar as compared to other products within the food category. We chose a within category approach to mirror the approach taken for the HCS program. A food product is classified as high-in-sugar if it is among the top 20% of products with the highest sugar content per 100 g within the food category. A beverage is classified as high-in-sugar if it contains at least 10 g per 100 ml (i.e. 10%) of sugar. Using this approach, 20% of food within each food category and 27% of beverages were defined as high-in-sugar and received the corresponding label for the SS and TW arms. As with the HCS symbol, the labels were displayed at the bottom of the product images (See Fig. 2). Figure 2 shows the storefront and an example of a fictional product as it appears in each arm of the study.
Participants and procedures
We powered the study to detect differences of at least 3 percentage points across arms in terms of the percentage of high in sugar products purchased. Assuming a common group standard deviation of 0.83 (based on unpublished data from ongoing studies), an alpha of 0.05 and power of 0.8, and adjusted for multiple comparisons, a sample of 170 participants per arm was required to test our hypotheses.
Based on this power calculation, 512 participants were recruited anonymously from an on-line panel in August 2017. Potential participants were emailed unique links that directed them to a screener. They were excluded if they were under 21 years of age or a non-resident of Singapore. All others were offered the chance to participate. Those who consented were randomized into 1 of the 3 arms and asked to spend between S$50 (approximately 37 USD) and S$250 (approximately 183 USD) on NUSMart as if it were a real household grocery shopping trip (see Fig. 3 for diagram of study flow). A pop-up message appeared on-screen if they attempted to checkout below or above the minimum or maximum respectively. The minimum expenditure was intended to ensure sufficient purchasing data would be collected per sales order and the maximum was intended to ensure that our results were not overly influenced by a few shoppers with very large expenditures. Following the shopping task, participants completed a brief survey and were compensated according to the web panel’s in-house point system. The survey included information on age, gender, height, weight, ethnicity, presence of children in household, and whether the participant is the primary grocery shopper in the household.
The primary outcome of interest is the proportion of high in sugar products purchased, as this is the most direct test of the influence of the labels. However, it is possible that consumers could respond to the labels by purchasing fewer labelled products but not reduce their net sugar intake, partly because a change in the labels could also influence their total spending. Therefore, we also include the following secondary outcomes:
Total sugar purchased (in g) per shopping trip,
Sugar purchased per dollar spent (in grams per $),
Total spending (in $) given that high-in-sugar products tend to be less expensive, and
Total expenditure on high-in-sugar products ($).
All analyses on primary and secondary outcomes were conducted using Ordinary Least Squares (OLS) regression. A Generalized Linear Model (GLM) with logit link was also used for analysis of the primary outcome, given it represents a proportion. However, as results were identical to the OLS results, we do not report the GLM results although they are available upon request. Specifically, the outcome of interest was regressed on treatment indicators for the two labelling conditions, with the Control Arm being the omitted reference group. Results were run on the full shopping basket and separately for beverages given Sugar Sweetened Beverages are a prime target of labelling efforts [29,30,31]. All regressions controlled for age, gender, ethnicity, body mass index (BMI), whether the participant is a primary purchaser for the household and has children. All statistical analyses were performed using STATA.
Table 1 presents the characteristics of the final sample, by allocated Arm. Five hundred twelve participants were part of the final sample for the analysis. The total sample was largely Chinese (86.1%) and the mean age was 38.1 years (SD = 11.5). The average BMI was 22.8 (SD = 4.9). The majority (72.9%) reported being the primary grocery shopper for the household, and about half (46.7%) were female.
Table 2 presents the regression output for each dependent variable for the full shopping basket. Both SS and TW participants purchased a lower proportion of High-in-Sugar products than Control participants but the difference was only statistically significant for TW (P < 0.01). Differences between SS and TW were not statistically significant (P = 0.231). None of the secondary outcomes (total sugar purchased (g), sugar purchased per dollar spent (g per $), total spending ($) and total expenditure on high-in-sugar products ($)) were statistically different across arms.
Table 3 presents the regression output for each dependent variable when the sample is restricted to beverage purchases made by the 432 participants who purchased beverages. For this restricted sample, the proportion of High-in-Sugar products was 33% for the Control arm. The proportion was 6 percentage points lower (P = 0.085) for the SS arm and 11 percentage points lower (P = 0.002) for the TW arm compared to Control. As with the full sample we could not reject the hypothesis of equal effectiveness of the two warning labels (P = 0.172) nor were there any statistically significant differences across arms in any of the secondary outcomes.
Higher BMI is associated with a higher proportion of High-in Sugar products purchased (P < 0.01). Older age was associated with higher purchases of sugar (P < 0.01) and greater spending (P < 0.01). There were also significant effects of gender on sugar purchased per dollar spent, with women on average purchasing 1.5 g per dollar less than men (P < 0.01). Chinese respondents also purchased significantly less total sugar (P < 0.05) and sugar per dollar (P < 0.01) than non-Chinese.
The primary objective of this pilot study was to determine whether one or both of two promising FOP warning labels for high in sugar products would be worth testing further in a large-scale randomized controlled trial in Singapore using actual purchases. Results lend support to proceeding with a full scale trial as one of the two labels generated a statistically significant reduction in labelled products purchased. Our findings are consistent with recent studies examining SSB warning labels. A text-only warning label was shown to reduce purchase probabilities of SSBs, reduce perceived product attractiveness, quality and taste, and reduce perceptions of consumer “coolness” in a hypothetical experiment . Another hypothetical trial focusing on warning labels for SSBs showed that the labels increase parents’ understanding of health harms associated with over-consumption of SSBs and reduce intentions to purchase SSBs for their children . To date, no studies have assessed how the food labelling law in Chile has impacted purchases of sugar or other macronutrients.
Although our study only found one of the labels to be effective at influencing purchases of targeted products, a full scale trial including both labels should be pursued given that we could not reject the hypothesis that one label outperformed the other. Moreover, a full scale trial with actual purchases will allow for determining whether label that effectively influences purchasing patterns also leads to improvements in diet quality. This is relevant given that an effective label may not reduce sugar or calories purchased if consumers alter their behavior by purchasing more of unlabeled products.
As this is a pilot study, it is subject to several limitations. All shopping was hypothetical and may not generalize to actual purchases. The NUSMart store at the time this study was conducted also had fewer products than would appear in a full grocery store but more products than available in most convenience stores and it is likely that the number and type of products will influence the effectiveness of FOP labels. The NUSMart store has been expanded to include over 4000 products, which will allow for a more realistic test of the effectiveness of these labels. However, it is worth noting that even if shown to be effective (or ineffective), effectiveness may be size and venue specific and differ for web versus in store shopping. For example, the influence of labels may differ when shopping for a few products for immediate consumption, as is likely when shopping in a convenience store, compared to when making larger purchases for foods to last over a longer period of time. Effectiveness may also wane over repeated shops. Hunger and other visceral factors may also mediate the relationship between labels and food purchases regardless of venue and time to consumption. Results could also be influenced by the color, size, placement and implementation strategy (e.g., what percent of products are labelled) of the labels. In this pilot, the two warning labels were of differing sizes because we needed the health warning label to be large enough such that the text could be clearly seen on even small devices. One reason the text based label was more effective may be due to its larger dimensions. Although we could not realistically reduce the size of this label, we could test the effect of a larger stop sign label. Finally, a small sample size could have masked true but relatively small differences in outcomes between arms. Many of these concerns can be addressed by a carefully conducted 3 arm randomized trial using repeated actual, as opposed to hypothetical, purchases which is now in the planning stages.
Results from the present pilot suggest that FOP warning labels have the potential to reduce demand for high in sugar products and should be tested via a full scale randomized trial. This test is warranted given that our pilot results suggest that even an effective label that reduces demand for high in sugar products may not generate a reduction in sugar or calories purchased, which is the ultimate goal of the labelling policy.
Generalized Linear Model
Healthier choice symbol
Nutrition information panel
Ordinary least squares
Randomized controlled trial
Black stop-sign with the words high-in-sugar
Health warning label with deterring text
Reedy J, Krebs-Smith SM, Miller PE, Liese AD, Kahle LL, Park Y, et al. Higher diet quality is associated with decreased risk of all-cause, cardiovascular disease, and cancer mortality among older adults. J Nutr. 2014;144(6):881–9.
Basu S, Yoffe P, Hills N, Lustig RH. The relationship of sugar to population-level diabetes prevalence: an econometric analysis of repeated cross-sectional data. PLoS One. 2013;8(2):e57873.
Malik VS, Popkin BM, Bray GA, Despres JP, Willett WC, Hu FB. Sugar-sweetened beverages and risk of metabolic syndrome and type 2 diabetes: a meta-analysis. Diabetes Care. 2010;33(11):2477–83.
Te Morenga L, Mallard S, Mann J. Dietary sugars and body weight: systematic review and meta-analyses of randomised controlled trials and cohort studies. BMJ. 2013;346.
Corvalan C, Reyes M, Garmendia ML, Uauy R. Structural responses to the obesity and non-communicable diseases epidemic: the Chilean law of food labeling and advertising. Obes Rev. 2013;14(Suppl 2):79–87.
Mozaffarian D. Dietary and policy priorities for cardiovascular disease, diabetes, and obesity: a comprehensive review. Circulation. 2016;133(2):187–225.
Popkin BM, Hawkes C. Sweetening of the global diet, particularly beverages: patterns, trends, and policy responses. Lancet Diab Endocrinol. 2016;4(2):174–86.
Cowburn G, Stockley L. Consumer understanding and use of nutrition labelling: a systematic review. Public Health Nutr. 2005;8(1):21–8.
Grunert KG, Wills JM. A review of European research on consumer response to nutrition information on food labels. J Public Health. 2007;15(5):385–99.
Golan E, Kuchler F, Mitchell L, Greene C, Jessup A. Economics of food labeling. J Consum Policy. 2001;24(2):117–84.
Hawley KL, Roberto CA, Bragg MA, Liu PJ, Schwartz MB, Brownell KD. The science on front-of-package food labels. Public Health Nutr. 2013;16(3):430–9.
Becker MW, Bello NM, Sundar RP, Peltier C, Bix L. Front of pack labels enhance attention to nutrition information in Novel & Commercial Brands. Food Policy. 2015;56:76–86.
Machin L, Aschemann-Witzel J, Curutchet MR, Gimenez A, Ares G. Does front-of-pack nutrition information improve consumer ability to make healthful choices? Performance of warnings and the traffic light system in a simulated shopping experiment. Appetite. 2018;121:55–62.
Feunekes GI, Gortemaker IA, Willems AA, Lion R, van den Kommer M. Front-of-pack nutrition labelling: testing effectiveness of different nutrition labelling formats front-of-pack in four European countries. Appetite. 2008;50(1):57–70.
Antúnez LE, Giménez ABS, Maiche AP, Ares GP. Influence of interpretation aids on attentional capture, visual processing, and understanding of front-of-package nutrition labels. J Nutr Educ Behav. 2015;47(4):292–9 e1.
Ares G, Giménez A, Bruzzone F, Antúnez L, Sapolinski A, Vidal L, et al. Attentional capture and understanding of nutrition labelling: a study based on response times. Int J Food Sci Nutr. 2012;63(6):679–88.
Roberto CA, Shivaram M, Martinez O, Boles C, Harris JL, Brownell KD. The smart choices front-of-package nutrition label. Influence on perceptions and intake of cereal. Appetite. 2012;58(2):651–7.
Hodgkins C, Barnett J, Wasowicz-Kirylo G, Stysko-Kunkowska M, Gulcan Y, Kustepeli Y, et al. Understanding how consumers categorise nutritional labels: a consumer derived typology for front-of-pack nutrition labelling. Appetite. 2012;59(3):806–17.
Hartley J, Black A, Rayner M. Just read the label: understanding nutrition information in numeric, verbal and graphic formats. (London: HMSO, 1992). Inf Design J. 1996;8(1):86–90.
Hammond D. Health warning messages on tobacco products: a review. Tob Control. 2011;20(5):327–37.
Borland R, Hill D. Initial impact of the new Australian tobacco health warnings on knowledge and beliefs. Tob Control. 1997;6(4):317–25.
Roberto CA, Wong D, Musicus A, Hammond D. The influence of sugar-sweetened beverage health warning labels on Parents’ choices. Pediatrics. 2016;137(2):e20153185.
Bansal-Travers M, Hammond D, Smith P, Cummings KM. The impact of cigarette pack design, descriptors, and warning labels on risk perception in the US. Am J Prev Med. 2011;40(6):674–82.
Moran AJ, Roberto CA. Health warning labels correct Parents’ misperceptions about sugary drink options. Am J Prev Med. 2018.
Strahan EJ, White K, Fong GT, Fabrigar LR, Zanna MP, Cameron R. Enhancing the effectiveness of tobacco package warning labels: a social psychological perspective. Tob Control. 2002;11(3):183–90.
Wilkinson C, Room R. Warnings on alcohol containers and advertisements: international experience and evidence on effects. Drug Alcohol Rev. 2009;28(4):426–35.
VanEpps EM, Roberto CA. The influence of sugar-sweetened beverage warnings. Am J Prev Med. 2016;51(5):664–72.
Arrua A, Machin L, Curutchet MR, Martinez J, Antunez L, Alcaire F, et al. Warnings as a directive front-of-pack nutrition labelling scheme: comparison with the guideline daily amount and traffic-light systems. Public Health Nutr. 2017;20(13):2308–17.
Ruff RR. Sugar-sweetened beverage consumption is linked to global adult morbidity and mortality through diabetes mellitus, cardiovascular disease and adiposity-related cancers. Evid Based Med. 2015;20(6):223–4.
Singh GM, Micha R, Khatibzadeh S, Shi P, Lim S, Andrews KG, et al. Global, regional, and National Consumption of sugar-sweetened beverages, fruit juices, and Milk: a systematic assessment of beverage intake in 187 countries. PLoS One. 2015;10(8):e0124845.
Malik VS, Popkin BM, Bray GA, Despres JP. Hu FB. Sugar-sweetened beverages, obesity, type 2 diabetes mellitus, and cardiovascular disease risk. Circulation. 2010;121(11):1356–64.
Bollard T, Maubach N, Walker N, Ni Mhurchu C. Effects of plain packaging, warning labels, and taxes on young people’s predicted sugar-sweetened beverage preferences: an experimental study. Int J Behav Nutr Phys Act. 2016;13(1):95.
Financial support for this study was provided by the Singapore National Medical Research Council (grant number NMRC-HSRG-0060-2016) and the Global Asia Institute (grant number AG-2014-001). Neither funder had any role in the study design, data collection, analysis and interpretation of the data; or the writing of the report. The research was conducted independently of the funders.
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
Ethics approval and consent to participate
This study protocols and procedures are in accordance with the Declaration of Helsinki and were approved by the National University of Singapore Institutional Review Board Reference Code: S-17-172. Written informed consent was obtained from all subjects.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
NUSMart product categories in the Pilot-DIET study. NUSMart Category names, number of products per category, and proportions of products qualifying for the logos per category. (DOCX 14 kb)