This article has Open Peer Review reports available.
Do physical activity and dietary smartphone applications incorporate evidence-based behaviour change techniques?
© Direito et al.; licensee BioMed Central Ltd. 2014
Received: 28 February 2014
Accepted: 12 June 2014
Published: 25 June 2014
There has been a recent proliferation in the development of smartphone applications (apps) aimed at modifying various health behaviours. While interventions that incorporate behaviour change techniques (BCTs) have been associated with greater effectiveness, it is not clear to what extent smartphone apps incorporate such techniques. The purpose of this study was to investigate the presence of BCTs in physical activity and dietary apps and determine how reliably the taxonomy checklist can be used to identify BCTs in smartphone apps.
The top-20 paid and top-20 free physical activity and/or dietary behaviour apps from the New Zealand Apple App Store Health & Fitness category were downloaded to an iPhone. Four independent raters user-tested and coded each app for the presence/absence of BCTs using the taxonomy of behaviour change techniques (26 BCTs in total). The number of BCTs included in the 40 apps was calculated. Krippendorff’s alpha was used to evaluate interrater reliability for each of the 26 BCTs.
Apps included an average of 8.1 (range 2-18) techniques, the number being slightly higher for paid (M = 9.7, range 2-18) than free apps (M = 6.6, range 3-14). The most frequently included BCTs were “provide instruction” (83% of the apps), “set graded tasks” (70%), and “prompt self-monitoring” (60%). Techniques such as “teach to use prompts/cues”, “agree on behavioural contract”, “relapse prevention” and “time management” were not present in the apps reviewed. Interrater reliability coefficients ranged from 0.1 to 0.9 (Mean 0.6, SD = 0.2).
Presence of BCTs varied by app type and price; however, BCTs associated with increased intervention effectiveness were in general more common in paid apps. The taxonomy checklist can be used by independent raters to reliably identify BCTs in physical activity and dietary behaviour smartphone apps.
Lifestyle behaviours, such as diet and physical activity, are modifiable risk factors associated with many non-communicable diseases (NCDs), which account for 63% of deaths worldwide . To date, many intervention programs targeting physical activity and dietary changes have had modest effects and their long-term effectiveness is not well established [2–5]. Thus, public health researchers have begun to examine novel approaches to deliver behaviour change interventions. Mobile and wireless technology (mHealth) is a growing area in the prevention and management of NCDs and holds potential to deliver health-related behaviour change interventions [6–8]. Mobile phone ownership has reached saturation in many developed countries with an increase in smartphone ownership. A 2012 survey in the United States (U.S.) of three thousand adults indicated that 85% owned a mobile phone, 53% of those being smartphones. Moreover, 84% of smartphone owners had downloaded an app to their device and 19% had downloaded an app to specifically manage their health .
Despite the recent proliferation of apps to promote positive lifestyle change, there is a dearth of research evidence regarding their effectiveness. Further, content analysis of existing apps have identified gaps between evidence based guidelines and app content relating to smoking cessation [10, 11], weight loss [12, 13], diabetes  and exercise . While theoretically grounded mHealth behaviour interventions increase the likelihood of achieving behaviour change, it has been suggested that current theories are inadequate to guide mHealth interventions, which need to be more interactive and dynamic . Abraham and Michie have suggested that there are a number of behaviour change techniques (BCTs) common to many health behaviour theories , of which at least five are evident in effective physical activity and dietary interventions (i.e. self-monitoring, intention formation, specific goal setting, review of behavioural goals and feedback on performance) . While studies have been conducted to determine the extent to which behaviour change theory has been applied to app development, none have quantified the extent to which specific BCTs are included.
The present study sought to determine the presence/absence of BCTs in the top 20 free and top 20 paid physical activity and dietary smartphone apps from the New Zealand iTunes Apple App Store Health & Fitness category. A second aim was to determine whether the BCTs taxonomy checklist could be used to reliably identify BCTs in smartphone apps.
A comparative assessment of the presence of BCTs within smartphone apps from the New Zealand Apple App Store Health & Fitness category was undertaken by four independent raters. The raters were all trained in health behaviour change; one dietetics and nutrition masters student, two health sciences doctoral students and one health psychologist. The study was conducted in accordance to ethical standards. Human subjects were not recruited and therefore no ethics approval was required.
The Taxonomy of Behaviour Change Techniques Used in Interventions and the Coding Manual to Identify Behaviour Change Techniques in Behaviour Change Intervention Descriptions were used for the present evaluation . Abraham and Michie previously developed and demonstrated the feasibility and reliability of using the taxonomy for identifying BCTs in behavioural interventions. The coding manual provides guidelines to detect whether an intervention description includes any or all of the 26 defined BCTs. Mean kappa values of 0.80 and 0.82 (i.e. good reliability) have been observed when applying the taxonomy of BCTs to physical activity and healthy eating intervention descriptions, respectively . Each app was rated for inclusion of each of the 26 BCTs. Formal statistical comparisons in terms of differences in the number of BCTs between apps were not conducted for the following reasons. First this was an exploratory study to determine whether an existing coding system could be used reliably to assess BCTs among mobile phone apps. Second, given the number of apps assessed in this study and the potential for differences in BCTs between apps, the number of comparisons needed would likely result in Type 1 error.
For each app, descriptive information was retrieved regarding its popularity (i.e. frequency of downloads relative to other apps within the same category), average rating (i.e. average number of stars the app was rated ranging one to five), total ratings (i.e. number of users who downloaded the app and voluntarily rated it), total "hate it", “don’t like it”, “it’s ok”, “it’s good”, and “it’s great” ratings (i.e. number of times the app was rated with one to five stars, respectively), customer reviews (i.e. number of times the app was reviewed) and price (as shown in Additional file 1). Every app was evaluated by four independent raters using three iPhones between November 2012 and April 2013. The four raters separately tested all apps in detail to become familiar with the interfaces, menus, features, and functionality (e.g. “profile”, “routes”, “workouts”, “friends”, “meals”, “charts”, “analysis”, “my plan”, “nutrition”, “settings”, “tips & tricks”, “FAQ”). The apps were user-tested independently by each rater.
Prior to evaluation, all raters read the BCTs definitions carefully and had the opportunity to clarify and discuss the definitions. Before beginning a coding session raters read each BCT description carefully to ensure clear differentiation between techniques. After using each app, raters reviewed each of the menu functions to rate the presence or absence of BCTs according to the checklist. A dichotomous score of “0” absent or “1” present was applied for each of the 26 BCTs. Disagreements were resolved by consensus discussion.
All statistical analyses were conducted using IBM SPSS Statistics version 20.0. Frequencies and percentages of each of the 26 BCTs included in the 40 apps were calculated. Krippendorff’s alpha was used to evaluate interrater reliability for each of the 26 BCTs. This statistic is appropriate because it can be used with any number of observers, sample sizes, and satisfies all criteria for a good measure of reliability . Further, a macro that computes Krippendorff’s alpha is available for statistical software packages, such as SPSS .
Descriptive data of the top-40 apps
Average rating (1-5)
"hate it" ratings (1 star)
“don’t like it” ratings (2 stars)
“it’s ok” ratings (3 stars)
“it’s good” ratings (4 stars)
“it’s great” ratings (5 stars)
PA behaviour apps
Dietary behaviour apps
PA + Dietary behaviour apps
Reliability of BCT identification
1. Provide general information
2. Provide information on consequences
3. Provide information about others’ approval
4. Prompt intention formation
5. Prompt barrier identification
6. Provide general encouragement
7. Set graded tasks
8. Provide instruction
9. Model or demonstrate the behaviour
10. Prompt specific goal setting
11. Prompt review of behavioural goals
12. Prompt self-monitoring of behaviour
13. Provide feedback on performance
14. Provide contingent rewards
15. Teach to use prompts/cues
16. Agree on behavioural contract
17. Prompt practice
18. Use follow-up prompts
19. Provide opportunities for social comparison
20. Plan social support/social change
21. Prompt identification as a role model
22. Prompt self-talk
23. Relapse prevention
24. Stress management
25. Motivational interviewing
26. Time management
This study identified the presence or absence of BCTs in popular physical activity and/or dietary behaviour apps. There was substantial variation in the numbers of BCTs present, with an average of eight techniques per app. Using a taxonomy and coding manual it was possible to identify BCTs used in smartphone health behaviour change applications. Beyond these general observations, specific issues are outlined below.
Previous research has already highlighted the shortage of theoretical content present in interactive technologies such as web sites  and apps [10, 12, 14] designed to promote health behaviour change [11, 13, 15, 21, 22]. Consistent with previous research, our findings demonstrate the relative absence of behaviour change strategies present in physical activity and dietary apps. Moreover, this study highlights the potential to improve future app development by incorporating key strategies known to enhance behaviour change. For example, existing technologies permit real time assessment, feedback, and tailoring, however, in the present study, only 38% and 23% of the apps prompted specific goal setting or prompted review of behavioural goals, respectively.
The five BCTs shown to be commonly associated with greater effectiveness for modifying physical activity and diet in previous studies were present to varying degrees in the apps reviewed here (i.e. self-monitoring – 60% of apps, intention formation – 50%, specific goal setting – 38%, review of behavioural goals – 23% and feedback on performance – 53%). However, these five BCTs were in general more common in paid versus free apps. BCTs such as relapse prevention, which is important for sustained behavioural change  was not present in any of the reviewed apps, which questions the value of these apps for changing behaviour in the long-term.
The observed differences in reliability identifying BCTs indicate the need to clarify definitions and/or coding instructions. We evaluated the presence of BCTs using a coding instrument originally developed to identify BCTs from written text in published papers describing an intervention . Perhaps specific coding instructions to apply when assessing the active ingredients of mHealth or interactive technologies such as apps or video games can be developed. The present research included a taxonomy of 26 techniques; however, subsequent taxonomies have been developed . Future content analysis of apps should apply this updated hierarchical version of the BCT taxonomy.
While identifying the active content of health behaviour change interventions is crucial, researchers must be aware of the caveats of ascribing effectiveness to certain BCTs or combinations of BCTs. To do so, researchers should also consider the parameters for effectiveness for each BCT. These are the required characteristics that a translation of a BCT to usable intervention elements must incorporate (i.e., an effective BCT is undermined if not correctly applied) . Additionally, the effectiveness of BCTs is determined by contextual factors such as target population (e.g., sample characteristics), behavioural domain (e.g., physical activity, smoking) and study design factors (e.g., follow-up period, blinding). Further, BCTs frequently co-occur in interventions and they can interact with each other . Hence, conclusions about the behaviour change potential of apps based on incorporation of BCTs should be interpreted cautiously as BCTs are not effective under all conditions. Caution interpreting our findings in terms of differences in the number of BCTs between apps is also warranted as we did not conduct formal statistical comparisons.
The increasing number and diversity of apps available makes its assessment a difficult task for the public and clinicians to differentiate which apps can be useful in promoting behaviour change. Presumably, the value of apps can be enhanced by developers incorporating more features, theory, and BCTs into their apps, which in turn will increase the behaviour change potential of the app. The current study suggests the higher potential quality of paid apps should be a factor to weigh when selecting and using apps for personal use, clinical intervention, or future research. Furthermore, guidelines can be created to influence and help app developers as to which BCTs (and other components) to include that likely will enhance the behaviour change potential of apps.
Despite the proliferation of physical activity and dietary apps, it is not clear whether they are effective at modifying behaviour. At present, there is a dearth of effectiveness data of app-based interventions to promote healthy behaviours , and robust, rigorously conducted and adequately powered trials are required to determine their effectiveness. On the other hand, app development proceeds at a rate that far out paces time frames typically observed in trial development and conduct. Thus, more dynamic forms of evaluation methods are required to determine the effectiveness of such technologies . Generally, the effectiveness of mHealth interventions such as text messaging for modifying health behaviours (e.g., smoking cessation) has been established ; however the effectiveness of more complex and dynamic mHealth interventions including apps has yet to be determined.
A strength of this study was the use of an established instrument to systematically rate the incorporation of BCTs in the respective apps. However, in the present study, the presence of BCTs was determined by user-testing the apps rather than from text descriptions. Some app features were not explicit during use. For example, reminders, weekly updates, and pop-up feedback, etc, may have occurred for one, but not all raters at any given time. Despite these issues, modest reliability between raters was observed (0.6). Another strength was the use of four raters, with a range of behaviour change experiences, which provided a more comprehensive assessment of the apps and the use of the taxonomy checklist. A major limitation of this study was not including apps from other app stores such as the Google Play Store/Android platform, or app stores from other countries besides NZ, which limits the generalisability of the findings. Nevertheless, we investigated the most popular and commonly downloaded apps of the iTunes Apple App Store Health & Fitness category, which represent a sample of apps that many people are using and therefore increases the study relevance. Of note, apps may exist that incorporate more evidence based BCTs than those included in the study sample as we only rated the most popular apps. Furthermore, technology has a dynamic nature with new apps and updates developed every day, consequently, these evaluations need to be updated periodically.
The advantages of mobile phone (mHealth) solutions compared to other health intervention delivery modes include the persistent interactivity, personalisation and engagement, potential to make healthcare more accessible and scalable, more cost-effective and more equitable . Such characteristics provide significant potential to assist in disease prevention strategies and supporting sustained change in lifestyle behaviours. However, there are too many apps for consumers and professionals to choose from . In addition, the majority within the health & fitness category of the Apple iTunes U.S. store scored less than 40 out of a possible 100 for functionality according to a recent report from the IMS Institute for Healthcare Informatics that concluded apps do little more than providing information . Emerging evidence demonstrates the need for collaboration between health behaviour change experts and app developers to create apps that include effective BCTs. Future research is also needed to better understand how individuals use apps after downloading them, and to investigate features that may impact user acceptability and preference .
Presence of BCTs varied by app type and price; however, BCTs associated with increased intervention effectiveness were in general more common in paid apps. The BCTs taxonomy checklist can be used by independent raters to reliably identify BCTs in physical activity and dietary behaviour smartphone apps.
University of Auckland Postgraduate Research Student Support was used by AD to fund app purchases.
- World Health Organization (WHO): Global Status Report On Noncommunicable Diseases 2010. 2010Google Scholar
- Brown T, Avenell A, Edmunds LD, Moore H, Whittaker V, Avery L, Summerbell C: For the PT: Systematic review of long-term lifestyle interventions to prevent weight gain and morbidity in adults. Obes Rev. 2009, 10 (6): 627-638.View ArticlePubMedGoogle Scholar
- Foster C, Hillsdon M, Thorogood M, Kaur A, Wedatilake T: Interventions for promoting physical activity. Cochrane Database Syst Rev. 2005, CD003180-1Google Scholar
- Oude Luttikhuis H, Baur L, Jansen H, Shrewsbury VA, O'Malley C, Stolk RP, Summerbell CD: Interventions for treating obesity in children. Cochrane Database Syst Rev. 2009, 1: CD001872-PubMedGoogle Scholar
- Waters E, de Silva-Sanigorski A, Burford BJ, Brown T, Campbell KJ, Gao Y, Armstrong R, Prosser L, Summerbell Carolyn D: Interventions for preventing obesity in children. Cochrane Database Syst Rev. 2011, CD001871-12Google Scholar
- Free C, Phillips G, Galli L, Watson L, Felix L, Edwards P, Patel V, Haines A: The effectiveness of mobile-health technology-based health behaviour change or disease management interventions for health care consumers: a systematic review. PLoS Med. 2013, 10 (1): 1-45.Google Scholar
- Kumar S, Nilsen WJ, Abernethy A, Atienza A, Patrick K, Pavel M, Riley WT, Shar A, Spring B, Spruijt-Metz D, Hedeker D, Honavar V, Kravitz R, Lefebvre RC, Mohr DC, Murphy SA, Quinn C, Shusterman V, Swendeman D: Mobile health technology evaluation: the mhealth evidence workshop. Am J Prev Med. 2013, 45 (2): 228-236.View ArticlePubMedPubMed CentralGoogle Scholar
- Steinhubl SR, Muse ED, Topol EJ: Can mobile health technologies transform health care?. JAMA. 2013, 310 (22): 2395-2396.View ArticlePubMedGoogle Scholar
- Mobile Health: 2012, http://pewinternet.org/Reports/2012/Mobile-Health.aspx,
- Abroms LC, Padmanabhan N, Thaweethai L, Phillips T: iPhone apps for smoking cessation: a content analysis. Am J Prev Med. 2011, 40 (3): 279-285.View ArticlePubMedPubMed CentralGoogle Scholar
- Abroms LC, Lee Westmaas J, Bontemps-Jones J, Ramani R, Mellerson J: A content analysis of popular smartphone apps for smoking cessation. Am J Prev Med. 2013, 45 (6): 732-736.View ArticlePubMedGoogle Scholar
- Breton ER, Fuemmeler BF, Abroms LC: Weight loss—there is an app for that! But does it adhere to evidence-informed practices?. Transl Behav Med. 2011, 1 (4): 523-529.View ArticlePubMedPubMed CentralGoogle Scholar
- Pagoto S, Schneider K, Jojic M, DeBiasse M, Mann D: Evidence-based strategies in weight-loss mobile apps. Am J Prev Med. 2013, 45 (5): 576-582.View ArticlePubMedGoogle Scholar
- Chomutare T, Fernandez-Luque L, Årsand E, Hartvigsen G: Features of mobile diabetes applications: review of the literature and analysis of current applications compared against evidence-based guidelines. J Med Internet Res. 2011, 13 (3): e65-View ArticlePubMedPubMed CentralGoogle Scholar
- Cowan LT, Van Wagenen SA, Brown BA, Hedin RJ, Seino-Stephan Y, Hall PC, West JH: Apps of steel: are exercise apps providing consumers with realistic expectations? A content analysis of exercise apps for presence of behavior change theory. Health Educ Behav. 2013, 40 (2): 133-139.View ArticlePubMedGoogle Scholar
- Riley W, Rivera D, Atienza A, Nilsen W, Allison S, Mermelstein R: Health behavior models in the age of mobile interventions: are our theories up to the task?. Transl Behav Med. 2011, 1 (1): 53-71.View ArticlePubMedPubMed CentralGoogle Scholar
- Abraham C, Michie S: A taxonomy of behavior change techniques used in interventions. Health Psychol. 2008, 27 (3): 379-387.View ArticlePubMedGoogle Scholar
- Michie S, Abraham C, Whittington C, McAteer J, Gupta S: Effective techniques in healthy eating and physical activity interventions: a meta-regression. Health Psychol. 2009, 28 (6): 690-701.View ArticlePubMedGoogle Scholar
- Hayes AF, Krippendorff K: Answering the call for a standard reliability measure for coding data. Commun Meth Meas. 2007, 1 (1): 77-89.View ArticleGoogle Scholar
- Doshi A, Patrick K, Sallis JF, Calfas K: Evaluation of physical activity web sites for use of behavior change theories. Ann Behav Med. 2003, 25 (2): 105-111.View ArticlePubMedGoogle Scholar
- West JH, Hall PC, Hanson CL, Barnes MD, Giraud-Carrier C, Barrett J: There’s an app for that: content analysis of paid health and fitness apps. J Med Internet Res. 2012, 14 (3): e72-View ArticlePubMedPubMed CentralGoogle Scholar
- Azar KMJ, Lesser LI, Laing BY, Stephens J, Aurora MS, Burke LE, Palaniappan LP: Mobile applications for weight management: theory-based content analysis. Am J Prev Med. 2013, 45 (5): 583-589.View ArticlePubMedGoogle Scholar
- Williams SL, French DP: What are the most effective intervention techniques for changing physical activity self-efficacy and physical activity behaviour—and are they the same?. Health Educ Res. 2011, 26 (2): 308-322.View ArticlePubMedGoogle Scholar
- Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, Eccles MP, Cane J, Wood CE: The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013, 46 (1): 81-95.View ArticlePubMedGoogle Scholar
- Peters G-JY, de Bruin M, Crutzen R: Everything should be as simple as possible, but no simpler: towards a protocol for accumulating evidence regarding the active content of health behaviour change interventions. Health Psychol Rev. 2013, Advance online publication. doi:10.1080/17437199.2013.848409Google Scholar
- Glynn L, Hayes P, Casey M, Glynn F, Alvarez-Iglesias A, Newell J, ÓLaighin G, Heaney D, Murphy A: SMART MOVE - a smartphone-based intervention to promote physical activity in primary care: study protocol for a randomized controlled trial. Trials. 2013, 14 (1): 1-7.View ArticleGoogle Scholar
- Mohr DC, Cheung K, Schueller SM, Hendricks Brown C, Duan N: Continuous evaluation of evolving behavioral intervention technologies. Am J Prev Med. 2013, 45 (4): 517-523.View ArticlePubMedGoogle Scholar
- Whittaker R, McRobbie H, Bullen C, Borland R, Rodgers A, Gu Y: Mobile phone-based interventions for smoking cessation. Cochrane Database Syst Rev. 2012, CD006611-11Google Scholar
- Whittaker R: Key issues in mobile health and implications for New Zealand. Health Care Inform Rev Onlin. 2012, 16 (2): 2-7.Google Scholar
- van Velsen L, Beaujean DJ, van Gemert-Pijnen JE: Why mobile health app overload drives us crazy, and how to restore the sanity. BMC Med Inform Decis Mak. 2013, 13 (1): 23-View ArticlePubMedPubMed CentralGoogle Scholar
- Aitken M, Gauntlett C, IMS Institute for Healthcare Informatics: Patient Apps for Improved Healthcare: From Novelty to Mainstream. 2013, NJ, USA: IMS Institute for Healthcare InformaticsGoogle Scholar
- Dennison L, Morrison L, Conway G, Yardley L: Opportunities and challenges for smartphone applications in supporting health behavior change: qualitative study. J Med Internet Res. 2013, 15 (4): e86-View ArticlePubMedPubMed CentralGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/14/646/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.