A novel experience-based internet intervention for smoking cessation: feasibility randomised controlled trial

Background

The internet is frequently used to share experiences of health and illness, but this phenomenon has not been harnessed as an intervention to achieve health behaviour change. The aim of this study was to determine the feasibility of a randomised trial assessing the effects of a novel, experience-based website as a smoking cessation intervention. The secondary aim was to measure the potential impact on smoking behaviour of both the intervention and a comparator website.

Methods

A feasibility randomised controlled single-blind trial assessed a novel, experience-based website containing personal accounts of quitting smoking as a cessation intervention, and a comparator website providing factual information. Feasibility measures including recruitment, and usage of the interventions were recorded, and the following participant-reported outcomes were also measured: Smoking Abstinence Self-Efficacy Questionnaire, the single-item Motivation to Stop Scale, self-reported abstinence, quit attempts and health status outcomes. Eligible smokers from two English regions were entered into the trial and given access to their allocated website for two weeks.

Results

Eighty-seven smokers were randomised, 65 completed follow-up (75 %). Median usage was 15 min for the intervention, and 5 min for the comparator (range 0.5–213 min). Median logins for both sites was 2 (range 1–20). All participant-reported outcomes were similar between groups.

Conclusions

It was technically feasible to deliver a novel intervention harnessing the online sharing of personal experiences as a tool for smoking cessation, but recruitment was slow and actual use was relatively low, with attrition from the trial. Future work needs to maximize engagement and to understand how best to assess the value of such interventions in everyday use, rather than as an isolated ‘dose of information’.

Trial registration

ISRCTN29549695 DOI 10.1186/ISRCTN29549695. Registered 17/05/2013.

The internet and social media have the potential to deliver accessible, low-cost health behaviour change interventions to smokers [1] who can access them privately and at a time and place of convenience to them. In England almost half of smokers surveyed reported interest in using online smoking cessation interventions [2]. Reviews of internet-based smoking cessation interventions have shown high levels of acceptability and user satisfaction [3], but comparisons of online interventions with usual care have had inconsistent findings [4]. The most promising interventions appear to be those that are structured, include some level of interactivity, and some tailoring to the individual user [3, 4]. More work is needed to determine the most effective elements of internet and social media interventions [1].

One of the key characteristics of current internet use, since the advent of Web 2.0 technologies that have enabled people to share information and interact online, and the widespread uptake of cheap broadband and mobile devices, is the interaction between people in internet settings, and the opportunities for online peer support. Over the last ten years consumers have become “pro-sumers”, producing as well as consuming content, sharing their experiences in blogs, fora, and other forms of social media. Ziebland and Wyke have shown that this internet-based sharing of people’s experience about health issues could influence health through seven domains: finding information, feeling supported, maintaining relationships with others, affecting behaviour, experiencing health services, learning to tell the story, and visualizing disease [5].

Taking the findings of the Ziebland and Wyke [5] conceptual review as the starting point, we attempted to harness the value of other people’s experiences by developing and testing three experienced-based internet interventions (multi-media websites): one for smoking cessation (reported here), and two other interventions which will be reported separately: one for asthma and one for carers of people with multiple sclerosis. This study builds on an emerging evidence base seeking to use digital tools to harness narrative information from peers to influence health behaviour (although not yet in the field of smoking cessation), for example studies on control of hypertension [6], attitudes to breast screening among African American women [7, 8], and lifestyle change for people with coronary heart disease and low-back pain [9].

For smokers, social support can be of benefit in quitting [10], although the evidence base is relatively limited [11, 12]. Peer support interventions may be of particular value to smokers who have fewer opportunities for informal social support [13]. A study of pregnant smokers showed that they valued high levels of personalized online support (from peers and ‘experts’) while quitting, maintaining abstinence and managing relapse [14], and there is an emerging literature on the value of online social networking in smoking cessation [15]. As described in the Theory of Planned Behaviour, social norms have an influence in health behavior change, as has been well recognized in the field of smoking cessation (e.g. [16]). Online social contact may also help smokers who are contemplating cessation, by both providing new ideas about strategies to try, and by helping to give the strategies authenticity, salience and meaning. It may have particular authority for those who feel that non-smoking health professionals (and family, friends, or colleagues) are not able to empathise with the challenges of quitting.

Brandt and colleagues [17] found that the majority of messages on a blog associated with a smoking cessation intervention could be categorized as ‘personal stories and experiences’ (53 %) or ‘emotional support’ (34 %) and that members of the blog could be inspired and motivated [17]. These authors propose social comparison as a mechanism for the beneficial effect of these messages: that users wanting to quit are motivated by stories from successful quitters; and that successful quitters are motivated to remain abstinent by reading posts from those who are in the early stages of quitting. This is supported by previous work on using testimonials to support smoking cessation which has shown that both inspiring ‘how to quit’ positive personal stories, as well as more negative accounts conveying ‘why to quit’ messages, can encourage quitting [18].

The primary aim of this study was therefore to determine the feasibility of trialing this novel experience-based website containing personal accounts of quitting as a smoking cessation intervention. The secondary aim was to report the effect of the intervention and comparator websites on various self-reported outcome measures including motivation to stop smoking, abstinence rates, and smoking abstinence self-efficacy.

Participants

Current smokers who indicated some willingness to quit were recruited through sixteen primary care practices in two regions of England between June 2013 and August 2014. Practices were identified and reimbursed through the local primary care research network and initiated as recruitment sites by the trial manager. Individuals were eligible if they had been smokers for at least one year, had some interest in quitting, were aged 18 years or over, lived in England and had internet access. We recruited men and women. Individuals were excluded if they were unable to read English or if they were terminally ill or had another significant disease or disorder which, in the opinion of the GP, may either put that person at risk because of participation in the study, or may influence the result of the study, or affect that person’s ability to participate in the study. General practitioners were asked to identify potentially eligible individuals and to mail out study participation invitation letters and information sheets with details of how to take part. Potential participants were required to contact the study team who then sent a consent form, and once this was returned, participants were invited to complete an eligibility screening questionnaire and enrolled.

Interventions

The ‘experience-based’ intervention was a multi-media website developed by the University of Oxford Health Experiences Research Group and the Healthtalk.org charity, guided by an advisory panel that included leading clinicians, researchers, and lay representatives. The content included text, video and audio extracts from qualitative interviews with 34 ex-smokers, who had been purposively recruited to capture a diverse range of experiences. The interviews were analysed qualitatively using a thematic approach to identify the common, important themes [19]. As a result, the research team prepared analytic summaries of 22 separate topics with over 250 illustrative video and audio extracts chosen from across the set of the interviews. These topic summaries with illustrative personal accounts were then presented on the website as a menu of topics which a user could browse and navigate in whichever way they chose. The website was not personalized to the individual user: all users experienced the same website and they could browse it in any order they chose. There was no ‘tunneling’ and no interactivity other than the option to provide feedback to the website team. Example topics were: first thinking about quitting; life events and their effect on people’s motivation to stop smoking; the role of others in the decision to quit; cutting down, unsuccessful attempts and trying again. The selection of topics, the wording of the summaries and the selection of illustrative clips were all guided by the advisory panel to help ensure that the site encapsulated the value of hearing a wide range of other people’s experiences of giving up smoking.

In this feasibility study we wanted to compare against a high quality information-based alternative. We therefore provided a website based on facts and figures about smoking cessation taken from NHS Choices (www.nhs.uk) the leading authoritative provider of online health information in the UK. This comparator site contained no personal experience information. We constructed a new site which had the look and feel of our intervention site (same design features, including video and audio clips of health professionals talking about smoking cessation, same colours and logos, same navigation, etc.) and contained ‘facts and figures’ information.

Design and procedures

This was a randomised, controlled, single-blind study. Potential participants completed an eligibility screening questionnaire and provided consent. They then completed baseline measures (using an online portal), after which they were randomised to have access to either the intervention or comparator website. Randomisation used a computer-generated random number sequence in a 1:1 ratio, created by an independent statistician. Each participant created their own username and password allowing unlimited access to their allocated website for a two-week period. After this participants were invited (by email) to complete final follow-up measures. Up to two emails and one telephone call were used as reminders. Participants could not be blind to the nature of the website to which they were allocated but they did not know whether they were receiving the comparator or the intervention website, only that we were evaluating two approaches to giving health information. Those conducting the analysis were blinded to allocation. We also conducted interviews with the participants in this trial and with participants in the two other trials attempting to harness online personal experiences as interventions and the joint analysis of these (across all 3 studies) will be reported separately [20].

Outcome measures

As a feasibility study, our primary measures concerned the number of participants consented and recruited, use of the websites (numbers of logins, page views, and time on site) and the numbers with completed outcome measures or lost to follow-up. We also used various self-report measures at two weeks post-randomisation to the website, mainly to test the feasibility of using these measures as for many of these we would not expect significant change in a short period of time: Motivation to Stop Scale (MTSS, single item with an 8-point scale); abstinence rates (single question); quit attempts (single question); Smoking Abstinence Self-efficacy Questionnaire (SASEQ, 6-item); and the 36-item Short Form Health Survey (SF36) (including both physical and mental dimensions and all subscales). Finally, we used the E-Health Impact Questionnaire (eHIQ) which captures the attitudes of respondents towards the website they have recently viewed [21, 22]. The eHIQ consists of two independently administered and scored parts (eHIQ-Part 1 and eHIQ-Part 2). The eHIQ part 1 consists of 11 items asking about a person’s general attitudes towards health-related websites. The eHIQ part 2 consists of 26 items asking about a person’s views regarding a specific health-related website. We therefore only used part-2 as an outcome measure.

Sample size and statistical analyses

As described above, this smoking cessation study was one of three feasibility studies harnessing patient experiences as interventions and the target sample size for each study was 100 participants, with the feasibility the primary determinant of this. In terms of effect sizes, based on a balanced 1:1 randomisation, the study would detect potential large effects of the intervention: for dichotomous outcomes these were equivalent to relative risks of 2.1 or above for a baseline rate of 30 % or less given an alpha of 0.05 and 90 % power; for continuous outcomes these detectable differences would be of the order of 0.4 standard deviations (SD) based on the same power and significance. Feasibility outcome measures were summarized using descriptive statistics such as rates reported as percentages. Formal hypothesis testing was not performed in this feasibility study. However, estimated difference in outcome measures of efficacy and corresponding 95 % confidence intervals were calculated using analysis of covariance (ANCOVA) adjusting for baseline values.

129 invitations were sent in response to expressions of interest in the study, and 89 individuals (69 %) completed registration (i.e. consented and completed baseline questionnaires). Two participants withdrew before randomisation, leaving 87 randomised participants. 44 of these (51 %) were allocated to the patient experience website. Of the randomised participants 22/87 (25 %) were lost to follow-up. Figure 1 shows the CONSORT flow diagram.

CONSORT flow diagram

Full size image

Table 1 shows baseline demographic and smoking characteristics of participants. Forty-five of the 87 participants (52 %) were women. Most participants were regular internet users who rated their internet ability as ‘good’ to ‘excellent’. Most reported smoking between 11 and 20 cigarettes per day (53 % of the sample). Although most had intentions to quit smoking, despite our inclusion criteria, 19 participants (22 %) reported either not wanting to quit (3 %, n = 3) or knowing that they should but not ‘really’ wanting to (18 %, n = 16). 27 participants reported having made an attempt to quit during the 2 weeks before starting the study (31 %).

The recorded usage of the websites is shown in Table 2. This does not include time spent on study enrolment or completing measures. This shows that the median number of logins in the two-week period for both sites was 2, with a median number of page views of 12 for the intervention site and 7 for the comparator site. The median duration of use of the patient experience site was 15 min, and for the comparator site was 5 min. According to these data, one user never logged in to their allocated site, and two other users logged in but did not record a page view or spend any time on the site. The accuracy of this data is discussed in the limitations section below.

No adverse events or harms were reported. The mean Smoking Abstinence Self-Efficacy Questionnaire (SASEQ) scores were similar between the randomised groups. The baseline mean score (SD) for the intervention group was 1.94 (1.02) and for the comparator group 1.84 (0.89), at 2-week follow-up these scores were 1.89 (0.99) and 1.71 (0.95) respectively. Both groups had low mean SASEQ scores indicating low self-confidence in abstaining from smoking in a variety of situations. An ANCOVA found an adjusted mean difference for the change in SASEQ scores between the two randomised groups of 0.155 (95 % CI −0.262 to 0.573), adjusted for baseline SASEQ scores (i.e. showing no significant difference).

The findings from the other exploratory comparisons of the smoking-specific outcome measures are shown in Table 3. This table shows that the baseline and follow-up scores and the change scores for the Motivation to Stop Scale, abstinence rates, and quit attempts, were similar between groups for baseline and follow-up measures and for change scores.

Table 4 shows the results for the E-Health Impact Questionnaire part 2 indicating very slight differences between groups, favouring the comparator “facts and figures” site, both in the overall score and in the “information and presentation” and “understanding and motivation” subscales (although in all cases the upper 95 % confidence interval limit was very close to no difference).

The results for the SF-36 were similar between groups. Participants in both arms showed non-significant improvement in the mental component and a very small, non-significant worsening in the physical component (see Table 5). There was no visible trend between the two groups. The adjusted mean differences between the two groups (ANCOVA analysis, n = 64 participants with full data, data not shown in tables) for the absolute change in physical component score of the SF-36 was 1.393 (95 % CI −0.702 to 3.489) and for the absolute change in mental component score was 0.785 (95 % CI −3.09 to 4.648) (no significant differences between groups).

The primary objective of this trial was to assess the feasibility of using a randomised trial to measure the impact of a novel internet intervention which attempts to harness patient experiences for behaviour change. The intervention was delivered to participants and there were no adverse events or protocol deviations. Our findings show that to a certain extent it was feasible to use a primary care approach to recruit and consent people who smoke to the study, although recruitment took a long time, and we only recruited 87 % of our target sample size (87/100). There has only been limited previous research into the optimum recruitment of participants to internet-based smoking cessation interventions, with a recent study suggesting the benefit of a combination of offline and online routes [23], and other studies have shown that online only approaches can yield high recruitment [24]. Our questionnaire responses suggest that the eligibility criteria were not always applied correctly: some smokers had already given up, while others had little desire to quit. It may be difficult to identify, through primary care, people who are poised to give up smoking yet are not currently trying, and who are willing to take part in a trial. We relied on primary care practices identifying potential participants according to the eligibility criteria, and they were free to do so in whichever way they chose. This limitation may have introduced some bias in the recruited population. Also, as might be expected for this type of intervention, the recruited participants had a relatively high self-rated ability to use the internet. By chance the intervention group contained more participants who used the internet once a week or less (n = 6) than the comparator group (n = 0).

This study was not designed to assess efficacy, but our comparisons between randomised groups showed no important differences on the self-report measures that included smoking-specific outcomes and health status. The eHIQ findings suggested that the participants rated the intervention site slightly lower for items reflecting trust and suitability of the content, and items reflecting learning relevant information and motivation to take action. In this study the comparator group received access to ‘gold standard’ factual information about smoking cessation, so it would be surprising if our novel intervention containing personal accounts of stopping smoking showed a major comparative benefit. The experience-based intervention group showed no harm compared with the fact-based website comparator.

Retention rates (75 % retention at two-weeks) were moderate, considering the short period of follow-up. We sent up to two reminder emails to participants to complete their self-report follow-up measures, and one telephone contact. Other work has shown the high levels of attrition in online trials of fully automated internet interventions, and the value of more intensive contact in reducing this [25, 26]. In future work we would recommend more telephone or SMS contact in addition to email to help minimize attrition. The absence of face-to-face contact is one attraction of internet trials for public health interventions as it lowers cost and allows them to be more geographically dispersed, but there is a trade-off between this lack of personal contact and rates of loss to follow-up.

We used a period of two weeks during which we invited participants to access their allocated website. In practice the median number of recorded logins was 2, and the median amount of time spent on the site was 10 min, although there was wide variation (up to 4 h ‘exposure’). This low actual use of an internet intervention is common in many e-health trials [27], and the plausibility of this level of exposure having an effect must be questioned. Future work should seek to maximize engagement with the intervention. McClure et al. [28] showed how intervention design can influence engagement with online smoking cessation, with relatively ‘directive’ design measures including a prescriptive message tone, dictating content viewing order, and sending reminder emails, all increasing engagement [28].

Future work should also address the issue of what constitutes a ‘dose’ of online information. We mean this in both a ‘dose as concept’ sense (should an information-based intervention be conceptualised as a ‘dose’ and assessed in the same ways as medicines), as well as in a ‘dose as measurement’ sense (how much of the intervention is required to have an effect). In a real world setting experiential information is rarely isolated from other resources, and internet users do not all use websites in the same way or ‘consume’ them in a two-week period. Internet users search and browse, and do not generally visit ‘on prescription’. Understanding and interpreting the level of use and the nature of engagement with a digital intervention in a trial setting, and drawing conclusions relevant to everyday use, represent major current challenges in digital heath research.

This was feasibility work and the next steps for this research, before progressing to a larger efficacy study with adequate power and length of follow-up, are as follows. Firstly, to refine the intervention, ensuring any further development is grounded in health psychology theory of behaviour change (for example using the Theory of Planned Behaviour, given the potential influence of the intervention on normative beliefs and subjective norms). Secondly, to ensure future recruitment more accurately and rapidly identifies eligible participants. Thirdly to maximize engagement with both the intervention and the trial, for example by using reminders and considering a more pragmatic design where use of the intervention fits more into everyday internet use, alongside other sources of help and information. In this work we compared against a high quality information alternative, as we wanted to determine whether any possible harms might arise with the novel intervention, compared with the information usually provided by the NHS. Future evaluation should determine the value of this intervention in addition to other smoking cessation approaches. It should also identify whether there are certain user groups that this type of intervention may benefit - perhaps groups who have low levels of social support, or perhaps people who have already quit and need help to maintain abstinence (in a qualitative study of online forum posts, Burri et al. analyzed the forum aimed at recent ex-smokers because it was far more active than forums aimed at current smokers [29]). Future work could also assess the potential value in being able to tell your story, as well as the opportunity for an experience-based intervention to be changed by its users, by examining interactive approaches to peer support. In this present study we used a curated website containing personal accounts which had been solicited and rigorously analysed, and which could be presented to each participant in the same way. In practice people who are giving up smoking may choose to contribute their own experiences and comments, as well as look at others, and websites which gather experiences tend to evolve over time. Future studies should also consider that barriers and facilitators to the wider implementation of this novel approach.

Smoking remains a major challenge for global public health. Alongside successful legislative measures such as changes to taxation or advertising rules, there remains a need for innovative approaches and resources to support or motivate smokers to give up [1]. The internet is playing a significant role in health and health care and offers one opportunity for innovative, low cost, highly scaleable approaches to smoking cessation. Harnessing online personal experiences of health and illness to deliver public health benefit is a new approach and we have shown this can be packaged as an intervention and we have tested the feasibility of assessing its impact in a randomised controlled trial. Future work needs to not only address the feasibility issues and investigate efficacy, but also determine the place of such an intervention alongside other tools, as well as methods to maximise engagement. In the real world, those smokers who are interested in seeking information or support online will increasingly find their own way to the websites that appeal to them when they are ready, which may be hard to predict. People considering a behaviour change such as smoking cessation are unlikely to use a single website at a single time, and future work should allow for more naturalistic access and use of such interventions.

ANCOVA:

Analysis of co-variance

CONSORT:

Consolidated standards of reporting trials

eHIQ:

E-Health Impact Questionnaire

MTSS:

Motivation to Stop Scale

NHS:

National Health Service

SASEQ:

Smoking Abstinence Self-efficacy Questionnaire

SD:

Standard deviation

SF36:

Short form health survey

UK:

United Kingdom

We are very grateful for the guidance provided by our Trial Steering Committee (TSC) chaired by Professor Elizabeth Murray. We thank all the participants who took part in the study. We thank the University of Oxford Health Experiences Research Group and the Healthtalk.org charity, particularly those who carried out the narrative interviews and contributed to the intervention and comparator sites. Many thanks also to Professor Sally Wyke for her help with the coding frame for the interviews. The iPEx study group is composed of: University of Oxford (Sue Ziebland, John Powell, Louise Locock, Andrew Farmer, Crispin Jenkinson, Rafael Perera, Nikki Newhouse, Ruth Sanders, Angela Martin, Laura Griffith, Susan Kirkpatrick, Nicolas Hughes, Laura Kelly, Braden O’Neill, Ally Bradley, Mina Davoudianfar, Ly-Mee Yu), University of Edinburgh (Fadhila Mazanderani), Northumbria University (Pamela Briggs, Elizabeth Sillence, Claire Hardy), University of Sussex (Peter Harris), University of Glasgow (Sally Wyke), Department of Health (Robert Gann), Oxfordshire Primary Care Trust (Sula Wiltshire), and User advisor (Margaret Booth). In addition to those named above, we thank Peter Davidson of the National Evaluation and Trials Coordinating Centre, and Maria Breen of the Oxford University Primary Care Clinical Trials Unit, for their advice.

Funding

The iPEx programme presents independent research funded by the UK National Institute for Health Research (NIHR) under its Programme Grants for Applied Research funding scheme (RP-PG-0608-10147). The views expressed in this paper are those of the authors, representing iPEx, and not necessarily those of the NHS, the NIHR or the Department of Health.

Availability of data and materials

The datasets analysed during the current study available from the corresponding author on reasonable request.

Authors’ contributions

JP led the study supported by SZ who led the overall programme of work; L-MY and SJ undertook the statistical analysis; MD managed the trial; NN, AM and LL contributed to intervention development, study design and piloting, recruitment, and other aspects of trial conduct. All authors contributed to interpretation of findings and writing up. All authors read and approved the final manuscript.

Competing interests

The authors declare that they have no competing interests.

Consent for publication

Not applicable.

Ethics approval and consent to participate

Ethical approval for this study was provided by the NHS Health Research Authority Research Ethics Committee, reference 13/NW/0162. All participants in the study provided consent.

Affiliations

1. Health Experiences Research Group, Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK

   • John Powell
   • , Nikki Newhouse
   • , Angela Martin
   • , Louise Locock
   •  & Sue Ziebland

2. Primary Care Clinical Trials Unit, Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK

   • Sena Jawad
   • , Ly-Mee Yu
   •  & Mina Davoudianfar

Corresponding author

Correspondence to John Powell.

Reprints and Permissions