- Study protocol
- Open Access
Efficacy of a smartphone-based intervention — “Holidaily” — promoting recovery behaviour in workers after a vacation: study protocol for a randomised controlled trial
BMC Public Health volume 20, Article number: 1286 (2020)
While work-related rumination increases the risk of acute stressors developing into chronic load reactions and adverse health, mental detachment has been suggested as a way to interrupt this chain. Despite the importance of mentally detaching from work during leisure time, workers seem to struggle to disengage and, instead, experience the constant mental representation of work-related stressors, regardless of their absence. Those who struggle with work-related rumination could benefit from an easy-access intervention that fosters mental detachment by promoting recreational activities. Especially during vacations, workers appear to naturally engage in sufficient recovery activities; however, this beneficial behaviour is not sustained. The smartphone app-based intervention “Holidaily” promotes recovery behaviour and, thus, mental detachment from work with the intension of extending the beneficial effects of workers’ vacations into their daily working life.
This randomised-controlled trial (RCT) evaluates the efficacy of “Holidaily”. The Holidaily app is a German stand-alone program for mobile devices with either Android/iOS operating systems. The sample includes workers, who are awaiting to go on vacation and are randomly assigned to either the intervention (IG) or a waitlist-control group (CG). The IG receives two weeks pre-vacation access to Holidaily, while the CG receives access two weeks post-vacation. On a daily basis participants in the IG are provided with three options promoting recreational activities and beneficial recovery experiences. Online questionnaires are distributed to all participants at several timepoints. The primary outcome measure assesses participants’ work-related rumination (Irritation Scale). A significant difference two weeks post-vacation is expected, favouring the IG. Secondary outcomes include symptoms of depression, insomnia severity, emotional exhaustion, thinking about work, recovery experiences, vacation specifics, work and personal characteristics. To help explain the intervention’s effect, explorative analyses will investigate the mediation properties of the frequency of engaging in recreational activities and the moderation properties of Holidaily users’ experiences.
If successful, workers will maintain their recovery behaviour beyond their vacation into daily working life. Findings could, therefore, provide evidence for low-intensity interventions that could be very valuable from a public-health perspective. App-based interventions have greater reach; hence, more workers might access preventative tools to protect themselves from developing adverse health effects linked to work-related rumination. Further studies will still be needed to investigate whether the vacation phenomenon of “lots of fun quickly gone” can be defied and long-term benefits attained.
German Clinical Trials Registration DRKS00013650. Registered retrospectively 15.01.2018.
Occupational stress and health
A large body of research has established that occupational stress can negatively impact workers’ physical and psychological health. Examples of adverse effects include increased heart rate and blood pressure , increased risk of coronary heart disease  and its recurrence [3,4,5,6], as well as metabolic syndrome , gastrointestinal issues  and, especially, mental health problems like sleep complaints  and depression [10, 11].
While chronic exposure to occupational stress can lead to adverse health effects, regular periods of respite can protect workers’ wellbeing and health [12, 13]. Results of a recent meta-analysis also suggest that recovery positively influences worker performance . Generally speaking, recovery can be defined as a process of unwinding, of reducing or eliminating strain caused by work stressors, thereby returning to pre-stress levels . Renowned models, like the effort-recovery model  and allostatic load model , explain how the initial adaptive stress response to acute stressors may develop into chronic load and sequential maladaptive stress reactions, unless recovery takes place. Although insufficient recovery may lead to health impairment, the transition from an acute to chronic load reaction can be averted when workers recover sufficiently and replenish both their mental and physical resources [15, 17, 18].
In turn, a risk factor that fosters the transition from acute stress to chronic load is repetitive negative thinking about work. This can be explained by the constant mental representation of work-related stressors, despite their absence , which is known as repetitive negative thinking. It has been assumed that repetitive thoughts prolong stress-related physiological activation [20, 21] and are a transdiagnostic risk-factor for the development and maintenance of stress-related conditions, such as depression, anxiety, sleep complaints, cardiovascular disease [22, 23], and eating and substance-related disorders [24,25,26]. The repetitive nature of this process is perceived as difficult to control and focuses on negative content  by ruminating about the past or worrying about the future . When repetitive negative thinking focuses on work, it can be referred to as work-related rumination. Work-related rumination has been described as perseverative cognition, whereby repetitive thoughts focus on work-related problems . Similarly, Mohr, Müller, Rigotti, Aycan and Tschan  label rumination as difficulty disconnecting from work during leisure time, either at home or during vacations, and named this cognitive irritation. Work-related rumination has been found to mediate the relationship between general work stress and sleep complaints , and the relationship between the appraisal of stressful interruptions at work and psychosomatic symptoms . The constant representation of negative thoughts can be considered a severe form of insufficient detachment from work .
While work-related rumination increases the risk of acute stressors developing into chronic load reactions and adverse health, mental detachment has been found to buffer this relationship. Mentally disengaging and experiencing a “sense of being away” (, p. 579) from work during leisure time describes the process of mental detachment . Although several recovery experiences are important, mental detachment has received the most research attention and been found to be particularly vital for the recovery process . Among others, the Stressor-Detachment Model  and DRAMMA Model  concordantly emphasise the central role of mental detachment in protecting workers from chronic load reactions. Results from several meta-analysis indicate that mental detachment is strongly related to health indicators like depression, burnout, sleep complaints, and general wellbeing . They also indicate a positive relationship between mental detachment and state of recovery amongst workers . Moreover, the influence of mental detachment does not seem limited to worker health and recovery. It also can affect workers’ creativity [37, 38]. Similar associations between both work-related rumination and the lack of mental detachment and health outcomes might be explained by findings that suggest a high degree of overlap between work-related rumination and (lower levels of) mental detachment . Despite the importance of mental detachment, workers who experience severe forms of occupational stress struggle, especially to mentally disengage or “switch off” from work, despite their increased need to recover .
Recovery during leisure time
Physical distance from work may, in turn, foster a “sense of being away”. Studies have indicated that work breaks [41,42,43] and leisure time in the evenings and on weekends [44, 45] can provide promising opportunities for recovery. Moreover, engaging in recovery behaviour (i.e., recreational activities like going for walks or seeing friends/family) may reduce work-related rumination by promoting mental disengagement from work . Vacations typically offer longer periods of respite [46, 47], and evidence suggests that spending time on vacation can positively effect workers’ mental health [48,49,50]. This is commonly termed the beneficial “vacation-effect”.
The beneficial “vacation-effect”
With regard to change in workers’ health indicators during their vacation, in one longitudinal field study, from pre- to mid-vacation, considerable improvement was identified in scores for fatigue, satisfaction, mood, tension and energy level (Cohen’s d = 0.73) . From a methodological point of view, this study contributes by raising awareness about the importance of assessing baseline scores 2 weeks prior to vacations, rather than immediately before. Baseline scores assessed directly before vacations can be biased, due to workers’ anticipation of their vacation [51, 52] or pre-vacation work stress [53–55]. Considering workers’ change in health indicators from pre- to post-vacation, one meta-analysis also detected an increase in positive and a decline in negative mood, exhaustion, and other negative outcomes, with a mean effect size, Cohen’s d = 0.43 . In de Bloom et al.’s (2016) observational study, the difference in recovery between workers staying at home and those traveling was investigated and no significant difference was found between the two groups. This is similar to the results of a recently-published randomised control trial (RCT) among middle-managers, which compared short-term vacations between the intervention group, who spent their vacation away, and the control group, who remained at home . Their findings indicate that 4 days away from work is sufficient for workers to experience beneficial effects in their wellbeing, strain, and recovery levels. Overall, irrespective of length and location, spending time on vacation appears to have an initial positive effect on workers’ mental health. However, this effect is not sustained after they return to daily working life.
The short-lived “vacation-effect”
Typically within 2 weeks of having resumed work, mental health indicators return to pre-vacation levels [46, 47, 56]. Interestingly, Kühnel and Sonnentag  found that relaxation experiences after vacations could delay the fading of beneficial effects. This creates the impression that promoting recreational activities, which in turn foster relaxation experiences, may help sustain the beneficial vacation effect. In another recently-published, pre-post-design, intervention study, which investigated whether a mobile application could extend the beneficial effects of a vacation, meaningful improvements in mental health outcomes were noted between pre-vacation and 14-days post-vacation, where workers scores did not return to pre-vacation levels, indicating that the beneficial effect could be prolonged . Consequently, while digital interventions may therefore be a promising tool, as they can be widely accessed by workers, RCT’s are needed to generate stronger evidence and provide insights into how worker recovery behaviours can be maintained beyond their vacation.
Internet- and mobile-based interventions
To date and to the best of our knowledge, only a few RCT’s have been conducted to assess the potential of an intervention to promote recovery behaviour and reduce work-related rumination among workers. Some internet-based recovery interventions that focus on reducing repetitive negative thinking in workers have been found to have substantial effects on work-related rumination, as assessed using the Irritation Scale , when comparing intervention and waitlist-control groups immediately post-intervention up to 6 months follow-up [59,60,61]. Results indicate that the intervention’s effect on the primary outcome, insomnia severity, was found to be mediated by both work-related rumination  and increased recreational activities . While these studies indicate the potential of digital interventions to reduce work-related rumination to a substantial and meaningful degree, they were not conducted in a vacation setting. Furthermore, internet-based interventions usually require a computer and might, therefore, be impractical for workers to access during their vacations.
App support for recovery
Instead, an increasingly popular way to provide behavioural interventions  supporting change and the maintenance of specific behaviours — like weight loss and physical activity , lifestyle modification among Type 1 and 2 diabetics  and mindfulness [65,66,67] — entails the use of mobile applications (apps). Apps constitute a low-threshold, scalable tool that is assumed to support behavioural change in real-world, real-time settings  and is promising for the delivery of mental and physical health interventions. For instance, in one meta-analysis on RCT’s, which focused on the efficacy of smartphone-based mental-health interventions for a clinical and non-clinical sample with depressive symptoms, a moderate positive effect was detected on depression relative to controls . In another recently published systematic review and meta-analysis of RCT’s investigating the efficacy of standalone smartphone apps for adults with heightened symptom severity (e.g., depression, anxiety, substance use, sleep complaints), a significant effect on depression was identified relative to controls . One crucial aspect of app-based interventions appears to be a good design, leading to a positive user experience. A positive user experience may determine participants engagement [71, 72], where in turn, participants engagement may determine interventions efficacy [73, 74]. The inclusion of gamification features additionally appears to enhance user engagement . Recent findings suggest that users’ recovery is uniquely predicted by the user experience of a gamified app .
Furthermore, from a public health perspective, an app-based intervention seems promising as a tool that can be accessed easily at times and places that are most convenient for its users. On the other hand, although apps may be convenient and practical, no studies to date have investigated their efficacy promoting recovery behaviours beyond workers’ vacations.
To summarize, for the protection of workers’ mental health, it is crucial to prevent acute stress from escalating into a chronic load reaction. One major risk factor for the development of chronic load reaction is work-related rumination, since the “sense of being away” is lacking and the individual is mentally preoccupied with work-related problems. Work breaks, and especially vacations, offer opportunities for recovery, as physical distance fosters mental disengagement. Moreover, workers engage in a variety of recreational activities that promote recovery and better mental health. This effect is short-lived, however. Nevertheless, vacations may offer an ideal intervention setting, particularly since workers already intuitively engage in recovery behaviours. Encouraging workers to maintain their engagement in recreational activities beyond their vacation and to implement healthier habits when they resume work, therefore, seems the next logical step. There is evidence that internet-based interventions may reduce work-related rumination, and that mobile applications promote health behaviour changes and increase mental health. However, to the best of our knowledge, the potential of mobile applications to prolong the beneficial vacation-effect by helping workers to maintain their recovery behaviours and, thereby, experience reduced work-related rumination, has not yet been investigated.
Primary research objective and hypothesis
The current protocol describes a randomised control trial (RCT) investigating the efficacy of the mobile application (app) “Holidaily 2.0”. It is assumed that Holidaily promotes recovery behaviour before, during and especially after vacations to prolong the beneficial vacation effect. Following the PICO framework, we hypothesise that (P-participants) workers returning to work after vacation using (I-intervention) the recovery promotion mobile application Holidaily 2.0. compared to (C-control) a wait-list control group experience (O-outcome) lower levels of work-related rumination 2 weeks after their vacation.
In addition, two explorative analyses will be conducted to investigate a potential underlying mechanism and further possible modifier of the assumed effect.
More specifically, given that levels of recreational activities are of major importance for the recovery process, they may account for the intervention’s underlying mechanism. For instance, in one intervention study, recreational activities appeared to mediate the intervention’s effect, with workers who engaged in recreational activities during lunch breaks experiencing higher levels of wellbeing at the end of their work day . These findings are in line with those of an earlier RCT, in which the intervention’s effect also was mediated by increased recreational activities, leading to fewer sleep complaints . In accordance with these findings and Holidaily’s intention to foster recreational activities, activity levels may explain, to a certain degree, the mechanism through which the intervention works, if it works at all.
Moreover, participants user experience might determine participants engagement [71, 72], where in turn, participants engagement may determine interventions efficacy [73, 74]. Recent findings by this study team suggest that users’ recovery is uniquely predicted by user experience . On an explorative basis, we therefore intend to investigate whether users’ experience moderates the intervention’s effect.
Analysis of secondary outcomes and other variables
Secondary health-related outcomes will also be compared in the intervention and waitlist-control groups. It is important to note that all analyses related to secondary outcomes will be descriptive and non-explanatory in nature. As intervention research on promoting recovery after vacations is in its infancy, evaluating a wide range of secondary outcomes will help us gain knowledge to generate further hypotheses and guide future studies. Finally, all variables not directly related to health, like personal and work characteristics, are considered other variables. Other variables will be used to evaluate a potentially underlying mechanism, effect modifier and confounders of the primary study outcome. Moreover, app-use compliance will be tracked and analysed on a descriptive basis (i.e., how often was the app used).
For a proof of concept study and employing a pre-post-design, our research team has investigated the feasibility of use of the app-based intervention “Holidaily 1.0.” amongst workers (N = 77) . Holidaily is a low-intensity, gamified, smartphone-based intervention. The app provides users with three suggestions promoting recovery behaviour daily. In this study, the intervention was begun 2 weeks prior to each worker’s vacation and continued beyond their return to daily working life. Initial findings were promising, as workers reported a significant improvement from 2 weeks before to 2 weeks after their vacation, and exhibited reduced work-related rumination during their leisure time, with an effect size of d = 0.68. To date, research indicates that, with no intervention, mental health variables resume baseline scores within 2 weeks after a vacation has ended . Our next step is to establish whether meaningful effects can also be detected when an intervention and control group are compared.
Therefore, the current two-armed randomised controlled trial is being conducted to evaluate the efficacy of the app-based intervention “Holidaily 2.0” relative to a waitlist-control group (CG). All participants are invited via email to complete online questionnaires 2 weeks prior to their vacation, on their last working day, in the middle of their vacation, at the end of their first day working post-vacation, and 2 weeks after their vacation has ended (see Table 1). The intervention group receives an additional questionnaire 4 weeks after their vacation (extended follow-up). On average, these assessments last 15–30 min each. After the CG complete their final questionnaire, 2 weeks after their vacation, they receive an automated code via Email which allows them to immediately access Holidaily.
All procedures were approved by the ethics committee of Leuphana University in Lueneburg (reference number: 201606, EB-Antrag Lehr201606_holidaily). The trial is registered with the German Clinical Trial Register (DRKS00013650).
Inclusion and exclusion criteria
To participate in the study, prospective applicants must sign up at least 14 days prior to their vacation. They also must be gainfully employed, at least 18 years of age, a smartphone user with internet access, willing to give informed consent, returning to work after their vacation, and indicating, with a score of ≥14 on the Irritation Scale, higher levels of work-related rumination . This last criterion was chosen to compare our results against those of previous studies that employed this criterion [60, 61] and only address those workers who struggle with mentally disengaging from work . A further requirement is that all participants must be able to read and write German to complete the questionnaires. Participants are excluded if they are taking part in other recovery/stress training, engaging in psychotherapy, or using variable-dose medication for sleeping complaints.
Recruitment and study execution have been taking place since the summer of 2017 and will continue until roughly the winter of 2021. Participants have been and will continue to be recruited via newspaper announcements, on-air media and related websites. Individuals interested in participating in the study can register anonymously online at www.holidaily.de by providing the research team with their e-mail address or by sending an e-mail to the research team directly. Potential participants receive an email with study information.
Prospective participants must complete an online screening questionnaire that includes questions to assess their level of work-related rumination and vacation period, and provide informed consent. The informed consent form provides details on the background, objectives and procedures of the study. Participants are assured that all data will remain confidential and that they have the right to withdraw from the study at any time. Participant identifiers will only be available to those conducting the study. Anonymised information will be used for analysis. Subjects are included in the study if they fulfil all the inclusion criteria and none of the exclusion criteria. They are then randomly allocated to one of two study conditions (see Fig. 1). Randomisation takes place once participants have completed the baseline questionnaire. Participants who fulfil the criteria will be randomly allocated in blocks with variable block length at a 1:1 ratio to the intervention or the control group. This balanced randomisation technique should ensure an equal distribution of participants into both groups. This concealed allocation sequence takes place automatically through the online platform Unipark (Questback, Cologne, Germany).
Assessment and allocation to the intervention
Participants are randomised to the conditions through a computer-generated algorithm created by Unipark. The allocation sequence is concealed to the researchers until interventions are assigned. For each measurement timepoint, participants receive an individual link via email that invites them to complete the online questionnaires at Unipark. Participants in the intervention group receive a personalized reminder 2 weeks after their vacation via email, asking them to complete the final questionnaire. All study-related information will be stored securely at the study site and handled with great care. Data are recorded and evaluated pseudonymised and transmitted in encrypted form. Data are stored on the server of Leuphana University in Lueneburg. Neither personal photos nor the content of notes in the app is transmitted or analysed. Only the amount of Dailys will be recorded for each participant.
Sample size calculation
Sample size calculation was based on the expected standardized difference in the primary outcome measure — work-related rumination (Irritation Scale, ) — between the intervention and control groups 2 weeks post vacation. Evidence from meta-analyses and systematic reviews on the efficacy of digital interventions for mental health, and specifically stress management, in workers indicate an effect size of g = 0.54 . More precisely, data on mental health apps as a standalone treatment for clinical samples targeting various conditions yield mixed results: for instance, a significant effect for depression g = 0.33, but no effect for anxiety . Few RCTs indicate the potential of any app-based intervention targeting stress-related complaints amongst workers [65, 66, 74]. Though clear results concerning the efficacy of app-based interventions cannot be drawn, findings nonetheless indicate their potential. From a public health perspective, the aim is to reach the whole population. As such, smaller effects are meaningful, as more people can potentially benefit from an intervention. Taking these two lines of reasoning together, we regard an effect of d = 0.20 for work-related rumination as meaningful, especially when considering that the app constitutes a low-intensity self-help intervention for the general working population. A priori G*Power analysis  for a two-tailed test, in which 80% power and a 5% significance level are assumed, indicates that an overall sample size of N = 788 is needed to detect differences statistically.
Intervention content and app design
The Holidaily app is a stand-alone program for mobile devices with either Android or iOS operating systems. Holidaily is available in German, Finish and English and was developed along several lines of research. Its key components are prompts for recreational activities, called “Dailys”. Dailys are based on behavioural activation strategies and refer to specific activities that positively influence mental health . To promote behavioural change, appropriate behaviour-change techniques — like health-development tracking and prompts — were included . An important element of the gamified app is its potential to reward participants by enabling the collection of points in exchange for completing Dailys and tracking one’s wellbeing (for examples, see Additional file 1).
Holidaily’s key features
The Holidaily-app consists of five sections (for examples, see Additional file 2). First, on the “Home” screen, users can keep track of their collected points and navigate directly to “Dailys”. The more points the user collects, the “richer” the background of the home screen appears. The avatar on the home screen also reflects whether users are on vacation or not. This is indicated by the avatar either holding a cup of coffee and wearing a business-like outfit, representing daily working life, or holding a cocktail and wearing a flower chain and hula skirt to indicate that they are on vacation.
The second section consists of “Dailys”. This is the main section, with each Daily corresponding to at least one of the six mechanisms of the DRAMMA model . The various exercises differ before, during, and after vacation. Dailys foster each mechanism to a different degree of intensity, duration and effort. This section consists of three features: (i) Users choose and “book” one Daily from three suggestions or, alternatively, generate their own recovery activity. Users can also place Dailys “on hold” to be carried out at a more convenient time. (ii) After the user completes the respective exercise, they are asked to rate it, based upon the six DRAMMA recovery experiences. Users rate the extent to which the Daily helped to foster the experiences of detachment, relaxation, autonomy, mastery, meaning and affiliation. The mean score of the user’s rating is displayed graphically in the third section, called “Recovery”. Encouraging users to rate their recovery experience fosters reflection over which particular activity was helpful for the individual’s recovery experience, while also encouraging perceived recovery self-efficacy. As a reward, users receive points for each completed Daily; (iii) users are presented with an overview of all “on hold”, “booked”, and “done” Dailys. The fourth section, “Feel”, invites users to rate their wellbeing using three validated, one-item questions regarding their experience of their past day, mood and energy level [81,82,83]. Users are encouraged to complete this section on a daily basis. The fifth section, “Recovery”, provides users with a summary of their recovery profile and has three sub-sections. Graphs visualize users’ recovery and wellbeing history, as well as their individual recovery strengths. This information is based on data entered by users. The section aims to promote users’ self-reflection, self-monitoring, and perceived self-efficacy.
Holidaily offers additional features, like information about the vacation location, weather forecasts, a walkthrough, and a section with additional information about the app’s scientific background. Pictures can be uploaded to individualize Holidaily’s interface and keep track of the completed Dailys (i.e., users can upload a photo and write a short note about how they completed the Daily). The Daily overview can serve as a diary and users can always go back to view their completed Dailys.
Improving adherence to the intervention
Several steps have been taken to improve participants’ adherence to intervention protocols and reduce non-responses, as suggested by Newman  (Additional file 2). For example, Holidaily sends push-messages on a daily basis to remind users to complete Dailys and rate their wellbeing. To further foster engagement in recovery behaviour, participants can search for specific Dailys that were particularly helpful at promoting experiences of recovery via a sorting function within the app. Users also receive a weekly feedback email that summarises their recovery development.
As high user exposure rates are considered pivotal to an app’s effectiveness , aspects highlighted by the Mobile App Rating Scale (MARS: ) were considered when designing Holidaily. Special focus was given to attain good user experiences, as they are considered by MARS to be highly influential, in terms of determining the quality of the app promoting behavioural change . More specifically, recent findings by this study team support this claim and that a user’s recovery seems to be uniquely predicted by the user’s experience with the app . Furthermore, an app review that investigated the use of gamification techniques in stress management apps identified 17 commonly-used gamification features . Of these 17 features, nine were considered during the designing of Holidaily (see Additional file 1). These, for instance, include the avatars called “Holidaisy” and “Holidave”, which reflect users’ wellbeing.
Holidaily-app intervention group
Participants in the Holidaily-app intervention group (IG) receive access to the Holidaily-training app 3 weeks before their vacation is due to start. After logging in, users create an individual profile for their upcoming vacation. This step includes entering the following data: vacation location, first and last day of work, and first and last day of vacation. Finally, users answer three questions related to each of the six DRAMMA dimensions. These questions will make it possible to compare their actual and desired levels of recovery experiences 2 weeks after returning from their vacation. After they have generated a personal vacation profile, users can start using the app, completing and keeping track of their Dailys and wellbeing.
Participants in the waitlist-control group (CG) are invited to answer the same questionnaires following the same timeframe as the IG. However, subjects in the CG only receives access to Holidaily 2 weeks after they have returned to work. Controls can, therefore, use Holidaily during their subsequent daily working life and next vacation.
Outcome measures & potential mediator and moderator
Work-related rumination after vacation is considered the primary outcome measure. Secondary outcome measures include mental health and work related health, and are only descriptive and non-explanatory in nature. Further variables not directly related to health, like personal and work characteristics, are defined as other variables. Table 1 provides an overview of all instruments applied at each measurement time point. Participants are asked to respond to all questions thinking about the previous week, unless otherwise clearly stated. All self-report measures are assessed in German.
A self-designed questionnaire is used to collect general and vacation specific demographic data 2 weeks prior to the vacation; for instance, participant’s age, sex, relationship status, number of children, educational background, work status (part/fulltime), work hours per week per their contract, and actual working hours, length of employment, whether or not they have a managerial position, frequency working from home, last/first work day, and first/last vacation day.
Directly before participants leave for their vacation, they are asked to indicate their anticipated work accumulation during their absence (on a scale 1–5), type of vacation, who they are going on vacation with and how good their relationship is (on a scale 1–10), do they perceive they have control regarding the organisation of their vacation (on a scale 1–10), what is their vacation destination and have they been there before, and what are their expectations regarding their vacation. Further vacation specific questions are asked directly after their vacation, including did they enjoy their vacation (on a scale 1–10); what was the weather like; did they have negative/positive experiences during their vacation (open-ended question); how many hours did they work during their vacation; and, if so, did they enjoy it and experience control over their work (on a scale 1–5); what did their work involve; and to what extent and how often were participants contacted by colleagues, clients or superiors during their vacation.
Primary outcome measure
Work-related rumination is measured using the cognitive irritation subscale of the Irritation Scale (IS) . This subscale consists of three items, each with a 7-point Likert response scale (range 0–6) to assess workers’ ability to mentally detach from work during leisure time. The level of internal consistency previously reported was Cronbach’s α = 0.89 .
Secondary outcome measures
All secondary outcomes are health-related.
Symptoms of depression is assessed with the Patient Health Questionnaire (PHQ-8) . This instrument consists of eight items. Participants indicate how “down, depressed, or hopeless” they feel on a 4-point Likert response scale (range 0–3). Internal consistency has been reported as α = 0.84 .
Insomnia severity is assessed using four items from the Insomnia Severity Index (ISI) . For example, participants are asked to rate, on a 5-point Likert scale (range 0–4), how much they struggled to sleep during the night. A summation score from participant’s answers is calculated. Internal consistency of this measure has been found to be α = 0.74 .
Emotional exhaustion is being measured with the Maslach Burnout Inventory General Survey (MBI-GS-D). Five items from the exhaustion subscale, assessed on a 6-point Likert scale (range 0–6), are used. Participants rate statements indicating whether their work made them feel emotionally drained or exhausted. The internal consistency of this measure has been reported as α = 0.85 .
Thinking about work
Further aspects related to thinking about work are assessed using the work-related rumination questionnaire (WRRQ) . The subscale, affective rumination, consists of five items and assesses workers’ negative and reoccurring thoughts about work; for example, “do I feel irritated by work issues when not at work?” The second subscale, problem-solving pondering, also consists of five items and assesses workers constructive thoughts about how they can improve their performance; for example, “after work, I tend to think of how I can improve my work-related performance”. All items are rated on a 7-point Likert response scale (range 0–6). Internal consistency has been found to be α = 0.90 for affective rumination and α = 0.81 for problem-solving pondering .
Participants’ recovery experiences are measured employing the DRAMMA questionnaire (DRAMMA-Q), which consists of six subscales measuring detachment, relaxation, autonomy, mastery, meaning and affiliation. All 18 items are rated on a 5-point Likert scale (range 0–4). DRAMMA-Q was based on existing, validated questionnaires, and has itself been validated .
The following measures are not directly related to mental health.
Various work characteristics of participants are also assessed. Unless otherwise stated, questions refer to the past 7 days. Work engagement is assessed using the Utrecht Work Engagement Scale (on a scale 1–7) (UWES: ). Other aspects such as, vitality (PANAS: [96, 97]) (on a scale 1–7), perceived need of recovery (NFR: ) (on a scale 1–5), and objective (TTCT) and subjective creativity (on scales 1–5) [99,100,101] are also assessed. Further measures include the perceived number of unfinished tasks (on a scale 1–5) ; work performance (e.g., did participants accomplish tasks that were beyond their job description?) (on a scale 1–7) (OCB: ); and whether participants experienced time pressure (on a scale 1–5) (ISTA: . We also take into consideration whether participants experience autonomy in the order in which they completed their tasks, as well as the variety of tasks at hand (on a scale 1–5) (WDQ: ), and whether they perceive receiving social support from their colleagues (on a scale 1–5) (SzSU: ).
For assessing workers ability to manage boundaries between their work and private life, we employ the Work-life Indicator (WLI)  and Work-Life-Balance scale (on a scale 1–6) (TKS-WLB: ) (on a scale 1–6), as well as the Life Satisfaction Scale (on a scale 1–7) (SWLS: ). Participants perceived levels of physical health and subjective wellbeing are measured (see for instance, ). Personal characteristics include resilience (RS) (on a scale 1–5) .
Potential mediator, moderator
Health behaviour: Recreational activities.
The frequency of participants’ engagement in recreational activities after work during the past week is assessed using 21 items from the Recreation Experience and Activity Questionnaire (ReaQ) . Items are rated on a 5-point Likert scale (range 0–4) and have an internal consistency of α = 0.88 .
Technical aspects: User experience.
Participants’ digital experiences using Holidaily are assessed employing a 28-item questionnaire from the AttrakDiff2 . A seven-point Likert scale is used for responses. The questionnaire provides information concerning global attractiveness (ATT), pragmatic quality (PQ), hedonic quality-identity (HQ-I), and hedonic quality-stimulation (HQ-S), and has an internal consistency of α = 0.94 .
All analyses will be reported according to the Consolidated Standards of Reporting Trials (CONSORT) for web-based and mobile health interventions , employing intention-to-treat (ITT) procedures. All reported p values will be two-tailed, with α = 0.05 the chosen significance level. Characteristics of the sample will be analysed using descriptive statistics. For the primary and all continuous secondary outcomes, Cohen’s d will be calculated based on group differences in means post-vacation, standardized by the pooled standard deviation of the post-vacation scores. Missing data will be dealt with following the recommendations of Little and Rubin  and Schafer . Multiple imputation (MI) is an especially robust approach for handling missing data . A stability score, in form of correlation analyses, will also be reported in the results section.
The primary analysis will evaluate the efficacy of Holidaily. The primary endpoint is the difference in work-related rumination, assessed using the irritation score, between the IG and CG 2 weeks after the vacation. We will use analysis of covariance (ANCOVA) to investigate differences in the primary outcome between the two groups, as simulation studies have demonstrated that ANCOVA is the most robust method for analysing RCT’s, in terms of protecting against bias, while enhancing precision and statistical power [117, 118]. Baseline scores for the primary outcome will be included as a covariate. In addition, for the analyses of differences in work-related rumination at the end of the last work day, mid-vacation and at the end of the first work day Bonferroni-Holm corrections will be used to reduce the chances of chance capitalisation .
To assess the robustness of these results, sensitivity analyses will be conducted. First, a separate analysis will be performed for participants who complete the main assessment 2 weeks after vacation (study completer sample). Second, all participants that used the app at least three times per week will be analysed (per protocol sample). Third, to account for potential baseline differences, despite randomisation, we will include all continuous variables with a between group difference of d = 0.20 or more and each categorical variable with 10% difference or more as covariates.
Secondary analyses will include further ANCOVAs for each mental health and work related health variable. Baseline scores for the respective independent outcome will be included as a covariate to control for potential baseline differences.
To assess the mediating role of proposed variables for the intervention’s effects on work-related rumination, mediation analysis will be performed . As Holidaily encourages users to engage in recreational activities, these may have increased 2 weeks after vacation among those in the IG. To attain temporal precedence, the change in reactional activities will be calculated (post-vacation minus pre-vacation scores). An indirect effect is considered significant if its 95% confidence interval excludes zero.
In addition, when employing mobile interventions, it may appear relevant to investigate whether users’ technical experience moderates the intervention’s effect. For this reason, participants’ user experience will be considered as a moderator. To detect significant moderation, the Johnson-Neyman (J-N) [120, 121] procedure will be used to pinpoint at which moderation value a meaningful difference between groups is observable in the primary outcome.
This study protocol describes a randomised control trial (RCT) examining the efficacy of a newly-developed behaviour change smartphone app, called Holidaily. Holidaily encourages workers to engage in recreational activities before, during and especially after vacations to ideally prolong the beneficial effects of vacationing. We expect levels of the primary outcome, work-related rumination, to be significantly lower 2 weeks post vacation in the intervention versus waitlist-control group. This finding would be important, especially because the constant mental representation of stressors, despite their absence, has been found to extend stress-related physiological activation and, thereby, contribute to the development and maintenance of mental illness. In addition, the hypothesised mechanism — that a change in recreational behaviour causes the effect on work-related rumination — will be investigated via mediation analysis.
Particularly because intervention research on the promotion of recovery after vacations is in its infancy, the present study can contribute to the emerging field in several ways.
First, to the best of our knowledge, this is the first RCT to investigate the efficacy of an app-based intervention encouraging workers to improve and maintain their engagement in recreational activities, with the aim of reducing work-related rumination beyond their vacation into daily working life.
Second, implementing an intervention that promotes recovery behaviours during a period when workers naturally engage in restorative activities may be promising. A systematic review of behaviour theories by Kwasnicka et al.  suggests that initiating behaviour change should occur when an individual’s motivation level is high and their opportunity costs are low. Especially during vacations, it appears that workers can effortlessly create opportunities and are naturally invested, as well as motivated, to engage in recreational activities [46, 47]. Although vacations seem to offer a promising starting point for implementing a behaviour change intervention, this has not yet been investigated. Our study’s findings may, therefore, contribute by assessing the value of promoting behaviour change maintenance during and beyond workers’ vacations.
Third, so far, only high-intensity interventions — such as personally-guided web-based training — have been investigated and found effective at reducing work-related rumination (i.e., ). Consequently, little is known about app-based interventions’ potential when targeting the reduction of work-related rumination. From a public-health perspective, app-based interventions may be a favourable alternative, as internet-based interventions usually require a laptop computer, which might be inconvenient for workers to access during their vacations. As such, app-based interventions may be more practical, since they can be accessed flexibly and independent of time and place. Our study could, therefore, contribute to this research field by providing insights into the effectiveness of app-based interventions.
Fourth, investigating a potentially underlying mechanism may extend our understanding of the efficacy of low-intensity interventions and health behaviour. Mediation analysis will assess whether change in recreational activities mediates the app’s effect on work-related rumination.
Fifth, exploring whether users’ technical experience with Holidaily contribute to a greater intervention effect could be of great value when designing future app-based interventions. For this reason, moderation analysis will be performed, focusing on Holidaily users’ experiences and the intervention’s effectiveness.
Despite the potential contributions of the present study, several limitations must be considered. First, this study’s recruitment strategy involves public media, including Facebook, Instagram, and both radio and TV interviews. Prior to receiving access to Holidaily, the waitlist-control group might become aware of the intervention’s primary aim: to promote the maintenance of recovery behaviours beyond vacations. This could, perhaps, lead to behavioural changes in the waitlist-control group, as well. If this happens, the intervention’s effect could be diffused , indicating only small differences between the two groups at 2 weeks after vacation, leading to underestimation of the app’s true potential. Although public media might reduce the study’s internal validity, external validation of the app might be greatly improved. By broadcasting about the intervention via public media, a potentially wider range of workers could learn about public health measures and may, thus, access health interventions like Holidaily. As a result, the study’s samples may become more heterogenous. Overall, recruiting via public media mimics real-life implementation of health promotion and, therefore, increases the external validity of the current study.
Second, relative to high-intensity interventions and clinical studies, the expected effect size could be considered relatively small. However, this interpretation might be misleading. Clinical studies commonly target mental illnesses like depression and anxiety , where a greater range of improvement is expected. Conversely, this study targets a risk factor in the general working population for which a smaller degree of improvement is anticipated. This has been described as the prevention paradox , stating: “however much it may offer to the community as a whole, it offers little to each participating individual” (, page 1850). Accordingly, health-promotion strategies might only offer a small amount of benefit per individual, but exert a major societal impact by reaching a large population. At a population level, promoting the reduction of work-related rumination may contribute to the prevention of mental illnesses and may, therefore, be beneficial to a larger population. In turn, this also could reduce the costs and time otherwise spent on later treatment for mental illnesses triggered by work-related rumination.
Third, findings from previous observational studies suggest that the beneficial vacation effect experienced by workers is not sustained, but fades out shortly after they return to work, with mental health indicators returning to pre-vacation levels [46, 47, 56]. Consistent with previous investigators, who usually selected 2 weeks to describe the fading effect, we maintained this timeframe for our primary measurement. Additionally, a 2 week extended follow-up also is included, albeit only to assess stabilisation after the vacation in the intervention group. Further investigations are, therefore, needed. While 2 weeks may be insufficient to verify lasting behavioural changes, they might provide insights into whether the fadeout effect can be reduced. If Holidaily appears to be effective in the short-term only, future studies should also consider potential facilitators and barriers for long-term maintenance.
In the present study, three possible barriers might limit the intervention’s effect to two-weeks. For instance, after their vacation, workers may experience reduced motivation and increased effort to engage in recovery behaviours, due to stresses encountered at work (e.g., work accumulation during their absence; see also ). This might lead to an initial relapse, prompting the fading of the beneficial effect. To overcome such barriers, certain behavioural change techniques, like prompts and self-monitoring, were integrated into this intervention to promote engagement in recovery behaviours during daily working life. It is unclear whether these are appropriate strategies, however. To assess changes and control for potential confounders, for instance, workers’ motivation/engagement is being measured by the Utrecht Work Engagement Scale 
Second, the length of workers’ vacation may play a greater role determining the maintenance of behavioural change than previously anticipated. In one study, as few as 18 or as many as 254 days are required before a newly adopted health behaviour — like improved diet or regular exercise — becomes stable and replaces previously dominant behaviours . Contrastingly, workers in Germany are legally entitled to a minimum of 24 days of paid vacation. Although the length of workers’ vacation period may be long enough to initiate short-term behavioural change, it might be insufficient for benefits to be maintained long-term. Hence, vacation length will be considered as a confounder.
Third, contrary to studies that suggest that fading of the beneficial vacation effect could be related to barriers hindering behaviour change maintenance, in fact this could be an expression of hedonic adaptation. According to Norrish and Vella-Brodrick , individuals quickly adapt to change, beneficial effects and novel situations. To counteract adaptation, literature highlights the importance of variety . Although varying recreational activities are integrated into the intervention, perhaps further digital elements — like audio and video features demonstrating specific recovery exercises, or the capacity to upload a video recording from their vacation — could be useful.
Finally, a strong conclusion about the efficacy of the intervention can only be drawn for the primary outcome, the effect of Holidaily on work-related rumination. Results for all secondary outcomes and other variables are descriptive in nature and should therefore be interpreted with caution. However, as interventional research aiming to prolong the beneficial effects of vacation is in its infancy the broad assessment of secondary outcomes should expand the knowledge in this under researched field and guide future research.
In summary, this study uses a naturally occurring emotional highlight, workers’ vacations, as a starting point to encourage workers to maintain their beneficial health behaviours beyond their return to work. If successful, this study’s findings could provide evidence for low-intensity interventions to promote mental health amongst workers. App-based interventions have an especially great reach. Consequently, more workers could access preventative tools to help protect them from mental illness linked to work-related rumination. Finally, the strategy of using positively-tuned events (i.e., vacations) to implement health promotion might also be a viable option for addressing other health behaviours.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author upon reasonable request.
Randomised control trail
Eddy P, Wertheim EH, Kingsley M, Wright BJ. Associations between the effort-reward imbalance model of workplace stress and indices of cardiovascular health: a systematic review and meta-analysis. Neurosci Biobehav Rev. 2017;83:252–66 https://doi.org/10.1016/j.neubiorev.2017.10.025.
Li J, Zhang M, Loerbroks A, Angerer P, Siegrist J. Work stress and the risk of recurrent coronary heart disease events: a systematic review and meta-analysis. Int J Occup Med Environ Health. 2015;28(1):8–19 https://doi.org/10.2478/s13382-014-0303-7.
Dragano N, Siegrist J, Nyberg ST, Lunau T, Fransson EI, Alfredsson L, Kivimäki M. Effort-reward imbalance at work and incident coronary heart disease: a multicohort study of 90,164 individuals. Epidemiology. 2017;28(4):619–26 https://doi.org/10.1097/EDE.0000000000000666.
Kivimäki M, Nyberg ST, Batty GD, Fransson EI, Heikkilä K, Alfredsson L, Theorell T. Job strain as a risk factor for coronary heart disease: a collaborative meta-analysis of individual participant data. Lancet. 2012;380(9852):1491–7 https://doi.org/10.1016/S0140-6736(12)60994-5.
Kivimäki M, Virtanen M, Elovainio M, Kouvonen A, Väänänen A, Vahtera J. Work stress in the etiology of coronary heart disease - a meta-analysis. Scand J Work Environ Health. 2006;32(6):431–42 https://doi.org/10.5271/sjweh.1049.
Richardson S, Shaffer JA, Falzon L, Krupka D, Davidson KW, Edmondson D. Meta-analysis of perceived stress and its association with incident coronary heart disease. Am J Cardiol. 2012;110(12):1711–6 https://doi.org/10.1016/j.amjcard.2012.08.004.
Tenk J, Mátrai P, Hegyi P, Rostás I, Garami A, Szabó I, Balaskó M. Perceived stress correlates with visceral obesity and lipid parameters of the metabolic syndrome: a systematic review and meta-analysis. Psychoneuroendocrinology. 2018;95(December 2017):63–73 https://doi.org/10.1016/j.psyneuen.2018.05.014.
Nixon AE, Mazzola JJ, Bauer J, Krueger JR, Spector PE. Can work make you sick? A meta-analysis of the relationships between job stressors and physical symptoms. Work Stress. 2011;25(1):1–22 https://doi.org/10.1080/02678373.2011.569175.
Litwiller B, Snyder LA, Taylor WD, Steele LM, Litwiller B, Snyder LA, Steele LM. The relationship between sleep and work: a meta-analysis. J Appl Psychol. 2016;101(10) https://doi.org/10.1037/apl0000169.
Madsen IEH, Nyberg ST, Magnusson Hanson LL, Ferrie JE, Ahola K, Alfredsson L, Kivimäki M. Job strain as a risk factor for clinical depression: systematic review and meta-analysis with additional individual participant data. Psychol Med. 2017;47(8):1342–56 https://doi.org/10.1017/S003329171600355X.
Theorell T, Hammarström A, Aronsson G, Träskman Bendz L, Grape T, Hogstedt C, Hall C. A systematic review including meta-analysis of work environment and depressive symptoms. BMC Public Health. 2015;15(1):1–14 https://doi.org/10.1186/s12889-015-1954-4.
Bennett AA, Bakker AB, Field JG. Recovery from work-related effort: a meta-analysis. J Organ Behav. 2018;39(3):262–75 https://doi.org/10.1002/job.2217.
Steed LB, Swider BW, Keem S, Liu JT. Leaving work at work: a meta-analysis on employee recovery from work. J Manag. 2019:1–31 https://doi.org/10.1177/0149206319864153.
Sonnentag S, Venz L, Casper A. Advances in recovery research: What have we learned? What should be done next? J Occup Health Psychol. 2017;22(3):365.
Meijman TF, Mulder G. Psychological aspects of workload. In: Drenth PJD, Thierry H, de Wolff CJ, editors. Handbook of work and organizational psychology, Work psychology, vol. 2. 2nd ed. Hove: Psychology Press; 1998. p. 5–33.
McEwen BS. Stress, adaptation, and disease. Allostasis and allostatic load. Ann N Y Acad Sci. 1998;840(1):33–44.
Geurts SA, Sonnentag S. Recovery reactions and chronic health impairment. Scand J Work Environ Health. 2006; https://doi.org/10.5271/sjweh.1053.
Wendsche J, Lohmann-Haislah A. A meta-analysis on antecedents and outcomes of detachment from work. Front Psychol. 2017;7(2072) https://doi.org/10.3389/fpsyg.2016.02072.
Brosschot JF, Pieper S, Thayer JF. Expanding stress theory: prolonged activation and perseverative cognition. Psychoneuroendocrinology. 2005;30(10):1043–9 https://doi.org/10.1016/j.psyneuen.2005.04.008.
Brosschot JF, Gerin W, Thayer JF. The perseverative cognition hypothesis: a review of worry, prolonged stress-related physiological activation, and health. J Psychosom Res. 2006;60(2):113–24 https://doi.org/10.1016/j.jpsychores.2005.06.074.
Ottaviani C, Thayer JF, Verkuil B, Lonigro A, Medea B, Couyoumdjian A, Brosschot JF. Physiological concomitants of perseverative cognition: a systematic review and meta-analysis. Psychol Bull. 2016;142(3):231–59 https://doi.org/10.1037/bul0000036.
Ehring T, Watkins ER. Repetitive negative thinking as a transdiagnostic process. Int J Cogn Ther. 2008;1(3):192–205 https://doi.org/10.1521/ijct.2008.1.3.192.
Watkins ER. Constructive and unconstructive repetitive thought. Psychol Bull. 2008;134(2):163–206 https://doi.org/10.1037/0033-2909.134.2.163.
Aldao A, Nolen-Hoeksema S, Schweizer S. Emotion-regulation strategies across psychopathology: a meta-analytic review. Clin Psychol Rev. 2010;30(2):217–37 https://doi.org/10.1016/j.cpr.2009.11.004.
Frone MF. Relations of negative and positive work experiences to employee alcohol use: testing the intervening role of negative and positive work rumination. J Occup Health Psychol. 2015;20(2):148–60 https://doi.org/10.1016/j.physbeh.2017.03.040.
McLaughlina KA, Nolen-Hoeksemab S. Rumination as a transdiagnostic factor in depression and anxiety. Behav Res Ther. 2011;49(3):186–93 https://doi.org/10.1038/jid.2014.371.
Wisco BE, Plate AJ, May CL, Aldao A. A latent profile analysis of repetitive negative thinking: distinguishing ruminators from worriers. J Exp Psychopathol. 2018;9(4):2–14 https://doi.org/10.1177/2043808718811428.
Cropley M, Zijlstra F. Work and Rumination. In: Langan-Fox J, Cooper CL, editors. Handbook of Stress in the Occupations. Cheltenham: Edward; 2011.
Mohr G, Müller A, Rigotti T, Aycan Z, Tschan F. The assessment of psychological strain in work contexts: concerning the structural equivalency of nine language adaptations of the irritation scale. Eur J Psychol Assess. 2006;22(3):198–206 https://doi.org/10.1027/1015-5718.104.22.168.
Van Laethem M, Beckers DG, Kompier MA, Kecklund G, van den Bossche SN, Geurts SA. Bidirectional relations between work-related stress, sleep quality and perseverative cognition. J Psychosom Res. 2015;79(5):391–8.
Zoupanou Z, Rydstedt LW. The mediating and moderating role of affective rumination between work interruptions and well-being. Work. 2019;62(4):553–61. https://doi.org/10.3233/WOR-192890.
Sonnentag S, Bayer UV. Switching off mentally: predictors and consequences of psychological detachment from work during off-job time. J Occup Health Psychol. 2005;10(4):393.
Etzion D, Eden D, Lapidot Y. Relief from job stressors and burnout: reserve service as a respite. J Appl Psychol. 1998;83(4):577–85 https://doi.org/10.1037//0021-9010.83.4.577.
Sonnentag S, Fritz C. The recovery experience questionnaire: development and validation of a measure for assessing recuperation and unwinding from work. J Occup Health Psychol. 2007;12(3):204–21 https://doi.org/10.1037/1076-8922.214.171.124.
Sonnentag S, Fritz C. Recovery from job stress: the stressor-detachment model as an integrative framework. J Organiz Behav. 2014;36(1):72–103 https://doi.org/10.1002/job.1924. Recovery.
Newman D, Tay L, Diener E. Leisure and subjective well-being: a model of psychological mechanisms as mediating factors. J Happiness Stud. 2014;15(3):555–78 https://doi.org/10.1007/s10902-013-9435-x.
de Jonge J, Spoor E, Sonnentag S, Dormann C, van den Tooren M. “Take a break?!” off-job recovery, job demands, and job resources as predictors of health, active learning, and creativity. Eur J Work Organ Psychol. 2012;21(3):321–48 https://doi.org/10.1080/1359432X.2011.576009.
Vahle-Hinz T, Mauno S, de Bloom J, Kinnunen U. Rumination for innovation? Analysing the longitudinal effects of work-related rumination on creativity at work and off-job recovery. Work Stress. 2017;31(4):315–37 https://doi.org/10.1080/02678373.2017.1303761.
Weigelt O, Gierer P, Syrek CJ. My mind is working overtime—towards an integrative perspective of psychological detachment, work-related rumination, and work reflection. Int J Environ Res Public Health. 2019;16(16) https://doi.org/10.3390/ijerph16162987.
Sonnentag S. The recovery paradox: portraying the complex interplay between job stressors, lack of recovery, and poor well-being. Res Organ Behav. 2018;38:169–85 https://doi.org/10.1016/j.riob.2018.11.002.
de Bloom J, Sianoja M, Korpela K, Tuomisto M, Lilja A, Geurts S, Kinnunen U. Effects of park walks and relaxation exercises during lunch breaks on recovery from job stress: two randomized controlled trials. J Environ Psychol. 2017b;51:14–30 https://doi.org/10.1016/j.jenvp.2017.03.006.
Hunter EM, Wu C, Hunter EM, Wu C. Give me a better break: choosing workday break activities to maximize resource recovery. J Appl Psychol. 2015;101(2):302 https://doi.org/10.5465/AMBPP.2013.16859abstract.
Sianoja M, Syrek CJ, de Bloom J, Korpela K, Kinnunen U. Enhancing daily well-being at work through lunchtime park walks and relaxation exercises: recovery experiences as mediators. J Occup Health Psychol. 2017;23(3):428 https://doi.org/10.1037/ocp0000083.
Fritz C, Sonnentag S, Spector PE, McInroe JA. The weekend matters: relationships between stress recovery and affective experiences. J Organ Behav. 2010;31(1):1137–62 https://doi.org/10.1002/job.
Sonnentag S, Binnewies C, Mojza EJ. Did you have a nice evening? A Day-Level Study on Recovery Experiences, Sleep, and Affect. J Appl Psychol. 2008;93(3):674–84.
de Bloom J, Geurts SAE, Kompier MAJ. Vacation (after-) effects on employee health and well-being, and the role of vacation activities, experiences and sleep. J Happiness Stud. 2013;14(2):613–33 https://doi.org/10.1007/s10902-012-9345-3.
de Bloom J, Kompier M, Geurts S, de Weerth C, Taris T, Sonnentag S. Do we recover from vacation? Meta-analysis of vacation effects on health and well-being. J Occup Health. 2009;51(1):13–25 https://doi.org/10.1539/joh.K8004.
Chen Y, Lehto XY, Cai L. Vacation and well-being: a study of chinese tourists. Ann Tour Res. 2013;42:284–310 https://doi.org/10.1016/j.annals.2013.02.003.
de Bloom J, Geurts SAE, Kompier MAJ. Effects of short vacations, vacation activities and experiences on employee health and well-being. Stress Health. 2012;28(4):305–18 https://doi.org/10.1002/smi.1434.
de Bloom J, Nawijn J, Geurts S, Kinnunen U, Korpela K. Holiday travel, staycations, and subjective well-being. J Sustain Tour. 2017a;25(4):573–88 https://doi.org/10.1080/09669582.2016.1229323.
Gilbert D, Abdullah J. Holidaytaking and the sense of well-being. Ann Tour Res. 2004;31(1):103–21 https://doi.org/10.1016/j.annals.2003.06.001.
Nawijn J, de Bloom J, Geurts S. Pre-vacation time: blessing or burden? Leis Sci. 2013;35(1):33–44 https://doi.org/10.1080/01490400.2013.739875.
DeFrank RS, Konopaske R, Ivancevich JM. Executive travel stress: perils of the road warrior. Acad Manag Exec. 2000;14(2):58–70.
Syrek C, Weigelt O, Kühnel J, de Bloom J. All I want for Christmas is recovery – changes in employee affective well-being before and after vacation. Work Stress. 2018;8373:1–21 https://doi.org/10.1080/02678373.2018.1427816.
Westman M. Strategies for coping with business trips: a qualitative exploratory study. Int J Stress Manag. 2004;11(2):167–76 https://doi.org/10.1037/1072-5245.11.2.167.
Blank C, Gatterer K, Leichtfried V, Pollhammer D, Mair-Raggautz M, Duschek S, et al. Short vacation improves stress-level and well-being in german-speaking middle-managers—a randomized controlled trial. Int J Environ Res Public Health. 2018;15(1):130 https://doi.org/10.3390/ijerph15010130.
Kühnel J, Sonnentag S. How long do you benefit from vacation? A closer look at the fade-out of vacation effects. J Organ Behav. 2011;32(1):125–44 https://doi.org/10.1002/job.699.
Smyth A, Syrek C, Reins JA, Domin M, Janneck M, Lehr D. User experience predicts the effectiveness of a gamified recovery app: investigation of Holidaily—an app promoting recovery behavior after vacation and during daily working life. Pravention Und Gesundheitsforderung. 2018;13(4):319–26 https://doi.org/10.1007/s11553-018-0664-z.
Behrendt D, Ebert DD, Spiegelhalder K, Lehr D. Efficacy of a self-help web-based recovery training in improving sleep in workers: randomized controlled trial in the general working population. J Med Internet Res. 2020;22(1):1–18 https://doi.org/10.2196/13346.
Ebert D, Berking M, Thiart H, Riper H, Laferton J, Cuijpers P, et al. Restoring depleted resources: efficacy and mechanisms of change of an internet-based unguided recovery training for better sleep and psychological detachment from work. Health Psychol. 2015;34:1240–51.
Thiart H, Lehr D, Ebert DD, Berking M, Riper H. Log in and breathe out: internet-based recovery training for sleepless employees with work-related strain – results of a randomized controlled trial. Scand J Work Environ Health. 2015;41(2):164–74 https://doi.org/10.5271/sjweh.3478.
Zhao J, Freeman B, Li M. Can mobile phone apps influence people’s health behavior change? An evidence review. J Med Internet Res. 2016;18(11):1–12 https://doi.org/10.2196/jmir.5692.
Mateo GF, Granado-Font E, Ferré-Grau C, Montaña-Carreras X. Mobile phone apps to promote weight loss and increase physical activity: a systematic review and meta-analysis. J Med Internet Res. 2015;17(11):1–11 https://doi.org/10.2196/jmir.4836.
Wu X, Guo X, Zhang Z. The efficacy of mobile phone apps for lifestyle modification in diabetes: systematic review and meta-analysis. J Med Internet Res. 2019;21(1):1–13 https://doi.org/10.2196/12297.
Bostock S, Crosswell AD, Prather AA, Steptoe A, Kingdom U, Francisco S, Kingdom U. Mindfulness on-the-go: effects of a mindfulness meditation app on work stress and well-being. J Occup Health Psychol. 2019;24(1):127–38 https://doi.org/10.1037/ocp0000118.Mindfulness.
Economides M, Martman J, Bell MJ, Sanderson B. Improvements in stress, affect, and irritability following brief use of a mindfulness-based smartphone app: a randomized controlled trial. Mindfulness. 2018;9(5):1584–93 https://doi.org/10.1007/s12671-018-0905-4.
Rosen K, Potter J. Participant engagement in a commercially available app-based mindfulness training intervention delivered to women diagnosed with breast cancer. Iproceedings. 2018;4(2):e11907 https://doi.org/10.2196/11907.
Bakker D, Kazantzis N, Rickwood D, Rickard N. Mental health smartphone apps: review and evidence-based recommendations for future developments. JMIR Ment Health. 2016;3(1):1–31 https://doi.org/10.2196/mental.4984.
Firth J, Torous J, Nicholas J, Carney R, Pratap A, Rosenbaum S, Sarris J. The efficacy of smartphone-based mental health interventions for depressive symptoms: a meta-analysis of randomized controlled trials. World Psychiatry. 2017;16(3):287–98 https://doi.org/10.1002/wps.20472.
Weisel KK, Fuhrmann LM, Berking M, Baumeister H, Cuijpers P, Ebert DD. Standalone smartphone apps for mental health—a systematic review and meta-analysis. Npj Digit Med. 2019;2(1):1–10 https://doi.org/10.1038/s41746-019-0188-8.
Bardus M, van Beurden SB, Smith JR, Abraham C. A review and content analysis of engagement, functionality, aesthetics, information quality, and change techniques in the most popular commercial apps for weight management. Int J Behav Nutr Phys Act. 2016;13(1):1–9 https://doi.org/10.1186/s12966-016-0359-9.
Stawarz K, Preist C, Tallon D, Wiles N, Coyle D. User experience of cognitive behavioral therapy apps for depression: an analysis of app functionality and user reviews. J Med Internet Res. 2018;20(6):1–16 https://doi.org/10.2196/10120.
Schoeppe S, Alley S, Van Lippevelde W, Bray NA, Williams SL, Duncan MJ, Vandelanotte C. Efficacy of interventions that use apps to improve diet, physical activity and sedentary behaviour: a systematic review. Int J Behav Nutr Phys Act. 2016;13(1) https://doi.org/10.1186/s12966-016-0454-y.
Weber S, Lorenz C, Hemmings N. Improving stress and positive mental health at work via an app-based intervention: a large-scale multi-center randomized control trial. Front Psychol. 2019;10(2745) https://doi.org/10.3389/fpsyg.2019.02745.
Looyestyn J, Kernot J, Boshoff K, Ryan J, Edney S, Maher C. Does gamification increase engagement with online programs? A systematic review. PLoS One. 2017;12(3):1–19 https://doi.org/10.1371/journal.pone.0173403.
Mohr G, Rigotti T, Müller A. IS - irritations-Skala zur Erfassung arbeitsbezogener Beanspruchungsfolgen [irritation scale for the assessment of psychological strain in work contexts]. Göttingen: Hogrefe; 2007.
Phillips EA, Gordeev VS, Schreyögg J. Effectiveness of occupational e-mental health interventions: a systematic review and meta-analysis of randomized controlled trials. Scand J Work Environ Health. 2019;45(6):560–76 https://doi.org/10.5271/sjweh.3839.
Faul F, Erdfelder E, Lang AG, Buchner A. G* power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods. 2007;39(2):175–91.
Mazzucchelli TG, Kane RT, Rees CS. Behavioral activation interventions for well-being: a meta-analysis. J Posit Psychol. 2010;5(2):105–21 https://doi.org/10.1080/17439760903569154.
Michie S, Johnston M. Theories and techniques of behaviour change developing a cumulative science of behaviour change. Health Psychol Rev. 2012;6:1–6.
Abdel-Khalek AM. Measuring happiness with a single-item scale. Soc Behav Personal Int J. 2006;34(2):139–50.
Elo AL, Leppänen A, Jahkola A. Validity of a single-item measure of stress symptoms. Scand J Work Environ Health. 2003;29(6):444–51 https://doi.org/10.5271/sjweh.752.
Van Hooff MLM, Geurts SAE, Kompier MAJ, Taris TW. “How fatigued do you currently feel?” convergent and discriminant validity of a single-item fatigue measure. J Occup Health. 2007;49(3):224–34 https://doi.org/10.1539/joh.49.224.
Newman, D. A. Missing data techniques and low response rates. Statistical and methodological myths and urban legends: Doctrine, verity and fable in the organizational and social sciences, 7. 2009.
Johnson D, Deterding S, Kuhn KA, Staneva A, Stoyanov S, Hides L. Gamification for health and wellbeing: a systematic review of the literature. Internet Interv. 2016;6:89–106 https://doi.org/10.1016/j.invent.2016.10.002.
Stoyanov SR, Hides L, Kavanagh DJ, Zelenko O, Tjondronegoro D, Mani M. Mobile app rating scale: a new tool for assessing the quality of health mobile apps. JMIR MHealth UHealth. 2015;3(1):1–9 https://doi.org/10.2196/mhealth.3422.
Hoffmann A, Christmann CA, Bleser G. Gamification in stress management apps: a critical app review. JMIR Serious Games. 2017;5(2):1–15 https://doi.org/10.2196/games.7216.
Kroenke K, Strine TW, Spitzer RL, Williams JBW, Berry JT, Mokdad AH. The PHQ-8 as a measure of current depression in the general population. J Affect Disord. 2009;114(1–3):163–73 https://doi.org/10.1016/j.jad.2008.06.026.
Zhu DR, Julian J, Lee SJA, Thanataveerat A, Sumner JA. Patterns of peritraumatic threat perceptions in patients evaluated for suspected acute coronary syndrome according to prior and current posttraumatic stress symptoms. Gen Hosp Psychiatry. 2018;53:119–24 https://doi.org/10.1016/j.genhosppsych.2018.03.003.
Bastien CH, Vallières A, Morin CM. Validation of the insomnia severity index as an outcome measure for insomnia research. Sleep Med. 2001;2(4):297–307 https://doi.org/10.1016/S1389-9457(00)00065-4.
Neubach B, Schmidt K-H. Gütekriterien einer deutschen Fassung des Maslach burnout inventory (MBI—D)— Eine Replikationsstudie bei Altenpflegekräften [psychometric properties and validity of a German version of the Maslach burnout inventory (MBI—D): a replication study among profe]. Z Arbeits- Und Organisationspsychologie. 2000;44(3):140–4.
Cropley M, Michalianou G, Pravettoni G, Millward LJ. The relation of post-work ruminative thinking with eating behaviour. Stress Health. 2012;28(1):23–30 https://doi.org/10.1002/smi.1397.
Querstret D, Cropley M. Exploring the relationship between work-related rumination, sleep quality, and work-related fatigue. J Occup Health Psychol. 2012;17(3):341–53 https://doi.org/10.1037/a0028552.
Kujanpää, M., Syrek, C., Lehr, D., Kinnunen, U., Reins, J. A., & de Bloom, J. Need satisfaction and optimal functioning at leisure and work: a longitudinal validation study of the DRAMMA model. J Happiness Stud, 2020;(0123456789). https://doi.org/10.1007/s10902-020-00247-3.
Schaufeli WB, Bakker AB, Salanova M. The measurement of short questionnaire: a cross-national study. Educ Psychol Meas. 2006;66(4):701–16 https://doi.org/10.1177/0013164405282471.
Crawford JR, Henry JD. The positive and negative affect schedule (PANAS): construct validity, measurement properties and normative data in a large non-clinical sample. Br J ClinPsychol. 2004;43:245–65.
Watson D, Clark LA, Tellegen A. Development and validation of brief measures of brief measures of positive and negative affect: the PANAS scales. J Pers Soc Psychol. 1988;54(6):1063–70.
van Veldhoven M, Broersen S. Measurement quality and validity of the “need for recovery scale”. J Occup Environ Med. 2003;60:i3–9 https://doi.org/10.1136/oem.60.suppl_1.i3.
George JM, Zhou J. When openness to experience and conscientiousness are related to creative behavior: an interactional approach. J Appl Psychol. 2001;86(3):513.
Kim KH. Can we trust creativity tests? A review of the Torrance tests of creative thinking (TTCT). Creat Res J. 2006;18(1):3–14 https://doi.org/10.1207/s15326934crj1801_2.
Torrance EP. The Torrance tests of creative thinking norms—technical manual gural (streamlined) forms A & B. Bensenville: Scholastic Testing Service, Inc.; 1998.
Syrek CJ, Weigelt O, Peifer C, Antoni CH. Zeigarnik’s sleepless nights: how unfinished tasks at the end of the week impair employee sleep on the weekend through rumination. J Occup Health Psychol. 2016;22(2):225–38 https://doi.org/10.1037/ocp0000031.
Staufenbiel T, Hartz C. Organizational citizenship behavior: entwicklung und erste validierung eines meßinstruments. Diagnostica. 2000;46(2):73–83.
Semmer N, Zapf D, Dunckel H. Instrument zur stressbezogenen Tätigkeitsanalyse (ISTA). Handbuch Psychologischer Arbeitsanalyseverfahren. 1999;14:179–204.
Stegmann S, Van Dick R, Ullrich J, Charalambous J, Menzel B, Egold N, Wu TT-C. Der work design questionnaire. Z Arbeits- Und Organisationspsychologie. 2010;54(1):1–28 https://doi.org/10.1026/0942-4089/a000002.
Fydrich T, Sommer G, Tydecks S, Brähler E. Fragebogen zur sozialen Unterstützung (F-SozU): Normierung der Kurzform (K-14). Z Med Psychol. 2009;18(1):43–8 https://doi.org/10.1026/1616-34126.96.36.199.
Kossek EE, Ruderman MN, Braddy PW, Hannum KM. Work-nonwork boundary management profiles: a person-centered approach. J Vocat Behav. 2012;81(1):112–28 https://doi.org/10.1016/j.jvb.2012.04.003.
Syrek C, Bauer-Emmel C, Antoni C, Klusemann J. Entwicklung und validierung der trierer kurzskala zur messung von work-life balance (TKS-WLB). Diagnostica. 2011;57(3):134–45 https://doi.org/10.1026/0012-1924/a000044.
Diener E, Emmons RA, Larsen RJ, Griffin S. The satisfaction with life scale. J Pers Assess. 1985;49(1):71–5 https://doi.org/10.1207/s15327752jpa4901_13.
Leppert K, Koch B, Brähler E, Strauss B, Von Feststellungen R. Die Resilienzskala (RS) - Überprüfung der Langform RS-25 und einer Kurzform RS-13. Klin Diagn Und Eval. 2008;1:226–243.
Lehr D. The Recreation Experience and Activity Questionnaire (ReaQ). In: Koch S, Lehr D, Hillert A, editors. Burnout und chronischer beruflicher Stress. Goettingen: Hogrefe; 2015. p. 107–8.
Hassenzahl, M., Burmester, M., & Koller, F.. AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualität, 187–196. 2003. https://doi.org/10.1007/978-3-322-80058-9_19.
Eysenbach G. CONSORT-EHEALTH: improving and standardizing evaluation reports of web-based and mobile health interventions. J Med Internet Res. 2011;13(4) https://doi.org/10.2196/jmir.1923.
Little RJ, Rubin DB. Statistical Analysis with Missing Data. New York: Wiley; 1987.
Schafer, J. L.. Analysis of incomplete multivariate data. Chapman & Hall/CRC, iv. 1997 https://doi.org/10.1016/b978-0-12-815489-2.00016-2.
Schafer JL, Graham JW. Missing data: our view of the state of the art. Psychol Methods. 2002;7(2):147–77 https://doi.org/10.1037/1082-989X.7.2.147.
Connell NSO, Dai L, Jiang Y, Speiser JL, Ward R, Wei W, et al. Methods for analysis of pre-post data in clinical research: a comparison of five common methods. J Biom Biostat. 2017;8(1):1–8 https://doi.org/10.4172/2155-6180.1000334.Methods.
Egbewale BE, Lewis M, Sim J. Bias, precision and statistical power of analysis of covariance in the analysis of randomized trials with baseline imbalance: a simulation study. BMC Med Res Methodol. 2014;14(1):1–12 https://doi.org/10.1186/1471-2288-14-49.
Holm S. A simple sequentially rejective multiple test procedure. Scand J Stat. 1979;6(2):65–70 Retrieved from http://www.jstor.org/stable/4615733.
Hayes A, Rockwood N. Regression-based statistical mediation and moderation analysis in clinical research: observations, recommendations, and implementation. Behav Res Ther. 2017;98:39–57 https://doi.org/10.1016/j.brat.2016.11.001.
Hayes A. Introduction to mediation, moderation, and conditional process analysis: a regression-based approach. Introduction to mediation, moderation and conditional process analysis. New York: The Guilford Press; 2018. https://doi.org/978-1-60918-230-4.
Kwasnicka D, Dombrowski SU, White M, Sniehotta F. Theoretical explanations for maintenance of behaviour change: a systematic review of behaviour theories. Health Psychol Rev. 2016;10(3):277–96 https://doi.org/10.1080/17437199.2016.1151372.
Rulison K, Feinberg M, Gest S, Osgood D. Diffusion of Iintervention effects: the impact of a family-based substance use prevention program on friends of participants. J Adolesc Health. 2015;25(3):289–313 https://doi.org/10.1016/j.bbi.2017.04.008.
Bradley P, Shiekh M, Mehra V, Vrbicky K, Layle S, Olson MC, Lukowiak AA. Improved efficacy with targeted pharmacogenetic-guided treatment of patients with depression and anxiety: a randomized clinical trial demonstrating clinical utility. J Psychiatr Res. 2018;96:100–7 https://doi.org/10.1016/j.jpsychires.2017.09.024.
Rose G. Strategy of prevention: lessons from cardiovascular disease. Br Med J (Clin Res Ed). 1981;282(6279):1847–51 Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/6786649%0A, http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=PMC1506445.
Lally P, Van Jaarsveld CH, Potts HW, Wardle J. How are habits formed: Modelling habit formation in the real world. Eur J Soc Psychol. 2010;40:998–1009 https://doi.org/10.1002/ejsp.
Norrish JM, Vella-Brodrick DA. Is the study of happiness a worthy scientific pursuit? Soc Indic Res. 2008;87(3):393–407 https://doi.org/10.1007/s11205-007-9147-x.
Sheldon K, Boehm J, Lyubomirsky S. Variety is the spice of happiness: the hedonic adaptation prevention (HAP) model. The Oxford Handbook of Happiness, (December 2017) 2013. p. 901–914. https://doi.org/10.1093/oxfordhb/9780199557257.013.0067.
We would like to thank Julia Graßhoff for supporting the administration of this study, and extend our gratitude to Dörte Behrendt, Hanna Heckendorf, and Leif Boss for their valuable support.
The health insurance company, Barmer, funded the “Holidaily” research project. Funding for this trial covered the employment of one app-designer and one research assistant, as well as meetings and central organizational costs.
This source of funding played no role in the design of this study and the funding organization will have no say during its execution, analyses, interpretation of data, or decision to submit result. Open Access funding provided by Projekt DEAL.
Ethics approval and consent to participate
The ethics committee of Leuphana University in Lueneburg approved the design of this study (reference number: 201606, EB-Antrag Lehr201606_holidaily). Each participant provided via the survey tool informed consent for participation in the study at the time of enrolment.
Consent for publication
The authors declare that they have no competing interests. The source of funding played no role in the design of this study and the funding organization will have no say during its execution, analyses, interpretation of data, or decision to submit results.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix 1. Behaviour Change Techniques implemented in Holidaily and Gamification feature implemented in Holidaily. Description of data: The included date shows examples of which/how behaviour change techniques and gamification features were been implemented/employed in the Holidaily app
Appendix 2. Description of data: Date shows five example images of what users would see when using Holidaily, for instance, Holidaily’s “Home”–screen, one particular “Daily” and participants “Recovery” process in form of a diagram.
About this article
Cite this article
Smyth, A., de Bloom, J., Syrek, C. et al. Efficacy of a smartphone-based intervention — “Holidaily” — promoting recovery behaviour in workers after a vacation: study protocol for a randomised controlled trial. BMC Public Health 20, 1286 (2020). https://doi.org/10.1186/s12889-020-09354-5
- Occupational stress
- Work-related rumination
- Mental detachment
- Smartphone-application (app)
- App-based intervention