- Research article
- Open Access
- Open Peer Review
Positive psychology interventions: a meta-analysis of randomized controlled studies
BMC Public Healthvolume 13, Article number: 119 (2013)
The use of positive psychological interventions may be considered as a complementary strategy in mental health promotion and treatment. The present article constitutes a meta-analytical study of the effectiveness of positive psychology interventions for the general public and for individuals with specific psychosocial problems.
We conducted a systematic literature search using PubMed, PsychInfo, the Cochrane register, and manual searches. Forty articles, describing 39 studies, totaling 6,139 participants, met the criteria for inclusion. The outcome measures used were subjective well-being, psychological well-being and depression. Positive psychology interventions included self-help interventions, group training and individual therapy.
The standardized mean difference was 0.34 for subjective well-being, 0.20 for psychological well-being and 0.23 for depression indicating small effects for positive psychology interventions. At follow-up from three to six months, effect sizes are small, but still significant for subjective well-being and psychological well-being, indicating that effects are fairly sustainable. Heterogeneity was rather high, due to the wide diversity of the studies included. Several variables moderated the impact on depression: Interventions were more effective if they were of longer duration, if recruitment was conducted via referral or hospital, if interventions were delivered to people with certain psychosocial problems and on an individual basis, and if the study design was of low quality. Moreover, indications for publication bias were found, and the quality of the studies varied considerably.
The results of this meta-analysis show that positive psychology interventions can be effective in the enhancement of subjective well-being and psychological well-being, as well as in helping to reduce depressive symptoms. Additional high-quality peer-reviewed studies in diverse (clinical) populations are needed to strengthen the evidence-base for positive psychology interventions.
Over the past few decades, many psychological treatments have been developed for common mental problems and disorders such as depression and anxiety. Effectiveness has been established for cognitive behavioral therapy [1, 2], problem-solving therapy  and interpersonal therapy . Preventive and early interventions, such as the Coping with Depression course , the Don’t Panic course  and Living Life to the Full [7, 8] are also available. The existing evidence shows that the mental health care system has traditionally focused more on treatment of mental disorders than on prevention. However, it is recognized that mental health is more than just the absence of mental illness, as expressed in the World Health Organization’s definition of mental health:
Mental health is a state of well-being in which the individual realizes his or her own abilities, can cope with the normal stresses of life, can work productively, and is able to make a contribution to his or her community.
Under this definition well-being and positive functioning are core elements of mental health. It underscores that people can be free of mental illness and at the same time be unhappy and exhibit a high level of dysfunction in daily life . Likewise, people with mental disorders, can be happy by coping well with their illness and enjoy a satisfactory quality of life . Subjective well-being refers to a cognitive and/or affective appraisal of one’s own life as a whole . Psychological well-being focuses on the optimal functioning of the individual and includes concepts such as mastery, hope and purpose in life [13, 14]. The benefits of well-being are recorded both in cross-sectional and longitudinal research and include improved productivity at work, having more meaningful relationships and less health care uptake [15, 16]. Well-being is also positively associated with better physical health [17–19]. It is possible that this association is mediated by a healthy lifestyle and a healthier immune system, which buffers the adverse influence of stress . In addition, the available evidence suggests that well-being reduces the risk of developing mental symptoms and disorders [21, 22] and helps reduce mortality risks in people with physical disease .
Seligman and Csikszentmihaly’s (2000) pioneered these principles of positive psychology in their well-known article entitled ‘Positive psychology: An introduction’, published in a special issue of the American Psychologist. They argued that a negative bias prevailed in psychology research, where the main focus was on negative emotions and treating mental health problems and disorders . Although the basic concepts of well-being, happiness and human flourishing have been studied for some decades [12, 25–27], there was a lack of evidence-based interventions . Since the publication of Seligman and Csikszentmihaly’s seminal article, the positive psychology movement has grown rapidly. The ever-expanding International Positive Psychology Association is among the most extensive research networks in the world  and many clinicians and coaches embrace the body of thought that positive psychology has to offer.
Consequently, the number of evaluation studies has greatly increased over the past decade. Many of these studies demonstrated the efficacy of positive psychology interventions such as counting your blessings [29, 30], practicing kindness , setting personal goals [32, 33], expressing gratitude [30, 34] and using personal strengths  to enhance well-being, and, in some cases, to alleviate depressive symptoms . Many of these interventions are delivered in a self-help format. Sin and Lyubomirsky (2009) conducted a meta-analytical review of the evidence for the effectiveness of positive psychology interventions (PPIs). Their results show that PPIs can indeed be effective in enhancing well-being (r = 0.29, standardized mean difference Cohen’s d = 0.61) and help to reduce depressive symptom levels in clinical populations (r = 0.31, Cohen’s d = 0.65). However, this meta-analysis had some important limitations. First, the meta-analysis included both randomized studies and quasi-experimental studies. Second, study quality was not addressed as a potential effect moderator. In recent meta-analyses, it has been shown that the treatment effects of psychotherapy have been overestimated in lower quality studies [35, 36]. The lack of clarity in the inclusion criteria constitutes a third limitation. Intervention studies, although related to positive psychology but not strictly developed within this new framework (e.g. mindfulness, life-review) were included in the meta-analysis. However, inclusion of these studies reduces the robustness of the results for pure positive psychology interventions.
The aim of the present study is to conduct a meta-analysis of the effects of specific positive psychology interventions in the general public and in people with specific psychosocial problems. Subjective well-being, psychological well-being and depressive symptoms were the outcome measures. Potential variables moderating the effectiveness of the interventions, such as intervention type, duration and quality of the research design, were also examined. This study will add to the existing literature and the above meta-analytical review  by 1) only including randomized controlled studies, 2) taking the methodological quality of the primary studies into account, 3) including the most recent studies (2009 – 2012), 4) analyzing not only post-test effects but also long-term effects at follow up, and 5) applying clear inclusion criteria for the type of interventions and study design.
A systematic literature search was carried out in PsychInfo, PubMed and the Cochrane Central Register of Controlled Trials, covering the period from 1998 (the start of the positive psychology movement) to November 2012. The search strategy was based on two key components: there should be a) a specific positive psychology intervention, and b) an outcome evaluation. The following MeSH terms and text words were used: “well-being” or “happiness” or “happy*”, “optimism”, “positive psychology” in combination with “intervention”, “treatment”, “therapy” and “prevention”. This was combined with terms related to outcome research: “effect*”, or “effic*”, or “outcome*”, or “evaluat*”. We also cross-checked the references from the studies retrieved, the earlier meta-analysis of Sin & Lyubomirsky (2009) and two other reviews of positive psychological interventions [38, 39]. The search was restricted to peer-reviewed studies in the English language.
Selection of studies
Two reviewers (LB and MH) independently selected potentially eligible studies in two phases. At the first phase, selection was based on title and abstract, and at the second phase on the full-text article. All studies identified as potentially eligible by at least one of the reviewers during the first selection phase, were re-assessed at the second selection phase. During the second phase, disagreements between the reviewers were resolved by consensus. The inter-rater reliability (kappa) was 0.90.
The inclusion criteria were as follows:
Examination of the effects of a positive psychology intervention. A positive psychology intervention (PPI) was defined in accordance with Sin and Lyubomirsky’s (2009) article as a psychological intervention (training, exercise, therapy) primarily aimed at raising positive feelings, positive cognitions or positive behavior as opposed to interventions aiming to reduce symptoms, problems or disorders. The intervention should have been explicitly developed in line with the theoretical tradition of positive psychology (usually reported in the introduction section of an article).
Randomization of the study subjects (randomizing individuals, not groups) and the presence of a comparator condition (no intervention, placebo, care as usual).
Publication in a peer-reviewed journal.
At least one of the following are measured as outcomes: well-being (subjective well-being and/or psychological well-being) or depression (diagnosis or symptoms).
Sufficient statistics are reported to enable the calculation of standardized effect sizes.
If necessary, authors were contacted for supplementary data. We excluded studies that involved physical exercises aimed at the improvement of well-being, as well as mindfulness or meditation interventions, forgiveness therapy, life-review and reminiscence interventions. Furthermore, well-being interventions in diseased populations not explicitly grounded in positive psychology theory (‘coping with disease courses’) were excluded. Apart from being beyond the scope of this meta-analysis, extensive meta-analyses have already been published for these types of intervention [40–42]. This does not imply that these interventions do not have positive effects on well-being, a point which will be elaborated on in the discussion section of this paper.
Data extraction and study quality assessment were performed by one reviewer (LB) and independently checked by a second reviewer (MH). Disagreements were resolved by consensus. Data were collected on design, intervention characteristics, target group, recruitment methods, delivery mode, number of sessions, attrition rates, control group, outcome measures and effect sizes (post-test and at follow up of at least 3 months). The primary outcomes in our meta-analysis were subjective well-being (SWB), psychological well-being (PWB) and depressive symptoms/depression.
The methodological quality of the included studies was assessed using a short scale of six criteria tailored to those studies and based on criteria established by the Cochrane collaboration : 1) Adequacy of randomization concealment, 2) Blinding of subjects to the condition (blinding of assessors was not applicable in most cases), 3) Baseline comparability: were study groups comparable at the beginning of the study and was this explicitly assessed? (Or were adjustments made to correct for baseline imbalance using appropriate covariates), 4) Power analysis: is there an adequate power analysis and/or are there at least 50 participants in the analysis?, 5) Completeness of follow up data: clear attrition analysis and loss to follow up < 50%, 6) Handling of missing data: the use of intention-to-treat analysis (as opposed to a completers-only analysis). Each criterion was rated as 0 (study does not meet criterion) or 1 (study meets criterion). The inter-rater reliability (kappa) was 0.91. The quality of a study was assessed as high when five or six criteria were met, medium when three or four criteria were met, and low when zero, one or two criteria were met. Along with a summary score, the aspects relating to quality were also considered individually, as results based on composite quality scales can be equivocal . Table 1 shows the quality assessment for each study. The quality of the studies was scored from 1 to 5 (M = 2.56; SD = 1.25). Twenty studies were rated as low, 18 were of medium quality and one study was of high quality. None of the studies met all quality criteria. The average number of participants in the analysis was rather high (17 out of 39 studies scored positive on this criterion), although none of the studies reported an adequate power analysis. Also, baseline comparability was frequently reported (26/39 studies). On the other hand, independence in the randomization procedure was seldom reported (7/39 studies) and an intention-to-treat analysis was rarely conducted (3/39 studies).
In a meta-analysis, the effects found in the primary studies are converted into a standardized effect size, which is no longer placed on the original measurement scale, and can therefore be compared with measures from other scales. For each study, we calculated effect sizes (Cohen’s d) by subtracting the average score of the experimental group (Me) from the average score of the control group (Mc), and dividing the result by the pooled standard deviations of both groups. This was done at post-test because randomization usually results in comparable groups across conditions at baseline. However, if baseline differences on outcome variables did exist despite the randomization, d’s were calculated on the basis of pre- post-test differences: by calculating the standardized pre- post change score for the experimental group (de) and the control group (dc) and subsequently calculating their difference as Δd= de – dc. For example, an effect size of 0.5 indicates that the mean of the experimental group is half a standard unit (standard deviation) larger than the mean of the control group. From a clinical perspective, effect sizes of 0.56 – 1.2 can be interpreted as large, while effect sizes of 0.33 – 0.55 are of medium size, and effects of 0 – 0.32 are small .
In the calculation of effect sizes for depression, we used instruments that explicitly measure depression (e.g. the Beck Depression Inventory, or the Center for Epidemiological Studies Depression Scale). For subjective and psychological well-being, we also used instruments related to the construct of well-being (such as positive affect for SWB and hope for PWB). If more than one measure was used for SWB, PWB or depression, the mean of the effect sizes was calculated, so that each study outcome had one effect size. If more than one experimental group was compared with a control condition in a particular study, the number of subjects in the control groups was evenly divided across the experimental groups so that each subject was used only once in the meta-analysis.
To calculate pooled mean effect sizes, we used Comprehensive Meta-Analysis (CMA, Version 2.2.064). Due to the diversity of studies and populations, a common effect size was not assumed and we expected considerable heterogeneity. Therefore, it was decided a priori to use the ‘random effects model’. Effect sizes may differ under this model, not only because of random error within studies (as in the fixed effects model), but also as a result of true variation in effect sizes between studies. The outcomes of the random effects model are conservative in that their 95% Confidence Intervals (CIs) are often broad, thus reducing the likelihood of type-II errors.
We tested for the presence of heterogeneity with two indicators. First, we calculated the Q-statistic. A significant Q rejects the null-hypothesis of homogeneity and indicates that the true effect size probably does vary from study to study. Second, the I2-statistic was calculated. This is a percentage indicating the study-to-study dispersion due to real differences, over and above random sampling error. A value of 0% indicates an absence of dispersion, and larger values show increasing levels of heterogeneity where 25% can be considered as low, 50% as moderate and 75% as a high level of heterogeneity .
Owing to the expected high level of heterogeneity, all studies were taken into account. Outliers were considered, but not automatically removed from the meta-analysis. The procedure of removing outliers which are outside the confidence interval of the pooled effect size is advised when a common effect size is assumed. However, in our meta-analysis, high dispersion was expected and therefore only the exclusion of Cohen’s d > 2.5 from the final sample was planned.
Subgroup analyses were performed by testing differences in Cohen’s d’s between subgroups. Six potential moderators were determined based on previous research and the characteristics of the investigated interventions and studies: 1) Self-selected sample/not self-selected: did the participants know that the aim of the intervention was to make them feel better?; 2) Duration: less than four weeks, four to eight weeks, or more than eight weeks; 3) Type of intervention: self-help, group intervention, or individual therapy; 4) Recruitment method: community (in a community center, local newspapers), internet, by referral/hospital, at university; 5) Psychosocial problems (Yes/none): was the data based on a group with certain psychosocial problems or was the study open to everyone?; 6) Quality rating: low (score 1 or 2), medium (score 3 or 4) or high (score 5 or 6). The impact of the duration and quality ratings was also assessed using meta-regression.
Results of meta-analysis may be biased due to the fact that studies with non-significant or negative results are less likely to be published in peer-reviewed journals . In order to address this issue, we used three indices: funnel plots, the Orwin’s fail-safe number and the Trim and Fill method. A funnel plot is a graph of effect size against study size. When publication bias is absent, the observed studies are expected to be distributed symmetrically around the pooled effect size. The Orwin’s fail-safe number indicates the number of non-significant unpublished studies needed to reduce the overall significant effect to non-significance (according to a self-stated criterium) . The effect size can be considered to be robust if the number of studies required to reduce the overall effect size to a non-significant level exceeds 5 K + 10, where K is the number of studies included. If asymmetry is found in the funnel plot, the Trim and Fill method adjusts the pooled effect size for the outcomes of missing studies . Imputing missing studies restores the symmetry in the funnel plot and an adjusted effect size can be calculated.
For the reporting of the results of this meta-analysis, we applied Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines .
Description of studies
The selection process is illustrated in Figure 1. First, 5,335 titles were retrieved from databases and 55 titles were identified through searching the reference list accompanying the meta-analysis by Sin and Lyubomirsky (2009)  as well as two other literature reviews of positive psychological interventions [38, 39]. After reviewing the titles and abstracts and removing duplicates, 84 articles were identified as being potentially eligible for inclusion in our study. Of these 84 articles, 40 articles in which 39 studies were described, met our inclusion criteria (of these, 17 articles describing 19 studies were also included in the meta-analysis by Sin and Lyubomirsky, 2009). In two articles [29, 51] two studies were described, and one study [52–55] was published in four articles.
The characteristics of the studies included are described in Table 2. The studies evaluated 6,139 subjects, 4,043 in PPI groups and 2,096 in control groups. Ten studies compared a PPI with a no-intervention control group [29, 51, 56–63], 17 studies compared a PPI with a placebo intervention [29, 30, 32, 34, 52–55, 64–75], seven studies with a waiting list control group [33, 76–81] and five studies with another active intervention (care as usual) [51, 82–85]. A minority of seven studies [51, 57, 76, 77, 82, 83] applied inclusion criteria to target a specific group with psychosocial problems such as depression and anxiety symptoms. Half of the studies, 19 in total, recruited the subjects (not necessarily students) through university [29, 32, 34, 51, 56, 58–61, 64–68, 70, 72, 75, 80, 85]. In seven studies subjects were recruited in the community [33, 57, 71, 73, 76, 77, 81], in four studies by referral from a practitioner or hospital [29, 51, 82, 83], in three studies in an organization [62, 78, 79] and six studies recruited through the internet [30, 52–55, 63, 69, 74, 84]. Twenty-eight studies measured subjective well-being, 20 studied psychological well-being and 14 studied depressive symptoms. Half of the studies (20) were aimed at adult populations [29, 30, 33, 51–56, 62, 63, 65, 69, 71, 73, 74, 76, 78, 79, 81–84]. A substantial number of studies (17) were aimed at college students [29, 32, 34, 51, 58–61, 64, 66–68, 70, 72, 75, 80, 85] and two studies were aimed at older subjects [57, 77]. In most studies (26) the PPI was delivered in the form of self-help [29, 30, 34, 52–56, 58, 59, 61, 63–71, 73–75, 77, 78, 80, 84, 85]. Eight studies used group PPIs [32, 33, 51, 57, 60, 62, 72, 76] and five used individual PPIs [51, 79, 81–83]. Intensity varied considerably across studies, ranging from a short one-day exercise  and a two-week self-help intervention  to intensive therapy [51, 82, 83] and coaching [33, 81].
The random effect model showed that the PPIs were effective for all three outcomes. Results are presented in Table 3. The effect sizes of the individual studies at post-test are plotted in Figures 2, 3 and 4.
A composite moderate and statistically significant effect size (Cohen’s d) was observed for subjective well-being d = 0.34 (95% CI [0.22, 0.45], p<.01). For psychological well-being, Cohen’s d was 0.20 (95% CI [0.09, 0.30], p<.01) and for depression d = 0.23 (95% CI [0.09, 0.38], p<.01), which can be considered as small.
Heterogeneity was moderate for subjective well-being (I2 = 49.5%) and depression (I2 = 47.0%), and low for psychological well-being (I2 = 29.0%). Effect sizes ranged from −0.09  to 1.30  for subjective well-being, -0.06  to 2.4  for psychological well-being and −0.17  to 1.75  for depression.
Removing outliers reduced effect sizes for all three outcomes: 0.26 (95% CI [0.18, 0.33], Z=6.43, p<.01) for subjective well-being (Burton & King, 2004 and Peters et al., 2010 removed) [64, 70], 0.17 (95% CI [0.09, 0.25], Z=4.18, p<.01) for psychological well-being (Fava et al. (2005) removed)  and 0.18 (95% CI [0.07, 0.28], Z=3.33, p<.01) for depression (Fava, 2005 and Seligman, 2006 study 2, removed) [51, 83]. Removing the outliers reduced heterogeneity substantially (to a non-significant level).
Ten studies examined follow-up effects after at least three months and up to 12 months (Table 3). For the purposes of interpretation, we used only those studies examining effects from three to six months (short-term follow-up), thus excluding Fava et al. (2005)  which had a follow-up at one year. The random-effects model demonstrated small but significant effects in comparison with the control groups for subjective well-being (Cohen’s d 0.22, 95% CI [0.05, 0.38], p<.01) and for psychological well-being (0.16, 95% CI [0.02, 0.30], p = .03). The effect was not significant for depression (0.17, 95% CI [−0.06, 0.39], p = .15). Heterogeneity was low for subjective well-being (I2 = 1.1%) and psychological well-being (I2 = 26.0%), and high for depression (I2 = 63.9%).
Subgroup analyses are presented in Table 4. We looked at self-selection, duration of the intervention, type of intervention, recruitment method, application of inclusion criteria related to certain psychosocial problems, and quality rating.
For depression, five out of six subgroups of studies resulted in significantly higher effect sizes. Higher effect sizes were found for 1) interventions of a longer duration (only in the meta regression analysis), 2) individual interventions, 3) studies involving referral from a health care practitioner or hospital, 4) studies which applied inclusion criteria based on psychosocial problems and 5) lower quality studies. For subjective well-being and psychological well-being, there were no significant differences between subgroups, although for the latter there was a recognizable trend in the same direction and on the same moderators, except for quality rating.
Twenty-six out of 39 studies were self-help interventions for which we conducted a separate subgroup analysis. However, there was little diversity within the self-help subgroup: only six studies examined intensive self-help for longer than four weeks, self-help was offered to people with specific psychosocial problems in only one study and more than half of the self-help studies (n=14) recruited their participants via university. Consequently, there were no significant differences between subgroups for self-help interventions.
Indications for publication bias were found for all outcome measures, but to a lesser extent for subjective well-being. Funnel plots were asymmetrically distributed in such a way that the smaller studies often showed the more positive results (in other words, there is a certain lack of small insignificant studies). Orwin’s fail-safe numbers based on a criterium effect size of 0.10 for subjective well-being (59), psychological well-being (16) and depression (13) were lower than required (respectively 150, 110 and 80). Egger’s regression intercept also suggests that publication bias exists for psychological well-being (intercept=1.18, t=2.26, df=18, p=.04) and depression (intercept=1.45, t=2.26, df=12, p=.03), but not for subjective well-being (intercept=1.20, t=1.55, df=26, p=0.13). The mean effect sizes of psychological well-being and depression were therefore recalculated by imputing missing studies using the Trim and Fill method. For psychological well-being, three studies were imputed and the effect size was adjusted to 0.16 (95% CI 0.03-0.29). For depression, five studies were imputed and the adjusted effect size was 0.16 (95% CI 0.00-0.32).
This meta-analysis synthesized effectiveness studies on positive psychology interventions. Following a systematic literature search, 40 articles describing 39 studies were included. Results showed that positive psychology interventions significantly enhance subjective and psychological well-being and reduce depressive symptoms. Effect sizes were in the small to moderate range. The mean effect size on subjective well-being was 0.34, 0.20 on psychological well-being, and 0.23 on depression. Effect sizes varied a great deal between studies, ranging from below 0 (indicating a negative effect) to 2.4 (indicating a very large effect). Moreover, at follow-up from three to six months, small but still significant effects were found for subjective well-being and psychological well-being, indicating that effects were partly sustained over time. These follow-up results should be treated with caution because of the small number of studies and the high attrition rates at follow-up.
Remarkably, effect sizes in the current meta-analysis are around 0.3 points lower than the effect sizes in the meta-analysis by Sin and Lyubomirsky (2009) . We included a different set of studies in which the design quality was assured using randomized controlled trials only. Effectiveness research in psychotherapy shows that effect sizes are relatively small in high-quality studies compared with low-quality studies  and this might also be true for positive psychology interventions. In addition, we applied stricter inclusion criteria than those used by Sin and Lyubomirsky (2009) and therefore did not include studies on any related areas such as mindfulness and life review therapy. These types of interventions stem from long-standing independent research traditions for which effectiveness has already been established in several meta-analyses [40, 41]. Also, the most recent studies were included. This might explain the overestimation of effect sizes in the meta-analysis by Sin and Lyubomirsky (2009).
Several characteristics of the study moderated the effect on depressive symptoms. Larger effects were found in interventions with a longer duration, in individual interventions (compared with self-help), when the interventions were offered to people with certain psychosocial problems and when recruitment was carried out via referral from a health care professional or hospital. Quality rating also moderated the effect on depression: the higher the quality, the smaller the effect. Interestingly, these characteristics did not significantly moderate subjective well-being and psychological well-being. However, there was a trend in the moderation of psychological well-being that was the same as that observed in the studies which included depression as an outcome. In general, effectiveness was increased when interventions were offered over a longer period, face-to-face on an individual basis in people experiencing psychosocial problems and when participants were recruited via the health care system.
Although it is clear that more intensive and face-to-face interventions generate larger effects, the effects of short-term self-help interventions are small but significant. From a public health perspective, self-help interventions can serve as cost-effective mental health promotion tools to reach large target groups which may not otherwise be reached [86–88]. Even interventions presenting small effect sizes can in theory have a major impact on populations’ well-being when many people are reached . The majority of positive psychology interventions (in our study 26 out of 39 studies) are already delivered in a self-help format, sometimes in conjunction with face-to-face instruction and support. Apparently, self-help suits the goals of positive psychology very well and it would be very interesting to learn more about how to improve the effectiveness of PPI self-help interventions. However, a separate subgroup analysis on the self-help subgroup revealed no significant differences in the present meta-analysis. There was very little variation in the subgroups as regards population, duration of the intervention and recruitment method. As a result, this analysis does not give firm indications on how to improve the effectiveness of self-help interventions. It is possible that self-help could be enhanced by offering interventions to people with specific psychosocial problems, increasing the intensity of the intervention and embedding the interventions in the health care system. However, more studies in diverse populations, settings and with varying intensity are needed before we can begin to derive recommendations from this type of meta-analysis. Other research gives several additional indications on how to boost the efficacy of self-help interventions. Adherence tends to be quite low in self-help interventions [90, 91] and therefore, enhancing adherence could be a major factor in improving effectiveness. Self-help often takes a ‘one size fits all’ approach, which may not be appropriate for a large group of people who will, as a consequence, not fully adhere to the intervention. Personalization and tailoring self-help interventions to individual needs  as well interactive support  might contribute to increased adherence and likewise improved effectiveness of (internet) self-help interventions.
This study has several limitations. First, the quality of the studies was not high, and no study met all of our quality criteria. For example, the randomization procedure was unclear in many studies. Also, most studies conducted completers-only analysis, as opposed to intention-to-treat analysis. This could have seriously biased the results . However, the low quality of the studies could have been overstated as the criteria were scored conservatively: we gave a negative score when a criterion was not reported. Even so, more high-quality randomized-controlled trials are needed to enable more robust conclusions about the effects of PPIs. Second, different types of interventions are lumped together as positive psychology interventions, despite the strict inclusion criteria we applied. As expected, we found a rather high level of heterogeneity. In the future, it might be wise and meaningful to conduct meta-analyses that are restricted to specific types of interventions, for example gratitude interventions, strengths-based interventions and well-being therapy, just as has already been carried out with, for example, mindfulness and life review. In the present meta-analysis, studies on these specific interventions were too small and too diverse to allow for a subgroup-analysis. Third, the exclusion of non peer-reviewed articles and grey literature could have led to bias, and possibly also to the publication bias we found in our study. Fourth, although we included a relatively large number of studies in the meta-analysis, the number of studies in some subgroups was still small. Again, more randomized-controlled trials are needed to draw firmer conclusions. Sixth, the study of positive education is an emerging field in positive psychology [94–98] but school-based interventions were excluded from our meta-analysis due to the strict application of the inclusion criteria (only studies with randomization at individual level were included).
This meta-analysis demonstrates that positive psychology interventions can be effective in the enhancement of subjective and psychological well-being and may help to reduce depressive symptom levels. Results indicate that the effects are partly sustained at short-term follow-up. Although effect sizes are smaller in our meta-analysis, these results can be seen as a confirmation of the earlier meta-analysis by Sin and Lyubomirsky (2009). Interpretation of our findings should take account of the limitations discussed above and the indications for publication bias.
Implications for practice
In mental health care PPIs can be used in conjunction with problem-based preventive interventions and treatment. This combination of interventions might be appropriate when clients are in remission; positive psychology interventions may then be used to strengthen psychological and social recourses, build up resilience and prepare for normal life again. On the basis of the moderator analysis, we would recommend the delivery of interventions over a longer period (at least four weeks and preferably eight weeks or longer) and on an individual basis. Practitioners can tailor their treatment strategy to the needs and preferences of a client and can use positive psychology exercises in combination with other evidence-based interventions that have a positive approach and aim to enhance well-being, such as mindfulness interventions , Acceptance and Commitment Therapy [7, 99], forgiveness interventions , behavioral-activation  and reminiscence [41, 101].
In the context of public health, positive psychology interventions can be used as preventive, easily accessible and non-stigmatizing tools. They can potentially be used in two ways: 1) in mental health promotion (e.g. leaflets distributed for free at community centers, (mental) health internet portals containing psycho-education), and 2) as a first step in a stepped care approach. In the stepped care model, clients start with a low-intensity intervention if possible, preferably a self-directed intervention. These interventions can be either guided by a professional or unguided, and are increasingly delivered over the internet. Clinical outcomes can be monitored and people can be provided with more intensive forms of treatment, or referred to specialized care, if the first-step intervention does not result in the desired outcome .
Recommendations for research
Regarding the research agenda, there is a need for more high-quality studies, and more studies in diverse (clinical) populations and diverse intervention formats to know what works for whom. Standards for reporting studies should also be given more attention, for example by reporting randomized controlled trials according to the CONSORT statement . In addition, we encourage researchers to publish in peer-reviewed journals, even when the sample sizes are small or when there is a null finding of no effect, as this is likely to reduce the publication bias in positive psychology. Furthermore, most studies are conducted in North America. Therefore, replications are needed in other countries and cultures because some positive psychology concepts may require adaptation to other cultures and outlooks (e.g. see Martinez et al., 2010) . Last but not least, we strongly recommend conducting cost-effectiveness studies aiming to establish the societal and public health impact of positive psychology interventions. This type of information is likely to help policy makers decide whether positive psychology interventions offer good value for money and should therefore be placed on the mental health agenda for the 21st century.
Rupke SJ, Blecke D, Renfrow M: Cognitive Therapy for Depression. Am Fam Physician. 2006, 73: 83-86.
Dobson KS: A meta-analysis of the efficacy of cognitive therapy for depression. J Consult Clin Psychol. 1989, 57: 414-419.
Cuijpers P, van Straten A, Warmerdam L: Problem solving therapies for depression: a meta-analysis. Eur Psychiatry. 2007, 22: 9-15. 10.1016/j.eurpsy.2006.11.001.
Cuijpers P, Geraedts AS, van Oppen P, Andersson G, Markowitz JC, van Straten A: Interpersonal psychotherapy for depression: a meta-analysis. Am J Psychiatry. 2011, 168: 581-592. 10.1176/appi.ajp.2010.10101411.
Cuijpers P, Munoz RF, Clarke GN, Lewinsohn PM: Psychoeducational treatment and prevention of depression: the coping with depressioncourse thirty years later. Clin Psychol Rev. 2009, 29: 449-458. 10.1016/j.cpr.2009.04.005.
Meulenbeek P, Willemse G, Smit F, van Balkom A, Spinhoven P, Cuijpers P: Early intervention in panic: pragmatic randomised controlled trial. Br J Psychiatry. 2010, 196: 326-331. 10.1192/bjp.bp.109.072504.
Fledderus M, Bohlmeijer E, Smit F, Westerhof GJ: Mental health promotion as a new goal in Public Mental Health Care: a randomized controlled trial of an intervention enhancing psychological flexibility. American Journal of Mental Health. 2011, 100: 2372-2378.
Bohlmeijer ET, Fledderus M, Rokx TAJJ, Pieterse ME: Efficacy of an early intervention based on acceptance and commitment therapy for adults with depressive symptomatology: evaluation in a randomized controlled trial. Behav Res Ther. 2011, 49: 62-67. 10.1016/j.brat.2010.10.003.
WHO: Promoting mental health: Concepts, emerging evidence, practice (summary report). 2004, Geneva: World Health Organization
Keyes CLM: Promoting and protecting mental health as flourishing: a complementary strategy for improving National Mental Health. Am Psychol. 2007, 62: 95-108.
Bergsma A, ten Have M, Veenhoven R, De Graaf R: Most people with mental disorders are happy. J Posit Psychol. 2011, 6: 253-259. 10.1080/17439760.2011.577086.
Diener E, Suh EM, Lucas RE, Smith HL: Subjective well-being: three decades of progress. Psychol Bull. 1999, 125: 276-302.
Ryff CD: Happiness is everything, or is it? Explorations on the meaning of psychological well-being. J Pers Soc Psychol. 1989, 57: 1069-1081.
Luthans F, Avolio BJ, Avey JB, Norman SM: Positive psychological capital: measurement and relationship with performance and satisfaction. Pers Psychol. 2007, 60: 541-572. 10.1111/j.1744-6570.2007.00083.x.
Keyes CLM, Grzywacz JG: Health as a complete state: the added value in work performance and healthcare costs. J Occup Environ Med. 2005, 47: 523-532. 10.1097/01.jom.0000161737.21198.3a.
Veenhoven R: Gezond geluk: Effecten van geluk op gezondheid en wat dat kan betekenen voor de preventieve gezondheidszorg (Healthy happiness: effect of happiness on health and what this could mean for preventive public health). 2006, Rotterdam: Erasmus Universiteit
Howell RT, Kern ML, Lyubomirsky S: Health benefits: meta-analytically determining the impact of well-being on objective health outcomes. Health Psychological Review. 2007, 1: 83-136. 10.1080/17437190701492486.
Diener E, Chan MY: Happy people live longer: subjective well-being contributes to health and longevity. Applied Psychology: Health and Well-being. 2011, 3: 1-43. 10.1111/j.1758-0854.2010.01045.x.
Lamers SMA, Bolier L, Westerhof GJ, Smit F, Bohlmeijer ET: The impact of emotional well-being on long-term recovery and survival in physical illness: a meta-analysis. J Behav Med. 2012, 35: 538-547. 10.1007/s10865-011-9379-8.
Pressman SD, Cohen S: Does positive affect influence health?. Psychol Bull. 2005, 131: 925-971.
Keyes CLM, Dhingra SS, Simoes EJ: Change in level of positive mental health as a predictor of future risk of mental health. Am J Public Health. 2010, 100: 2366-2371. 10.2105/AJPH.2010.192245.
Wood AM, Joseph S: The absence of positive psychological (eudemonic) well-being as a risk factor for depression: a ten year cohort study. J Affect Disord. 2010, 122: 213-217. 10.1016/j.jad.2009.06.032.
Lamers S, Bolier L, Westerhof GJ, Smit F, Bohlmeijer E: The impact of emotional well-being on long-term recovery and survival in physical illness: a meta-analysis. J Behav Med. 2012, 5: 538-547.
Seligman MEP, Csikszentmihalyi M: Positive psychology: an introduction. Am Psychol. 2000, 55: 5-14.
Maslow AH: Toward a psychology of being. 1968, Oxford England: D. Van Nostrand, 2
Veenhoven R: The utility of happiness. Soc Indic Res. 1988, 20: 333-354. 10.1007/BF00302332.
Ryan RM, Deci EL: On happiness and human potentials: a review of research on hedonic and eudaimonic well-being. Annu Rev Psychol. 2001, 52: 141-166. 10.1146/annurev.psych.52.1.141.
IPPA: 2009, Mount Royal, New Jersey: International Positive Psychology Association, http://www.ippanetwork.org,
Emmons RA, McCullough ME: Counting blessings versus burdens: an experimental investigation of gratitude and subjective well-being in daily life. J Pers Soc Psychol. 2003, 84: 377-389.
Seligman MEP, Steen TA, Park N, Peterson C: Positive psychology progress: empirical validation of interventions. Am Psychol. 2005, 60: 410-421.
Otake K, Shimai S, Tanaka-Matsumi J, Otsui K, Fredrickson BL: Happy people become happier through kindness: a counting kindnesses intervention. J Happiness Stud. 2006, 7: 361-375. 10.1007/s10902-005-3650-z.
Sheldon KM, Kasser T, Smith K, Share T: Personal goals and psychological growth: testing an intervention to enhance goal attainment and personality integration. Journal of Personality S2- Character & Personality; A Quarterly for Psychodiagnostic & Allied Studies. 2002, 70: 5-31.
Green LS, Oades LG, Grant AM: Cognitive-behavioral, solution-focused life coaching: enhancing goal striving, well-being, and hope. J Posit Psychol. 2006, 1: 142-149. 10.1080/17439760600619849.
Sheldon KM, Lyubomirsky S: How to increase and sustain positive emotion: the effects of expressing gratitude and visualizing best possible selves. J Posit Psychol. 2006, 1: 73-82. 10.1080/17439760500510676.
Cuijpers P, van Straten A, Bohlmeijer E, Hollon SD, Andersson G: The effects of psychotherapy for adult depression are overestimated: a meta-analysis of study quality and effect size. Psychol Med: A Journal of Research in Psychiatry and the Allied Sciences. 2010, 40: 211-223. 10.1017/S0033291709006114.
Bohlmeijer E, Prenger R, Taal E, Cuijpers P: The effects of mindfulness-based stress reduction therapy on mental health of adults with a chronic medical disease: a meta-analysis. J Psychosom Res. 2010, 68: 539-544. 10.1016/j.jpsychores.2009.10.005.
Sin NL, Lyubomirsky S: Enhancing well-being and alleviating depressive symptoms with positive psychology interventions: a practice-friendly meta-analysis. J Clin Psychol. 2009, 65: 467-487. 10.1002/jclp.20593.
Mitchell J, Vella-Brodrick D, Klein B: Positive psychology and the internet: a mental health opportunity. Electronic J Appl Psychol. 2010, 6: 30-41.
Meyer MC, Van Woerkom M, Bakker AB: The added value of the positive: a literature review of positive psychology interventions in organizations. Eur J Work Organ Psychol. 2012, In press
Grossman P, Niemann L, Schmidt S, Walach H: Mindfulness-based stress reduction and health benefits: a meta-analysis. J Psychosom Res. 2004, 57: 35-43. 10.1016/S0022-3999(03)00573-7.
Bohlmeijer E, Roemer M, Cuijpers P, Smit F: The effects of reminiscence on psychological well-being in older adults: a meta-analysis. Aging Ment Health. 2007, 11: 291-300. 10.1080/13607860600963547.
Lundahl BW, Taylor MJ, Stevenson R, Roberts KD: Process-based forgiveness interventions: a meta-analytic review. Res Soc Work Pract. 2008, 18: 465-478. 10.1177/1049731507313979.
Higgins JPT, Green S: Cochrane Handbook for systematic reviews of interventions (4.2.5). 2005, Chichester: John Wiley
Juni P, Witschi A, Bloch R, Egger M: The hazards of scoring the quality of clinical trials for meta-analysis. JAMA: The Journal Of The American Medical Association. 1999, 282: 1054-1060. 10.1001/jama.282.11.1054.
Lipsey MW, Wilson DB: The efficacy of psychological, educational, and behavioral treatment. Confirmation from meta-analysis. Am Psychol. 1993, 48: 1181-1209.
Higgins JPT, Thompson SG, Deeks JJ, Altman DG: Measuring inconsistency in meta-analyses. Br Med J. 2003, 327: 557-560. 10.1136/bmj.327.7414.557.
Borenstein M, Hedges LV, Higgins JPT, Rothstein HR: Introduction to Meta-Analysis. 2009, West Sussex: John Wiley & Sons, 1
Orwin RG: A fail-safe N for effect size in meta-analysis. J Educ Stat. 1983, 8: 157-159.
Duval S, Tweedie R: Trim and fill: a simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics. 2000, 56: 455-463. 10.1111/j.0006-341X.2000.00455.x.
Moher D, Liberati A, Tetzlaff J, Altman DG: Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009, 6: e1000097-10.1371/journal.pmed.1000097.
Seligman MEP, Rashid T, Parks AC: Positive psychotherapy. Am Psychol. 2006, 61: 774-788.
Mongrain M, Anselmo-Matthews T: Do positive psychology exercises work? A replication of Seligman et al. (). J Clin Psychol. 2012, 68: 382-389.
Mongrain M, Chin J, Shapira L: Practicing compassion increases happiness and self-esteem. J Happiness Stud. 2011, 12: 963-981. 10.1007/s10902-010-9239-1.
Sergeant S, Mongrain M: Are positive psychology exercises helpful for people with depressive personality styles?. J Posit Psychol. 2011, 6: 260-272. 10.1080/17439760.2011.577089.
Shapira LB, Mongrain M: The benefits of self-compassion and optimism exercises for individuals vulnerable to depression. J Posit Psychol. 2010, 5: 377-389. 10.1080/17439760.2010.516763.
Buchanan KE, Bardi A: Acts of kindness and acts of novelty affect life satisfaction. J Soc Psychol. 2010, 150: 235-237. 10.1080/00224540903365554.
Kremers IP, Steverink N, Albersnagel FA, Slaets JPJ: Improved self-management ability and well-being in older women after a short group intervention. Aging Ment Health. 2006, 10: 476-484. 10.1080/13607860600841206.
Lyubomirsky S, Sousa L, Dickerhoof R: The costs and benefits of writing, talking, and thinking about life’s triumphs and defeats. J Pers Soc Psychol. 2006, 90: 692-708.
Quoidbach J, Wood AM, Hansenne M: Back to the future: the effect of daily practice of mental time travel into the future on happiness and anxiety. J Posit Psychol. 2009, 4: 349-355. 10.1080/17439760902992365.
Feldman D, Dreher D: can hope be changed in 90 minutes? Testing the efficacy of a single-session goal-pursuit intervention for college students. J Happiness Stud. 2012, 13: 745-759. 10.1007/s10902-011-9292-4.
Hurley DB, Kwon P: Results of a study to increase savoring the moment: differential impact on positive and negative outcomes. J Happiness Stud. 2012, 13: 579-588. 10.1007/s10902-011-9280-8.
Page K, Vella-Brodrick D: The working for wellness program: RCT of an employee well-being intervention. J Happiness Stud. 2012, 1-25. http://link.springer.com/article/10.1007%2Fs10902-012-9366-y?LI=true
Schueller MS, Parks CA: Disseminating self-help: positive psychology exercises in an online trial. J Med Internet Res. 2012, 14: e63-10.2196/jmir.1850.
Burton CM, King LA: The health benefits of writing about intensely positive experiences. J Res Personal. 2004, 38: 150-163. 10.1016/S0092-6566(03)00058-8.
Luthans F, Avey JB, Patera JL: Experimental analysis of a web-based training intervention to develop positive psychological capital. Acad Manag Learn Educ. 2008, 7: 209-221. 10.5465/AMLE.2008.32712618.
King LA: The health benefits of writing about life goals. Pers Soc Psychol Bulletin. 2001, 27: 798-807. 10.1177/0146167201277003.
Lyubomirsky S, Dickerhoof R, Boehm JK, Sheldon KM: Becoming happier takes both a will and a proper way: an experimental longitudinal intervention to boost well-being. Emotion. 2011, 11: 391-402.
Martinez MML, Avia MD, Hernandez-Lloreda MJ: The effects of counting blessings on subjective well-being: a gratitude intervention in a Spanish sample. Span J Psychol. 2010, 13: 886-896.
Mitchell J, Stanimirovic R, Klein B, Vella-Brodrick D: A randomised controlled trial of a self-guided internet intervention promoting well-being. Comput Hum Behav. 2009, 25: 749-760. 10.1016/j.chb.2009.02.003.
Peters ML, Flink IK, Boersma K, Linton SJ: Manipulating optimism: can imagining a best possible self be used to increase positive future expectancies?. J Posit Psychol. 2010, 5: 204-211. 10.1080/17439761003790963.
Wing JF, Schutte NS, Byrne B: The effect of positive writing on emotional intelligence and life satisfaction. J Clin Psychol. 2006, 62: 1291-1302. 10.1002/jclp.20292.
Luthans F, Avey JB, Avolio BJ, Peterson SJ: The development and resulting performance impact of positive psychological capital. Hum Resour Dev Q. 2010, 21: 41-67. 10.1002/hrdq.20034.
Boehm JK, Lyubomirsky S, Sheldon KM: A longitudinal experimental study comparing the effectiveness of happiness-enhancing strategies in Anglo Americans and Asian Americans. Cognition & Emotion. 2011, 25: 1263-1272. 10.1080/02699931.2010.541227.
Gander F, Proyer RT, Ruch W, Wyss T: Strength-based positive interventions: further evidence for their potential in enhancing well-being and alleviating depression. J Happiness Stud. 2012, http://link.springer.com/article/10.1007/s10902-012-9380-0,
Layous K, Nelson KS, Lyubomirsky S: What is the optimal way to deliver a positive activity intervention? The case of writing about one’s best possible selves. J Happiness Stud. 2012, Published Online 06 May 2012. http://link.springer.com/article/10.1007/s10902-012-9346-2
Cheavens JS, Feldman DB, Gum A, Michael ST, Snyder CR: Hope therapy in a community sample: a pilot investigation. Soc Indic Res. 2006, 77: 61-78. 10.1007/s11205-005-5553-0.
Frieswijk N, Steverink N, Buunk BP, Slaets JPJ: The effectiveness of a bibliotherapy in increasing the self-management ability of slightly to moderately frail older people. Patient Educ Couns. 2006, 61: 219-227. 10.1016/j.pec.2005.03.011.
Abbott JA, Klein B, Hamilton C, Rosenthal A: The impact of online resilience training for sales managers on wellbeing and performance. E-J Appl Psychol. 2009, 5: 89-95.
Grant AM, Curtayne L, Burton G: Executive coaching enhances goal attainment, resilience and workplace well-being: a randomised controlled study. J Posit Psychol. 2009, 4: 396-407. 10.1080/17439760902992456.
Lichter S, Haye K, Kammann R: Increasing happiness through cognitive retraining. 1980, Psychologist: New Zealand, 9-
Spence GB, Grant AM: Professional and peer life coaching and the enhancement of goal striving and well-being: an exploratory study. J Posit Psychol. 2007, 2: 185-194. 10.1080/17439760701228896.
Fava GA, Rafanelli C, Cazzaro M, Conti S, Grandi S: Well-being therapy: a novel psychotherapeutic approach for residual symptoms of affective disorders. Psychol Med. 1998, 28: 475-480. 10.1017/S0033291797006363.
Fava GA, Ruini C, Rafanelli C, Finos L, Salmaso L, Mangelli L, et al: Well-being therapy of generalized anxiety disorder. Psychotherapy and Psychosomatics S2- Acta Psychotherapeutica. 2005, 74: 26-30. 10.1159/000082023.
Goldstein ED: Sacred moments: implications on well-being and stress. J Clin Psychol. 2007, 63: 1001-1019. 10.1002/jclp.20402.
Grant AM: Making positive change: a randomized study comparing solution-focused vs. problem-focused coaching questions. J Systemic Therapies. 2012, 31: 21-35. 10.1521/jsyt.2012.31.2.21.
Bergsma A: Do self-help books help?. J Happiness Stud. 2007, 9: 341-360.
den Boer PCAM, Wiersma D, Van Den Bosch RJ: Why is self-help neglected in the treatment of emotional disorders? A meta-analysis. Psychol Med: A Journal of Research in Psychiatry and the Allied Sciences. 2004, 34: 959-971. 10.1017/S003329170300179X.
Parks AC, Schueller SM, Tasimi A: Increasing happiness in the general population: empirically supported self-help?. To appaer in: Oxford Handbook of Happiness. Edited by: Boniwell I, David S. 2012, Oxford: Oxford University Press
Huppert FA: A new approach to reducing disorder and improving well-being. Perspect Psychol Sci. 2009, 4: 108-111. 10.1111/j.1745-6924.2009.01100.x.
Christensen H, Griffiths KM, Farrer L: Adherence in internet interventions for anxiety and depression. J Med Internet Res. 2009, 11: e13-10.2196/jmir.1194.
Schueller SM: Preferences for positive psychology exercises. J Posit Psychol. 2010, 5: 192-203. 10.1080/17439761003790948.
Schueller SM: To each his own well-being boosting intervention: using preference to guide selection. J Posit Psychol. 2011, 6: 300-313. 10.1080/17439760.2011.577092.
Cuijpers P, Donker T, van Straten A, Li J, Andersson G: Is guided self-help as effective as face-to-face psychotherapy for depression and anxiety disorders? A systematic review and meta-analysis of comparative outcome studies. Psychol Med: A Journal of Research in Psychiatry and the Allied Sciences. 2010, 40: 1943-1957. 10.1017/S0033291710000772.
Ruini C, Belaise C, Brombin C, Caffo E, Fava GA: Well-being therapy in school settings: a pilot study. Psychotherapy and Psychosomatics S2- Acta Psychotherapeutica. 2006, 75: 331-336. 10.1159/000095438.
Ruini C, Ottolini F, Tomba E, Belaise C, Albieri E, Visani D, et al: School intervention for promoting psychological well-being in adolescence. J Behav Ther Exp Psychiatry. 2009, 40: 522-532. 10.1016/j.jbtep.2009.07.002.
Wong MCS, Lee A, Sun J, Stewart D, Cheng FFK, Kan W, et al: A comparative study on resilience level between WHO health promoting schools and other schools among a Chinese population. Health Promot Int. 2009, 24: 149-155. 10.1093/heapro/dap010.
Gillham J, Reivich K: Cultivating optimism in childhood and adolescence. Ann Am Acad Pol Soc Sci. 2004, 591: 146-163. 10.1177/0002716203260095.
Knoop HH: Education in 2025: How positive psychology can revitalize education. Applied positive psychology: Improving everyday life, health, schools, work and society. Edited by: Donaldson SI, Csikszentmihalyi M, Nakamura J. 2011, New York: Routledge
Veehof MM, Oskam MJ, Schreurs KMG, Bohlmeijer ET: The effects of acceptance-based therapies on mental and physical health in chronic pain patients: results of a meta-analysis. Pain. 2011, 152: 533-542. 10.1016/j.pain.2010.11.002.
Mazzucchelli TG, Kane RT, Rees CS: Behavioral activation interventions for well-being: a meta-analysis. J Posit Psychol. 2010, 5: 105-121. 10.1080/17439760903569154.
Korte J, Bohlmeijer ET, Cappeliez P, Smit F, Westerhof GJ: Life review therapy for older adults with moderate depressive symptomatology: a pragmatic randomized controlled trial. Psychol Med. 2012, 42: 1163-1173. 10.1017/S0033291711002042.
van Straten A, Seekles W, Beekman ATF, Cuijpers P, van ’t Veer-Tazelaar N: Stepped care for depression in primary care: what should be offered and how?. Med J Australia. 2010, 192: S36-S39.
Altman DG: Better reporting of randomized controlled trials: the CONSORT statement. Br Med J. 1996, 313: 570-571. 10.1136/bmj.313.7057.570.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/13/119/prepub
We are grateful to Toine Ketelaars and Angita Peterse for the literature search and Jan Walburg for his comments on the manuscript. We would also like to thank Deirdre Brophy for the English language edit.
The authors declare that they have no competing interests.
LB conducted the meta-analysis, including the literature selection and data-analysis, and wrote the manuscript. MH took care of selecting the articles and cross-checking the data. All authors contributed to the design of the study. EB, GW, HR and FS are advisors in the project. All authors provided comments and approved the final manuscript.