- Study protocol
- Open Access
(Cost)effectiveness of life review for Older Adults: Design of a randomized controlled trial
BMC Public Health volume 8, Article number: 211 (2008)
Depression in older adults is a serious health problem with a poor prognosis. There is a need for indicated preventive psychological interventions for older adults, that show to be promising in preventing depressive disorders.
This manuscript describes the design of a study evaluating 'Looking for Meaning', a newly developed prevention course for older adults with depressive symptoms, based on life-review. Both clinical and economic effectiveness are evaluated in a pragmatic randomized controlled trial. The control condition of this 12-session preventive intervention is a 20-minute video movie. The primary outcome is symptoms of depression at post-treatment and follow-up (6 months after post-treatment). Secondary outcomes are symptoms of anxiety, satisfaction with life, mastery, reminiscence styles, quality of life, and health care costs. An additional result of this study is the insight into the working elements of the course, provided by the qualitative study. The qualitative data, mainly based on 20 open-ended interviews with participants, are to be analyzed with an emphasis on newly emerging insight.
This study will add to the existing scientific knowledge in several ways, especially by also including an economic evaluation and a qualitative study to gain insight into the working mechanisms of the course, both rather new in the field of life review. Positive results of this study will make an evidence-based intervention to improve public health among older people available.
Current Controlled Trials Ltd, ISRCTN66645855
Depression in older adults is a serious health problem with a poor prognosis . Major depression occurs in approximately 1,8% of the general population aged 55 and over, and minor depression in another 9,8% . Considering the high prevalence rate of depressions in people aged 55 and older, there is a need for effective, low-threshold preventive interventions tailored to older adults.
Indicated prevention starts tackling disorders at the symptom level . In contrast with universal prevention (general; aims at no specific target group) and selective prevention (focuses on risk groups with no symptoms yet), indicated prevention directly deals with the major risk factor for developing a full-blown depression particularly in old age: the presence of some of the depressive symptoms . A recent meta-analysis shows that psychological interventions for older adults with depressive symptoms are indeed promising in preventing depressive disorders .
Several psychological interventions are currently available for reducing depression symptoms in older people, including psycho-educational approaches, cognitive behavioral therapy, psychodynamic therapy, and interpersonal therapy [6–8]. The use of life review is gaining popularity, because this type of intervention may pertain to older adults in particular. Meta-analyses have shown that life-review has significant and substantial effects on both depression and psychological well-being [9, 10].
The first to emphasize the importance of life review in old age was Butler . He observed that older adults increasingly review their lives as they grow older, and that they seem to do so naturally. He considered life review the expression of a universal mental process reflecting the need to come to terms with one's life when the end is approaching. Since Butler's observations, scientists and clinicians have shown a growing interest in life review, both as a phenomenon and as a method of treatment for older adults with depression [12–14].
Life review, can fulfill various functions for the individual; people review their lives for different reasons and with different motivations. An individual may apply more than one style. A particular reminiscence style is assumed to relate with more or less favorable outcomes in terms of mental health . Integrative life review is most well-known, and implies an evaluation of one's past in order to accept negative events, resolve past conflicts, identify continuity of past and present, and, eventually, find meaning in life . However, for some older adults life review can be depressing or burdensome. Especially when they tend to focus on negative past experiences, life-review may have a self-subversive rather than positive impact. Life review prompted by 'negative' motivations, such as boredom reduction or bitterness revival, are associated with undesirable clinical outcomes (e.g., anxiety, a low sense of self efficacy, dissatisfaction with life, or depressive symptoms). Transforming these styles and supporting 'positive' reminiscence may therefore promote older adults' mental health.
We developed an indicated prevention course, called 'Looking for Meaning', which is a well-structured type of life review with the underlying assumptions that reminiscence styles influence coping with depressive symptoms and can be changed or transformed by means of an intervention . This course may prevent depressive symptoms from developing into a major depression. A pilot study with a previous version of this course exploring the impact of this approach showed promising results for the mental health of older adults . A next step is to carry out a randomized controlled trial (RCT).
In this paper the design of the RCT on (cost)effectiveness of life review for older adults will be described. In order to be able to explicitly relate reminiscence styles to clinical outcomes, we also measured reminiscence styles and -functions. In addition, a qualitative study was designed to gain an insight into what participating in this course meant to the older adults and how life review in particular might have influenced coping with depression and other mental health issues in their lives. The specific research questions these studies aimed to answer were:
1. Does the prevention program Looking for Meaning lead to a significant reduction of depressive symptoms and a significant enhancement of wellbeing, satisfaction with life, and quality of life in elderly people with depressive symptoms, in comparison with a no-treatment control group?
2. Which prognostic factors (demographic, clinical symptoms, mastery), in combination with the intervention, predict lower or higher effects on depressive symptoms, wellbeing, satisfaction with life and quality of life?
3. What is the incremental cost-utility in the treatment group as compared to the control group?
4. Which are the working components of the intervention, leading to reduction of depression and enhancement of wellbeing, mastery and satisfaction with life, according to the participants?
To evaluate the (cost)effectiveness of the life review course 'Looking for Meaning', we carry out a pragmatic randomized controlled trial (RCT) with a cost effectiveness analysis (CEA). Participants are randomly assigned to either the 12-session prevention course or the control condition, the twenty-minute video movie entitled 'The Art of Growing Older'. In addition, we conduct a qualitative interview- and observational study to gain insight into how participants apply and use life review, how they think it helps them coping with depression, and to learn about which course elements have or have not worked for them. The research has been judged and ethically approved by the METiGG, a medical-ethical committee for research in mental health care settings in the Netherlands.
Participants are recruited via advertisements in local and national newspapers, magazines targeted at an older audience, or selected with the help of professionals affiliated to one of eleven regional institutes for mental health care in both rural and urban areas of the Netherlands participating in this study. These mental health care institutes support the participant recruitment and -intake, make available the professionals needed, and eventually take care of organizing and offering the course within their institute.
In order to participate in this study, participants have to show slight to moderate depressive symptoms; people diagnosed with a major depression are excluded, as well as people showing no symptoms at all. The intended population is aged 55 and up, as the course was developed for older adults. People who respond, are screened for depressive symptoms by mental healthcare professionals (e.g., a psychologist or a therapist). People scoring 24 or higher on the Center for Epidemiological Studies Depression Scale (CES-D), are further examined with the Mini International Neuropsychiatric Interview (MINI) in order to decide whether a major depression is present or not [19–21]. People with scores below 5 are excluded from the study as well, because improvement is hardly possible. People eligible to participate are asked to complete the consent form.
Participants are randomly assigned to either of the two research conditions by means of a centrally conducted randomization stratified for gender. This means the randomization takes place at the research institute (Netherlands Institute of Mental Health and Addiction), independent of the participating institutions; they receive the outcome of the procedure in the regular mail and are to schedule the participants accordingly.
In order to demonstrate a standardized effect size of 0.35 (a medium-sized effect ) a minimum of eighty participants in each condition is required at the time of the follow-up measurement (t2), based on a statistical power (1-beta) of 0.80, a one-sided test, and a conventional alpha of 0.05 (power calculation in Stata 7.0). Anticipating a drop-out of 20% between t0 and t2, slightly over one hundred participants per condition were included at t0, the baseline measurement.
In this study residents, therapists and interviewers collecting data for the qualitative part of the study were not blinded. Therapists are encouraged to present both the experimental and the control condition with equal enthusiasm.
Subjects in the experimental condition are assigned to the life review-based prevention course 'Looking for Meaning' for people aged 55 and older . Groups are typically consisting of eight participants. They are conducted by two mental health care professionals with a therapeutic background or an education in behavioral sciences (e.g., psychology) or social work, who for this purpose receive a two-day training program in advance and one day during the course. The 12 sessions of two hours each are similarly structured, including sensory recall exercises, creative activity, and verbal exchange of experiences. Each session is centered on a topic related to the course of life, also making an explicit link between the past and the present.
Meetings are entitled: your name; smells from the past; houses you've lived in; recognizing your resources; hands; photographs; friendship; balance; thread of life and turning points; longing and desire; the future in me; and identity. Participants are encouraged to make use of the senses in order to evoke memories. In addition, creative exercises may open up new ways of expression besides the verbal mode. The course also offers the possibility of further reading and reflection; poems, short stories and literature suggestions are included in the course material.
Based on the experiences of participants in the pilot study , three sessions have been replaced or changed. Participants in the pilot indicated that they missed verbal exchange, and would also like to learn about problem solving techniques. These elements were included in the course after the pilot.
The participants assigned to the control group receive an invitation to come watch 'The Art of Growing Older' . This 20-minute educational video movie supplies information about factors and skills that promote growing older successfully. This intervention is considered a minimal intervention, as no treatment is involved.
Table 1 provides an overview of the economic and effect measurements. As a part of the intake and selection interview, we administer the Center for Epidemiological Studies Depression Scale (CES-D), in order to screen the participants. The outcome is considered the CES-D baseline score for those included; the course starts shortly thereafter. Data at t0 (baseline), t1 (effect; 3 months after t0), and t2 (retention; 6 months after t1) are collected by means of a questionnaire. Demographics and additional personal characteristics are recorded at t0 only, and evaluation questions about the participant's experience with the intervention are asked only at t1. Except for that, the three questionnaires are identical.
1. Reduction of depressive symptoms measured using the Center for Epidemiological Studies Depression Scale (CES-D).
The Center for Epidemiologic Studies Depression scale (CES-D) is a 20-item self-report scale developed to measure depressive symptoms in the community . Subjects were asked to indicate how often they experienced each symptom during the previous week. Response categories, ranging form 0 to 3, were 'rarely or never', 'some of the time', 'occasionally', or 'mostly or always'. Summation results in the CES-D score, ranging from 0 to 60. A score of 16 or higher is considered indicative for clinically relevant depressive syndromes. The psychometric properties of the scale are found to be good in older populations .
2. Reduction of anxiety symptoms measured using the Hospital Anxiety and Depression Scale (HADS)
The HADS is a 14-item, self-reporting screening scale comprising two 7-item Likert scales, measuring depression and anxiety, respectively. We use the anxiety scale (HADS-A) . Respondents are asked to indicate whether they experienced feelings of restlessness, tenseness, or panic during the past four weeks. Items range from 0 (rarely or never) to 3 (always or most of the time). The total score ranges from 0 to 21.
3. An increase of satisfaction with life measured using the Manchester Short Assessment of Quality of Life (MANSA).
The Manchester Short Assessment of Quality of Life (MANSA) comprises 16 items: 4 objective questions and 12 subjective questions . We use the 12 subjective items, assessing satisfaction with life as a whole, employment or retirement, financial situation, friendships, leisure, accommodation, personal safety, people that the individual lives with (or living alone), sex life, relationship with family, physical health, and mental health. Each item is rated on a seven-point scale ranging from 1 (couldn't be worse) to 7 (couldn't be better). Summary scores range from 12 to 84; the higher the score the better the quality of life.
4. An increase in perceived control over one's life, measured using the Pearlin and Schooler's Mastery Scale.
The Pearlin and Schooler's Mastery Scale consists of seven items that are intended to assess beliefs of perceived control over one's life in general or beliefs regarding one's ability to control an event . We use the abbreviated version of five items, phrased in a negative way. Possible responses are given on a 5-point scale ranging from 1 (strongly disagree) to 5 (strongly agree). Summary scores range from 5 to 25. Higher scores on the scale indicate lower levels of perceived control.
5. Change or transformation into more positive reminiscence styles measured using the Reminiscence Function Scale (RFS).
The Reminiscence Function Scale is a 43-item questionnaire that can be used to assess reminiscence functions over the life course . The scale comprises eight subscales (factors) reflecting possible functions of reminiscence for the individual. The subscales are labeled 'boredom reduction', 'death preparation', 'identity', 'problem-solving', 'conversation', 'intimacy maintenance', 'bitterness revival', and 'teach/inform'. Questions typically start with "when I reminiscence, it is..." and are completed with 43 possible reasons or motivations to reminiscence. Respondents are asked to indicate the extent to which each of the 43 reasons apply to them. Possible answers range from 1 to 6 (never, rarely, seldom, occasionally, often, or very frequently). For the purpose of this research, 23 questions covering four subscales have been selected: 6 about boredom reduction, 6 about identity, 6 about problem-solving, and 5 about bitterness revival. Examples are: "When I reminisce, it is... to pass the time during idle or restless hours" (boredom reduction), "to see how my past fits in with my journey through life" (identity), "to help me plan for the future" (problem solving), or "to keep painful memories alive" (bitterness revival). Scores are averaged per subscale, representing a reminiscence function each. The higher the score, the more the indicated function applies. In addition, the summary score (all items) indicates the extent to which a person reminiscences irrespective of its reason or function.
Additional measures: confounding or modifying variables
In addition to the measurements mentioned above, we assess the following variables that may act as modifying factors of primary and secondary outcomes: Chronic disorders (such as coronary diseases, lung diseases, or rheumatism) critical life events within in the past three years (such as the lost of a spouse, divorce, or having moved), socioeconomic status (SES) according to employment, finances, level of education, and living arrangement.
The aim of the economic evaluation is to estimate the incremental cost-utility in terms of quality-adjusted life years (Qualy) gained in the treatment group, as compared to the non-treatment group. The economic evaluation is based on the EQ-5d and the Tic-P. Costs of the intervention itself are estimated as well. Measures are described below.
9. An increase of quality of life as measured with the EQ-5D.
The EuroQoL EQ-5D is a pre-scored health classification system that is defined over five domains of health: mobility, self-care, usual activity, pain/discomfort and depression/anxiety [27–29]. Each of the five domains is categorized into three severity levels; 0 (none), 1 (some) and 2 (severe). Responses are combined by a scoring algorithm to produce a summary utility score between -0.594 and 1.0, where 1 represents the state of best imaginable health. Values correspond with Quality-adjusted life years (Qualy) gained or lost. We use an index based on the Dutch population, in accordance with the Dutch TTO tariff . In our study, we also use the EQ-5D as a clinical outcome measure indicating one's perceived quality of life.
10. A decrease in costs of receiving (in)formal health care as measured with the TIC-P.
Cost data are collected using the TIC-P . Costs are defined from a societal perspective and include direct and indirect costs related to receiving formal and informal health care. Production losses in both paid and unpaid work are also covered by the TIC-P. These costs arise when people are absent from work, or work less efficiently due to depression, for example. Production losses will be estimated with the help of the TIC-P.
The analyses will be performed according to the íntention to treat' principle. Therefore, all missing values were imputed. In order to replace the missing values by plausible estimates, we will use the regression imputation procedure as implemented in Stata version 9.1 .
We will calculate effect sizes for the immediate improvement of the experimental and the control group on the primary and secondary outcomes by dividing the absolute difference between the post-treatment average score and the pretreatment average score by the pretreatment standard deviation. To establish the maintenance of improvement of both groups, effects sizes will be calculated by dividing the absolute difference between the follow-up average score and the post-treatment average score by the pretreatment standard deviation. For between-group effect sizes, the effect size of the experimental group will be subtracted from the effect size of the control group. Effect sizes of 0.56–1.2 can be assumed to be large, while effect sizes of 0.33–0.55 are moderate, and effect sizes of 0–0.32 are small .
In the cost-effectiveness analyses, we will calculate the pre-post changes in costs and identify which respondents show a moderate to large improvement in depressive symptoms in both conditions. These respondents changed reliably, and could thus be considered a 'success'. Then we calculated the incremental cost-effectiveness ratio (ICER) across the experimental and control condition, which represents the incremental costs (or savings) per 'success' (i.e. moderate to large improvement in depressive symptoms) in the experimental condition relative to the control condition. Uncertainty will be assessed by means of non-parametric bootstrapping (2,500 times) of the data of the individual respondents.
To answer research question 4, and gain an insight into the working mechanisms of a life-review approach in general and the course 'Looking for Meaning' in particular, we designed a qualitative study.
The study comprises twenty semi-structured interviews with participants of approximately one hour each, and research observations in three different participant groups during six hours in total. Both the interviews and the observations are centered on participants' experiences with the course, with an emphasis on the life review aspect in relation to the participants' personal experiences and clinical outcome measures. The interview questions are typically open-ended and put in a non-leading way. They leave open if life review is helpful or effective at all and gives the participants room to also respond negatively.
The audio-taped interviews are transcribed verbatim. The group observations result in detailed notes about the evaluation process and the interactions between participants. They serve as a point of reference when interpreting the interview data; observations might support or contradict the other qualitative findings.
Qualitative data analysis
More than one method may apply to analyze qualitative data, including 'code-and-retrieve' methods (33–35). 'Code and retrieve' means that relevant parts of the material are selected or highlighted (coded), extracted, and clustered in the end. In this process, abductive inference combines new and interesting empirical facts from the data in the first place (bottom-up) with previous theoretical knowledge , whereas inductive inference is more restrictive and departs from a theoretical framework (top down) to classify the data.
In this study, we will use a top-down, theory driven approach with an emphasis on newly emerging insight irrespective of whether an observation is made repeatedly or can be easily classified. It is added to the quantitative analysis in order to better understand the outcomes. Relevant information can be recognized in relation to, or in contrast with, the knowledge to date. By reading and re-reading the data materials and making notes with in mind the research questions, the researcher yields descriptive and explanatory research outcomes integrated with his or her theoretical knowledge.
In this paper we described the design of a study on the (cost)effectiveness of a newly developed life-review-based course 'Looking for Meaning'. The results of this study will add to the literature in different ways. Due to the pragmatic character of the Randomized Controlled Trial (RCT), results will show whether potential effects hold in mental health care practice and can be considered ecological valid. We added an economic evaluation, which is the first one regarding life review. In addition, we included a measurement scale based on reminiscence styles, the Reminiscence Function Scale (RFS), to show a change or transformation in reminiscence styles as an outcome of the intervention, which is also a novelty. Finally, we added a qualitative study consisting of interviews with participants and observations of group sessions, because a RCT may show that an intervention is effective, but the reason why often remains unclear. The qualitative study enables us to gain more insight into the working mechanisms of the intervention. This insight is important for several reasons. It helps refuting the argument that it was 'mere attention', and not the specific therapeutic approach that has caused the effect. It can also facilitate the selection and motivation of the 'right' participants for the 'right' type of intervention. In addition, it enables scientists and clinicians to improve or adjust the intervention without distorting its effectiveness. The same holds for therapists and other professionals who conduct the course.
Obviously, the research has limitations too. Most of them are related to nonspecific therapeutic benefits that are usually not controlled for in the design of randomized controlled trials, and are inherent in mental health studies of a pragmatic or naturalistic kind. Instead of being put on a waiting list or receiving care-as-usual, for ethical reasons our control group participants are invited to view an informative movie with relevant contents, representing the control condition. In this way, the intervention of which the effectiveness is indicated but not proven yet (Looking for Meaning) is compared with a minimal intervention (movie) of which the effectiveness is unknown. Although a 20-minute movie cannot be expected to rival the impact of a 12-session course, we cannot be sure. Any effectiveness of the movie will lead to an underestimation of the incremental effect size, i.e. the difference between the improvement in the experimental and the control condition. On the other hand, although we encourage therapists to present both interventions with the same enthusiasm, the novelty of the reminiscence course may cause more enthusiasm among the therapists compared to regular courses, leading to an overestimation of the incremental effect size.
The significance of depression for public health especially in older people, underscores the need for preventive interventions. In this study, we investigate the cost(effectiveness) of the indicated prevention course 'Looking for Meaning', which is a well-structured type of life review. Positive results of this study will make an evidence-based intervention to improve public health among older people available.
Licht-Strunk E, Windt van der DA, van Marwijk HW, de Haan M, Beekman AT: The prognosis of depression in older patients in general practice and the community. A systematic review. Fam Pract. 2007, 24: 168-180. 10.1093/fampra/cml071.
Beekman ATF, Copeland JR, Prince MJ: Review of community prevalence of depression in later life. Br J Psychiatry. 1999, 174: 307-311.
Smit F, Ederveen A, Cuijpers P, Deeg D, Beekman ATF: Opportunities for cost-effective prevention of late-life depression: An epidemiological approach. Arch Gen Psychiatry. 2006, 63: 290-296. 10.1001/archpsyc.63.3.290.
Mrazek PJ, Haggerty RJ: Reducing risks for mental disorders: Frontiers for preventive intervention research. 1994, Washington DC, National Academy Press
Cuijpers P, Smit F, van Straaten A: Psychological treatments of subthreshold depression: a meta-analytic review. Acta Psychiatr Scand. 2007, 115: 434-441. 10.1111/j.1600-0447.2007.00998.x.
Cuijpers P: A psycho-educational approach to the treatment of depression; a meta-analysis of Lewinsohn's 'Coping with Depression' course. Beh Ther. 1998, 29: 521-533. 10.1016/S0005-7894(98)80047-6.
Wilson KC, Mottram PG, Vassilas CA: Psychotherapeutic treatments for older depressed people. Cochrane Database Syst Rev. 2008, CD004853-1
Miller MD: Using interpersonal therapy (IPT) with older adults today and tomorrow: a review of the literature and new developments. Curr Psychiatr Rep. 2008, 10: 16-22. 10.1007/s11920-008-0005-6.
Bohlmeijer E, Smit F, Cuijpers P: Effects of reminiscence and life review on late-life depression: a meta-analysis. Int J Ger Psychiatry. 2003, 18: 1088-1094. 10.1002/gps.1018.
Bohlmeijer ET, Roemer M, Cuijpers P, Smit F: The effects of life-review on psychological well-being in older adults: a meta-analysis. Aging Ment Health. 2007, 11: 291-300. 10.1080/13607860600963547.
Butler RN: The life-review: An interpretation of reminiscence in the aged. Psychiatry. 1963, 26: 65-76.
Fry PS: Structured and unstructured reminiscence training and depression in the elderly. Clin Gerontologist. 1983, 1: 15-37. 10.1300/J018v01n03_06.
Watt LM, Cappeliez P: Integrative and instrumental reminiscence therapies for depression in older adults: intervention strategies and treatment effectiveness. Aging Ment Health. 2000, 4: 166-177. 10.1080/13607860050008691.
Haight BK, Coleman P, Lord K: The Linchpins of a successful life review: Structure evaluation, and individuality. The art and science of reminiscing: Theory, research, methods, and applications. Edited by: Haight BK, Webster JD. 1995, Washington DC: Taylor & Frances, 179-192.
Webster JD: Construction and Validation of the reminiscence Functions Scale. J Gerontol. 1993, 48 (5): P256-262.
Wong PT, Watt LM: What types of reminiscence are associated with successful aging?. Psych Aging. 1991, 6: 272-279. 10.1037/0882-7922.214.171.1242.
Franssen J, Bohlmeijer E: Op zoek naar zin, een cursus rond het eigen levensverhaal voor ouderen met depressieve klachten. [Looking for meaning, a course on the own life-story for older adults with depressive symptoms.]. 2003, Utrecht, Trimbos-instituut
Bohlmeijer E, Valenkamp M, Westerhof G, Smit F, Cuijpers P: Creative reminiscence as an early intervention for depression: results of a pilot project. Aging Ment Health. 2005, 9: 302-304. 10.1080/13607860500089567.
Radloff LS: The CES-D scale: a self-report depression scale for research in the general population. J Applied Psychol Measurement. 1977, 1: 385-401. 10.1177/014662167700100306.
Radloff LS, Teri L: Use of the CES-D with older adults. Clin Gerontol. 1986, 5: 119-36. 10.1300/J018v05n01_06.
Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E: The Mini-International Neuropsychiatric Interview (M.I.N.I): The development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry. 1998, 59: 22-33.
Lipsey MW, Wilson DB: The efficacy of psychological, educational, and behavioral treatment. Am Psychologist. 1993, 48: 1181-1209. 10.1037/0003-066X.48.12.1181.
Parnassia psycho-medisch centrum: 'De kunst van het ouder worden'. Videofilm en handleiding ['The Art of Growing Older'. Movie and manual]. 2003, Den Haag, Parnassia psycho-medisch centrum
Zigmond AS, Snaith RP: The hospital anxiety and depression scale. Acta Psychiatr Scand. 1983, 67: 361-370. 10.1111/j.1600-0447.1983.tb09716.x.
Priebe S, Huxley P, Knight S, Evans S: Application and results of the Manchester Short Assessment of quality of life (MANSA). Int J Soc Psychiatry. 1999, 45: 7-12. 10.1177/002076409904500102.
Pearlin LI, Schooler C: The structure of coping. J Health Soc Behav. 1978, 19: 2-21. 10.2307/2136319.
Brooks R: EuroQol: the current state of play. Health Policy. 1996, 37: 53-72. 10.1016/0168-8510(96)00822-6.
Euroqol group: EuroQol-a new facility for the measurement of health-related quality of life. Health Policy. 1990, 16: 199-208. 10.1016/0168-8510(90)90421-9.
Lamers LM, Stalmeier PFM, McDonnell J, Krabbe PFM, van Busschbach JJ: Kwaliteit van leven meten in economische evaluaties: het Nederlands EQ-5D-tarief. [Measuring the quality of life in economic evaluations: the Dutch EQ-5D tariff]. Ned Tijdschr Geneeskd. 2005, 149: 1574-1578.
Hakkaart-van Rooijen L, van Straten A, Doner M, Tiemens B: Trimbos/iMTA questionnaire for costs associated with psychiatric illness (TIC-P). 2002, Rotterdam: Erasmus University
StataCorp: Stata Statistical Software: Release 9.1. 2005, College Station, Texas: Stata Corporation
Cohen J: Statistical Power Analysis for the Behavioural Sciences. Edited by: Hillsdale NJ. 2005, Lawrence Erlbaum Associates, 2
Kelle U: Introduction: An overview of computer-aided methods in qualitative research. Computer-Aided Qualitative Data Analysis: Theory, methods and practice. Edited by: Kelle U. 1995, London, Sage, 1-17.
Kelle U: Theory Building in Qualitative Research and Computer Programs for the Management of Textual Data. Soc Res Online. 1997, 2 (2):
Richards T, Richards L: Using Computers in Qualitative Research. Handbook of Qualitative Research. Edited by: Denzin N, Lincoln Y. 1995, Thousand Oaks, Sage
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/8/211/prepub
The authors declare that they have no competing interests.
AMP drafted the manuscript and supervised the study. A–SM drafted the manuscript and partly analyzed the data of the study. SO helped to draft this manuscript and partly analyzed the data of the study. ETB designed the study and helped to draft this manuscript. All authors read and approved the final manuscript.