- Study protocol
- Open Access
The effectiveness of Stepping stones Triple P: the design of a randomised controlled trial on a parenting programme regarding children with mild intellectual disability and psychosocial problems versus care as usual
BMC Public Health volume 11, Article number: 676 (2011)
Children with an intellectual disability are at increased risk of psychosocial problems. This leads to serious restrictions in the daily functioning of the children and to parental stress. Stepping Stones Triple P aims to prevent severe behavioural, emotional and developmental problems in children with a (intellectual) disability by enhancing parenting knowledge and skills, and the self-confidence of parents. This paper aims to describe the design of a study of the effectiveness of parenting counselling using Stepping Stones Triple P compared to Care as Usual.
The effects of Stepping Stones Triple P will be studied in a Randomised Controlled Trial. Parents of children aged 5-12 years with an IQ of 50-85 will be recruited from schools. Prior to randomisation, parents complete a screening questionnaire about their child's psychosocial problems and their parenting skills. Subsequently, parents of children with increased levels of psychosocial problems (score on Strengths and Difficulties Questionnaire ≥ 14) will be invited to participate in the intervention study. After obtaining consent, parents will be randomised either to the experimental group (Stepping Stones Triple P) or to Care as Usual. The primary outcome is a change in the child's psychosocial problems according to parents and teachers. The secondary outcome is a change in parenting skills. Data will be collected before the start of the intervention, immediately after the intervention, and six months after.
This paper presents an outline of the background and design of a randomised controlled trial to investigate the effectiveness of Stepping Stones Triple P, which aims to decrease psychosocial problems in children with a mild intellectual disability. Stepping Stones Triple P seems promising, but evidence on its effectiveness for this population is still lacking. This study provides evidence about the effects of this intervention in a community-based population of children with a mild intellectual disability.
Netherlands Trial Register (NTR): NTR2624
Psychosocial problems, such as problems with behaviour, emotions and relationships, occur frequently in children with an intellectual disability (ID). Estimates of their prevalence rates vary widely, from 30% to over 60% [1–3]. The combination of psychosocial problems and ID significantly limits occupational opportunities in the post-school period and can also lead to major restrictions in participation in educational and recreational programmes . Moreover, a child's psychosocial problems and parenting stress exacerbate each other over time . Further, the presence of psychosocial problems also leads to parental stress due to parenting challenges [6, 7].
The improvement of parenting skills by parenting interventions may lead to a significant reduction in both the psychosocial problems of the child and the parental stress . A promising parenting programme that may help to reduce these problems in these children is Stepping Stones Triple P (SSTP). SSTP aims to prevent severe behavioural, emotional and developmental problems in children with a disability by enhancing the knowledge, skills and confidence of parents . However, although SSTP looks promising, there is little strong evidence on its effectiveness. There are two studies in Australia in preschool-aged children with developmental disabilities and problem behaviour [10, 11]. Furthermore, there is a study in Australia on children diagnosed with autism spectrum disorders . The results of these studies demonstrate maintained significant improvements in child behaviour and parenting styles, and parents reported a high level of satisfaction with SSTP. A recent Dutch study on SSTP without control groups shows positive effects on the child's psychosocial problems, on parenting skills, family functioning and parental wellbeing . However, there is no evidence with Randomised Controlled Trials (RCT) for SSTP among this broad target population of children with mild ID and their parents.
The aim of this study is to assess the effectiveness of SSTP regarding the reduction of a child's psychosocial problems and parental stress among children with mild ID and their parents. This paper describes the design of the evaluation of the effectiveness of parenting counselling according to SSTP regarding the psychosocial problems of children with mild ID compared to a control group receiving Care as Usual (CAU).
The design of the study will be described following the CONSORT guidelines . The study will be conducted as an RCT on the effectiveness of parenting counselling according to SSTP compared to a control group receiving CAU (Figure 1). There will be a screening before the intervention (T0), an assessment immediately after the intervention (T1) and a follow-up assessment after six months (T2). Parents will participate voluntarily in this study and are free to leave the study at any time. All parents will provide written informed consent before they participate in the study. Ethical permission for this study has been obtained from the Medical Ethics Committee of the University Medical Center Groningen. The study will be performed between October 2010 and December 2013.
Via schools, parents of children aged 5-12 years with an IQ of 50-85, living in the four Northern provinces of the Netherlands (Groningen, Friesland, Drenthe and a part of Overijssel) will be invited to fill out a screening questionnaire about their child's psychosocial problems and their parenting skills. The majority of children with mild ID attend three types of school for special educational needs in the Netherlands, in Dutch called 'SBO', 'REC3' and 'REC4'. SBO ('Speciaal Basis Onderwijs'; special primary education) comprises children with mild intellectual disabilities (IQ of between 70 and 85), learning difficulties and/or behaviour difficulties. REC 3 ('Regional Expertise Center cluster 3') includes children with physical disabilities, (mild) ID (IQ < 55 or IQ between 56 and 70 with other severe disabilities), and/or chronic diseases. REC 4 ('REC cluster 4') includes children with psychiatric and/or behavioural disorders with or without mild ID (IQ > 70) [15, 16]. Participating schools expect that 30% of the REC4 pupils, 30% of the REC3 pupils and 95% of the SBO pupils will be eligible for screening (age 5-12 years and IQ 50-85).
In order to increase response rates, we will offer assistance if required to fill out the screening questionnaire and will visit all families to fill out the second and third questionnaires . Exclusion criteria are: (1) the child lives in residential care (except foster care), (2) parents are unable to speak Dutch, (3) information about the child's IQ is not available, and (4) parents live outside the research area.
When parents report psychosocial problems in their child at T0, they will be invited to participate in the intervention study. Exclusion criteria are: (1) a brother or sister (with a higher Strengths and Difficulties Questionnaire (SDQ) score) is participating in the study, and (2) the parents are receiving treatment for parenting skills or other treatment that potentially clashes with SSTP.
SSTP is a family intervention and aims to prevent severe behavioural, emotional and developmental problems in children with all kinds of disabilities, including mild ID, by enhancing the knowledge, skills and confidence of parents . This method is part of the Australian Triple P - Positive Parenting Program, a system of parenting and family interventions for parents of children who have or are at risk of psychosocial problems . There are seven principles of parenting in SSTP: (1) ensure a safe interesting environment, (2) create a positive learning environment, (3) use assertive discipline, (4) have realistic expectations, (5) take care of oneself as a parent, (6) family adaptation to having a child with a disability, and (7) be part of the community. The last two principles are additional ones, specifically related to the parenting of children with a disability .
SSTP takes 8-10 individual sessions, provided over 10-12 weeks. Each session typically lasts 60-120 minutes. The first module, 'Assessment', consists of two sessions of about 60-90 minutes. In this module, parents formulate hypotheses about the problems and make relevant causes and factors clear. The second module, 'Positive Parenting', also consists of two sessions of about 60-90 minutes. In these sessions parenting strategies should be introduced to parents. The third module, 'Practice', consists of three sessions of about 40-60 minutes. In these sessions, parents will practise the parenting strategies and receive support. The final module, 'Planned Activities Training', consists of three sessions. Parents will be assisted in the practical implementation of the strategies .
Participants assigned to the control condition may utilise any service, except SSTP. These services can be anything aimed to alleviate parental stress or the psychosocial problems of the child. CAU can consist of Practical Pedagogical Family Support (PPG), Video-home training (VHT), Intensive Pedagogical Homecare (IPT) or Intensive Orthopedagogical Family Care (IOG), but also of psychiatric or psychological care for the child and, in some cases, no care at all .
The primary outcome is the child's psychosocial problems measured by the SDQ (parent and teacher versions) and the Eyberg Child Behaviour Inventory (ECBI). The SDQ is a 25-item questionnaire, covering emotional symptoms, conduct problems, hyperactivity, peer relationship problems, pro-social behaviour and the impact of the problems on functioning . We will use two informants to measure each child's psychosocial problems (i.e. the teacher and the parent). Multiple informants on a child's psychosocial problems are invaluable for understanding the home and community functioning of children with mild ID, because psychosocial problems may be highly situational and differ at school and at home [20–22]. The ECBI, a 36-item questionnaire, will be used to measure parental perceptions of the disruptive behaviour of the child, including frequency and its identification as a problem .
The secondary outcome is parenting skills measured by the Parenting Stress Index (PSI) and the Alabama Parenting Questionnaire (APQ). The PSI measures parents' perceived stress due to parenting. The short 25-item version of the PSI comprises questions on experience of parenting leading to a total 'parenting stress' score . The APQ measures parenting practices. The short version of the APQ consists of 35 items categorised into four subscales: parental involvement, positive parenting, poor monitoring and inconsistent discipline .
In addition, data will be collected about the current use of health care and use of health care in the past (in the preceding four weeks, six months and longer than six months ago). Moreover, questions will be asked regarding the need for parental support and satisfaction with care.
Data on sociodemographic characteristics (parental education, family income, family structure, ethnicity, parental age and parental employment) and child medical conditions will be collected at baseline to adjust for potential differences between the intervention and control groups.
The parental SDQ score will serve as the primary outcome measure to determine the sample size. For a 3-point decrease in the SDQ total score, given a standard deviation (SD) of the SDQ of 6 points (an effect size of 0.5), at alpha = 0.05 (two-sided) and beta = 0.20, 63 children need to be included in each group (SSTP and CAU). With adjustment for a 'loss to follow-up' of about 40%, 210 children need to be included in the study, 105 children in each treatment condition.
Parents will be included if their child has an SDQ total problems score of 14 or higher. The prevalence rate of an SDQ ≥ 14 among children who are not under current treatment for their mental health problems is estimated at 55% . Therefore, (2 × 105)/55% = 381 children with mild ID aged 5-12 years are required. Adjusting for 30% refusal to participate and 10% incomplete SDQs, 635 parents will have to fill in the SDQ.
After informed consent by the parents and application of the exclusion criteria by the researcher, the parents will be randomised to either SSTP or CAU. The randomisation will be based on a computer-generated randomisation algorithm. Individuals will be randomised per centre in each of the four participating centres in mixed blocks of four and six to prevent unequal randomisation within the centres . If parents are randomised to SSTP, the intervention will start within four weeks of administering the screening questionnaire. Blinding will be imposed on the teachers, i.e. they will not know who is participating in which group. The SSTP trainers cannot be blinded to treatment status during the intervention, because blinding is apparently impossible.
The results will be analysed on an intention to treat principle with all randomised participants, using all follow-up measures. Consequently, participants who filled out the questionnaire will be included in the analyses, regardless of whether or not they have completed the intervention.
The baseline characteristics of the parents in both research groups will be compared using Chi-squared tests for nominal and ordinal variables, and t-tests for continuous variables. The differences between the intervention and control condition over time will be assessed by mixed model techniques to consider factors that may influence the outcomes. If necessary, data on subjects lost to follow-up will be handled by extrapolation of the last observation or by sophisticated imputation techniques. Changes in the child's psychosocial problems and parenting characteristics will be expressed as standardised effect sizes with 95% confidence intervals. The CONSORT guidelines will be followed . All the analyses will be carried out using SPSS 17.0.
This paper presents an outline of the background and design of an Randomised Controlled Trial (RCT) to assess the effectiveness of Stepping Stones Triple P (SSTP) in children with a mild intellectual disability (ID) and psychosocial problems.
The majority of children with mild ID also have psychosocial problems. In the long term, these problems can increase and cause distress, disturb family life and interfere with other everyday activities . The combination of psychosocial problems and mild ID can be a major cause of reduced participation and social integration. This can lead to problems in the future, for example problems in living in society and being autonomous . SSTP is a parenting support programme that aims to decrease psychosocial problems in children with mild ID. However, as yet there does not seem to have been an RCT for SSTP.
This study will contribute to science in that it will provide empirical evidence on the effect of SSTP on psychosocial problems at home and at school in children with mild ID. Decreasing a child's psychosocial problems will lead to better development and a strengthening of the child's participation .
The study will be conducted in an experimental design. Therefore, the risk of selection and allocation bias will be minimised and the internal validity will be high. Random allocation ensures no systematic differences between the SSTP or Care as Usual (CAU) groups in factors, known and unknown, that may affect the outcome.
The SSTP intervention will be carried out by a Dutch healthcare organisation especially for adults and/or children with a disability or chronic illness (in Dutch: MEE). The intervention will be carried out in daily practice, and thus the study will also provide evidence on the feasibility of the implementation of SSTP.
Another strength of this study is the use of two informants in order to measure the child's psychosocial problems (i.e. teacher and parent). Multiple informants on the Strengths and Difficulties Questionnaire (SDQ) are invaluable for understanding the home and community functioning of children with mild ID, because psychosocial problems may be highly situational and differ at school and at home [20–22].
Furthermore, the potential participants will be recruited by schools for special education. In this way, the majority of parents of children with mild ID will be reached and can participate in the study . In addition, due to their personal contact with parents, schools can play an important role in motivating parents to participate in the study. A representative sample will increase the external validity and conclusions will be able to be generalised. Finally, teachers will be blind as to whether a family is in the intervention or control group, which will prevent any information bias.
The study also has some potential limitations. Selective dropout may occur in the intervention group, i.e. a certain proportion of parents may not complete the study. Also, selective non-response may occur in the screening. People with lower incomes, more family problems and a lower IQ are at a higher risk of dropout or non-response. For example, parents with mild ID need a lot of practical support and research activities like filling out questionnaires may be difficult for them . To prevent such selective non-response, we may assist parents in filling out the questionnaires.
Moreover, loss to follow-up may be high in this target population, potentially leading to biased results. To prevent this bias, all parents will receive assistance in filling out the questionnaire if they participate in the intervention study.
Another potential limitation is that we will not observe the parents' interaction with their child. Direct observation would provide the opportunity to precisely register the activities and behaviour of parents and their children during the intervention period. However, this method is costly and labour-intensive for both researchers and families . Moreover, the observations themselves may affect the parent-child interactions, and may thus be a somewhat biased alternative as well.
Finally, in the study there is a short follow-up period of six months because studies about the effectiveness of parenting programmes establish findings at least on the short-term outcomes of family functioning, parenting skills and a child's psychosocial behaviour . Nevertheless, this intervention aims to prevent developmental problems in children in the future, which leads to a limitation of this study being the short follow-up period. To determine long-term effects, there should be follow-up after a couple of years to assess the effects when the child is older .
Children with psychosocial problems and mild ID are at risk of psychosocial problems and consequently problems with participation and social integration. The SSTP programme seems a promising intervention to decrease these problems, but evidence on its effectiveness for this broad population is still lacking. This study will lead to evidence-based information about the effects of this intervention in a broad population at home and at school. Its results may support public interventions to decrease the large burden due to a child's psychosocial problems for children with mild ID and their parents.
Dekker MC, Koot HM, van der Ende J, Verhulst FC: Emotional and behavioral problems in children and adolescents with and without intellectual disability. J Child Psychol Psychiatry. 2002, 43 (8): 1087-1098. 10.1111/1469-7610.00235.
Kaptein S, Jansen DE, Vogels AG, Reijneveld SA: Mental health problems in children with intellectual disability: use of the Strengths and Difficulties Questionnaire. J Intellect Disabil Res. 2008, 52 (Pt 2): 125-131.
Tonge B, Einfeld S: The trajectory of psychiatric disorders in young people with intellectual disabilities. Australian & New Zealand Journal of Psychiatry. 2000, 34 (1): 80.-10.1046/j.1440-1614.2000.00695.x.
Einfeld SL, Piccinin AM, Mackinnon A, Hofer SM, Taffe J, Gray KM, Bontempo DE, Hoffman LR, Parmenter T, Tonge BJ: Psychopathology in young people with intellectual disability. JAMA. 2006, 296 (16): 1981-1989. 10.1001/jama.296.16.1981.
Lecavalier L, Leone S, Wiltz J: The impact of behaviour problems on caregiver stress in young people with autism spectrum disorders. J Intellect Disabil Res. 2006, 50: 172-183. 10.1111/j.1365-2788.2005.00732.x.
Hastings RP, Taunt HM: Positive perceptions in families of children with developmental disabilities. Am J Ment Retard. 2002, 107 (0895-8017; 0895-8017; 2): 116-127.
Beck A, Hastings RP, Daley D: Pro-social behaviour and behaviour problems independently predict maternal stress. J Intellect Dev Disabil. 2004, 29 (4): 339-349. 10.1080/13668250400014509.
McGillivray JA, McCabe MP: Early detection of depression and associated risk factors in adults with mild/moderate intellectual disability. Res Dev Disabil. 2007, 28 (1): 59-70. 10.1016/j.ridd.2005.11.001.
Sanders MR, Mazzucchelli TG, Studman LJ: Paractitioner's Manual for Standard Stepping Stones Triple P: for families with a child who has a disability. 2003, Brisbane: The University of Queensland and Disability Services Commission of Western Australia, 1
Roberts C, Mazzucchelli T, Studman L, Sanders MR: Behavioral family intervention for children with developmental disabilities and behavioral problems. J Clin Child Adolesc Psychol. 2006, 35 (1537-4416; 1537-4416; 2): 180-193.
Plant KM, Sanders MR: Reducing problem behavior during care-giving in families of preschool-aged children with developmental disabilities. Res Dev Disabil. 2007, 28 (0891-4222; 0891-4222; 4): 362-385.
Whittingham K, Sofronoff K, Sheffield J, Sanders MR: Stepping Stones Triple P: an RCT of a parenting program with parents of a child diagnosed with an autism spectrum disorder. J Abnorm Child Psychol. 2009, 37 (1573-2835; 1573-2835; 4): 469-480.
Speetjens P, de Graaf I: Stepping Stones Triple P Opvoedhulp voor ouders van kinderen met een beperking. Evaluatie van een pilot studie. 2010, Utrecht: Trimbos Instituut
Altman DG, Schulz KF, Moher D, Egger M, Davidoff F, Elbourne D, Gotzsche PC, Lang T, CONSORT GROUP (Consolidated Standards of Reporting Trials): The revised CONSORT statement for reporting randomized trials: explanation and elaboration. Ann Intern Med. 2001, 134 (8): 663-694.
Europese Commissie: Organisatie van het onderwijssysteem in Nederland 2008/2009. 2008, Nederland: EURYDICE
Oeseburg B: Prevalence and impact of chronic diseases in adolescents with intellectual disability. PhD thesis. 2010, University of Groningen, department of health sciences, Groningen
Sanders MR, Bor W, Morawska A: Maintenance of treatment gains: a comparison of enhanced, standard, and self-directed Triple P-Positive Parenting Program. J Abnorm Child Psychol. 2007, 35: 983-998. 10.1007/s10802-007-9148-x.
Joha D, Gerards G, Nas M, van Gendt J, Kersten M: Ondersteuning van ouders met een verstandelijke beperking. 2006, Den Haag: Boom Lemma uitgevers
Goodman R: The Strengths and Difficulties Questionnaire: a research note. J Child Psychol Psychiatry. 1997, 38 (5): 581-586. 10.1111/j.1469-7610.1997.tb01545.x.
Achenbach TM, McConaughy SH, Howell CT: Child/adolescent behavioral and emotional problems: implications of cross-informant correlations for situational specificity. Psychol Bull. 1987, 101 (2): 213-232.
Goodman R, Renfrew D, Mullick M: Predicting type of psychiatric disorder from Strengths and Difficulties Questionnaire (SDQ) scores in child mental health clinics in London and Dhaka. Eur Child Adolesc Psychiatry. 2000, 9 (2): 129-134. 10.1007/s007870050008.
De LR, Kazdin AE: When the Evidence Says, "Yes, No, and Maybe So": Attending to and Interpreting Inconsistent Findings Among Evidence-Based Interventions. Current Directions in Psychological Science (Wiley-Blackwell). 2008, 17 (1): 47-51. 10.1111/j.1467-8721.2008.00546.x.
Eyberg SM: Eyberg Child Behavior Inventory. J Clin Psychol. 1980, 9:
De Brock AJLL, Vermulst AA, Gerris JRM, Abidin RR: NOSI-Nijmeegse Ouderlijke Stress Index, Handleiding experimentele versie. Lisse: Swets en Zeitlinger;. 1992
Shelton KK, Frick PJ: Assessment of parenting practices in families of elementary school-age children. J Clin Child Psychol. 1996, 25 (3): 317.-10.1207/s15374424jccp2503_8.
Creinin MD, Meyn LA, Borgatta L, Barnhart K, Jensen J, Burke AE, Westhoff C, Gilliam M, Dutton C, Ballagh SA: Multicenter comparison of the contraceptive ring and patch: a randomized controlled trial. Obstet Gynecol. 2008, 111: 267-277. 10.1097/01.AOG.0000298338.58511.d1.
Reijneveld SA, Brugman E, Verhulst FC, Verloove-Vanhorick S: Identification and management of psychosocial problems among toddlers in Dutch preventive child health care. Arch Pediatr Adolesc Med. 2004, 158 (8): 811-817. 10.1001/archpedi.158.8.811.
de Winter M, Baerveldt C, Kooistra J: Enabling children: Participation as a new perspective on child-health promotion. Child: Care, Health and Development. 1999, 25 (1): 15-25. 10.1046/j.1365-2214.1999.00073.x.
Ward L: Supporting parents, supporting families: Changing approaches to parents with intellectual disability. Advances in Mental Health and Intellectual Disabilities. 2010, 4 (2): 38-42. 10.5042/amhid.2010.0319.
Kerig PK, Lindahl KM: Family observational coding systems: Resources for systemic research. 2001, Mahwah, NJ US: Lawrence Erlbaum Associates Publishers
Horner RH, Sugai G, Anderson CM: Examining the Evidence Base for School-Wide Positive Behavior Support. Focus on Exceptional Children. 2010, 42 (8): 1-14.
Reynolds AJ, Temple JA, Robertson DL, Mann EA: Long-term Effects of an Early Childhood Intervention on Educational Achievement and Juvenile Arrest: A 15-Year Follow-up of Low-Income Children in Public Schools. JOURNAL- AMERICAN MEDICAL ASSOCIATION. 2001, 285: 2339-2346. 10.1001/jama.285.18.2339.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/11/676/prepub
The Netherlands Organisation for Health Research and Development is funding this study (ZonMW).
The authors declare that they have no competing interests.
SAR and DEMCJ had the original idea for the project, wrote the study proposal and obtained funding for the study. MK and DEMCJ wrote the study protocol, which was discussed by all authors leading to the final design. MK wrote the final manuscript, which was discussed, edited and revised by all authors. All authors read and approved the final manuscript.
Daniëlle EMC Jansen and Sijmen A Reijneveld contributed equally to this work.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
About this article
Cite this article
Kleefman, M., Jansen, D.E. & Reijneveld, S.A. The effectiveness of Stepping stones Triple P: the design of a randomised controlled trial on a parenting programme regarding children with mild intellectual disability and psychosocial problems versus care as usual. BMC Public Health 11, 676 (2011). https://doi.org/10.1186/1471-2458-11-676
- Autism Spectrum Disorder
- Intellectual Disability
- Intellectual Disability
- Psychosocial Problem
- Parenting Skill