- Research article
- Open Access
- Open Peer Review
A realist evaluation of community-based participatory research: partnership synergy, trust building and related ripple effects
BMC Public Healthvolume 15, Article number: 725 (2015)
Community-Based Participatory Research (CBPR) is an approach in which researchers and community stakeholders form equitable partnerships to tackle issues related to community health improvement and knowledge production. Our 2012 realist review of CBPR outcomes reported long-term effects that were touched upon but not fully explained in the retained literature. To further explore such effects, interviews were conducted with academic and community partners of partnerships retained in the review. Realist methodology was used to increase the understanding of what supports partnership synergy in successful long-term CBPR partnerships, and to further document how equitable partnerships can result in numerous benefits including the sustainability of relationships, research and solutions.
Building on our previous realist review of CBPR, we contacted the authors of longitudinal studies of academic-community partnerships retained in the review. Twenty-four participants (community members and researchers) from 11 partnerships were interviewed. Realist logic of analysis was used, involving middle-range theory, context-mechanism-outcome configuration (CMOcs) and the concept of the ‘ripple effect’.
The analysis supports the central importance of developing and strengthening partnership synergy through trust. The ripple effect concept in conjunction with CMOcs showed that a sense of trust amongst CBPR members was a prominent mechanism leading to partnership sustainability. This in turn resulted in population-level outcomes including: (a) sustaining collaborative efforts toward health improvement; (b) generating spin-off projects; and (c) achieving systemic transformations.
These results add to other studies on improving the science of CBPR in partnerships with a high level of power-sharing and co-governance. Our results suggest sustaining CBPR and achieving unanticipated benefits likely depend on trust-related mechanisms and a continuing commitment to power-sharing. These findings have implications for building successful CBPR partnerships to address challenging public health problems and the complex assessment of outcomes.
Community Based Participatory Research (CBPR) is an approach to research in which researchers and community stakeholders (both individuals and organizations) form equitable partnerships and co-construct research for the mutual and complementary goals of community health improvement and knowledge production [1–5]. This is an increasingly popular approach across academic, governmental and philanthropic domains , which raises the need to better understand and develop the science of CBPR assessment [7–11]. Work in this area is growing, and includes theorizing participation and conceptual modeling [1, 12–16] and operationalizing key CBPR assessment constructs (e.g., trust, capacity & readiness, participation, relational dynamics, etc.) [8, 9, 17, 18].
We previously undertook a realist review of the benefits and implications of CBPR, focusing on how outcomes are produced through partnerships over time. Previous publications from that review addressed the rationale for using realist methodology to assess CBPR , the review protocol , overall findings , CBPR using quantitative methodologies  and critical reflections on the realist review experience in the context of CBPR . A key finding was that CBPR in projects genuinely oriented to shared decision-making and co-governance yielded solutions to research barriers and created benefits for individuals, communities, institutions, and policy development [21, 22].
Our previous analyses documented that CBPR supports (a) the production of culturally and logistically appropriate research; (b) the capacity to recruit participants to projects and interventions; (c) the capacity building of academic and community partners; (d) productive conflict resolution and negotiation processes; (e) the accumulation of partnership synergy, which increases the quality of outputs and outcomes over time; (f) the capacity to sustain project goals beyond funded time frames and during gaps in external funding; and (g) the generation of systemic changes and new unanticipated projects and activity.
To explore CBPR benefits further and because we believed that there were likely experiences of both academic and community partners not captured in journal publications, the lead author (JJ) received a Canadian Institutes of Health Research (CIHR) postdoctoral fellowship to interview academic and community partners of CBPR partnerships retained in the review.
Methodology and methods: realist evaluation
This study used realist evaluation methodology  informed by a realist synthesis . It is based on qualitative research methods for data collection . A central tenet of realist methodology is that programs work differently in different contexts – hence a community partnership that achieves ‘success’ in one setting may ‘fail’ (or only partially succeed) in another setting, because the mechanisms needed for success are triggered to different degrees in different contexts. A second tenet is that for social programs, mechanisms are the cognitive or affective responses of participants to resources offered . Thus the realist methodology is well suited to the study of CBPR, which can be understood, from an ecological perspective, as a multiple intervention strategies implemented in diverse community contexts [25, 28] dependant on the dynamics of relationships among all stakeholders.
Realist methodology begins by explicating the underlying assumptions or candidate middle-range theories  about the mechanisms by which programs (or components of programs) might work. Candidate middle –range theories are then used to focus the research questions and develop data collection protocols. A range of data (which may be qualitative or quantitative, and typically a combination of both) are collected and then tested against the candidate theories through a heuristic process of constructing, exploring, and refining context-mechanism-outcome (CMO) configurations. The final research product from realist methodology is not a statement of ‘effect size’ (since the same program will have different effects in different contexts), but a refinement of middle-range theory  that addresses (some or all of) the questions: what works for whom, under what circumstances, why and how? Evidence can include primary outcome data, but also program and setting descriptions that portray contextual elements as well as interpretation of outcomes by study authors. Further detail about realist methodology can be found elsewhere [24, 27]. Table 1 provides definitions of realist concepts.
With ethics approval by McGill University, Faculty of Medicine Institutional Review Board, lead academic author(s) of the 23 partnerships retained in the prior review  were sent an invitational letter through email to participate in an interview. They were asked to recommend community partners for interviewing as well. On contact, three partnerships were discovered to be no longer active. Of the remaining 20 partnerships, seven did not respond to an email request and two declined the invitation. Partners from the remaining eleven partnerships (24 participants–14 academic and 10 community members) participated across numerous interviews and one focus group (See Additional file 1 for details). All interviews were conducted in person or by telephone by lead author (JJ). The focus group was conducted in person. A semi-structured interview guide was used to anchor the interview process (see Additional file 2). All interviews were audio recorded and transcribed.
Analysis of interviews
Interviews were analyzed using CMO configurations which were drafted by JJ and confirmed by PLB before being discussed and refined by all other authors. This sequential feedback approach was chosen based on limited resources available for this study and because the sample scope remained limited to the 2012 review, which involved two-person independent coding. Through multiple rounds of feedback and iteration, the CMO configurations were debated and refined, along with new theoretical propositions about the effects of participation. In the findings section below, CMO configurations are linked to the clearest quotations that illustrate our theoretical propositions about trust building and sustainability arising from CBPR.
Middle-range theory: the ripple effect of trust building in partnership synergy
With realist methodology, middle-range theory (MRT)  is used to explicate the underlying logic of programs, which is then tested against the evidence in various ways, using context-mechanism-outcome configurations  (see definitions in Table 1). Partnership synergy theory  was the MRT identified and developed in our CBPR realist review [21, 23]. Partnership synergy theory holds that the fair and equitable combining of skills and resources of multiple stakeholders increases the facility of research processes and achievability of results, especially over the course of time . Here, we expounded the theory of partnership synergy by showing how context-mechanism-outcome configurations can be linked to each other - with the outcome of one phase of a project becoming an aspect of context for the next phase ( p. 329). Thus, we linked CMOcs (using: C1M1O1 -- > C2M2O2) with the concept of ‘the ripple effect’  (see Fig. 1).
The ripple effect concept is premised on the idea that CBPR activity is a series of ‘events in the history of a system, leading to the evolution of new structures of interaction and new shared meanings’ p. 267 . The ripple effect, in conjunction with CMO configurations, served as a framework to better understand how partnership activities accrue in stages, with the outcomes of one stage of the partnership life course informing or transforming the context for subsequent stages. As with the prior review we still view partnership synergy as the middle-range theory, but moving it forward, we theorize that trust is a foundational element of partnership synergy building. It is a commitment to building and maintaining trusting relationships over the long-term that produces an increase of synergy over time, resulting in the longitudinal outcomes that we see in terms of sustainability. Realist evaluation acknowledges ‘ontological depth’, . For us, this means that what manifests in terms of CBPR process and outcomes can be understood in terms of layers of reality. At the empirical level are commonly observed outcomes, at a deeper layer we have theorized the underpinnings of such outcome in terms of the creation of partnership synergy, and at a deeper layer still are issues of trust amongst members. It is through the theorizing of CBPR through partnership synergy and trust that longitudinal outcomes come into view. Thus the role of our MRT is to say that that partnership synergy is built on trust in academic-community relationships and is a key process in sustaining partnerships in the long-term and producing the extensive array of CBPR effects over time. These effects are detailed in the findings section below, and include sustainability, spin-off projects and systemic transformations.
By using the ripple effect concept with context-mechanism-outcome configuration (CMOc), trust was at times configured as an aspect of context (i.e. trust/mistrust as a precondition or potential resource), other times as a mechanism (i.e. how stakeholders responded to partnership activities) and was also an outcome (i.e. the result of partnership activities) in dynamically changing partnerships over time. Trust as context, mechanism and outcome in partnerships generated longer-term outcomes related to sustainability, spin-off project and systemic transformations. The findings presented below are organized in two sections: (1) Dynamics of trust and (2) Longer-term outcomes including sustainability, spin-off projects and systemic transformations.
The quotations in this section illustrate the complexity of building and maintaining trusting relations for partnership members as well as the role of history and pre-context. The trust analysis is depicted visually in Fig. 2, which shows community history and other issues interacting with the process of building and maintaining trust. As one interviewee of a long standing partnership states, “…we’re learning…that trust is [not only] built but must be maintained…every time a resource decision is made, trust comes up. …If you continually make resource decisions that are making people distrustful it’s not going to work”. (Partnership C – academic stakeholder)
Another academic partner, working on multiple community projects, suggested that a healthy mistrust by communities toward outsider research interests, in early stages of partnership development, is a beneficial context for establishing trust in the long run:
Partnership B – Academic stakeholder: “The community people came to the table saying, ‘…I have an earned scepticism that I’m holding with me’. And I think that’s one of the things that made it such a good strong partnership. We have another partnership [in another neighborhood], which is a…wonderful community. So they are like ‘you guys [academics] are great! this is great!’…but in terms of the process of how research gets done…because they have no level of defensiveness, and no negative experiences, they could easily be taken advantage of by people who don’t really care”.
The first community had prior experience with research (context) and a savvy resistance to being exploited (mechanism), which led to the establishment of trustworthy partnership relationships based on negotiation and equity (outcome). The second community did not have previous experience with research (context) and brought a naïve sense of trust and enthusiasm (mechanism) to the partnership, increasing their risk of being exploited by the research process (potential outcome) or running into unforeseen conflicts in subsequent stages, hampering productivity or partnership relations (potential outcome).
Trust was a response that was not only tested over time, but was gained through association or reputation. As the following example indicates, based on community-based networks and coherence, trust of an academic partner by one community group created a feeling of ‘trust by proxy’ by other community stakeholders:
Partnership F – Academic stakeholder: “I attended their…  meetings and I think they were surprised that I just kept showing up. I would say, ‘hey there, me again, the doctor, but I don’t have anything and I don’t know anything’. And I did that for three years. After my residency…I said ‘ok guys, here I am. Now I can do stuff’.… they said, ‘we have this sister agency on the South side that has a whole bunch of people working on asthma. You should work with them’. So all it took was a phone call from one director to the other director saying that this doctor is going to come meet with you guys, she is good; you can trust her. So with that, they just welcomed me in.
There was no prior partnership relationship between the community and academic researchers (context). The academic partner demonstrated time commitment and humility over three-years and the community partners came to trust this academic partner (mechanism). Due to community networks (context) and the endorsement of the academic by one community group, the academic partner was deemed to be a credible person by others (mechanism) and began an immediate productive working relationship with an associated community agency (outcome).
Issues of trust were addressed also through the perceived importance of the research. When community partners felt invested in the need for community-based research, sincere attempts were made to improve trust and to ensure productive working relationships. The following quotation shows how a pre-conditional mistrust of outsiders by one community partner interacted with trust-building efforts overall, and the general sense of need for the research being proposed (cancer prevention and awareness):
Partnership D– Academic stakeholder “at a community advisory board meeting [one person] talked about how I’m just another white researcher who’s coming in to rearrange people’s furniture and it was very violent. I literally felt like someone had a sword going through my gut…and this person later went on try to get me fired from the university. But the board got [covered] my back… not that people are in love with me, but people have in this project the goal of what we are working on. And that really trumps any kind of crap that gets tossed around… it’s really because there is such a strong focus on what we’re up to…what we want to have happen”.
A degree of resistance or hostility to outside researchers existed within the community, in part because of the historical exploitation in the name of research (context). The focus on relevant health issues for the community (e.g., cervical cancer) overrode fears of repeating the history of exploitation (mechanism). Community members defended the academic member based on the research focus and the felt need to proceed with research development (outcome).
The following quotation shows how building and maintaining trust over time increased productivity in the long-run and created community environments that were conducive to research:
Partnership C – Academic stakeholder “So, when you finish the project you may no longer want to do that project with that particular priority, but, now you got, you know, logistics - you’ve got mechanisms and trust. And working with community organizations…they are already in the game as advocates for their community [so] they will stay in the game…Because once they know that now the group is genuine; the group is effective; they will stay in the game with much less resources”.
The partnership had a long standing history of successful relationship building and trust among members (context). Partners felt committed to sustaining the partnership and working on new projects (mechanism). With a long-standing relationship, the coalition was able to sustain their efforts, and achieve goals with fewer resources (outcome).
Sustainability, spin-off projects and systemic transformations
As partnerships built and maintained trust over time, a host of outcomes was seen as arising from their activities. These impacts have been categorized as sustainability efforts, spin-off projects and systemic transformations. Spin-off projects were defined as unanticipated projects that arose through intentional CBPR activities, and systemic transformations meant activities that transformed elements of the physical, cultural, institutional, or policy context leading to improved health or health services outcomes. See Fig. 3 for a composite sketch of these outcomes.
With successful research activities, partnerships reported creating new, unanticipated projects and activities. This was credited to the trust built and maintained over time, and the expanded need for services. One community partner described how the partnership which had achieved success in raising awareness to counter female reproductive cancers, felt the need to sustain the partnership when the men in the community requested their help:
Partnership D – Community stakeholder ‘I didn’t expect that we would become a non-profit. We were coming to the close of the project and it just seemed…we just had to continue our services. And we began to see that the men are just getting alerted to this too and there’s just so much more that we could do so we had to become a non-profit.’
The research partnership had been in productive operation for many years (context1) and had gained profile and status within the community. The community saw value to the work that was being done by the coalition (mechanism1) and approached them with ideas for other projects (outcome1). This prompted the coalition to find ways to sustain their work, and in doing so, transformed the partnership in to a non-profit agency (outcome1). The non-profit agency became a new community resource for a widening array of community health issues (outcome1 - > enabling context2 in a ripple or reinforcing feedback effect).
The creation of resources and motivation within partnerships led to other project ideas and activities that were not originally intended or planned. These new projects were facilitated by the work already conducted and the motivation of partnership members. For example, a community pastor involved in a partnership was able to start a new project in a different neighbourhood, based on expertise he gained through the initial partnership:
Partnership H – Academic stakeholder “When the pastor moved to another neighborhood - because we were [already] involved in the partnership together, he saw that there were children there that needed help, so we started [a new] project over there”.
The partnership had been established for a number of years (context1). The community partner, relying on trusting relationships developed with academic members (mechanism1), and expertise gained in research (outcome1a), identified new areas of need for research beyond original goals (outcome1b). Prior partnering ensured that the coalition was research ready and was able to create an unanticipated spin-off project (outcome1 - > context2).
Spin-off activity was shown to occur for the academic partners as well. The following quotation illustrates how academic professional development was gained and used to redesign a university-based, foundation-sponsored Clinical Scholars program that emphasized CBPR in the training of physician researchers:
Partnership E – Academic stakeholder “the Director of a [U.S. National] Clinical Scholars program asked me if… I’d redesign the program based on a CBPR perspective. So that was about 7 years ago, so I did that. The scholars program itself has been a very powerful thing going on… my particular edge was on the one hand, dealing with a highly stigmatized set of illnesses, and on the other hand, really working on bringing the partnership into… highly rigorous methods…such as doing a large RCT. And figuring out how to do that by addressing all the trust issues”.
The academic stakeholder had been working in partnership with community members for many years (context1) and though valuing CBPR practice (mechanism1), gained expertise in the conduct of ethically sensitive research in partnership with community groups (outcome1a). This expertise was seen to have relevance to the director of a national U.S. Clinical Scholars program (outcome1b) and curriculum of Robert Wood Johnson Clinical Scholars Program was redesigned based on this expertise, creating a diffusion of CBPR research innovations (outcome1 - > context2).
Systemic transformations took the form of cultural shifts, the implementation of new policies and improvement to health service provision. In the following quotation a community partner describes how the academic-community relationship helped to break cultural taboos around the word ‘cancer’. This led to radically new perspectives on the disease, as well as increased prevention and diagnosis:
Partnership D- Community stakeholder. I’m just in awe about the breakthrough [we had] in cancer awareness in [our community. We didn’t even say the word [cancer], it was culturally taboo…When there was a diagnosis, they went through treatment alone and it was only at the end of their life that they shared this information. And now, it’s like this has all changed due to the impact of cancer awareness to the efforts of [the Partnership]. Now [community] women overcome these cultural barriers and it’s ok. We can talk about the mammogram. We can say the word cancer and we’re not asking for it to come upon us…women are approaching us in public places and asking ‘could you schedule me for a pap test or a mammogram?’ , and that’s the shift. I mean this was unexpected.
Prior to development of the partnership, the cultural norm was to see cancer as an inevitably terminal illness not to be mentioned except in retrospect at the end of life (context). The development and strengthening of trust between academic and community partners of the coalition (mechanism1a) and the trust of the coalition by community members at large (mechanism1b) increased awareness of cancer as a treatable condition if diagnosed early, thereby encouraging community members to speak up about cancer screening (outcome1). As a result, the stigma and taboo around the disease was reduced overtime (outcome1 - > context2).
In another example, the systemic change was a change in policy at the state health department level. Here, the partnership lobbied the government to make changes to payment structure to increase universal access to health service:
Partnership C - Academic stakeholder “the biggest outcome of the entire project was that we got the state health department to change the way that they paid for [cancer] screening. And since they can’t do it for one ethnic group without applying it to everybody [they created a universal policy]”.
Due to successful research productivity of the partnership (context1), the partnership was empowered to advocate for improvements to the way cancer screening was paid for (mechanism1). This led to successfully convincing the state health department to change the policy for the community (outcome1) which then created a universal policy so it would apply to all people (outcome1 - > context2).
Finally, systemic transformation was seen in the way community groups were able to realize their self-empowerment. This quotation reveals how community members from a historically colonized population were positively influenced by their participation in CBPR, resulting in new beliefs and actions for community empowerment.
Partnership A – Academic stakeholder “…the fact that they [community members] became involved in getting control of the hospital in the Northern community was in part a reflection of the increasing activism in the sense that they [realized they] could control their own engagement….I think the partnership aided that process. They understood through the partnership, how you could be in different relationships than they’d been previously with people in authority. So they could assert themselves”.
The initial partnership dynamics were influenced by the negative history of mistrust (context1), but also by the fact that the academic members demonstrated cultural humility, which in part, supported the sense community members’ self-empowerment (mechanism1). This self-empowerment led the community to further efforts toward self-determination including gaining control of the community hospital (outcome1 - > context2).
These findings indicate that CBPR outcomes are complex and require longitudinal examination. Table 2 summarizes the main findings of this research in a composite sketch of CBPR project outcomes using CMO configurations and the ripple effect concept.
In this study, we used realist methodology  and middle-range theory  to facilitate the assessment of complex CBPR outcomes and showed how partnerships create a host of benefits to individuals, communities, institutions and policy development. We advanced the theory of partnership synergy by studying how trust building and maintenance was a key factor in increasing outputs and sustainability efforts over time, leading to partnership longevity, spin-off projects and systemic transformations. The ‘ripple effect’ concept as another component of the MRT supported the assessment of outcomes, by showing how one effect can lead to another over a course of partnership phases.
Our sample consisted of academic and community stakeholders from partnerships in the USA and Canada built on strong foundations of equity in co-governance and shared decision-making . The effects of such partnership formation and development are significant, considering the challenges in overcoming logistical, cultural and structural obstacles to community health improvement. Reforming health services, enhancing educational curricula, overcoming cultural taboos, creating non-profit societies, and increased empowerment and pro-action against morbidity are all important CBPR outcomes shown in this research. Thus investment in research partnerships may have significant returns which are unforeseeable at the outset, and require evaluation using complexity sensitive methodology such as realist evaluation.
The research presented here can be situated within a broader literature of understanding the science of CBPR, in which Wallerstein and colleagues’ work on CBPR modelling and assessment is perhaps the most relevant [8, 9, 12, 14, 18]. Their conceptual model of CBPR is similar to the way we have theorized participation including the need to understand context, trust, and relational dynamics in the production of complex outcomes. It is possible that realist evaluation in tandem with other approaches can enhance CBPR assessments [7, 8, 12], implementation [34, 35], policies development  and evidence integration , as many of these efforts recognize trust issues as central to CBPR frameworks. Specifically, qualitative studies can inform CBPR assessments by identifying the pathways (CMOs) that can be tested deductively using measures such as identified by Oetzel et al  and providing insight into the selection of the most appropriate measures to test these pathways.
An innovative aspect of this study was the sequential application of the realist approach (i.e., realist review of published CBPR studies followed by interviews with the authors of these studies, with realist analysis of the new empirical data) leading to cumulative theory development in the area of CBPR. Our finding of trust building and maintenance over time, partnership synergy of academic- community partnerships and intended and unanticipated benefits to the community, contrasts somewhat with the current pressure on research scholars in public health and beyond to demonstrate and measure how research leads to ‘impact’. Responses to such pressures are sometimes couched in simplistic and linear terms, depicting communities as (more or less) the passive recipients of research findings . Here we present a detailed theory of CBPR impact, which suggests that equitable co-governance based on trust may (in the right contextual conditions) lead to sustained partnerships, resulting in the generation of effective solutions to the complex problems of public health. From that perspective, our findings have significant implications for improving the effectiveness of programs, long-term sustainability, health change motivation, and finding potential solutions to the complex array of cultural, logistical and economic barriers to affecting change in many community-based settings.
Our findings on the reinforcement of trust over time in CBPR can be conceptualized with reference to the critical social science literature on trust and power. Greener, drawing on Lukes’ writings on the ‘three faces of power’ , distinguishes three kinds of trust in a healthcare setting: voluntary trust (achieved through close interpersonal relationships built over time, and defined as “a consensual absence of calculation, where we voluntarily forego calculating in a relationship”), involuntary trust (born of enforced dependency, for example trusting doctors when one is perilously ill), and hegemonic trust (when “we trust without realising there is an alternative”) . The trust relationships in CBPR are typically voluntary and based on a personal sense of commonality and reciprocity. Individuals from disempowered and marginalised groups have been shown to have low levels of trust in conventional health services, and that trust may be enhanced through interpersonal relationships and continuity of care .
Our sample consisted of community-academic research partnerships that exhibited high levels of co-decision-making and co-governance over time . We did not interview, and therefore can draw no conclusions about, partnerships that broke up or (for whatever reason) declined to participate. Thus whilst the findings from the successful partnerships included in this study are consistent and credible, we cannot extrapolate from them to draw conclusions about the mechanisms operating in the converse situation (e.g., when co-decision making is weak or trust is not built). In acquiring the sample for the study, we contacted academic authors of published CBPR studies and asked them to recommend community partners for interviewing. Thus we had to rely on the recommendation of the academic partners, which may have created a particular bias in the sample. As well, fewer numbers of community members were available for interviews as compared to academic members, which also created bias in the sample and is reflected in the analysis. Another limitation is that roughly half of the interviews were conducted by phone or skype which was a necessary limitation due to travel funding constraints.
What has not been covered by our research is examining how and when trust building fails, and the contextual factors involved in the failure of research partnerships to achieve their goals. Indeed, there is work to be done studying community-academic relationships that were not sustained over time, to examine the extent to which failure of both building and maintaining trust leads to the collapse of partnership. In such situations, outcomes could include deepening of mistrust between communities and outsiders. In addition, we caution that a top-down notion of public health sustainability is contentious . Budget cuts, shifting government priorities and volunteer burnout are critical factors in defining the nature of sustainable efforts which have not been fully explored in the current research. This will need to be theorized to inform a comprehensive view of how CBPR can contribute to the public health agenda.
Evidence-informed theorizing about how and in what circumstances CBPR works should be an on-going pursuit. Here we have provided theory and evidence showing that complex health improvement efforts can be addressed by a partnership approach involving shared decision making and equitable co-governance across the stages of research. We have indicated that trust building and maintenance can make significant contributions to sustainability and systemic transformation which are key to both increasing the knowledge of factors supporting successful community-academic partnerships and transforming contexts to improve the conditions and motivations that determine health status. We hope that this research, illuminating the complex requirements for health improvement and the role of CBPR therein, can inspire new ideas for sustainable approaches to public health and related fields.
Cargo M, Mercer SL. The Value and Challenges of Participatory Research: Strengthening Its Practice. Annu Rev Public Health. 2008;29(1):325–50.
Macaulay AC et al. Participatory research maximises community and lay involvement. Br Med J. 1999;319(7212):774–8.
Minkler M, Wallerstein N, editors. Community-Based Participatory Research for Health. 2nd ed. San Francisco: Jossey-Bass; 2008.
Wallerstein N, Duran B. The Theoretical, Historical, and Practice Roots of CBPR. In: Minkler M, Wallerstein N, editors. Community-Based Participatory Research for Health: From Process to Outcomes. San Francisco: Wiley & Sons; 2008. p. 25–39.
Ismail S. Participatory Health Research in International Observatory on Health Research Systems. Cambridge: RAND Report: UK Department of Health; 2009.
Minkler M, Wallerstein N. Introduction to Community-Based Participatory Research. In: Minkler M, Wallerstein N, editors. Community-Based Paticipatory Research for Health: From Process to Outcomes. San Fransisco: Wiley & Sons; 2008. p. 1–23.
Wallerstein N, Duran B. Community-Based Participatory Research Contribution to Intervention Research: The Intersection of Science and Practice to Improve Health Equity. Am J Public Health. 2010;100(S1):S40–6.
Hicks S et al. Evaluating community-based participatory research to improve community-partnered science and community health. Prog Community Health Partnersh. 2012;6(3):289–99.
Oetzel J, Zhou C, Duran B, Pearson C, Magarati M, Lucero J, et al. Establishing the psychometric properties of constructs in a community-based participatory research conceptual model. Am J Health Promot 2015 29(5):e188-202.
Marent B, Forster R, Nowak P. Theorizing participation in health promotion: A literature review. Soc Theory Health. 2012;10(2):188–207.
Mercer SL, Green LW, Cargo M, Potter MA, Daniel M, Scott Olds R, et al. Appendix C: Reliabilitytested guidelines for assessing PR projects. In: Community-Based Participatory Research for Health: from practice to outcomes, 2nd edition. edn. Edited by Minkler M, Wallerstein N. San Francisco: Jossey-Bass; 2008.
Wallerstein N, Oetzel J, Duran B, Tafoya G, Belone L, Rae R. What predicts outcomes in CBPR? In: Community-based participatory research for health: From process to outcomes. 2nd edn. Edited by Minkler M, Wallerstein N. San Francisco, CA: Jossey-Bass; 2008:371-92.
O’Fallon L, Tyson F, & Dearry A. Successful Models of Community-Based Participatory Research. Final Report. National Institute of Health and National Institute of Environmental Health Sciences, http://www.hud.gov/offices/lead/library/hhts/NIEHS_Successful_Models.pdf (download date 22.06.2015): Washington, DC. 2000.
Cacari-Stone L et al. The Promise of Community-Based Participatory Research for Health Equity: A Conceptual Model for Bridging Evidence with Policy. Am J Public Health. 2014;104(9):1615–23.
Berkowitz B. Studying the Outcomes of Community-Based Coalitions. Am J Community Psychol. 2001;29(2):213–27.
Khodyakov D et al. An Exploration of the Effect of Community Engagement in Research on Perceived Outcomes of Partnered Mental Health Services Projects(). Society and mental health. 2011;1(3):185–99.
Sandoval JA et al. Process and outcome constructs for evaluating community-based participatory research projects: a matrix of existing measures. Health Educ Res. 2012;27(4):680–90.
Khodyakov D et al. On Measuring Community Participation in Research. Health Educ Behav. 2013;40(3):346–54.
Macaulay A et al. Assessing the benefits of participatory research: a rationale for a realist review. Glob Health Promot. 2011;18(2):45–8.
Jagosh J, Pluye P, Macaulay AC, Salsberg J, Henderson J, Sirett E, et al. Assessing the outcomes of participatory research: protocol for identifying, selecting, appraising and synthesizing the literature for realist review. Implementation Science. 2011;6(1):24.
Jagosh J et al. Uncovering the Benefits of Participatory Research: Implications of a Realist Review for Health Research and Practice. Milbank Q. 2012;90(2):311–46.
Macaulay A et al. Quantitative Methods in Participatory Research: Being sensitive to issues of scientific validity, community safety, and the academic-community relationship. Nouvelles pratiques sociales. 2014;25(2):159–72.
Jagosh J et al. Critical Reflections on Realist Review: insights from customizing the methodology to the needs of participatory research assessment. Res Synth Methods. 2013;5(2):131–14.
Pawson R, Tilley N. Realistic Evaluation. London: Sage; 1997.
Pawson R. Evidence-based Policy: A Realist Perspective. London: SAGE publications; 2006.
Green J, Thorogood N. Qualitative Methods for Health Research. 2nd ed. London: Sage; 2009.
Pawson R et al. Realist review: a new method of systematic review designed for complex policy interventions. J Health Serv Res Policy. 2005;10:21–34.
Pawson R. The Science of Evaluation: A realist manifesto. London: Sage Publications; 2013.
Merton RK. Social theory and social structure. New York, NY: The Free Press; 1968.
Lasker R, Weiss E, Miller R. Partnership Synergy: A Practical Framework for Studying and Strengthening the Collaborative Advantage. Milbank Q. 2001;79(2):179–205.
Trickett E. The Ecology of Multilevel Interventions to Reduce Social Inequalities in Health. Am Behav Sci. 2013;57(8):1227–46.
Hawe P, Shiell A, Riley T. Theorising interventions as events in systems. Am J Community Psychol. 2009;43(3-4):267–76.
Cargo M et al. Community governance of the Kahnawake Schools Diabetes Prevention Project, Kahnawake Territory, Mohawk Nation, Canada. Health Promot Int. 2003;18(3):177–87.
Jones L & Wells K. Strategies for Academic and Clinician Engagement in Community-Participatory Partnered Research. Journal of the American Medical Association 2007, 297(4):407-410.
Chung B, Corbett C, Boulet B, Cummings J, Paxton K, McDaniel S, et al. Talking Wellness: a description of a community-academic partnered project to engage an African-American community around depression through the use of poetry, film, and photography. Ethn Dis 2006;16(1Suppl 1):S67-78.
Glasgow R et al. An Evidence Integration Triangle for Aligning Science with Policy and Practice. Am J Prev Med. 2012;42(6):646–54.
Milat A, Bauman A, Redman S. A narrative review of research impact assessment models and methods. Health Research Policy and Systems. 2015;13(1):18.
Lukes S. Power: A Radical View. Basingstoke: Macmillan; 1974.
Greener I. Patient choice in the NHS: the view from economic sociology. Social Theory and Health. 2003;1:72–89.
Robb N, Greenhalgh T. ‘You have to cover up the words of the doctor’. The mediation of trust in interpreted consultations in primary care. Social Science in Medicine. 2005;20:434–55.
Moynihan D. Maximum Feasible Misunderstanding: Community action in the war on poverty. New York: Free Press; 1969.
Trickett E et al. Advancing the Science of Community-Level Interventions. Am J Public Health. 2011;101(8):9.
This study was funded by a Canadian Institutes of Health Research Postdoctoral Fellowship, while Dr Jagosh was based at Participatory Research at McGill (PRAM), Department of Family Medicine, McGill University, Montreal, Canada (http://pram.mcgill.ca)
The authors declare they have no competing interests.
JJ led in the design and implementation of the study, which included development of protocols, data collection and analysis. PLB and ACM read all interview transcripts and provided feedback on the analysis. All other authors JS, MC, GW, TG, CPH, LWG, and PP provided feedback on the manuscript and participated in writing and editing. All authors read and approved the final manuscript.
About this article
- Community-based participatory research
- Public health
- Realist synthesis
- Realist analysis
- Partnership synergy
- Spin-off projects
- Systemic transformations
- Ripple effect