- Research article
- Open Access
Effectiveness of a combination prevention strategy for HIV risk reduction with men who have sex with men in Central America: a mid-term evaluation
BMC Public Health volume 14, Article number: 1244 (2014)
Despite over a decade of research and programming, little evidence is available on effective strategies to reduce HIV risks among Central American men who have sex with men (MSM). The Pan-American Social Marketing Organization (PASMO) and partners are implementing a HIV Combination Prevention Program to provide key populations with an essential package of prevention interventions and services: 1) behavioral, including interpersonal communications, and online outreach; 2) biomedical services including HIV testing and counseling and screening for STIs; and 3) complementary support, including legal support and treatment for substance abuse. Two years into implementation, we evaluated this program’s effectiveness for MSM by testing whether exposure to any or a combination of program components could reduce HIV risks.
PASMO surveyed MSM in 10 cities across Guatemala, El Salvador, Nicaragua, Costa Rica, and Panama in 2012 using respondent-driven sampling. We used coarsened exact matching to create statistically equivalent groups of men exposed and non-exposed to the program, matching on education, measures of social interaction, and exposure to other HIV prevention programs. We estimated average treatment effects of each component and all combined to assess HIV testing and condom use outcomes, using multivariable logistic regression. We also linked survey data to routine service data to assess program coverage.
Exposure to any program component was 32% in the study area (n = 3531). Only 2.8% of men received all components. Men exposed to both behavioral and biomedical components were more likely to use condoms and lubricant at last sex (AOR 3.05, 95% CI 1.08, 8.64), and those exposed to behavioral interventions were more likely to have tested for HIV in the past year (AOR 1.76, 95% CI 1.01, 3.10).
PASMO’s strategies to reach MSM with HIV prevention programming are still achieving low levels of population coverage, and few men are receiving the complete essential package. However, those reached are able to practice HIV prevention. Combination prevention is a promising approach in Central America, requiring expansion in coverage and intensity.
Despite several decades of work [1, 2], there is still insufficient evidence of how to effectively reach men who have sex with men (MSM) in low and middle-income countries with effective prevention programming, particularly in settings where stigma and homophobia are prevalent and MSM are difficult to reach. An estimated 112,000 people in Central America were newly infected with HIV in 2010. MSM in Central America are one of the most affected key populations in the region, with HIV prevalence ranging from 7.5% to 11.1% [3, 4]. Investments have been made in Central America to target key populations including MSM, but evidence is extremely limited on the effectiveness of these investments [5–7]. We aim here to assess the effectiveness of one combination prevention program for reducing HIV risks among MSM across 5 countries in Central America.
That MSM in Central America experience elevated HIV risks is well documented. High levels of unprotected anal intercourse have been reported in Nicaragua and El Salvador. Condom use is frequent, but the picture of consistent condom use is not clear, and in 2013, 60.2% of MSM reported sometimes or never using condoms with their partners [8, 9]. Use of HIV testing and counseling (HTC) is variable across the region, despite high levels of awareness of services [8–10]. HIV testing in the past year ranged from 54% in San Salvador, El Salvador in 2008 to 72% in Chinandega, Nicaragua in 2009 [11, 12].
HIV risk behaviors among MSM occur in a context of stigma and violence. Central America experiences high levels of generalized violence along with homophobia targeted against MSM and transgender women [13–15]. Stigmatizing social environments increase the vulnerability of MSM to a range of physical and mental health risks [1, 8, 16]. Violence against men, especially homosexual men, including forced sex, is common, along with MSM being refused services from health care providers [8, 13, 16, 17].
Given structural factors, such as homophobia and violence, it is difficult to reach targeted populations at impactful levels of coverage and challenging to maintain these contacts. In Central America and elsewhere, the HIV community is increasingly mobilized around combination prevention strategies, recognizing that it is not possible to get traction on the epidemic through isolated efforts that do not address contexts of risk [18, 19]. A combination prevention approach includes biomedical interventions that block the biological mechanisms through which HIV transmission occurs or reduce the chance of acquisition of infection, such as provision of condoms, STI treatment, pre-exposure prophylaxis, and post-exposure prophylaxis, as well as evidence-based behavioral interventions that use communications channels to promote behaviors that reduce HIV risk – which on their own can be effective but are difficult to sustain - as well as generate demand for biomedical interventions [20, 21]. Critically, combination prevention also includes structural interventions to address the social drivers of the epidemic to create environments more supportive for vulnerable populations [18, 20–22]. Structural interventions cover a wide scope of approaches, for example cash transfers, community dialogue, sensitivity training for law enforcement and health providers, and political advocacy, to address the multiple levels of social interactions that influence HIV risk and transmission . These interventions operate at the population level and aim to address an individual’s risk through indirect, upstream mechanisms that shape norms, behaviors and health outcomes in the population as a whole . Best practice recommends that the specific combination of interventions to be implemented from within the three components should be designed based on local epidemiology and social conditions .
While combination prevention is increasingly the consensus framework for HIV prevention, there is as yet little evidence on the effectiveness of different combination prevention strategies . The need to evaluate the combination prevention approach is clear, given the complexity of evaluating multi-level programming, but few dedicated studies have been conducted .
With support from USAID (United States Agency for International Development), the Pan-American Social Marketing Organization (PASMO) and Population Services International (PSI)/Mexico began implementing a Combination Prevention Program for HIV with community-based partners in 2011 across Belize, Guatemala, El Salvador, Nicaragua, Panama, Costa Rica, and Mexico. The program is designed to increase access to HIV prevention interventions in order to reduce risk behaviors among key populations and reduce social hostility that contributes to stigma and discrimination.
PASMO has defined an essential package of interventions for MSM following a combination prevention approach . To receive a complete package, an individual client should have a) participated in at least three behavior change communication interventions conducted by outreach teams or through online outreach, b) received a referral for biomedical services such as HTC or screening for sexually transmitted infections (STI), and c) received a referral to a set of complementary services.
The behavioral component includes integrated behavior change communications activities conducted by outreach workers. Based on the transtheoretical model and Population Services International’s PERForM framework, these activities were designed to generate demand for the program’s products and services, while also encouraging individuals reached to assess their health risks and build skills in HIV prevention [28–30]. Activities are conducted in person one-on-one, one-to-group or online through cyber-educators. Using Prochaska’s Stages of Change framework, outreach workers identify the stage a targeted individual is in to be able to practice a specific behavior being promoted, such as condom use or use of HTC, and tailor delivery of activities according to that stage through discussion and reflection . Outreach workers also ensure that condoms and lubricants are available for sample or purchase near to where activities are being implemented .
The biomedical component is core to the Combination Prevention program’s design. Services provided include HTC, STI screening and treatment, and for people living with HIV, referrals for care and treatment, including antiretroviral therapy. A variety of service providers participate in the program, including private laboratories, private and NGO clinics, and some public sector facilities. HTC is provided through fixed and mobile services, according to where the program is operating .
The addition of complementary services was designed to support program clients to locate resources that help them negotiate potential stigma and discrimination . These specifically include referrals to designated service providers for support groups, drug and alcohol treatment, legal support, and violence prevention services. In addition, the program operates beyond the interpersonal level to address stigma and discrimination and change social norms through sensitization and training of health care providers to improve perceived quality of care, media training, and mobilization of civil society leaders to foster public dialogue on homophobia and discrimination against people living with HIV.
Integrated HIV prevention teams conduct behavioral interventions and referrals to biomedical and complementary services in identified high-risk zones in program cities. For MSM, these zones are areas with large concentrations of nightclubs, bars, parks and areas where community organizations have identified that MSM are likely to meet each other. Teams include outreach workers, PASMO sales staff responsible for ensuring availability and access to condoms, community leaders, and service providers. When clients are contacted by an outreach worker, they receive an in-person behavioral intervention plus a packet of vouchers for other behavioral interventions, condoms, biomedical services, and complementary services. The program tracks client contacts and use of referral vouchers via unique identifier codes assigned to each client contacted . While conducting direct service delivery and coordinating with other program partners, PASMO and partners have also implemented a set of advocacy strategies as part of the structural component of the program. Advocacy is designed to encourage public discussion of HIV transmission and encourage reduction in social hostility towards key populations including MSM .
We aimed in this paper to provide early results on PASMO’s combination prevention program, as targeted to MSM in Central America. Two years into implementing the program, our objectives were to 1) assess population-level coverage of specific and combined intervention components and 2) determine whether program exposure to any or a combination of components was associated with HIV risk reduction behaviors, specifically condom and water-based lubricant use, HIV testing and counseling, and appropriate treatment of STIs.
Data sources and measures
We used behavioral survey data and data extracted from PASMO’s program monitoring system for this analysis.
Regional survey of MSM
From September-November 2012, PASMO recruited MSM from 10 cities in six Central American countries into a survey using respondent-driven sampling (n = 4231). The survey was conducted in areas where the Combination Prevention program operates: Belize City in Belize, San Jose in Costa Rica, San Salvador and Santa Ana in El Salvador, Guatemala City and Quetzaltenango in Guatemala, Managua and Chinandega in Nicaragua, and Panama City and Colón in Panama. These cities were selected because they had on-going program operations and national level evidence indicated high projected HIV prevalence in each city [3, 34]. Men were eligible to participate in the study if they were aged 18–40, had had anal sex with another man in the past 3 months, were resident in the study city, and knew the name or alias of the person who had recruited that respondent to participate. Respondent-driven sampling is a chain referral sampling technique developed to improve the population representativeness of surveys of hard-to-reach populations [35, 36]. We recruited 1–3 seeds in each city. We selected seeds based on socio-economic status, self-identification of sexual orientation, and working in commercial sex. Each seed was asked to recruit three peers within his social network to participate in the study, and subsequent study participants were asked to recruit an additional three peers.
Data was collected through in-person interviews administered by a male enumerator in a location that ensured the respondent’s privacy. The survey instrument included questions on socio-demographic characteristics, sexual behaviors, STI symptoms, use of STI treatment and HTC services, mass media and program exposure, knowledge and attitudes regarding HIV prevention, and experience with violence. The PSI Research Ethics Board provided ethical approval of this survey along with Ministries of Health in Belize, El Salvador, Guatemala and Nicaragua. The Panama National HIV/AIDS Program and the University of Medical Sciences in Costa Rica approved the study as well. Individuals were asked to provide informed consent before participating in the interview. No identifying information was collected from respondents.
For this analysis, we did not use data from Belize because program operations were not completely comparable. We also excluded transgender women (n = 400 self-identified cases) from this analysis because transgender women are increasingly considered to be a separate population programmatically and epidemiologically . Our final analytical sample was 3531 men.
We also used data extracted from PASMO’s routine program monitoring system. PASMO’s system for applied monitoring (SAM) tracks BCC activities and service utilization across all program implementers in six countries. A key feature of the SAM is the use of unique identifier codes (UICs) to track individual clients across program contacts. Unique identifier codes are based on personal information that does not vary over time and that clients can easily recall. Monitoring data are collected on BCC activities by type of activity and target population reached, messages and behaviors, referrals initiated and completed, plus client use of HTC, and STI treatment, and any referrals to other services, such as CD4 count and viral load testing for people living with HIV. Data on program contacts and service utilization are aggregated by country and reported to partners on a monthly basis. For this analysis, we extracted data from October 1, 2011-September 30, 2012. No identifying information on program clients was collected, and analysis of this data was determined to not constitute research with human subjects. From extraction of routine data, we identified 15031 program contacts across the five countries.
Five outcome measures were used for this analysis, all taken from behavioral survey data: 1) condom use at last sex, 2) condom use with water-based lubricant at last sex, 3) consistent condom use in the past 30 days, 4) receipt of an HIV test in the past 12 months, and 5) seeking medical care for a suspected STI symptom in the past 12 months. Consistent condom use was defined as using a condom from start to finish for all sex acts with any partner type for the past 30 days. We measured consistent condom use by partner type for commercial, casual and regular partners. Commercial partners were partners from whom the respondent received money or to whom the respondent gave money for sex. Casual partners were defined as partners with whom the respondent had sex with no emotional attachment and no financial transaction. Regular partners were defined as partners with whom the respondent had engaged in sex for more than 3 months and felt connected to, either by love or friendship.
We created several measures of program exposure from behavioral survey data. These measures were designed to capture specific components of the combination prevention approach in order to capture program operations and assess potentially additive effects of the different components. Exposure to behavioral interventions was defined as having been contacted by an outreach worker representing the project. Exposure to biomedical interventions was defined as having received a voucher for HIV testing and counseling, to capture the referral process. Exposure to complementary interventions was defined as receiving a voucher for other services. We defined any exposure to the program as receipt of any one of these components. We also created a measure of having received all three components, defined as the combination package.
After extracting individual records from the program monitoring system, we created measures of receipt of behavioral interventions (y/n, and number of interventions), receipt of biomedical services (y/n and number of services), and receipt of complementary interventions (y/n and number of services) for this analysis.
We considered a range of other factors from the survey data for this analysis. We looked at socio-demographic factors of age, education (primary education or less, some secondary education, any higher education), and an index of socio-economic status. The index of socio-economic status was constructed following methods of the Mexican Market Research Association and grouped individuals into categories of high, medium and low socio-economic status . We also considered how men described their sexual identity (gay, bisexual, heterosexual).
We considered a series of factors assessing men’s social interactions with gay, transgender and other MSM communities. These included: friends’ knowing the respondent’s sexual orientation, having participated in a gay/transgender event in the past 12 months, and going to a gay bar/disco in the past 30 days. We also considered exposure to other HIV/AIDS programming targeting MSM, measured as whether the respondent received a condom for free in the past 12 months. All factors were treated as dichotomous variables.
Analysis of survey data
For descriptive sample characteristics, we present un-weighted data. We conducted weighted analyses to assess program effects using multiple logistic regression. Because of our sampling and analysis strategy, we calculated weights using pooled data. Several types of weights were calculated and adjusted for in regression models. First, we calculated RDS weights using RDSAT software, which accounts for network size and recruitment patterns for each city . Second, we estimated city weights to account for differential proportions of the sample and estimated population size of each city. Because reliable estimates of the population size of men who have sex with men in all 9 cities were not available, we weighted by the city population of men 15–39 years . Population size estimates were retrieved from national statistics bureaus in each country [41–45]. Age- and sex-specific population size estimates were not available for Guatemala, and we therefore applied the national proportion of men in Guatemala to the age distribution for each city. A third set of weights was used as well, derived from the matching procedure described below. These weights were multiplied together and applied in regression models. Data analysis was conducted in Stata 13 and SPSS 22.
We next used a statistical matching technique, coarsened exact matching (CEM), to improve the quality of our estimates of program effects [46–48]. Coarsened exact matching was used to create statistically equivalent groups of survey respondents exposed and not exposed to any program component. This quasi-experimental approach allowed us to designate a counterfactual (no exposure to any Combination Prevention program components) when an experimental design was not feasible, since program implementation was ongoing at scale across several countries and was not designed or implemented with intervention and control groups [47, 49]. Coarsened exact matching is a monotonic imbalance matching method designed to reduce imbalance between treatment and control groups in observational data [49, 50]. CEM assigns each case into one of a specified set of strata in which members are exactly matched on a set of coarsened, or categorized, variables . Matched cases are then assigned a weight specific to that stratum and representative of the proportion of all cases present in the stratum [51, 52].
We matched survey respondents on factors likely to influence exposure to PASMO’s combination prevention program, given the strong likelihood of selection bias in a setting where MSM are highly stigmatized . We matched on education (categorized as primary education or less, any secondary education, any higher education), sexual orientation (heterosexual, homosexual, bisexual), whether the respondent’s friends knew he had sex with other men, whether the respondent had participated in a gay/transgender event in the past 12 months, whether the respondent had been to a gay bar or disco in the past 30 days, and whether the respondent had received free condoms in the past 12 months. We assessed relationships between potential matching variables and any program exposure using Spearman correlation coefficients. We matched variables that had a statistically significant correlation with program exposure at p < 0.05. An exact match made on the coarsened variables yielded an L1 measure of 4.814e-16, indicating minimal imbalance between respondents exposed and not exposed .
We calculated un-weighted descriptive statistics for key measures using country data and pooled data. Descriptive statistics in the pooled dataset were calculated for the full and the matched samples. We next compared distributions of program exposure in the survey data to program exposure from monitoring data by country. We then used weighted multivariable logistic regression to estimate odds ratios of average treatment effects for each measure of program participation, applying all three types of weights (RDSAT weights, city weights, CEM weights). We first estimated unadjusted odds ratios for each outcome of interest. We next adjusted for age and socio-economic status – factors not included in the matching procedure. We also investigated the effects of receiving two combination prevention channels (behavioral + biomedical and behavioral + complementary), with and without controls. The same modeling strategy was used in the full sample and with the matched sub-sample to estimate how estimates of treatment effects changed following matching.
Analysis of combined survey and MIS data
Finally, we created a new sub-sample of cases where we could link unique identifiers between routine data and survey data. Because of the limited sample size for these linked cases, we did not apply any sampling weights, and we did not match because all cases were exposed. We conducted chi-square tests of association between type of program exposure and the outcomes of interest by country.
More than 80% of respondents across all countries were under 30 (Table 1). Half of the surveyed men were educated at the secondary level and 40% had some university, except for Costa Rica where a quarter of the sample had only primary education. The majority of men were of middle or lower socio-economic status. Half of respondents identified as homosexual or gay, 40.5% as bisexual, and 8.4% as heterosexual. Trends in sexual identity varied by country; Panama had a relatively greater proportion of men indicating they were gay/homosexual while Costa Rica and El Salvador had larger proportions of men reporting they were heterosexual. The majority (70%) of respondents indicated that they had disclosed their sexual identity to their friends, 33% had participated in a gay/transgender event in past 12 months, and 63% had visited a gay bar or disco in the past 30 days.
Of the outcomes of interest, 85% of men reported having used a condom at last sex, and 48% used a condom with water-based lubricant at last sex. Regarding consistent condom use, 82% reported consistent condom use in the past 30 days with all partners. Consistent condom use was substantially higher when respondents reported having casual partners (90%) and commercial partners (92%). Just over half of respondents reported having had an HIV test in the last 12 months (52%), and of those with STI symptoms, 76% sought medical treatment.
Almost a third (32.2%) of respondents reported exposure to any component of the Combination Prevention program (Table 2). Across the five countries, exposure to the behavioral component reached 17.4% and was highest in Guatemala (27.9% overall and 74.2% of those with any exposure) and lowest in Costa Rica and Panama. Coverage of the biomedical component reached 16.4% of men regionally, with El Salvador and Panama achieving the greatest levels of biomedical exposure. Exposure to complementary interventions was reported by 11.2% of respondents regionally; the reach of the complementary component was minimal in Costa Rica but reached 65% of those with any exposure in El Salvador. Only 2.8% of respondents received all three components of the program, with El Salvador (6.1%) and Guatemala (5.5%) achieving the greatest levels of population-based coverage of combination prevention exposure.
We also report trends in program exposure from program monitoring data. Based on how the data were collected, exposure to behavioral interventions was considerably greater than to any other component across all countries, ranging from 84 to 100% of reported contacts. Only El Salvador and Guatemala reported anything other than minimal levels of biomedical contacts (16.5% and 22.7%, respectively), while El Salvador and Nicaragua had the greatest reported contacts with complementary services (both at 3.4%).
Table 3 reports findings from models estimating program effects for the outcomes of interest. We do not show modeling results for consistent condom use with casual partners or for STI treatment seeking, where there were no findings. Men exposed to any programmatic component were more likely to use condoms consistently with regular partners (OR 1.69; 95% CI 1.09, 2.62) and to have been tested for HIV (AOR 2.98; 95% CI 1.82, 4.87). Men exposed to the behavioral component were more likely to use a condom with water-based lubricant the last time they had sex (OR 1.84; 95% CI 1.08, 3.14), to use condoms consistently with regular partners (AOR 1.88; 95% CI 1.09, 3.25), and to have tested for HIV in the past 12 months (OR 1.76; 95% CI 1.001, 3.10). Exposure to the complementary component was also associated with HIV testing (OR 1.97; 95% CI 1.0, 4.05). The odds of condom and water-based lubricant use were greater when men received both the behavioral and biomedical component (OR 3.05; 96% CI 1.08, 8.64). Exposure to both behavioral and complementary components was associated with consistent condom use with commercial partners in the full sample prior to matching (OR 2.47; 95% CI 1.00, 6.09), but after matching, these results were not statistically significant. Overall, we found no evidence that receipt of all three program components was associated with any of the outcomes of interest, although this measure of exposure was rare.
We were able to link a total of 520 unique individuals between monitoring and survey data (Table 4). These cases were comparable to the full sample on socio-demographic factors, except that cases in Guatemala were somewhat younger on average than all men (results not shown). Consistent condom use with regular partners was higher for linked cases, except in Nicaragua. Use of condoms with water-based lubricant and HIV testing were both greater among linked cases in Costa Rica than in the full sample. Most MSM had been exposed to 1–2 behavioral activities, although in Costa Rica a quarter were exposed to more than five. Comparatively fewer of the linked cases had received any biomedical services. The country with the highest level of biomedical service use was Guatemala (22% of cases). Use of complementary services was rare. Overall, El Salvador and Nicaragua achieved the greatest levels of combination prevention exposure, but coverage was still low at 7.3% and 6.8%, respectively. No relationship between program exposure and behavioral outcomes was statistically significant when tested with chi-square tests of association.
In light of the need for a larger evidence base on the effectiveness of combination prevention, particularly from Latin America, we have aimed in this study to systematically evaluate a program strategy that seeks to link multiple program components for a priority population in Central America. We aimed to assess population-level coverage of a combination prevention program targeted to men who have sex with men and to determine whether program exposure was associated with HIV risk reduction in this population. We present preliminary evidence here that suggests this strategy is associated with condom use with water-based lubricant at last sex, consistent condom use with regular partners, and HIV testing.
Two years into implementation, PASMO’s Combination Prevention program has achieved fairly modest levels of coverage in the target population of MSM, a population that is notably difficult to reach [54, 55]. Condom use was relatively high in this population, but condom use with water-based lubricant less so. These levels of condom use are consistent with other reports from Central America [3, 56]. Condom use in our study tended to be slightly higher, particularly with casual partners, than recent IBBS surveys in in El Salvador, Guatemala and Nicaragua [11, 12, 57]. Over half of the population had received an HIV test in the past year, except in Costa Rica where receipt of testing was less common. These results were similar to the 2008 IBBS in El Salvador, but the 2009 Nicaragua IBBS reported higher levels of HIV testing in the past year compared to our study [11, 12]. STI treatment practices were highly variable across countries, but overall trends indicate that appropriate treatment-seeking was common.
Program coverage varied across countries, indicating that the program was at different stages of penetration into the target population. Exposure to the behavioral component of the program was most common at a population level, followed closely by exposure to referral for biomedical services Panama and Costa Rica both had relatively lower levels of exposure to the behavioral component, reflecting that these countries were relatively newer sites for program implementation than Guatemala or El Salvador. Variation in biomedical program exposure was likely due in part to differing periods of program operation.
The picture of program exposure based on records of contacts from monitoring data is somewhat different. Several countries showed high service utilization, but trends differed from survey data. This suggests issues with under-reporting in the monitoring system, likely due to problems with voucher redemption, and is compounded by likely under-reporting of program exposure through recall bias in survey data. Despite the potential for discrepancies, exposure to the complementary component was consistently low across data sources and countries. The notable exception was Guatemala, where complementary exposure was 45% of exposure amongst survey respondents with any exposure. This suggests that the program was more successful in implementing the voucher mechanism and service linkages in that country.
Modalities of program implementation also account for some of the differences in exposure trends. Specifically in Costa Rica, the program operates solely through referrals to the public sector Social Security Institute, following government policy on maintaining HTC services as a public sector service. Rapid HIV tests are not yet available in Costa Rican clinics, which may have influenced outcomes there. Based on coverage levels in other countries, including in Panama where the program also only recently began implementation, loosening policy guidelines on service providers and types of HTC services that can be provided in Costa Rica may be merited to increase the use of HTC.
Despite modest levels of coverage and inconsistencies across data sources, there is evidence that participation in the Combination Prevention program was associated with HIV risk reduction. The behavioral component was associated with consistent condom use with regular partners and with using condoms and water-based lubricants at last sex. Both of these behaviors are focuses of messaging during behavioral interactions. Print materials are distributed that demonstrate the importance of using condoms with water-based lubricant, and counselors are trained to talk about lubricant use in pre- and post-counseling. Effect estimates more than doubled for men who had received both the behavioral component and referral to biomedical services, suggesting that a greater dose of exposure was particularly effective at promoting water-based lubricant use with condoms.
Based on previously collected data showing comparatively lower levels of condom use with regular partners, compared to with casual or commercial partners, PASMO specifically focused messaging within BCC activities on condom use with regular partners during the period evaluated by this study [58–61]. The finding that exposure to the behavioral component was associated with condom use with regular partners suggests that interpersonal communications and a structured approach to BCC can be effective for influencing specific behaviors. Condom use across all partner types is now relatively high, suggesting that future messaging should focus on continued maintenance of these behaviors, along with greater adoption of the use of water-based lubricants.
There was also evidence that program exposure was associated with HIV testing, particularly the exposure to the behavioral component. The effectiveness of referral to complementary services was attenuated in the matched sample, and having received both program components was associated with an even higher likelihood of HIV testing, but these results were not statistically significant, likely due to the small numbers of men who reported both components. These results suggest that BCC strategies are effectively able to promote use of HIV testing and counseling services. The program’s emphasis on improving quality of care within testing service providers, adapting service hours to be convenient for the population being served, and helping service providers to treat client respectfully likely contributed to these results, along with making referrals to these service providers. Subsequent evaluations of this program should continue to investigate whether service linkages and making services MSM-friendly are able to achieve increases in demand for and use of HTC services. This study was not designed to assess links between HIV testing and care and treatment services, but other data from the Combination Prevention program suggest that the program has contributed to improved access to care and treatment for people living with HIV .
After linking cases from monitoring with survey data, we found no evidence that program exposure was associated with any of the outcomes. Again, this was likely due to the rarity of exposure, a result of challenges in locating men exposed to the program during survey data collection and perhaps inconsistencies in reporting of unique identifiers. Future survey research to evaluate this program may be able to address these challenges of recall during data collection.
The Combination Prevention program results are aligned with recent evidence from the HIV prevention literature and contribute unique results on condom use with water-based lubricants, especially in regards to the doubling of effect size for men who were exposed to both the behavioral and biomedical components in the program. Several evaluations from large-scale HIV prevention efforts focused on MSM show an increase in consistent condom use with regular male partners, some with all male partners [63–65]. Community-based peer interventions show evidence of increased condom use at last sex with a male partner and increased perception of behavioral control in taking up HIV testing and counseling . The Combination Prevention program, as well other programs for MSM in low and middle-income countries found to be effective, require additional investments to increase depth and breadth of program coverage.
This analysis has several limitations. In the survey data, recall of outcomes may have been biased. However, levels of condom use and of HIV testing were comparable to other reports from the region . Program exposure recall may have been biased as well. Comparison with program monitoring data suggests that program exposure recall from survey data may have been under-reported, thus attenuating estimates of coverage and effectiveness. The survey did not collect data on HIV status, either through self-report or biomarkers, nor were we able to go beyond experience with HIV testing to look at whether this program links HIV testing and counseling to the HIV treatment cascade, priority areas for understanding the effectiveness of HIV prevention strategies and linking prevention to a continuum of care . We also suspect under-reporting of program contacts in monitoring data, due to the need for program beneficiaries to redeem vouchers before registering in the system. Under-reporting may have attenuated estimates.
Another potential study limitation was in the coarsening of variables before matching. The matching procedure we used faces a trade-off in increasing the number of matched pairs at the expense of less exact matching [49, 51]. However, categorical variables were less likely to be affected by this potential source of bias. This analysis is also at risk for omitted variable bias, as we were not able to account for the effects of unobservable factors.
The measurement approach taken here primarily assesses program exposure and outcomes based on individual-level measurement. It has been argued that combination prevention programs require a multi-level exposure measurement approach or evaluation platform approach to assess the effects of structural factors [25, 26]. We were not able to measure changes at a structural level that may have been related to the program. However, measurement of the complementary component may stand in for some of these gaps, in that these services, including legal support and counseling on drug and alcohol use, influence other factors that affect risk. Further research and later rounds of the evaluation may investigate how to capture the advocacy and social mobilization components better.
We have early evidence that a combination prevention strategy is associated with HIV risk reduction among MSM in Central America. Additional strategies are needed to expand program coverage into a population that is difficult to reach due to stigma and discrimination. Service linkages appear to strengthen program impacts, but measurement may be hampered by under-reporting. Future evaluations should take a multi-level approach to account for complex program operations and the multiple levels (societal, social network, interpersonal) at which a combination prevention strategy operates.
Behavior change communication
Coarsened exact matching
Human immunodeficiency virus
HIV testing and counseling
Management Information System
Men who have sex with men
Pan-American Social Marketing Organization
Population Services International
System for applied monitoring
Sexually transmitted infections
Unique identifier codes
United States Agency for International Development.
Beyrer C, Sullivan PS, Sanchez J, Dowdy D, Altman D, Trapence G, Collins C, Katabira E, Kazatchkine M, Sidibe M, Mayer KH: HIV in men who have sex with men 6: a call to action for comprehensive HIV services for men who have sex with men. Lancet. 2012, 380 (9839): 424-438. 10.1016/S0140-6736(12)61022-8.
Sullivan PS, Carballo-Dieguez A, Coates T, Goodreau SM, McGowan I, Sanders EJ, Smith A, Goswami P, Sanchez J: Successes and challenges of HIV prevention in men who have sex with men. Lancet. 2012, 380 (9839): 388-399. 10.1016/S0140-6736(12)60955-6.
Soto RJ, Ghee AE, Nunez CA, Mayorga R, Tapia KA, Astete SG, Hughes JP, Buffardi AL, Holte SE, Holmes KK: Sentinel surveillance of sexually transmitted infections/HIV and risk behaviors in vulnerable populations in 5 Central American countries. J Acquir Immune Defic Syndr. 2007, 46 (Generic): 101-111.
UNAIDS: Global Report: UNAIDS Report on the Global AIDS Epidemic. 2010, Geneva: UNAIDS
Gómez-Jáuregui JCM, Infante C, Cruz R, Cuadra R, González T: Factors influencing Central America’s civil society organization’s capacity to provide AIDS related care. Salud Pública De México. 2013, 55 (Suppl 1): S15-S22.
UNAIDS: UNGASS El Salvador Country Progress Reports. 2014, San Salvador: UNAIDS
UNAIDS: UNGASS Country Progress Reports. 2014, Guatemala: UNAIDS
Ugarte Guevara WJ, Valladares Cardoza E, Essen B: Sexuality and risk behavior among men who have sex with men in Leon, Nicaragua: a mixed methods approach. J Sex Med. 2012, 9 (6): 1634-1648. 10.1111/j.1743-6109.2012.02713.x.
Kim EJ, Creswell J, Guardado ME, Shah N, Kim AA, Nieto AI, de Maria Hernandez-Ayala F, Monterroso E, Paz-Bailey G: Correlates of bisexual behaviors among men who have sex with men in El Salvador. AIDS Behav. 2013, 17 (4): 1279-1287. 10.1007/s10461-012-0152-y.
Adam PC, de Wit JB, Toskin I, Mathers BM, Nashkhoev M, Zablotska I, Lyerla R, Rugg D: Estimating levels of HIV testing, HIV prevention coverage, HIV knowledge, and condom use among men who have sex with men (MSM) in low-income and middle-income countries. J Acquir Immune Defic Syndr. 2009, 52 (Supplement 2): 8-
Ministry of Health and Social Assistance: Encuesta Centroamericana de Vigilancia de Compartamiento Sexual y Prevalencia de VIH/ITS en Poblaciones Vulnerables. 2009
Universidad del Valle GCFD (CDC): Encuesta Centroaméricana de Vigilancia de Comportamiento Sexual y Prevalencia de VIH e ITS en poblaciones vulnerables ECVC Nicaragua 2009: Principales resultados en la población de hombres que tienen sexo con hombres y personas trans [Spanish]. 2010, Guatemala City: Oficina Regional del Programa Global de SIDA para Centroamérica y Panamá, Universidad del Valle
Universidad del Valle El Salvador: Encuesta Centro de Vigilancia de Comportamiento Sexual y Prevalencia de VIH/ITS en Poblaciones Vunerables, El Salvador [Spanish]. 2010, San Salvador: Universidad del Valle
Cruz JM: Criminal violence and democratization in central America: the survival of the violent state. Latin Am Pol Soc. 2011, 53 (4): 1-33. 10.1111/j.1548-2456.2011.00132.x.
USAID/PASCA: Estigma y Discriminacion asociados al VIH: Encuesta de opinion publica. Informe regional. 2011, Guatemala City: USAID/PASCA
Goldenberg SM, Strathdee SA, Perez-rosales MD, Sued O: Mobility and HIV in central America and Mexico: a critical review. J Immigr Minor Health. 2012, 14 (1): 48-64. 10.1007/s10903-011-9505-2.
Infante CZA, Cuadra M, Morrison K, Caballero M, Bronfman M: Magis M El Estigma asociado al VIH/SIDA: el caso de los prestadores de servicios de salud en Mexico. Salud Publica Mex. 2006, 48 (2): 141-150.
Kurth AE, Celum C, Baeten JM, Vermund SH, Wasserheit JN: Combination HIV prevention: significance, challenges, and opportunities. Curr HIV/AIDS Rep. 2011, 8 (1): 62-72. 10.1007/s11904-010-0063-3.
Piot P, Bartos M, Larson H, Zewdie D, Mane P: HIV prevention 6 - coming to terms with complexity: a call to action for HIV prevention. Lancet. 2008, 372 (9641): 845-859. 10.1016/S0140-6736(08)60888-0.
PEPFAR: Guidance for the Prevention of Sexually Transmitted Infections. 2011, Washington, DC: PEPFAR, 53-
PEPFAR: Technical Guidance on Combination HIV Prevention. 2011, Washington, DC: PEPFAR, 21-
UNAIDS: Combination HIV Prevention: Tailoring and Coordinating Biomedical, Behavioural and Structural Strategies to Reduce New HIV Infections: a UNAIDS Discussion Paper. 2010, Geneva: UNAIDS
Blankenship KM, Friedman SR, Dworkin S, Mantell JE: Structural interventions: concepts, challenges and opportunities for research. J Urban Health. 2006, 83 (1): 59-72. 10.1007/s11524-005-9007-4.
Hankins CAZ, Barbara O: Combination prevention: a deeper understanding of effective HIV prevention [Editorial]. AIDS. 2010, 24 (Suppl 4): S70-S80. 10.1097/01.aids.0000390709.04255.fd.
Padian NS, McCoy SI, Manian S, Wilson D, Schwartlander B, Bertozzi SM: Evaluation of large-scale combination HIV prevention programs: essential issues. J Acquir Immune Defic Syndr. 2011, 58: E23-E28. 10.1097/QAI.0b013e318227af37.
Laga M, Rugg D, Peersman G, Ainsworth M: Evaluating HIV prevention effectiveness: the perfect as the enemy of the good. AIDS. 2012, 26: 779-783. 10.1097/QAD.0b013e328351e7fb.
Merson MH, O’Malley J, Serwadda D, Apisuk C: The history and challenge of HIV prevention. Lancet. 2008, 372 (9637): 475-488. 10.1016/S0140-6736(08)60884-3.
Chapman S: Evaluating social marketing interventions. Evaluating Health Promotion: Practice and Methods. Edited by: Coombes MTY. 2004, London: Oxford University Press, 93-109. 2
Prochaska J, Redding C, Evers K: The transtheoretical model and stages of change. Health Behavior and Health Education. Edited by: Glanz K, Rimer B, Marcus Lewis F. 2002, San Francisco: Jossey-Bass, 99-120. 2
Population Services International: Concept Paper: PSI Behavior Change Framework “Bubbles”: Proposed Revision. 2004, Washington, DC: Population Services International
PASMO: Combination prevention: evidence of a formula with real impact on behavior change in high-risk groups. 2012, USAID: Washington, DC
Lungo SCC, Rivas J, Oliva K: Use of a unique identifier code system to track key populations reached under a combination prevention program in six countries of Central America. International AIDS Conference Melbourne, Australia. 2014
Lungo S: NAB: Estudio Especial: Estigma y discriminacion hacia PMAR y PCV en Centro America In. 2011, Guatemala City: PASMO
Bastos FI, Cáceres C, Galvão J, Veras MA, Castilho EA: AIDS in Latin America: assessing the current status of the epidemic and the ongoing response. Int J Epidemiol. 2008, 37 (4): 729-737. 10.1093/ije/dyn127.
Johnston LG, Chen Y-H, Silva-Santisteban A, Raymond HF: An empirical examination of respondent driven sampling design effects among HIV risk groups from studies conducted around the world. AIDS Behav. 2013, 17 (6): 2202-2210. 10.1007/s10461-012-0394-8.
Heckathorn D: Respondent-driven sampling II: deriving valid population estimates from chain-referral samples of hidden populations. Soc Probl. 2002, 49 (1): 11-34. 10.1525/sp.2002.49.1.11.
Baral SD, Poteat T, Stromdahl S, Wirtz AL, Guadamuz TE, Beyrer C: Worldwide burden of HIV in transgender women: a systematic review and meta-analysis. Lancet Infect Dis. 2013, 13 (3): 214-222. 10.1016/S1473-3099(12)70315-8.
Lopez-Romo H: Los Niveles Socioeconomicos y la distribucion del gasto. 2009, [http://www.amai.org/NSE/NivelSocioeconomicoAMAI.pdf] AMAI
Michael WS, CC Heckathon D: RDSTAT: RDS Analysis Tool 7.1 User Manual. 2012, Ithaca, NY: Cornell University
Szwarcwald CL, de Souza PRB, Damacena GN, Barbosa AB, Kendall C: Analysis of data collected by RDS among sex workers in 10 Brazilian cities, 2009: estimation of the prevalence of HIV, variance, and design effect. J Acquir Immune Defic Syndr. 2011, 57 (Suppl 3): S129-
Instituto Nacional de Estadística y Censo (INEC): Estimaciones y Proyecciones de la Población Total en la República de Panamá, por Provincia y Comarca Indígena, según Sexo y Edad Período 2000–30. Situación Demográfica, Boletín N° 14. 2012, Panama City: INEC
Instituto Nacional de Estadística Guatemala (INE): Caracterizacion estadistica: Republica de Guatemala 2012. 2012, Guatemala City: INE
Instituto Nacional de Información de Desarrollo (INIDE): Población Total, estimada. 2007, Managua: INIDE
Dirección General de Estadística y Censos (DIGESTYC): Encuesta de Hogares de Propositos Multiples 2012. 2012, San Salvador: DIGESTYC
Instituto Nacional de Estadística y Censos (INEC): X Censo Nacional de Poblacion y VI de Vivienda 2011. 2011, San Jose, Costa Rica: INEC
Blackwell M, Iacus S, King G, Porro G: CEM: coarsened exact matching in Stata. Stat J. 2009, 9 (4): 524-546.
Stuart EA: Matching methods for causal inference: a review and a look forward. Stat Science. 2010, 25 (1): 1-21. 10.1214/09-STS313.
Shadish WR, Cook TD, Campbell DT: Experimental and quasi-experimental designs for generalized causal inference. 2002, Boston: Houghton Mifflin
Comparative Effectiveness of Matching Methods for Causal Inference. [http://gking.harvard.edu/files/gking/files/psparadox.pdf]
Haider AH, David J-S, Zafar SN, Gueugniaud P-Y, Efron DT, Floccard B, MacKenzie EJ, Voiglio E: Comparative effectiveness of inhospital trauma resuscitation at a French trauma center and matched patients treated in the United States. Ann Surg. 2013, 258 (1): 178-183. 10.1097/SLA.0b013e31828226b6.
Wells AR, Hamar B, Bradley C, Gandy WM, Harrison PL, Sidney JA, Coberley CR, Rula EY, Pope JE: Exploring robust methods for evaluating treatment and comparison groups in chronic care management programs. Popul Health Manag. 2013, 16 (1): 35-45. 10.1089/pop.2011.0104.
Pawa D, Firestone R, Ratchasi S, Dowling O, Jittakoat Y, Duke A, Mundy G: Reducing HIV risk among transgender women in Thailand: a quasi-experimental evaluation of the sisters program. PLoS One. 2013, 8 (10): e77113-10.1371/journal.pone.0077113.
Huedo-medina TB, Boynton MH, Warren MR, Lacroix JM, Carey MP, Johnson BT: Efficacy of HIV prevention interventions in Latin American and Caribbean nations, 1995–2008: a meta-analysis. AIDS Behav. 2010, 14 (6): 1237-1251. 10.1007/s10461-010-9763-3.
Caceres C: HIV among gay and other men who have sex with men in Latin America and the Caribbean: a hidden epidemic?. AIDS. 2002, 16 (3): 23-33.
Montealegre JR, Johnston LG, Murrill C, Monterroso E: Respondent driven sampling for HIV biological and behavioral surveillance in Latin America and the Caribbean. AIDS Behav. 2013, 17 (7): 2313-2340. 10.1007/s10461-013-0466-4.
Ugarte WJHU, Valladares E, Essen B: Assessing knowledge, attitudes, and behaviors related to HIV and AIDS in Nicaragua: a community-level perspective. Sex Repro Healthcare. 2013, 4: 37-44. 10.1016/j.srhc.2012.11.001.
Universidad del Valle Guatemala: Estudio centroamericano de vigilancia de comportamiento sexual y prevalencia de ITS y VIH. Capitulo Guatemala. La Unidad de VIH del Centro de Estudios en Salud de la Universidad del Valle de Guatemala (CES-UVG). 2013
Population Services International: Nicaragua (2009): Estudio TRaC de VIH/SIDA: Hombres que tienen sexo con otros Hombres en Managua, Chinandega, Masaya, Nueva Segovia y RAAN. 2a Ronda nacional. 2009, Washington, DC: PSI
Population Services International: El Salvador (2009): Estudio TRaC de VIH/SIDA: Hombres que tienen sexo con otros Hombres en San Salvador, Sonsonate, Santa Ana, San Miguel y La Paz. 2a Ronda nacional. 2009, Washington, DC: PSI
Population Services International: Guatemala (2009): Estudio TRaC de VIH/SIDA Hombres que tienen sexo con otros Hombres en Guatemala, Quetzaltenango, Suchitepéquez e Izabal. 2a Ronda naciona. 2009, Washington, DC: PSI
Population Services International: Panama (2009): Estudio TRaC de VIH/SIDA: Hombres que tienen sexo con otros Hombres en Ciudad Panamá, Colón y Darien. 2a Ronda nacional. 2009, Washington, DC: PSI
Vu L, Nieto-Andrade B, DiVincenzo A, Rivas J, Firestone R, Wheeler J, Lungo S: Effectiveness of behavior change communications for reducing transmission risks among people living with HIV in 6 countries in Central America. AIDS Behav. 2014, 5: Epub ahead of print
Subramanian T, Ramakrishnan L, Aridoss S, Goswami P, Kanguswami B, Shajan M, Adhikary R, Purushothaman GK, Ramamoorthy SK, Chinnaswamy E, Veeramani IB, Paranjape RS: Increasing condom use and declining STI prevalence in high-risk MSM and TGs: evaluation of a large-scale prevention program in Tamil Nadu, India. BMC Public Health. 2013, 13: 857-10.1186/1471-2458-13-857.
Ye S, Xiao Y, Jin C, Cassell H, Blevins M, Sun J, Vermund SH, Qian HZ: Effectiveness of integrated HIV prevention interventions among Chinese men who have sex with men: evaluation of a 16-city public health program. PLoS One. 2012, 7 (12): e50873-10.1371/journal.pone.0050873.
Goswami P, Rachakulla HK, Ramakrishnan L, Mathew S, Ramanathan S, George B, Adhikary R, Kodavalla V, Rajkumar H, Paranjape RS, Brahmam GN: An assessment of a large-scale HIV prevention programme for high-risk men who have sex with men and transgenders in Andhra Pradesh, India: using data from routine programme monitoring and repeated cross-sectional surveys. BMJ Open. 2013, 3 (4): e002183-
Duan Y, Zhang H, Wang J, Wei S, Yu F, She M: Community-based peer intervention to reduce HIV risk among men who have sex with men in Sichuan province. China AIDS Educ Prev. 2013, 25 (1): 38-48. 10.1521/aeap.2013.25.1.38.
Hayes R, Sabapathy K, Fidler S: Universal testing and treatment as an HIV prevention strategy: research questions and methods. Curr HIV Res. 2011, 9 (6): 429-445. 10.2174/157016211798038515.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/14/1244/prepub
The study was funded by the United States Agency for International Development (USAID) through the HIV Combination Prevention Program. Under this cooperative agreement, PSI’s regional affiliate PASMO works in partnership with the International Planned Parenthood Federation Western Hemisphere Region (IPPF/WHR) and its eight local member associations, Cicatelli Associates, Inc., Milk n’ Cookies, and numerous other community/faith-based organizations, nongovernmental organizations, and public, and private sector partners, to whom we are grateful. The authors would like to thank Giovanni Melendez, Laetitia Lemoine, and Julia Roberts for reviewing and commenting on earlier drafts of the manuscript. Karla Oliva, Jose Enrique Martinez, and Denis Valvert supported data collection and management. Dana Sievers provided research assistance. We acknowledge the Ministries of Health of Belize, Costa Rica, El Salvador, Guatemala, Nicaragua, and Panama for facilitating program implementation and data collection. PASMO field staff provided seeds and guidance on survey design. Deep appreciation goes to participants, field supervisors, and interviewers who contributed to survey data collection.
The authors declare that they have no competing interests.
Analyzed the data: RF JR. Wrote the paper: RF JR SL AC SR. Conceived and designed study: RF JR SL. Designed sampling strategy: RF JR. Collected data: JR SL. Interpreted results: RF JR SL AC JW LV. Edited the manuscript: RF JR AC SR LV. Reviewed final manuscript: RF JR SL AC SR JW LV. All authors read and approved the final manuscript.
About this article
Cite this article
Firestone, R., Rivas, J., Lungo, S. et al. Effectiveness of a combination prevention strategy for HIV risk reduction with men who have sex with men in Central America: a mid-term evaluation. BMC Public Health 14, 1244 (2014). https://doi.org/10.1186/1471-2458-14-1244
- Men who have sex with men
- Combination prevention
- Central America
- Condom use
- HIV testing and counseling
- HIV prevention interventions
- Social marketing