Skip to main content
Download PDF
  • Study Protocol
  • Open access
  • Published:

A randomized controlled trial of the dissemination of an mHealth intervention for improving health outcomes: the WiseApp for Spanish-speakers living with HIV study protocol

BMC Public Health volume 24, Article number: 201 (2024) Cite this article

Abstract

Background

While there is no cure for HIV, adherence to antiretroviral therapy can extend the lifespan and improve the quality of life of people with HIV. Despite the global reduction of HIV infection rates in recent years, New York City and La Romana, Dominican Republic, continue to report high infection rates among Latino populations. Many people with HIV remain virally unsuppressed in these geographic hotspots, suggesting a need for additional interventions to overcome medication adherence barriers. Tailored and culturally appropriate mobile health (mHealth) technology can be an engaging way to improve adherence. The primary objective of this trial is to test the effectiveness of an mHealth tool to improve HIV medication adherence among Spanish-speaking people living in New York City and the Dominican Republic.

Methods

The WiseApp study is a two-arm randomized controlled trial among 248 people with HIV across the New York and Dominican Republic sites over the course of 12 months. Participants are randomly assigned to either receive a CleverCap pill bottle that is linked to the WiseApp (intervention) or standard of care (control). All participants complete surveys at baseline, 3-month, 6-month, and 12-month follow-up visits and the study team obtains HIV-1 viral load and CD4 count results through blood draw at each study timepoint.

Discussion

The use of mHealth technologies to improve medication adherence among people with HIV has been implemented in recent years. Although some studies have found improvement in adherence to antiretroviral therapy in the short term, there is limited information about how these interventions improve adherence among Spanish-speaking populations. Disproportionate rates of HIV infection among Latinos in New York City suggest an existing inequitable approach in reaching and treating this population. Due to a lack of mHealth studies with Latino populations, and apps tailored to Spanish-speakers, the WiseApp study will not only demonstrate the effectiveness of this particular mHealth app but will also contribute to the mHealth research community as a whole.

Trial registration

This trial was registered with Clinicaltrials.gov (NCT05398185) on 5/31/2022.

Peer Review reports

Background

Thirty nine million people are currently living with HIV across the globe [1]. While there is no cure for HIV, antiretroviral therapy (ART) can be taken as a daily oral medication, or through longer-acting injections to suppress HIV replication to undetectable levels [2]. People with HIV (PWH) who adhere to their prescribed ART regimen can live a long, healthy life [2]. Despite the efficacy of ART, PWH must take their medication as prescribed to properly manage their HIV.

Although HIV infection rates have decreased globally throughout the past two decades, prevalence rates remain high in certain geographic hotspots [3]. Two settings, New York City (NYC) and La Romana, Dominican Republic (DR), are high priority areas in the US [4] and the Caribbean [5]. The DR has one of the highest rates of HIV infections in the Caribbean with approximately 79,000 PWH [6, 7]. Haiti, with whom DR shares territory on the island of Hispaniola, reports the highest rate in the region [8]. Despite increased accIn the proposed study , we are leveraging a mHealth tool (Wiseess to ART in recent years in the DR, only about 63% of people who have been diagnosed with HIV are taking ART and only 52% have achieved viral suppression (48% virally unsuppressed) [6]. These percentages are lower than in NYC where 84% of PWH have been prescribed ART and 79% are virally suppressed (21% virally unsuppressed) [9]. Regardless, additional interventions are needed to help PWH manage this disease and overcome barriers to achieving viral suppression in both locations. The most recent (2021) NYC HIV/AIDS surveillance report found that of the current 129,660 PWH in NYC, 33.4% self-reported their ethnicity as Latino/Hispanic [9]. This data shows a disproportionate rate of infections among the Latino population as only 28.9% of the total NYC population identifies as Latino [10].

PWH face several barriers to achieving and maintaining medication adherence such as substance use, depression, daily life events, missing refills, side effects, and cost of transportation/medications among others [11]. Mobile health (mHealth) interventions present an equitable solution to receiving tailored care for managing a chronic disease [12, 13]. Although the use of mHealth interventions in DR is still in the early stages of implementation [14], studies have found that 87.6% of people living in the DR own a cellphone [15] with 84% of people of the overall population of the Caribbean owning a smartphone [16], suggesting a high rate of smartphone users in the DR. Meanwhile, a recent study demonstrated that 85% of the United States (US) population owns a smartphone [17], with similar rates estimated in NYC [18]. High smartphone penetration allows for widespread use of mHealth interventions across diseases and populations.

In the proposed study, we are leveraging a mHealth tool (WiseApp) [19, 20] to test the effectiveness of a smart pill bottle, called the CleverCap, which is an electronic pill bottle that connects via Bluetooth to a medication adherence app (Fig. 1). Through formative work with expert panels, cognitive interviews and usability testing [21, 22], we translated the WiseApp into Spanish and tested it among end-users to refine content to meet the needs of Spanish-speaking Latino/Hispanic PWH in NYC and the DR. Similar studies have been conducted by the study team in NYC [23, 24], however, recruitment did not specifically target Spanish-speakers, and to date, few mHealth interventions have been tested among Spanish-speakers [25, 26]. The objective of this paper is to detail the procedures used for a randomized controlled trial (RCT) which began recruitment in March of 2023.

Fig. 1
figure 1

The WiseApp

Full size image

Methods

Study design

This study is a 12-month RCT among Spanish-speaking PWH living in NYC and the DR. Participants are randomized to either receive a CleverCap pill bottle that is linked to the WiseApp (Arm 1), or standard health services offered at each site and a brief adherence educational session (Arm 2). Regardless of randomization, all participants schedule baseline, 3-, 6-, and 12-month visits. Each visit includes taking blood samples (HIV-1 viral load and CD4 counts) and completing an online survey in Spanish. Participants in both arms receive referrals to mental health counseling, drug/alcohol treatment, and/or other HIV services as necessary.

Recruitment and eligibility

Participants are recruited primarily through direct outreach at the Comprehensive Health Program Adult Services Clinic in the New York-Presbyterian (NYP) Hospital in Washington Heights for the NYC site and at the Clínica de Familia La Romana in La Romana for the DR site. Additional targeted recruitment in NYC occurs through snowball sampling [27], online advertisements, and the distribution of flyers at HIV clinics and community-based organizations with services for PWH and the LGBTQ community. All verbal and written communication during the recruitment process is in Spanish. Those recruited through targeted recruitment are directed to an online web survey via Research Electronic Data Capture (REDCap) for eligibility screening. Eligibility is confirmed through screening in-person or over the phone. In order to be eligible, participants must: (1) speak, read, and write in Spanish; (2) be 18 years or older; (3) be willing to participate in any assigned arm; (4) have an HIV diagnosis of ≥ 6 months ago; (5) have an HIV-1 RNA level > 50 copies/mL; (6) have a viral load > 50; (7) own a smartphone; and (8) provide informed consent for study participation and access to medical records. Participants are not eligible if they: (1) reside in a nursing home, prison, and/or are receiving in-patient psychiatric care at the time of enrollment; (2) have a terminal illness with life expectancy less than six months; (3) plan to move out of the area (NYC or DR) in the next 12 months; (4) have a cognitive state minimum score of 24 measured by the Mini-Mental State Examination (MMSE) [28] to ensure participants are oriented to the time and place; and/or (5) have another family/household member who is already enrolled in the study due to study contamination [29].

Ethics

All study procedures were approved by the Columbia University Institutional Review Board (IRB) and the Consejo Nacional de Bioética en Salud (CONABIOS), the ethical review committee in the DR, prior to recruitment and enrollment of study participants. Participants review the Informed Consent Form with a study team member and sign consent through REDCap before starting any baseline procedures.

Sample size calculation

A power analysis was calculated to ensure that the sample size detects at least a medium effect size of the difference in adherence to ART at 3, 6, and 12 months between study arms. We estimated statistical power based on a previous mHealth study where results showed that adherence to ART was higher in the intervention compared to the control arm (0.565 vs. 0.460, that is in the small effect size range) and a Pearson correlation coefficient of adherence of 0.6 between consecutive study times [30]. Using two-sided tests for generalized linear mixed model, we have at least 80% power to test for such differences by site based on these assumptions: (1) target enrollment is 248 participants across sites randomized to each study arm; (2) outcomes are measured at each follow-up visit; and (3) an overestimate of 10% attrition at 3 months and 20% at 6 and 12 months. The sample size at each site does not have enough statistical power to detect a small effect size of difference between the two arms at each follow-up time, but it is enough to test for a medium effect size of difference or greater between the two arms at 3, 6, and 12 months, separately, or to test for a small effect size of difference during entire follow-up period with > 80% statistical power.

Randomization

Informed consent is obtained at the baseline visit and study participants are randomized to study arms in a 1:1 ratio of 1 - Intervention (arm 1: WiseApp and CleverCap) and 1 - Control (arm 2: standard of care), stratified by site (NYC and DR). Participants are randomized using computer-generated random numbers at baseline and are assigned to one of two trial arms using sequentially numbered, opaque, sealed envelopes containing the intervention assignment, which the staff member opens at the moment of randomization [31].

Description of the intervention: WiseApp

The WiseApp is an mHealth app [32,33,34] culturally adapted for Latinos and translated to Spanish through a rigorous iterative community participatory feedback process with the goal of helping PWH adhere to their ART medication regimen. The app is connected to the CleverCap, a smart pill bottle that automatically senses when the bottle is opened and closed, which then records that the user took their medication for the day on the graph within their app account. Participants add their ART to the CleverCap pill bottle at their baseline appointment. Within the app, there are medication reminders and tracking features to set a medication dosing schedule and view adherence statistics. Study participants can also communicate with study staff through the chat feature. The study team is able to view users’ medication adherence statistics through an online portal. More specifically, the study team can view if the participant took their medication on time, off schedule, or if they did not take it. Medication adherence data collected through use of the CleverCap is analyzed upon completion of the study.

Study assessments

All participants are enrolled on-site at NYP in NYC or Clínica de Familia La Romana, in the DR so that they can complete a blood draw to obtain HIV-1 viral load and CD4 count results at each study timepoint (baseline, 3-, 6-, and 12-months). Participants also complete a survey at all 4 visits. All study materials and visits are completed in Spanish. Surveys are administered through REDCap and are used to collect data on demographics, quality of life, HIV symptoms [35], engagement in HIV care [36], HIV-related stigma [37], alcohol and substance use [38], and depression and anxiety [39,40,41,42]. ART adherence is measured through self-report [43] and use of the WiseApp and CleverCap bottle. The differences in study arms are presented in Table 1.

Table 1 Intervention v. control procedures and measures
Full size table

Primary and secondary outcomes

The primary outcome is improvement in ART adherence at 3, 6, and 12 months for those randomized to the WiseApp and CleverCap (intervention arm) as compared to the control arm. Measures for ART adherence include: (1) ART adherence (SRSI) [43]; (2) the CleverCap adherence index, which is calculated as the number of unique days that CleverCap indicates either was “Taken” or “Improperly Closed” divided by the number of days during the assessment period; and (3) viral load. The secondary outcome for participants randomized to the intervention arm is (a) improved health-related quality of life; (b) decreased symptom burden; (c) improved engagement with healthcare providers; (d) decreased HIV-related stigma as compared to the control arm; and (e) changes in viral load and CD4 counts using bloods samples taken during study visits. The Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) flow diagram for the schedule of enrollment, interventions, and assessments of the study are presented in Fig. 2.

Fig. 2
figure 2

SPIRIT flow diagram for the schedule of enrollment, interventions, and assessments

Full size image

Statistical analysis

Study participants from NYC and DR may be different; therefore, the analyses will be conducted separately for each site as well as for the total data from both sites. Intervention and control arms will be described with respect to baseline characteristics (e.g., means, standard deviations, ranges, and proportions). We will check for outliers, examine patterns of missing data, and conduct evaluation of deviations from normality for all outcomes to determine the need for transformations of variables or special analytic techniques. All multivariate analyses will be preceded by standard descriptive bivariate analyses to describe key variables and relationships among them. These analyses will include means, frequency tables, histograms, and examination of distributions. Following the guidelines issued by the European Medicines Agency [44], we will not adjust for baseline differences in demographic characteristics when comparing the main outcomes between the intervention and control groups. Analyses will be based on linear or generalized linear mixed models. Inferences from mixed models are valid under the missing at random (MAR) assumption (i.e., missingness can be fully accountable by variables where there is complete information) with full-information maximum likelihood (FIML) estimation [45]. These analyses will be complemented with assessment of how sensitive the inferences are to the MAR assumptions. Sensitivity analysis will be performed based on selection models for dropout [46,47,48]. All analyses will use the Intention-to-Treat principle [49], which requires subjects’ data to be analyzed as randomized regardless of whether or not they used the WiseApp. We will assess for any significant differences in clinical factors (e.g., years since diagnosis, co-morbid conditions), since there is evidence that these clinical factors are related to our primary outcome [50,51,52]. All statistical tests will be two-sided tests with the level of significance at 0.05.

Discussion

Many mHealth interventions for medication adherence among PWH have been tested in recent years within the US [53,54,55,56,57,58,59,60,61,62,63,64,65] and abroad [66,67,68,69,70,71,72,73,74,75,76,77]. Past studies have identified usability, acceptability and feasibility of mHealth designed for PWH [53, 55, 60, 61, 67, 69, 73, 74] and some have demonstrated efficacy in improving adherence to ART in the short-term [32, 53, 55, 60, 66, 70, 73, 74]. Among mHealth interventions for PWH in the US, limited studies have recruited or plan to recruit Latino populations specifically [32, 53,54,55, 57, 58, 60, 61, 63, 64]. An additional limitation to these studies is that of the study samples that included Latino participants, few offered the intervention to those whose first language is Spanish (or, in other words, eligibility criteria includes only English-speakers) [32, 54, 63]. As for the Dominican Republic, there have been very few published health interventions for PWH in recent years [78,79,80] and more research is needed to identify acceptability of mHealth in low- and middle-income countries [81].

It is estimated that the DR only provides treatment to about 52% of PWH [82], meaning that alternative solutions are needed to ensure that PWH receive continued care to manage their disease. Some factors that affect HIV infection in the DR include poverty, lack of access to healthcare and prevention services, literacy, lack of information on sexuality and HIV/AIDS, and cultural barriers to preventive measures for HIV [7]. mHealth allows for PWH to receive a healthcare intervention on a regular basis when they are unable to see a provider. High smartphone penetration in the DR allows for PWH to engage in mHealth interventions which are well-suited to their needs.

While smartphones are widely used in the US and DR, technology literacy may differ among users, for example, among different age groups. The WiseApp is a simple mHealth application that is to be used primarily to communicate with study staff or view adherence statistics with the purpose of helping PWH take their ART as prescribed. It was created and refined to be a highly usable app for all Spanish-speaking PWH, applying a “Broadcast Spanish” translation, thus avoiding use of colloquial phrases. With the added technology of the CleverCap smart pill bottle, which functions much like a regular pill bottle, participants can easily respond to reminders to take their medication. The WiseApp in Spanish has the potential to reach populations that have been excluded from past interventional studies as well as address disproportionate health outcomes among Latino identifying people.

The WiseApp in Spanish is intended to help PWH better manage their chronic disease by encouraging patients to adhere to a medication dosing schedule. Because of the negative health outcomes which may result from remaining virally unsuppressed, it is crucial that interventions address the specific needs of the target population (Spanish-speaking PWH). Disproportionate rates of HIV infection among Latinos in NYC suggest an existing inequitable approach in reaching and treating this population. Due to a lack of mHealth studies with Latino populations, and apps tailored to Spanish-speakers, the WiseApp study will not only demonstrate the effectiveness of this particular mHealth app, but will also contribute to the mHealth research community as a whole.

Availability of data and materials

The datasets generated and/or analyzed during the current study contain sensitive personally identifiable information, including participant’s name and HIV status, and are not publicly available. Study information would be available from the corresponding author upon reasonable request.

Abbreviations

PWH:

People with HIV

ART:

Antiretroviral therapy

NYC:

New York City

DR :

Dominican Republic

RCT:

Randomized controlled trial

NYP:

New York-Presbyterian

MMSE:

Mini-Mental State Examination

SRSI:

Self-report scale item

MAR:

Missing at random

FIML:

Full-information maximum likelihood

References

  1. Organization WH. People living with HIV. 2022; Available from: https://www.who.int/data/gho/data/themes/hiv-aids.

  2. CDC. HIV Treatment. 2022; Available from: https://www.cdc.gov/hiv/basics/livingwithhiv/treatment.html.

  3. UNAIDS. Global HIV & AIDS statistics. 2022; Available from: https://www.unaids.org/en/resources/fact-sheet#:~:text=New%20HIV%20infections%20have%20been,4.3%20million%5D%20people%20in%201995.

  4. CDC. Ending the HIV Epidemic in the U.S. Progress. 2023. Available from: https://www.cdc.gov/endhiv/ehe-progress/index.html.

  5. UNFPA. HIV&AIDS. 2023. Available from: https://caribbean.unfpa.org/en/node/19856.

  6. UNAIDS. Country Factsheets: Dominican Republic. 2022. Available from: https://www.unaids.org/en/regionscountries/countries/dominicanrepublic.

  7. Rojas P, et al. The HIV/AIDS epidemic in the Dominican Republic: key contributing factors. J Int Assoc Physicians AIDS Care. 2011;10(5):306–15.

    Article  Google Scholar 

  8. Bank TW. Prevalence of HIV, total (% of population ages 15–49) - Latin America & Caribbean. 2021. Available from: https://data.worldbank.org/indicator/SH.DYN.AIDS.ZS?end=2021&locations=ZJ&most_recent_value_desc=true&start=2021&view=map&year=2021. Cited 2023 08/29/2023.

  9. Hygiene ND. o.H.a.M., HIV Surveillance Annual Report, 2021. 2021.

  10. Bureau UC. QuickFacts New York City, New York. 2022. Available from: https://www.census.gov/quickfacts/fact/table/newyorkcitynewyork/PST045222.

  11. Wallace DD, et al. The co-management of HIV and chronic non-communicable diseases in the dominican republic: a qualitative study. PLoS ONE. 2023;18(7): e0288583.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  12. Schnall R, Higgins T, Brown W, Carballo-Dieguez A, Bakken S. Trust, Perceived Risk, Perceived Ease of Use and Perceived Usefulness as Factors Related to mHealth Technology Use. Stud Health Technol Inform. 2015;216:467–71.

  13. Schnall R, Rojas M, Bakken S, Brown W, Carballo-Dieguez A, Carry M, Gelaude D, Mosley JP, Travers J. A user-centered model for designing consumer mobile health (mHealth) applications (apps). J Biomed Inform. 2016;60:243–51. https://doi.org/10.1016/j.jbi.2016.02.002.

  14. Stonbraker S, et al. Establishing content for a digital educational support group for new adolescent mothers in the Dominican Republic: a user-centered design approach. Int J Adolesc Med Health. 2020;34(4):219–32.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Statista. Number of mobile cellular subscriptions in the Dominican Republic from 2000 to 2021. 2023; Available from: https://www.statista.com/statistics/497193/number-of-mobile-cellular-subscriptions-in-dominican-republic/#:~:text=In%202021%2C%20there%20were%20over,penetration%20rate%20of%2087.56%20percent.

  16. Statista. Mobile internet penetration rate in Latin America and the Caribbean as of January 2023, by region. 2023. Available from: https://www.statista.com/statistics/934766/penetration-rate-mobile-internet-latin-america-region/.

  17. Center PR. Mobile phone ownership over time. 2021. Available from: https://www.pewresearch.org/internet/fact-sheet/mobile/.

  18. International, R. New York City Mobile Services Study. 2023. Available from: https://www.rti.org/impact/new-york-city-mobile-services-study#:~:text=The%20study%20found%20that%2096,is%20higher%20than%20national%20rates.

  19. Beauchemin M, et al. A multi-step usability evaluation of a self-management app to support medication adherence in persons living with HIV. Int J Med Inform. 2019;122:37–44. https://doi.org/10.1016/j.ijmedinf.2018.11.012.

    Article  PubMed  Google Scholar 

  20. Schnall R, Bakken S, Rojas M, Travers J, Carballo-Dieguez A. mHealth Technology as a Persuasive Tool for Treatment, Care and Management of Persons Living with HIV. AIDS Behav. 2015;19 Suppl 2(0 2):81–9. https://doi.org/10.1007/s10461-014-0984-8.

  21. Schnall R, et al. Expert Feedback on the adaptation and translation of Spanish version of wiseapp. Stud Health Technol Inform. 2023;302:500–1.

    PubMed  Google Scholar 

  22. Hahn A, et al. Comparison of evaluation methods for improving the usability of a Spanish mHealth Tool. International Journal of Medical Informatics (under review). 2023.

  23. Flynn G, et al. Protocol of the randomized control trial: the wiseapp trial for improving health outcomes in PLWH (WiseApp). BMC Public Health. 2020;20(1):1775.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Wood OR, et al. A community health worker and mobile health app intervention to improve adherence to HIV medication among persons with HIV: the CHAMPS study protocol. BMC Public Health. 2023;23(1):942.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Cantisano LM, et al. ePSICONUT: an e-Health programme to improve emotional health and lifestyle in university students. Int J Environ Res Public Health. 2022;19(15):9253.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  26. Muñoz AO, Camacho E, Torous J. Marketplace and literature review of Spanish language mental health apps. Front Digit Health. 2021;3:615366.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Goodman LA. Snowball Sampling. Ann Math Stat. 1961;32(1):148–70.

  28. Folstein MF, Folstein SE, McHugh PR. Mini-mental state. A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975;12(3):189–98.

    Article  CAS  PubMed  Google Scholar 

  29. Robinson K, et al. Contamination in complex healthcare trials: the falls in care homes (FinCH) study experience. BMC Med Res Methodol. 2020;20(1):46.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  30. Schnall R, et al. Mobile health technology for improving symptom management in low income persons living with HIV. AIDS Behav. 2018;22:3373–83.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Hedden SL, Woolson RF, Malcolm RJ. Randomization in substance abuse clinical trials substance abuse treatment. Prevention Policy. 2006;1(1):1–17.

    Google Scholar 

  32. Schnall R, et al. Efficacy of an mHealth self-management intervention for persons living with HIV: the WiseApp randomized clinical trial. J Am Med Inform Assoc. 2023;30(3):418–26. https://doi.org/10.1093/jamia/ocac233.

    Article  PubMed  Google Scholar 

  33. Schnall R, Rojas M, Travers J, Brown W 3rd, Bakken S. Use of Design Science for Informing the Development of a Mobile App for Persons Living with HIV. AMIA Annu Symp Proc. 2014;2014:1037–45.

  34. Schnall R, Bakken S, Brown Iii W, Carballo-Dieguez A, Iribarren S. Usabilty Evaluation of a Prototype Mobile App for Health Management for Persons Living with HIV. Stud Health Technol Inform. 2016;225:481–5.

  35. Justice AC, et al. Development and validation of a self-completed HIV symptom index. J Clin Epidemiol. 2001;54(Suppl 1):S77-90.

    Article  PubMed  Google Scholar 

  36. Bakken S, et al. Relationships between perception of engagement with health care provider and demographic characteristics, health status, and adherence to therapeutic regimen in persons with HIV/AIDS. AIDS Patient Care STDS. 2000;14(4):189–97.

    Article  CAS  PubMed  Google Scholar 

  37. Earnshaw VA, et al. HIV stigma mechanisms and well-being among PLWH: a test of the HIV stigma framework. AIDS Behav. 2013;17(5):1785–95.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Curran GM, et al. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care. 2012;50(3):217–26.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Beck AT, Steer RA, Carbin MG. Psychometric properties of the beck depression inventory: twenty-five years of evaluation. Clin Psychol Rev. 1988;8(1):77–100.

    Article  Google Scholar 

  40. Naar-King S, et al. Psychosocial factors and medication adherence in HIV-positive youth. AIDS Patient Care STDS. 2006;20(1):44–7.

    Article  PubMed  Google Scholar 

  41. Nugent NR, et al. Youth living with HIV and problem substance use: elevated distress is associated with nonadherence and sexual risk. J Int Assoc Physicians AIDS Care (Chic). 2010;9(2):113–5.

    Article  PubMed  Google Scholar 

  42. Derogatis LR. BSI brief symptom inventory: Administration, scoring and procedures manual. 4th ed. Mineapolis: National Computer Systems; 1993.

  43. Feldman BJ, et al. Evaluation of the single-item self-rating adherence scale for use in routine clinical care of people living with HIV. AIDS Behav. 2013;17:307–18.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  44. Use C. f.M.P.f.H, C.f.M.P.f.H. Use. Guideline on adjustment for baseline covariates in clinical trials. London: European Medicines Agency; 2015.

    Google Scholar 

  45. Little RJ, Rubin DB. Statistical analysis with missing data. Volume 793. Hoboken: Wiley; 2019.

  46. Carpenter J, Pocock S, Johan Lamm C. Coping with missing data in clinical trials: a model-based approach applied to Asthma trials. Stat Med. 2002;21(8):1043–66.

    Article  PubMed  Google Scholar 

  47. Liu X, Waternaux C, Petkova E. Influence of human immunodeficiency virus Infection on neurological impairment: an analysis of longitudinal binary data with informative drop-out. J Royal Stat Soc Ser C. 1999;48(1):103–15.

    Article  Google Scholar 

  48. Diggle P, Kenward MG. Informative drop-out in longitudinal data analysis. J Royal Stat Soc Ser C: Appl Stat. 1994;43(1):49–73.

    Google Scholar 

  49. Lachin JM. Statistical considerations in the intent-to-treat principle. Control Clin Trials. 2000;21(3):167–89.

    Article  CAS  PubMed  Google Scholar 

  50. Guaraldi G, et al. Aging with HIV vs. HIV seroconversion at older age: a diverse population with distinct comorbidity profiles. PLoS ONE. 2015;10(4): e0118531.

    Article  PubMed  PubMed Central  Google Scholar 

  51. Miners A, et al. Health-related quality-of-life of people with HIV in the era of combination antiretroviral treatment: a cross-sectional comparison with the general population. The Lancet HIV. 2014;1(1):e32–40.

    Article  PubMed  Google Scholar 

  52. Jia H, et al. A further investigation of health-related quality of life over time among men with HIV Infection in the HAART era. Qual Life Res. 2007;16:961–8.

    Article  PubMed  Google Scholar 

  53. Amico KR, et al. Randomized controlled trial of a remote coaching mHealth adherence intervention in Youth living with HIV. AIDS Behav. 2022;26(12):3897–913.

    Article  PubMed  PubMed Central  Google Scholar 

  54. Jones J, et al. Leveraging mHealth and patient supporters for African americans’ and Latinxs’ Engagement in HIV Care (LEAN): protocol for a Randomized, controlled, effectiveness-implementation trial. JMIR Res Protoc. 2023;12: e42691.

    Article  PubMed  PubMed Central  Google Scholar 

  55. Navarra AD, et al. Feasibility and acceptability of the adherence connection counseling, Education, and support (ACCESS) proof of Concept: a Peer-Led, Mobile Health (mHealth) cognitive behavioral antiretroviral therapy (ART) adherence intervention for HIV-Infected (HIV+) adolescents and young adults (AYA). AIDS Behav. 2023;27(6):1807–23.

    Article  PubMed  Google Scholar 

  56. Ranjit YS, et al. mHealth intervention to Improve Treatment outcomes among people with HIV who Use Cocaine: protocol for a pilot randomized controlled trial. JMIR Res Protoc. 2022;11(3): e28332.

    Article  PubMed  PubMed Central  Google Scholar 

  57. Saberi P, et al. Exploration of a mobile technology vulnerability scale’s association with antiretroviral adherence among young adults living with HIV in the United States. Mhealth. 2022;8:23.

    Article  PubMed  PubMed Central  Google Scholar 

  58. Sun CJ, et al. Virtual voices: examining social support exchanged through participant-generated and unmoderated content in a mobile intervention to improve HIV antiretroviral therapy adherence among GBMSM. AIDS Care. 2023;35(1):7–15.

    Article  CAS  PubMed  Google Scholar 

  59. Sun L, et al. Effectiveness of mHealth on adherence to antiretroviral therapy in patients living with HIV: meta-analysis of randomized controlled trials. JMIR Mhealth Uhealth. 2023;11: e42799.

    Article  PubMed  PubMed Central  Google Scholar 

  60. Ramsey SE, et al. A preliminary test of an mHealth facilitated health coaching intervention to improve medication adherence among persons living with HIV. AIDS Behav. 2021;25(11):3782–97.

    Article  PubMed  PubMed Central  Google Scholar 

  61. Saberi P, et al. A Mobile Health App (WYZ) for engagement in care and antiretroviral therapy adherence among youth and young adults living with HIV: single-arm pilot intervention study. JMIR Form Res. 2021;5(8): e26861.

    Article  PubMed  PubMed Central  Google Scholar 

  62. DeFulio A, et al. Smartphone-based incentives for promoting adherence to antiretroviral therapy: a randomized controlled trial. Prev Med Rep. 2021;21: 101318.

    Article  PubMed  PubMed Central  Google Scholar 

  63. Duthely LM, et al. A multilingual, culturally competent Mobile Health intervention to improve treatment adherence among women living with HIV: protocol for a Randomized Controlled Trial. JMIR Res Protoc. 2020;9(6): e17656.

    Article  PubMed  PubMed Central  Google Scholar 

  64. Ventuneac A, et al. A mobile health intervention in HIV primary care: supporting patients at risk for ART non-adherence. HIV Res Clin Pract. 2020;21(5):140–50.

    Article  PubMed  Google Scholar 

  65. Schnall R, Mosley JP, Iribarren SJ, Bakken S, Carballo-Diéguez A, Brown Iii W. Comparison of a User-Centered Design, Self-Management App to Existing mHealth Apps for Persons Living With HIV. JMIR Mhealth Uhealth. 2015;3(3):e91. https://doi.org/10.2196/mhealth.4882.

  66. Aunon FM, et al. Randomized controlled trial of a theory-informed mHealth intervention to support ART adherence and viral suppression among women with HIV in Mombasa, Kenya: preliminary efficacy and participant-level feasibility and acceptability. BMC Public Health. 2023;23(1):837.

    Article  PubMed  PubMed Central  Google Scholar 

  67. Mulawa MI, et al. Supporting adolescents with HIV in South Africa through an adherence-supporting app: mixed methods Beta-testing study. JMIR Form Res. 2023;7: e47575.

    Article  PubMed  PubMed Central  Google Scholar 

  68. Naggirinya AB, et al. Willingness to pay for an mHealth anti-retroviral therapy adherence and information tool: transitioning to sustainability, call for life randomised study experience in Uganda. BMC Med Inform Decis Mak. 2022;22(1):52.

    Article  PubMed  PubMed Central  Google Scholar 

  69. O’Connor C, et al. Delivering an mHealth Adherence Support intervention for patients with HIV: mixed methods process evaluation of the Philippines Connect for Life Study. JMIR Form Res. 2022;6(8): e37163.

    Article  PubMed  PubMed Central  Google Scholar 

  70. Tran BX, et al. Efficacy of a Mobile Phone-Based Intervention on Health Behaviors and HIV/AIDS Treatment Management: Randomized Controlled Trial. J Med Internet Res. 2023;25: e43432.

    Article  PubMed  PubMed Central  Google Scholar 

  71. Ameli V, et al. Tailored mHealth intervention for improving treatment adherence for people living with HIV in Iran (HamRaah): protocol for a feasibility study and randomised pilot trial with a nested realist evaluation. BMJ Open. 2021;11(6): e042296.

    Article  PubMed  PubMed Central  Google Scholar 

  72. Chory A, et al. A pilot study of a mobile intervention to support mental health and adherence among adolescents living with HIV in Western Kenya. AIDS Behav. 2022;26(1):232–42.

    Article  PubMed  Google Scholar 

  73. O’Connor C, et al. Interactive mobile phone HIV adherence support for men who have sex with men in the philippines connect for life study: mixed methods approach to intervention development and pilot testing. JMIR Form Res. 2022;6(2):e30811.

    Article  PubMed  PubMed Central  Google Scholar 

  74. Twimukye A, et al. Acceptability of a mobile phone support tool (call for Life Uganda) for promoting adherence to antiretroviral therapy among young adults in a randomized controlled trial: exploratory qualitative study. JMIR Mhealth Uhealth. 2021;9(6):e17418.

    Article  PubMed  PubMed Central  Google Scholar 

  75. Ahonkhai AA, et al. PEERNaija: a gamified mHealth behavioral intervention to improve adherence to antiretroviral treatment among adolescents and young adults in Nigeria. Front. Reprod Health. 2021;3:656507.

    Google Scholar 

  76. Krishnan A, et al. Assessing mobile technology use and mHealth acceptance among HIV-positive men who have sex with men and transgender women in Malaysia. PLoS ONE. 2021;16(3): e0248705.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  77. McCreesh-Toselli S, et al. Staff perceptions of preimplementation barriers and facilitators to a mobile health antiretroviral therapy adherence counseling intervention in South Africa: qualitative study. JMIR Mhealth Uhealth. 2021;9(4):e23280.

    Article  PubMed  PubMed Central  Google Scholar 

  78. Barrington C, et al. I’ve learned to Value myself more: piloting an adapted multilevel intervention for transgender women sex workers living with HIV in the dominican republic. Transgend Health. 2021;6(3):148–55.

    Article  PubMed  PubMed Central  Google Scholar 

  79. Budhwani H, et al. Adapting and pilot testing an HIV and intersectional stigma reducing intervention for Dominican Republic healthcare contexts: protocol for translational research. Contemp Clin Trials Commun. 2022;29: 100980.

    Article  PubMed  PubMed Central  Google Scholar 

  80. Derose KP, et al. Developing Pilot interventions to address Food Insecurity and Nutritional needs of people living with HIV in Latin America and the Caribbean: an Interinstitutional Approach using Formative Research. Food Nutr Bull. 2018;39(4):549–63.

    Article  PubMed  PubMed Central  Google Scholar 

  81. Nwaozuru U, et al. Mobile health interventions for HIV/STI prevention among youth in low- and middle-income countries (LMICs): a systematic review of studies reporting implementation outcomes. Implement Sci Commun. 2021;2(1):126.

    Article  PubMed  PubMed Central  Google Scholar 

  82. Project HFG. Treatment for All Strategy for HIV Adopted in the Dominican Republic. 2020; Available from: https://www.hfgproject.org/treatment-for-all-strategy-for-hiv-adopted-in-the-dominican-republic/.

Download references

Acknowledgements

The work was completed while at the Columbia University School of Nursing, New York City, USA.

Funding

Research reported in this publication was supported by the Agency for Healthcare Research.

and Quality (AHRQ) under award number R18HS028523. The content is solely the responsibility of the authors and does not necessarily represent the official views of the AHRQ.

Author information

Authors and Affiliations

  1. School of Nursing, Columbia University, 560 W 168th St, New York, NY, 10032, USA

    Felix Olaya, Maeve Brin, Haomiao Jia & Rebecca Schnall

  2. Clínica de Familia La Romana, La Romana, Dominican Republic

    Pamela Baez Caraballo & Mina Halpern

  3. NYU Steinhardt School of Culture, Education, and Human Development, New York, NY, 10003, USA

    Sergio Ozoria Ramírez

  4. NYU School of Medicine, New York, NY, 10016, USA

    Janeth Juarez Padilla

  5. University of Colorado College of Nursing, Anschutz Medical Campus, Aurora, CO, 80045, USA

    Samantha Stonbraker

Authors
  1. Felix Olaya
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Maeve Brin
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Pamela Baez Caraballo
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Mina Halpern
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Haomiao Jia
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Sergio Ozoria Ramírez
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Janeth Juarez Padilla
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Samantha Stonbraker
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Rebecca Schnall
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

RS and PBC contributed to the conceptualization and design of all aspects of the study. SOR, JJP, and FO contributed to the project administration and resources. MH contributed to the conceptualization, project administration, and resources. SS contributed to the methodology and investigation. HJ designed the proposed data analysis. FO and MB drafted the manuscript. All authors have read and approved the final manuscript.

Corresponding author

Correspondence to Rebecca Schnall.

Ethics declarations

Ethics approval and consent to participate

The study was approved by the Columbia University Institutional Review Board (IRB) and the National Council of Bioethics in Health (Consejo Nacional de Bioética en Salud, CONABIOS) in the Dominican Republic. Study participants provide written informed consent and HIPAA authorization at baseline visits prior to enrollment. Researchers follow institutional policies on data collection and management procedures. Current protocol version: August 15, 2023. Any modifications to the protocol are submitted to and approved by the IRB prior to implementation. Adverse events and unintended effects of the trial are tracked by the study principal investigators and reported to the IRB.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Olaya, F., Brin, M., Caraballo, P.B. et al. A randomized controlled trial of the dissemination of an mHealth intervention for improving health outcomes: the WiseApp for Spanish-speakers living with HIV study protocol. BMC Public Health 24, 201 (2024). https://doi.org/10.1186/s12889-023-17538-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12889-023-17538-y

Keywords

BMC Public Health

ISSN: 1471-2458

Contact us