This article has Open Peer Review reports available.
Development and effectiveness of a mobile phone application conducting health behavioral intervention among men who have sex with men, a randomized controlled trial: study protocol
© The Author(s). 2017
Received: 22 February 2017
Accepted: 6 April 2017
Published: 24 April 2017
Behavioral intervention is a key approach to HIV prevention among men who have sex with men (MSM). Widespread use of mobile phones provide us with novel opportunities to decrease HIV infection and transmission of MSM. The objective of the study was to design and develop a mobile phone application (app) aims to conduct behavioral intervention to MSM and to evaluate the efficacy of the app-based intervention compared to usual care, to analyze cost-effectiveness and mechanism of the intervention.
This study involves 2 phases, phase 1 use qualitative method and phase 2 is a randomized controlled trial lasting for 18 months, they will be conducted in Chagnsha, Hunan Province, China. Phase 1 is to design and develop the app, procedures including retrieval of domestic apps related to prevention and treatment about HIV and sexually transmitted diseases (HIV/STDs), personal interviews with MSM about preferences and functional needs of the HIV prevention app, multidisciplinary experts focused group discussions of the app, software engineers’ development and users test of the app will be performed. In phase 2, we will recruit 800 MSM by cooperating with the local center of disease control and prevention and nongovernmental organizations, and divide them into intervention and control group evenly. Intervention group participants will receive app-based HIV prevention. Control group participants will be provided with usual care including HIV/STDs knowledge brochure and free voluntary counseling services. Data will be collected at baseline, 6, 12 and 18 months since subject’s participation. Effectiveness of the intervention includes HIV/STDs infection rates, adherence to regularly HIV testing, sexual risk behavior, consistent condom use and relative risk of HIV infection. Cost-effectiveness will be analyzed by decision-analytic modeling, and mechanism analysis of this app-based intervention will be performed by path analysis.
This will be the first study of its kind in China to develop an app and implement app-based HIV prevention intervention among MSM. It is of great potential to determine whether app-based intervention is a cost-effective way to decrease HIV infection among MSM and explore intervention mechanism with an accurate method.
Chinese Clinical Trial Register (ChiCTR-IOR-15006724). Registered 10 July 2015.
Men who have sex with men (MSM) have been identified as high risk population of HIV infection and transmission since the world’s first AIDS case found in the United States at 1981 , and studies about HIV prevention among MSM had not been paid enough attention by Chinese researchers until the first case of AIDS patient in China found at 1985 . HIV prevalence among MSM population has been continuously increasing at a rapid speed [3, 4]. In China, the proportion of HIV infection among MSM population jumped from 1.4% in 2001 to 6.3% in 2011 . In 2007, MSM accounted for 12.2% among all of the yearly found new HIV infection cases, but this percentage soared to 29.4% in 2011 . And in Changsha, Hunan Province of China, 46% of the yearly found new HIV cases are MSM (Changsha CDC). MSM have become the key population of HIV prevention interventions.
Despite scientists’ ongoing efforts to explore biomedical techniques of HIV prevention such as vaccine development, circumcision, antiviral drug use and so forth [7–9], behavioral interventions are still regarded as key approaches to HIV prevention [10, 11]. These involve regularly HIV testing, free condom providing, health education (e.g. peer education), individual behavioral and mental health counseling [12–17], etc. They have been proved to be effective of improving MSM’s health behaviors, finding newly infected individuals timely and referring them to rapid care and treatment services. Lots of existed studies involved an intervention package which consists of more than one way of behavioral intervention [18, 19]. However, since most of the interventions were performed by face-to-face patterns, there were three limitations which may constrain their effects. (1) High financial cost, labor consumption, and time consuming, (2) narrow coverage of MSM group, and (3) unsatisfying intervention adherence . So it is imperative to explore more effective, extensively accessible, economic and comprehensive HIV prevention tools and strategies .
The contemporary world has been greatly changed by the Internet. And the Internet supported interventions have been regarded as “disruptive innovations” and become new weapons by researchers and health providers when it comes to HIV prevention . The internet-based interventions have 3 irreplaceable advantages over face-to-face delivered interventions, (1) these interventions can be broadly diffused and maintained at lower financial and personnel cost, (2) the Internet’s characteristics like anonymity and information confidentiality can improve acceptability of the interventions among MSM, (3) the interactive functionality of the Internet gains popularity among different populations, especially among those hard-to-reach groups [23, 24].
Online surveys can provided us with a large amount of information about MSM’s sexual behaviors and mental health in a short period of time, giving auto reminders of HIV testing to clients, conducting motivational interviews about behavior changing and health skills promoting, and performing health education by using websites [25–28]. Levine and colleagues developed an online partner notification system inSPOT to inform sex partners of the HIV-positive person to take HIV test . In China, gay websites often be used as tools for health behavior collecting, education delivering, and as a recruiting method for intervention outreach to offline sites [30–32]. Guangzhou CDC of China cooperated with a gay website named Guangtong website to develop a web platform named Easy Tell to do anonymous partner notification . Effects of these Internet-based HIV prevention interventions were proved to be comparable to those face-to-face interventions, and they were more accessible and acceptable.
Mobile network is the combination of mobile communication devices and the Internet, mobile phone application(app) is the typical type and current trend of mobile network . Six-hundred fifty-six million Chinese are currently using mobile phones to link to the Internet , and it is estimated that 6.72 to 16.8 million of them are MSM. Comparing with computer network, mobile network has more strength, especially with the users online almost 24/7, we can make the intervention to penetrate into the users daily lives. And because of the personal privacy of mobile phone, the intervention can be more targeted and individualized. Besides, personal behavioral data can be collected easily by mobile network due to its portability and access to sensing devices, the big data collected can be analyzed to explore the mechanism of the intervention, which previous studies cannot hold a candle to.
It was consumed that app-based interventions have great potential to become a vital window for health maintenance and promotion of MSM . Several qualitative studies conducted by MSM focus group discussions demonstrated preferences and functionality of HIV prevention app. The app should include educational content like information about HIV testing and prophylaxis distribution institutions and groups, HIV/STDs diagnose and treatment information, drug and alcohol abuse risk and safer sex skills. Interactive engagement such as connection with gay-friendly health providers, other HIV-positive gay men, and support peers/groups. Usability of the app is the most important feature because the app would not be of value if MSM do not use it, which means MSM feel useful, safe and trustworthy about the app’s language and confidentiality [24, 37, 38]. Our previous studies found that mobile phones were widely used among MSM, it was popular for MSM using the gay tailored dating apps such as Grindr, Jack’D, and domestic apps like Blued, ZANK for speed dating, casual sex, or even group sex. Lots of Chinese MSM expressed urgent need of humanistic care, professional mental and behavioral health services, and welcome interventions using the app, Wechat and other mobile network media with open arms [39, 40]. However, there is no MSM tailored, app-based HIV prevention emerged so far.
The objectives of the study are to (1) design and develop an easy to use, user-friendly, non-stigmatized and free app, and deliver app-based HIV prevention intervention to MSM, and (2) to evaluate the effectiveness of the app at decreasing rate of HIV infection, promoting HIV testing behavior and consistent condom use among MSM, and cost-effectiveness analysis of the intervention. App-based intervention mechanism will also be explored.
This study comprises 2 phases. In phase 1, qualitative method is employed for designing and developing the app. Functional modules of the app are designed on the basis of (1) a retrieval of currently exist HIV/STDs prevention and treatment related apps, (2) personal interviews with MSM about preferences and function needs of the app, and (3) periodical meetings of a multidisciplinary team. Fifty MSM will be invited to test the app after completion of app development and modifications will be made according to their use experience and advice. Phase 2 is a randomized controlled trial lasting for 18 months, to evaluate effectiveness of the app-based intervention and to explore intervention mechanism. Eight-hundred MSM will be recruited and evenly divided into the intervention arm and control. Participants in the intervention arm will receive app-based HIV prevention intervention, and the control arm individuals will receive usual care service which includes free health education materials, voluntary counseling and testing services.
Subjects recruitment will be performed in Changsha, provincial capital of Hunan province, China. The city has over 6 million people, including 15 thousand MSM. Implementation of this study will be cooperated with Chagnsha CDC. It is the authoritative HIV testing institution, and has the right to verify one’s HIV-positive status. In addition, the center takes charge of two non-governmental organizations (NGO) which exclusively providing HIV testing and counseling services for MSM. These organizations have built good relationship with MSM.
Inclusion and exclusion criteria
Participant inclusion criteria: (1) male aged 16 years or older, (2) has experience of same-sex anal intercourse during the last 12 months, (3) HIV negative, (4) own at least one smartphone, and (5) willing to report individual HIV/STDs testing results to the researcher. Participant exclusion criteria:(1) has only one sex partner who is also HIV negative, and their relationship has last for more than 2 years, (2) unable to participant the program because of cognitive or psychiatric disorders, or (3) has already attended another intervention program.
For the participant enrollment, in phase 1 and phase 2, MSM who are potential eligible for the study will be listed, and each individual will be invited to take free HIV testing and participate in the study through phone call performed by the staff of CDC and the two NGOs. An appointment will be made if the person agrees to participate. Following an oral informed consent, clients will be screened for eligibility as subjects of the study by a research member, demographic information and baseline data(details below) will be obtained, and blood samples will be taken for HIV testing. Written informed consent will be obtained from each one who is HIV-seronegtive and willing to participate in the study. Those HIV-seropositive persons will be referred to local CDC for verification and treatment.
Randomization and blinding
Participants in the randomized controlled trial will be assigned 1:1 to the intervention and control arms under restricted randomized block design (the block length is 4) after informed consent and collection of baseline data. The allocation sequence will be generated and released to the interventionist on a case-by-case basis by another independent department specializes in generating research random sequence. The recruitment staff have no access to the results of randomization prior to recruiting the subject. Participants will be informed of his group by a research assistant by phone. Interventionist, data collection staff, statistician are not the same persons. This is a single-blinded trial. The subjects cannot be blinded due to the nature of the intervention, and interventionist also acknowledge all those contacted are in the intervention arm. But anonymous responses will be entered into the database by a person unconnected with the project. The statistician will be blinded to individual result during the intervention period, and the allocation-to-trial-arm coding will not be revealed until dataset is sealed. The interventionist and supervisors will be blinded to the baseline and follow-up outcomes.
Phase 1: Development of the app
Function modules of HIV prevention app for MSM
Assessment about user’s unprotected sex behaviors and condom use rate
Behavior change plans
Setting personal goals and plans of health behavior change, and individualized reward/punishment plans
Buttons for enter into phone, message, Wechat and email counseling areas
Knowledge about HIV diagnosis, prevention and treatment, skills of condom using, etc
Personal health records
Uploading HIV/STDs testing results, building personal health records and health promotion plans
Delivering latest news HIV prevention, treatment and related policies, and reminders of personal behavior, encouragement and advice
Videos from professionals and celebrities to encourage user’s adherence to behavior change efforts
Providing information about addresses, connection methods, providers and services offered of CDC, hospitals, NGOs nearby
Building a communication platform where users can give feedback of using the app
Settings of time period of receiving information, passports of log in the app, latest versions, etc
Store and Android Market since the two markets occupy 90.61% of the current mobile application markets . We use the words “HIV/AIDS/human immunodeficiency virus/STD/ sexually transmitted disease/sexual health/sexual behavior/positive sex/condom” respectively to search for related apps, each eligible app will be downloaded and its features, including names, download numbers, target population, main function modules will be listed and analyzed.
Second, personal face-to-face interviews with MSM will be conducted by using a semi-structured outline, which involves questions about currently confronting behavioral, mental and social problems, promotion and barrier factors of taking HIV test, ever used or currently using MSM tailored apps and their characteristics, preferences of name, logo, and functional needs about a HIV prevention app especially for MSM. Sample size of the interview process will depend on the information saturation rule which means as sample expanding, no new theme be induced from information the participants supplied. A functional framework will be built based on the two processes.
Third, periodical focused multidisciplinary experts group sessions will be held to discuss the framework of the app from the interactivity, feasibility, acceptability and user experience aspects. Finally, functional modules of the app will be determined. The app will be developed by a company specialized in mobile application development. After the app development completed, 50 MSM will be invited to test it, necessary modifications will be made according to their advice.
Phase 2: Effectiveness evaluation of the app-based intervention
Participants in the intervention arm will receive app-based intervention. Each of them will be required to download the app and register as a user consequently, their accounts information, e.g. account name, email address used for registration will be collected. Four disciplines will be taken into account during the intervention period: (1) Interaction: at least once interaction will be required between the user and the app per week (e.g., sexual risk behavior report). (2) Non-stigmatization: a supportive atmosphere including social, behavioral, and psychological support will be built, and all contents will be presented without sense of discrimination. (3) Motivation encouragement: design and development of the app, information offered by the app will be in line with users’ needs, willingness and preferences so as to inspire their using motivation and maintain their adherence of the intervention. And two methods, health behavior goals setting according to the user’s sexual risk behavior, and exchange for free condoms with points earned by using the app regularly will be involved as incentive approaches to increase individual’s motivation of behavior change. (4) User-experience-centric: the app-based intervention will be user-oriented and we lay emphasis on user experience from aspects of interface and function modules as well.
For the control arm participants, each of them will be asked to build connection with the researcher through Wechat, the most widely used instant massaging app in China. They will receive usual care including free brochures of health information and free counseling services whenever they need. All of the participants will be promised of the confidentiality throughout the process.
All of the subjects in control and intervention arms will attend four visits, one at baseline for screening and enrollment, three at 6-, 12-, 18-month respectively to assess their sexual and other health behaviors (detailed below). Any subject gets HIV infected during the whole study period will be referred to professionals for timely treatment and withdrawn form the study. Information and psychological counseling services, positive sex tips and necessary links to care resources will be provided by the study staff.
Baseline data of all the subjects will be collected at the enrollment procedure. The measures including demographic information (age, marital status, current occupation, educational level, income and sexual orientation), sexual behaviors (number of male and female sex partners, frequency of sex, sex role, commercial sex behaviors, sex with fixed and casual sexual partners), and health-related behaviors (consistent condom use with multi-type of sex partners, regular HIV testing, drug use experience and sexual transmitted diseases infection history).
For the rest three times of data collection, sexual behaviors, health-related behaviors, and app user experience (user experience, feedback and suggestions) during the last 6 months will be involved in an electronic questionnaire. One version will be made into the app and be delivered every 6 months to intervention arm participants. Another without app user experience items will be delivered by Wechat to the ones in control arm.
Data of cost of the intervention and participants’ app use behaviors will also be collected. Direct cost involves cost of development, operation and maintenance of this app and worker cost, indirect cost consists of participants’ expenses due to their joining in the study such as time spending, cell phone internet data and traffic cost. App use behaviors will be collected through the management system which involves participants’ use frequency and time durance, information scanned, interaction times and frequency.
We use the electronic questionnaire to make sure that all of the items will be presented in a logical order and necessary answers missing will not be allowed. The participant will be offered a non-cash financial compensation as phone bills worth 20 RMB for compensation every time he complete the data collection.
Outcomes will be compared between intervention and control arms, and between different time points of each arm. The primary outcomes include HIV/STDs infection rates, relative risk of HIV/STDs infection, secondary outcomes include condom use rates, adherence to regularly HIV testing. The incremental cost is defined as per HIV infection case decreased according to the app-based intervention, cost of every 1% decrease of HIV/STDs infection, or every 10% increase of consistent condom use and adherence to regularly HIV testing. Another outcome is the app-based intervention mechanism (detailed below).
Sample size and calculation
The intervention arm and control arm are of equal size and two-tailed hypothesis testing is assumed. Sample size is calculated by using the specific sample size function module PASS on the statistical analysis software NCSS . By setting the α = 0.05, 1-β = 0.9, effect size as 0.25 , the sample size of each group is 336. With an estimated 20% loss to follow-up, 400 subjects are necessary for each group.
Statistical methods and analysis
Analysis of equivalence of two arms at baseline
The equivalence will be analyzed by using Mann-Whitley U test, Chi-square test, t test or ANOVA.
Analysis of intervention outcomes
For intervention arm and control arm comparison, indicators of rates of HIV/STDs infection, consistent condom use, adherence to regularly HIV testing and sexual risk behaviors at baseline and at 6-, 12- and 18-month will be compared by using Chi-square test. And a COX risk model will be used for predicting HIV/STDs infection risks.
For the cost-effectiveness analysis, the total cost consists of direct and indirect cost mentioned above. Effectiveness covers the increased rates of consistent condom use and regularly HIV testing, the decreased rate of HIV/STDs infection, relative risk of HIV/STDs infection. A decision analytic model will be used to evaluate economic evaluation of the intervention. Using the estimated effectiveness and incremental cost of per HIV infection case decreased, every 1% decrease of HIV/STDs infection, every 10% increase of consistent condom use or adherence to regularly HIV testing, incremental cost-effectiveness ratio will be calculated.
Outcome will be analyzed under the basis of ITT. First, the principles of ITT will be applied to test the effects of attrition, which means that all participants who have been randomized will be included in the analysis. Missing endpoints will be imputed by using the Expectation-Maximization (EM) algorithm. To gauge the robustness of the outcomes, this analysis will be repeated while using Multiple-Imputation approach. Second, propensity Score analysis will also be used. By using logistic model (1 for adherence and 0 for attrition) to predict the probability of be in adherence. And then use the predicted variable to replace the attrition dummy variable.
Analysis of intervention mechanism
Correlation analyses between each aspect of participants’ app use behaviors (e.g. app use frequency and time durance, information scanned, interaction frequency) and effectiveness of the intervention will be performed. A causal path model will be built according to correlation analyses results and related theories. And a path analysis will be subsequently conducted so as to calculate the residual path coefficient and determination coefficient, define causal relationships between different variables, and thus explore intervention mechanism of the app-based intervention.
In line with goals of implementation science, the study is going to develop a mobile phone app which comprises of behavioral, psychological and social services and for MSM, and implement a randomized controlled trial of HIV prevention intervention by using this app among MSM and evaluate effectiveness of the app-based intervention. The goals of the intervention are to provide MSM with health information, encourage their motivation of behavior change and promote their health skills.
It has been shown that apps are beneficial to self-management of people with chronic conditions, physical activity promotion among different age groups, and other health related behaviors [44–46]. There were systematic reviews pointed out that apps have great potential as tools for HIV prevention among MSM, and there were also studies on MSM’s acceptability and preferences of app-based. However, there is no randomized controlled trial targeting at MSM group with an app. This is the first study of its kind.
There are several strengths of the study. Mobile network is the combination of the Internet and mobile devices, and has the advantage of higher portability. The “always online” feature made it become a part of one’s daily life. Mobile phone can protect personal privacy and realizes point-to-point individualized intervention as well, which provide us with a better and accurate way to illustrate intervention mechanism. The long-term follow-up makes it possible to observe intervention effects with more persuasive results. And the cost-effectiveness analysis will help policy makers perform informed and practical decision-making.
As for the limitations of the study design, due to the open design we cannot mask the intervention, participants will be aware that they are in a HIV prevention intervention, which may introduce bias. Randomization allocation of participants into different groups can help achieve balance in sociodemographic characteristics. And researcher in charge of statistical analysis will be blinded to group allocation.
The authors wish to thank all the experts for their opinions during the development of the study protocol, and we are grateful to the participants as well as health advisers working in Changsha CDC for their work on this project.
The protocol reported in this publications was supported by the National Natural Science Foundation of China (81470154).
Availability of data and materials
JY conceived the study and is the principal investigator, drafted and revised the manuscript. AZ contributed to study design and manuscript drafting. LZ and ZH contributed to study design and helped with statistical support. PZ and GY designed the data collection tools. All authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
This trial was approved by the institution review committee of the 3rd Xiangya Hospital, Central South University (2014-s030). Consent forms will be signed by all participants. Participants will be informed the benefits and potential risks of the trial and the right of withdrawal from participation at any time without penalty. The trial is registered at the Chinese Clinical Trial Registry platform (ChiCTR-IOR-15006724).
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Centers for Disease Control and Prevention (CDC. HIV and AIDS--United States, 1981-2000 [J]. MMWR Morb Mortal Wkly Rep. 2001;50(21):430.Google Scholar
- Zheng X. A report on AIDS surveillance report from 1985 to 1988 in China [J]. Chin J Epidemiol. 1989;10:65–7.Google Scholar
- Beyrer C, Sullivan P, Sanchez J, Barala SD, Collinsd C, Wirtza AL, et al. The increase in global HIV epidemics in MSM [J]. AIDS. 2013;27(17):2665–78.View ArticlePubMedGoogle Scholar
- Wu ZY. Chinese response on the spread of HIV/AIDS among MSM [C]. National communication about HIV prevention and control among MSM, tenth anniversary of FRIENDS program and Bailey-Martin prize award ceremony, Beijing, 2008.Google Scholar
- Chow EP, Wilson DP, Zhang J, Jing J, Zhang L. Human immunodeficiency virus prevalence is increasing among men who have sex with men in China: findings from a review and meta-analysis [J]. Sex Transm Dis. 2011;38(9):845–57.View ArticlePubMedGoogle Scholar
- State Council AIDS Working Committee Office (SCAWCO): 2012 China AIDS. Response progress report [R]. Beijing, China: Ministry of Health of the People’s Republic of China; 2012:70.Google Scholar
- Mayer KH, Wheeler DP, Bekker LG, Grinsztejn B, Remien RH, Sandfort TG, Beyrer C. Overcoming biological, behavioral, and structural vulnerabilities: new directions in research to decrease HIV transmission in men who have sex with men [J]. J Acquir Immune Defic Syndr. 2013;63(Suppl.2):S161–7.View ArticlePubMedPubMed CentralGoogle Scholar
- Weiss HA, Quigley MA, Hayes RJ. Male circumcision and risk of HIV infection in sub-Saharan Africa: a systematic review and meta-analysis [J]. AIDS. 2000;14(15):2361–70.View ArticlePubMedGoogle Scholar
- Yan J, Lau JF, Tsui HY, Gu J, Wang ZX. Prevalence and factors associated with condom use among Chinese monogamous female patients with sexually transmitted infection in Hong Kong [J]. J Sex Med. 2012;9:3009–17.View ArticlePubMedGoogle Scholar
- Higa DH, Crepaz H, Marshall KJ, Kay L, Vosburgh HW, Spikes P, et al. A systematic review to identify challenges of demonstrating efficacy of HIV behavioral interventions for gay, bisexual, and other men who have sex with men (MSM) [J]. AIDS Behav. 2013;17(4):1231–44.View ArticlePubMedGoogle Scholar
- Yan J, Xiao SY, Zhou L, Tang Y, Xu GM, Luo D, Yi QF. A social epidemiological study of HIV/AIDS in Henan Province, China [J]. AIDS Care. 2013;25(3):302–8.PubMedGoogle Scholar
- Herbst JH, Sherba RT, Crepaz N, DeLuca JB, Zohrabyan L, Stall RD, Lyles C. The HIV/AIDS prevention research synthesis team. A meta-analytic review of HIV behavioral interventions for reducing sexual risk behavior of men who have sex with men [J]. J Acquir Immune Defic Syndr. 2005;39(2):228–41.PubMedGoogle Scholar
- Dai YB, Zhang YJ, Phatarpekar P, Mi YJ, Zhang H, Blackburn MR, Xia Y. Adenosine signaling, priapism, and novel therapies [J]. J Sex Med. 2009;6(Suppl 3):292–301.View ArticlePubMedGoogle Scholar
- Safren SA, O’Cleirigh CM, Skeer M, Elsesser SA, Mayer KH. Project enhance: a randomized controlled trial of an individualized HIV prevention intervention for HIV-infected men who have sex with men conducted in a primary care setting [J]. Health Psychol. 2013;32(2):171–9.View ArticlePubMedGoogle Scholar
- Mausbach BT, Semple SJ, Strathdee SA, Jim Z, Thomas LP. Efficacy of a behavioral intervention for increasing safer sex behaviors in HIV-positive MSM methamphetamine users: results from the EDGE study [J]. Drug Alcohol Depend. 2006;87:249–57.View ArticlePubMedPubMed CentralGoogle Scholar
- Guo W, Pang L, Wu ZY. Prevention and control progress and main problems among Chinese men who have sex with men [J]. Chin J AIDS STD. 2008;14(3):341–16.Google Scholar
- The Healthy Living Project Team. Effects of a behavioral intervention to reduce risk of transmission among people living with HIV: the healthy living project randomized controlled study [J]. J Acquir Immune Defic Syndr. 2007;44:213–21.View ArticleGoogle Scholar
- Hayes R, Ayles H, Beyers N, Hoddinott G, Krishnaratne S, Mathema H, et al. HPTN 071 (PopART): rationale and design of a cluster-randomised trial of the population impact of an HIV combination prevention intervention including universal testing and treatment–a study protocol for a cluster randomised trial [J]. Trials. 2014;15(1):1.View ArticleGoogle Scholar
- Sullivan PS, Carballo-Diéguez A, Coates T, Goodreau SM, McGowan I, Sanders EJ, et al. Successes and challenges of HIV prevention in men who have sex with men [J]. Lancet. 2012;380(9839):388–99.View ArticlePubMedPubMed CentralGoogle Scholar
- Lyles CM, Kay LS, Crepaz N, Herbst JH, Passin WF, Kim AS, et al. Best-evidence interventions: findings from a systematic review of HIV behavioral interventions for US populations at high risk, 2000–2004 [J]. Am J Public Health. 2007;97(1):133–43.View ArticlePubMedPubMed CentralGoogle Scholar
- Coates TJ. An expanded behavioral paradigm for prevention and treatment of HIV-1 infection [J]. J Acquir Immune Defic Syndr. 2013;63:S179–82.View ArticlePubMedPubMed CentralGoogle Scholar
- Swendeman D, Rotheram-Borus MJ. Innovation in sexually transmitted disease and HIV prevention: internet and mobile phone delivery vehicles for global diffusion [J]. Curr Opin Psychiatry. 2010;23:139–44.View ArticlePubMedPubMed CentralGoogle Scholar
- Yan J, Ouyang DS. Cost analysis and nursing [J]. Chin J Nurs. 2004;39(5):365–7.Google Scholar
- Muessig KE, Pike EC, MSIS BF, LeGrand S, Parsons JT, Bull SS, et al. Putting prevention in their pockets: developing mobile phone-based HIV interventions for black men who have sex with men [J]. AIDS Patient Care STDs. 2013;27(4):211–22.View ArticlePubMedPubMed CentralGoogle Scholar
- Schmidt AJ, Hickson F, Weatherburn P, Marcus U. Comparison of the performance of STI screening services for gay and bisexual men across 40 European cities: results from the European MSM internet survey [J]. Sex Transm Infect. 2013;89(7):575–82.View ArticlePubMedGoogle Scholar
- Magnus M, Herwehe J, Andrews L, Gibson L, Daigrepont N, De Leon JM, et al. Evaluating health information technology: provider satisfaction with an HIV-specific, electronic clinical management and reporting system [J]. AIDS Patient Care STDs. 2009;23:85–91.View ArticlePubMedGoogle Scholar
- Gilbert P, Ciccarone D, Gansky SA, Bangsberg DR, Clanon K, McPhee SJ, et al. Interactive “video doctor” counseling reduces drug and sexual risk behaviors among HIV-positive patients in diverse outpatient settings [J]. Plos One. 2008;3(4):e1988.View ArticlePubMedPubMed CentralGoogle Scholar
- Mikolajczak J, Kok G, Hospers HJ. Queermasters: developing a theory- and evidence-based internet HIV-prevention intervention to promote HIV-testing among men who have sex with men (MSM) [J]. Appl Psychol. 2008;57(4):681–97.View ArticleGoogle Scholar
- Levine D, Woodmff AJ, Mocello AR, et al. inSPOT:the first online STD partner notification system using electronic postcards [J]. PLoS Med. 2008;5(10):e213.View ArticlePubMedPubMed CentralGoogle Scholar
- Zhao HX, Zhao R, Wu WQ. The progress of network investigation and network intervention in the sex healthy among men who have sex with men [J]. Chin J Fam Plann Gynecotokology. 2011;05:75–8.Google Scholar
- Liu GW, Lu HY, Wang J, et al. Evaluation of web-based HIV/AIDS interventions among men who have sex with men [J]. Chin J AIDS STD. 2012;09:578–80.Google Scholar
- Li XG, Gu XC, Jing J, et al. Study on intemet—based HIV intervention targeted on men who have sex with men [J]. Chin J AIDS STD. 2013;19(8):599–601.Google Scholar
- Zhong W, Xu HF, Cheng WB, et al. Easy TellTM: an innovative online sexual partner notification system based on internet and mobile phone [J]. Chin J AIDS STD. 2012;1:41–4.Google Scholar
- Duggan M. Cell phone activities 2013 [J]. Pew Research Center. Available at: http://www.pewinternet.org/2013/09/19/cell-phone-activities-2013/. Accessed 19 Sept 2013.
- CNNIC. The 35 time of statistic report of Chinese Internet network development state. Available at: http://www.cnnic.cn/gywm/xwzx/rdxw/2016/201608/W020160803204144417902.pdf. Accessed 3 Aug 2016.
- Kirby T, Dunwell MT. Phone apps could help promote sexual health in MSM. Lancet. 2014;384:1415.View ArticlePubMedGoogle Scholar
- Goldenberg Y, McDougal SJ, Sullivan PS, et al. Preferences for a mobile HIV prevention app for men who have sex with men. JMIR mHealth uHealth. 2014;2(4):e47.View ArticlePubMedPubMed CentralGoogle Scholar
- Aliabadi N, Carballo-Dieguez A, Bakken S, et al. Using the information-motivation-behavioral skills model to guide the development of an HIV prevention smartphone application for high-risk MSM [J]. AIDS Educ Prev Off Publ Int Soc AIDS Educ. 2015;27(6):522.View ArticleGoogle Scholar
- Yan J, Xiao SY, Zhou L, et al. Development of perceived stigma scale for children affected by HIV/AIDS [J]. Chin J Clin Psych. 2008;16(2):129–30.Google Scholar
- Zhou L, Zhang GB, Hu HX, Fan ZJ, Hao W. Perceived interpersonal pressure and drinking behavior in South China [J]. Drug Alcohol Depend. 2013;130:122–8.View ArticlePubMedGoogle Scholar
- NetApplications. Market share map: operating system [EB/OL]. http://www.netmarketshare.com/. Accessed 5 Aug 2016.
- NCSS PASS. NCSS statistical software. Available at: http://www.ncss.com/software/pass/.. Accessed 25 Feb 2016.
- Noar SM, Black HG, Pierce LB. Efficacy of computer technology-based HIV prevention interventions: a meta-analysis [J]. AIDS. 2009;23(1):107–15.View ArticlePubMedGoogle Scholar
- Vassilev I, Rowsell A, Pope C, et al. Assessing the implementability of telehealth interventions for self-management support: a realist review [J]. Implement Sci. 2015;10:59.View ArticlePubMedPubMed CentralGoogle Scholar
- Stephens J, Allen J. Mobile phone interventions to increase physical activity and reduce weight: a systematic review [J]. J Cardiovasc Nurs. 2013;28(4):320–9.View ArticlePubMedPubMed CentralGoogle Scholar
- Duncan M, Vandelanotte C, Kolt GS, et al. Effectiveness of a web-and mobile phone-based intervention to promote physical activity and healthy eating in middle-aged males: randomized controlled trial of the ManUp study [J]. J Med Internet Res. 2014;16(6):e136.View ArticlePubMedPubMed CentralGoogle Scholar