Skip to main content
Download PDF

Validity and reliability of the Neilands sexual stigma scale among Kenyan gay, bisexual, and other men who have sex with men

BMC Public Health volume 22, Article number: 754 (2022) Cite this article

Abstract

Background

We evaluated the validity and reliability of the Neilands sexual stigma scale administered to 871 gay, bisexual, and other men who have sex with men (GBMSM) at two research locations in Kenya.

Methods

Using cross-validation, exploratory factor analysis (EFA) was performed on a randomly selected subset of participants and validated using confirmatory factor analysis (CFA) on the remaining participants. Associations of the initial and final stigma scale factors with depressive symptoms, alcohol use, and other substance use were examined for the entire dataset.

Results

EFA produced a two-factor scale of perceived and enacted stigma. The CFA model fit to the two-factor scale was improved after removing three cross-loaded items and adding correlated errors (chi-squared = 26.5, df 17, p = 0.07). Perceived stigma was associated with depressive symptoms (beta = 0.34, 95% CI 0.24, 0.45), alcohol use (beta = 0.14, 95% CI 0.03, 0.25) and other substance use (beta = 0.19, 95% CI 0.07, 0.31), while enacted stigma was associated with alcohol use (beta = 0.17, 95% CI 0.06, 0.27).

Conclusions

Our findings suggest enacted and perceived sexual stigma are distinct yet closely related constructs among GBMSM in Kenya and are associated with poor mental health and substance use.

Peer Review reports

Introduction

Gay, bisexual, and other men who have sex with men (GBMSM) experience stigma and discrimination in Kenya and other countries, especially where same-sex sexual behavior is criminalized [1, 2]. Chronic stress from experiences of sexual stigma contributes to mental and physical health disparities among GBMSM, and can be compounded, for some individuals, by intersecting stigmas such as those surrounding living with HIV or engaging in transactional sex [3,4,5,6,7,8,9,10,11]. While the World Health Organization (WHO) and Joint United Nations Progamme on HIV/AIDS (UNAIDS) recommend stigma reduction and anti-discrimination measures as part of a comprehensive HIV and STI prevention approach [12, 13], a better understanding of stigma surrounding same-sex sexual behavior in the Kenyan context is needed in order to develop effective, multi-pronged approaches.

Stigma is multi-dimensional and has been classified into perceived, enacted, and internalized forms [14]. Perceived stigma refers to expectations of negative opinions of one’s own group, along with fears of experiencing future discrimination. Enacted stigma includes direct encounters of violence or discrimination. Internalized stigma refers to the incorporation of discrediting social views into one’s own beliefs and opinions about oneself. Several instruments have been developed to assess each of these dimensions, such as Krieger’s Experiences of Discrimination and Mayfield’s Internalized Homonegativity Inventory [15, 16].

A 10-item scale evaluating perceived and enacted sexual stigma among men who have sex with men (referred to here as GBMSM to reflect the diversity of sexual orientation in this population [17]) was adapted by Neilands et al. [18] from a scale developed by Diaz et al. [19]. The Neilands sexual stigma scale has been used globally, including in South Africa and Kenya [20,21,22]. In coastal Kenya, higher Neilands sexual stigma scores were correlated with alcohol abuse, other substance abuse, and depressive symptoms [22].

The present study evaluated the reliability and validity of the Neilands sexual stigma scale adapted for use among GBMSM in Kenya. The specific aims were to describe the scale’s factorial structure and assess associations of this scale with self-reported levels of depressive symptoms, alcohol use, and substance use.

Methods

Study setting and participants

This secondary analysis used cross-sectional data from two research studies by members of the Kenya MSM Health Research Consortium, a collaboration focused on improving HIV prevention and care services for GBMSM in Kenya, and by Health Options for Young Men on HIV/AIDS and STIs (HOYMAS), the National AIDS and STI Control Programme (NASCOP), and Partners for Health and Development in Africa (PHDA).

Data from the Nairobi and coastal Kenya studies were pooled, as in previous research [23], to improve generalizability and to inform use of this scale in future research across multiple sites within Kenya. Mobility between locations is common, so care was taken to avoid duplicate enrollment.

Participants in both studies were at least 18 years of age. Researchers obtained written informed consent from all participants. This analysis was approved by the University of Washington Institutional Review Board.

Nairobi

Participants were recruited for a cross-sectional study on HIV vulnerability sponsored by the Canadian Institutes of Health Research, described previously [24]. This study grew out of a larger community-based research project, the South-to-South study, coordinated and supervised by HOYMAS community leaders with technical support from PHDA and the University of Manitoba. Recruitment took place at two health clinics providing services for GBMSM, one of which specifically targeted those who identified as sex workers, between January and May 2016. Men were eligible for participation if they were enrolled for services at either of the clinics and reported ever having had anal sex with a man. This study was the first evaluation of mental health and sexual stigma at these clinical sites using the measures described below.

Coastal Kenya

Participants were members of two ongoing cohort studies (one for HIV-positive and the other for HIV-negative adults at high risk for HIV transmission) based at the Kenya Medical Research Institute-Wellcome Trust Research Programme (KEMRI-WTRP) in Mtwapa [22, 25]. Recruitment was conducted at voluntary counseling and treatment centers adjacent to the research clinics or by peer recruiters at social venues such as night clubs, as described previously [26]. Sociodemographic data were collected at enrollment. Mental health data were collected at enrollment or at a follow-up visit from December 2015 through November 2017.

Men were eligible for the current analysis if they reported having had anal sex with a man in the past three months.

Measures

Neilands sexual stigma scale

The Neilands sexual stigma scale consists of ten items (for example, “How often have you heard that homosexuals are not normal?” and “How often have you been hit or beaten up because you have sex with men?”) with response choices of ‘Never,’ ‘Once or twice,’ ‘A few times,’ or ‘Many times.’ Neilands’ exploratory factor analysis found two factors, perceived and enacted stigma, with one item (Item 3, “How often have you been made fun of or called names for being homosexual?”) loading on both factors. This item was dropped from Neilands’ final model [18].

Changes to Neilands sexual stigma scale

The Neilands sexual stigma scale was adapted for use in the KEMRI-WTRP cohorts in preparation for a planned trial of an adherence support intervention for GBMSM living with HIV [27]. Based on feedback from translators and study staff, the tag ‘for being homosexual’ was changed to ‘because you have sex with men’ on each item since many participants did not identify as gay or homosexual. An additional item, ‘How often have you experienced police harassment because you have sex with men?’ was added due to criminalization of same-sex sexual behavior in Kenya and was a priori expected to load on the enacted stigma factor. The Cronbach’s alpha for this scale was 0.85 in a previous study among the KEMRI-WTRP cohorts, indicating good internal consistency between items [22].

Additional measures

Depressive symptoms were assessed using the Patient Health Questionnaire 9 (PHQ-9) depression module, which has been validated for use in Kiswahili in Kenya [28]. Responses were revised from the PHQ-9 standard ‘Not at all,’ ‘Several days,’ ‘More than half the days,’ and ‘Nearly every day’ to ‘Not at all,’ ‘A few days,’ ‘Several days,’ and ‘Nearly all the days’ based on translator feedback. Summed responses from the nine items ranged from 0 to 27 [29]. Previous studies of the KEMRI-WTRP cohorts found Cronbach’s alpha of 0.86 for the PHQ-9, indicating good internal consistency [22, 23].

Alcohol use was assessed using the Alcohol Use Disorder Identification Test (AUDIT). Each statement was rated on a five-point scale ranging from ‘Never’ to ‘Daily or almost daily.’ Summed responses for the 10 items ranged from 0 to 40 [30]. Previous studies of the KEMRI-WTRP cohorts found Cronbach’s alphas ranging from 0.87 to 0.88 for the AUDIT, indicating good internal consistency [22, 23].

Other substance use was evaluated using the Drug Abuse Screening Test 10 (DAST-10). Participants either agreed or disagreed with each statement, and summed responses ranged from 0 to 10 [31]. Commonly reported substances used included khat (an addictive stimulant typically chewed), marijuana, and pain medications [23]. A Cronbach’s alpha of 0.78 was found in the KEMRI-WTRP cohorts for the DAST-10, indicating acceptable internal consistency [22].

Translations

Questionnaires were translated from English to Kiswahili by two staff members, then back translated by two different staff members fluent in both languages. To ensure equivalence in meaning, a committee of researchers and translators held a harmonization meeting where discrepancies were resolved by consensus. At the Nairobi site, questionnaires were additionally translated and back translated by a community-based research team including GBMSM to ensure wording would be understood by study participants.

Data collection

The sexual stigma items and other measures were asked at both the Nairobi and coastal Kenya locations using audio computer-assisted self-interview (ACASI) in English or Kiswahili. After completing the ACASI, participants debriefed with a counselor and were provided referrals for mental health services as needed.

Data analysis

Descriptive statistics and Cronbach’s alphas were calculated for the summed Neilands sexual stigma scale score overall and separately for each site. Spearman’s rank-order correlation coefficients were calculated for correlations between the summed Neilands sexual stigma scores and the summed scores for the mental health and substance use variables (i.e., PHQ-9, AUDIT, DAST-10).

We divided participants into two groups using the random number generator, ensuring equal numbers from each site. For cross-validation, exploratory factor analysis (EFA) was performed on one subset of participants and validated using confirmatory factor analysis (CFA) on the remaining participants. Polychoric correlations were used as appropriate for ordinal Likert responses. We used oblique rotation for EFA and weighted least squares with adjustment for means and variances estimation for categorical variables (WLSMV) for CFA [32, 33].

EFA factors were assessed using scree plots and factor loadings. Following standard guidelines, we considered loadings of 0.40 or greater for to be significant. Items with significant loadings on multiple factors were considered cross-loaded. For differences between cross-loadings of 0.20 or more, we assigned the item to the factor where it loaded most strongly [34].

We used currently recommended model fit criteria to guide CFA model selection: root mean square error of approximation (lower is better), comparative-fit index (higher is better), standardized root mean squared residual (lower is better), and chi-square statistic (non-significance is better) [35]. We tested both a one-factor and a two-factor model using all 11 items. To determine if results would have differed by site, we also conducted CFAs for each site separately, using all 11 items. Finally, post-hoc alterations were made on the model using the CFA sample, in order to improve model fit and reduce misspecification, as unmodeled measurement error can produced unpredictably biased results [35, 36]. Fit statistics from all CFA models were compared.

Structural equation modeling was used to calculate associations between the factors in the final sexual stigma model and the summed scores for depressive symptoms, alcohol use, and other substance use using the complete dataset. We compared those associations to associations calculated using the initial 11-item model before post-hoc alterations were made.

Descriptive statistics were calculated using Stata version 14.2 (StatCorp, College Station, TX, USA), while factor analyses and associations were conducted using MPlus version 8.4 (Muthen & Muthen, Los Angeles, CA, USA).

Results

From the two locations, 880 participants completed the questionnaire. Nine who did not fully answer the stigma items were excluded, for a total of 871 participants (550 participants from Nairobi and 321 from coastal Kenya). Descriptive statistics are shown in Table 1, which presents characteristics overall, for the EFA and CFA samples, and for each site. Participants’ ages ranged from 18 to 64, with an average age of 27. Sixty-three percent (n = 548) had completed secondary school or had some higher education. Among participants, 54% (n = 466) reported engaging in transactional sex, and 30% (n = 258) were HIV positive. Cronbach’s alpha assessing internal consistency of the summed Neilands sexual stigma score was 0.86 overall, 0.88 in Nairobi, and 0.85 in coastal Kenya. The summed sexual stigma scale was weakly correlated with the mental health and substance use measures (PHQ-9, rs = 0.40; AUDIT, rs = 0.27, and DAST rs = 0.24).

Table 1 Descriptive statistics
Full size table

Exploratory factor analysis

The percent of respondents who reported experiencing each item are shown in Table 2. Among the 435 participants included in the EFA sample, the screeplot indicated a one- or two-factor solution, with an Eigenvalue of 1.1 for two factors (Fig. 1). Using two-factors, three items (1, 2, and 5) loaded on the perceived stigma factor and five items (4, 8, 9, 10, and 11), including the new item on police harassment, loaded on the enacted stigma factor (Table 3).

Table 2 Neilands sexual stigma scale items
Full size table
Table 3 Factor loadings for the Neilands sexual stigma scale, n = 435
Full size table
Fig. 1
figure 1

Exploratory factor analysis scree plot of the Neilands sexual stigma scale, n=435

Full size image

Three items (item 3, “How often have you been made fun of or called names because you have sex with men,” item 6, “How often has your family not accepted you because you have sex with men?” and item 7 “How often have you lost your friends because you have sex with men?”) had loadings of more than 0.40 on both factors. The difference between loadings was 0.20 or more for all three items (item 3 difference = 0.23, item 6 difference = 0.20, item 7 difference = 0.21, Table 3). All three loaded more strongly on the enacted stigma factor. The final hypothesized model is depicted in Fig. 2.

Fig. 2
figure 2

Hypothesized Neilands sexual stigma scale model

Full size image

Confirmatory factor analysis

A two-factor CFA was conducted using the random sample of 436 participants not included in the EFA. Items cross-loading on both factors were included on the enacted stigma factor, where they loaded most strongly. Fit statistics for the initial two-factor model indicated an acceptable fit for all measures except the chi-squared, which was significant at p < 0.01, indicating a poor fit.

A one-factor CFA conducted on the same sample indicated a similar fit to the two-factor model, while site-specific two-factor CFAs had similar fit to that of the two-factor CFA using the randomly selected CFA sample. Table 4 presents fit statistics for these models. Cronbach’s alpha for the CFA sample was 0.58 for the perceived factor, indicating questionable internal consistency, and 0.88 for the enacted factor, indicating good internal consistency.

Table 4 Model fit statistics for the Neilands sexual stigma scale
Full size table

Model re-specification

To improve model fit, we considered cross-loading and modification indices indicating high residual correlation to identify changes in the model. Item 3 cross-loaded on both factors, so was removed and the fit statistics re-run. This change produced a chi-squared of 136.7 (df 32), p < 0.01. The other two cross-loaded items (item 6 and item 7), which also had the highest modification indices, were subsequently removed to further improve model fit. After adding error correlation, the final 8- item model had a chi-squared value of 26.5 with 17 df, p = 0.07 and good fit on the other indices (Table 4, Fig. 3).

Fig. 3
figure 3

Final 8-item sexual stigma scale model with standardized loadings

Full size image

Construct validity associations

Eleven participants who did not answer one or more items on the PHQ-9, AUDIT, or DAST-10 were excluded from the construct validity analysis, leaving 860 participants. For the final 8-item model, perceived stigma was associated with PHQ-9 score (beta = 0.34, 95% CI 0.24, 0.45), alcohol use (beta = 0.14, 95% CI 0.03, 0.25), and other substance use (beta = 0.19, 95% CI 0.07, 0.31), while enacted stigma was associated with AUDIT score (beta = 0.17, 95% CI 0.06, 0.27) (Table 5). Using the initial 11-item model, perceived stigma was associated with PHQ-9 score (beta = 0.35, 95% CI 0.20, 0.51), and enacted stigma was associated with AUDIT score (beta = 0.21, 95% CI 0.07, 0.33).

Table 5 Association of the perceived and enacted factors of the Neilands sexual stigma scale with depressive symptoms (PHQ-9), alcohol use (AUDIT), and other substance use (DAST-10), comparing the final 8-item model and initial 11-item model, n = 860
Full size table

Discussion

These results provide validation of an adapted version of the Neilands sexual stigma scale with perceived and enacted stigma measures tailored for use with Kenyan GBMSM. Reliability, or internal consistency, of the summed sexual stigma scale was good both overall and at each research site. Exploratory analysis revealed a two-factor structure, while confirmatory analysis showed that using all items resulted in suboptimal model fit. Post-hoc analysis, in which three enacted stigma items which cross-loaded on both factors were removed and correlated errors added, produced a better fitting model. Construct validity analysis demonstrated associations between perceived stigma and PHQ-9, AUDIT, and DAST-10 scores, and between enacted stigma and AUDIT score, further supporting the validity of the scale.

Perceived stigma relates to one’s beliefs about others’ opinions. Items representing the perceived stigma factor asked about opinions held by others (i.e., item 1, “How often have you heard that homosexuals are not normal?”), one’s actions based on those opinions (i.e., item 5, “How often have you had to pretend that you are not homosexual in order to be accepted?”), and other’s reactions based on their opinions, (i.e., item 2, “How often have you felt that you hurt and embarrassed your family because you have sex with men?”). The perceived stigma factor, which contained only three items, had poor reliability. More items addressing community opinions about GBMSM and reactions to those opinions should be tested in order to increase the comprehensiveness of this factor. For example, Logie and Earnshaw [37] added two items to their perceived stigma scale for sexual minority women: “How often have you heard that lesbian, bisexual and queer women grow old alone?” and “How often have you felt you had to stop associating with your family because you are lesbian, queer or bisexual?” Adding items such as these to the Neilands sexual stigma scale may better represent the concept of perceived stigma among GBMSM as well, making this factor more stable and distinct from the enacted stigma factor.

Enacted stigma relates to actions of others. Items loading on this factor measured experiences of violence, discrimination, and loss of opportunity. Individuals endorsing these items may have a greater need for assistance and support. In coastal Kenya, 67% of GBMSM had experienced emotional, physical, or sexual abuse in the previous year, demonstrating the vulnerability of this population [21]. Disclosure of sexual orientation is particularly fraught and has been associated with blackmail and abuse in other rights-constrained African settings [11, 38]. While structural- and community-level interventions are needed to address stigma and discrimination [39, 40], individual-level interventions, such as learning about resilience from positive outliers, can help support GBMSM who have experienced enacted stigma [41].

In our analysis, three items loaded significantly on both the perceived and the enacted factors. These items, (3, 6, and 7) all represent perceptions of other’s actions and were dropped from our final model. Similarly, item 3 cross-loaded in Neilands’ initial factor analysis and was subsequently dropped [18]. Our changes to the model, including the addition of correlated error, resulted in a chi-squared test statistic indicating a good model fit. Using the chi-squared statistic to assess model fit has limitations, as the statistic is sensitive to sample size, and larger samples decrease the chi-squared p-value [35]. However, since poor model fit likely indicates misspecification, and misspecified models can be unpredictably biased, the conservative option is to adjust the model to improve chi-square fit [35].

Our analysis of construct validity looked at associations between each factor and both mental health and substance use outcomes, comparing the final 8-item model and the initial 11-item model. The enacted sexual stigma factor was associated with only alcohol use in both the initial and final model. This supports the conclusion that the enacted stigma factor is a good representation of its construct. However, the perceived stigma factor was less consistent. There was an association between perceived stigma and depressive symptoms using both models. For alcohol use and other substance use, the association point estimates (betas) were similar, but the associations were statistically significant in the final model only. This indicates that the perceived stigma factor is less stable, a conclusion also reached by Tucker et al., who found insufficient reliability in the perceived stigma scale [42].

This study had several limitations. First, while perceived and enacted sexual stigma were both measured, internalized sexual stigma was not. Internalized sexual stigma, or internalized homophobia, is a personalized endorsement of negative beliefs against GBMSM and has been associated with numerous negative mental health outcomes [43]. Not including this factor in the analysis may have overestimated the effects of the perceived and enacted stigma factors. Second, many participants experience additional stigmas from sources not measured here, such as HIV status or sex work, and stigmatizing experiences attributed by the participant to their other identities may underestimate the effects of sexual stigma [14]. Third, we did not measure “outness” in this study, and GBMSM who are more out to society may experience more enacted stigma compared to those who are not yet out. It is possible that outness could be considered as a potential confounder or modifier of the association between sexual stigma and health outcomes [44]. Fourth, participants were volunteers who were engaged in HIV care and prevention services targeting GBMSM, including those who sell sex, and are not representative of all GBMSM in Kenya. Finally, cross-sectional data were used, so the causal directionality of associations cannot be determined.

Despite these limitations, our study has several strengths. First, this is one of the few studies in sub-Saharan Africa to look at two types of sexual stigma, both perceived and enacted. Second, the study had a relatively large sample size that included a diverse population of GBMSM from Nairobi, the capital and largest city of Kenya, and from smaller communities in coastal Kenya north of Mombasa, Kenya’s second largest city. Third, collaboration fostered by the Kenya MSM Health Research Consortium (msmhealthresearch.org) allowed inclusion of the same item wording in cohort studies in two locations, allowing for a more comprehensive view of sexual stigma among GBMSM in Kenya.

Conclusions

Sexual stigma is commonly reported among GBMSM in Kenya, and can result in a substantial burden of physical, mental, and emotional abuse. Our exploratory factor analysis of the Neilands sexual stigma scale as modified for use in Kenya produced two factors: perceived and enacted sexual stigma. Confirmatory factor analysis corroborated two distinct factors, and three cross-loading items were dropped from the enacted factor to improve fit. Enacted and perceived stigma were associated with important measures of health: perceived stigma with depressive symptoms, alcohol use, and other substance use and enacted stigma with alcohol use. The enacted stigma factor showed more stability than the perceived factor when looking at associations using the initial and final model. Overall, the Neilands sexual stigma scale is a valid measure of sexual stigma among Kenyan GBMSM.

Availability of data and material

Data and data dictionary is available through public access on-line repository at https://dataverse.harvard.edu/dataverse/kwtrp.

Abbreviations

ACASI:

Audio computer-assisted self-interview

AUDIT:

Alcohol Use Disorder Identification Test

CFA:

Confirmatory factor analysis

CFI:

Comparative-fit index

DAST:

Drug Abuse Screening Test 10

EFA:

Exploratory factor analysis

GBMSM:

Gay, bisexual, and other men who have sex with men

HIV:

Human immunodeficiency virus

HOYMAS:

Health Options for Young Men on HIV/AIDS and STIs

KEMRI-WTRP:

Kenya Medical Research Institute-Wellcome Trust Research Programme

MSM:

Men who have sex with men

NASCOP:

National AIDS and STI Control Programme (Kenya)

PHDA:

Partners for Health and Development in Africa

PHQ-9:

Patient Health Questionnaire 9

RMSEA:

Root mean square error of approximation

SRMR:

Standardized root mean squared residual

UNAIDS:

Joint United Nations Progamme on HIV/AIDS

WHO:

World Health Organization

WLSMV:

Weighted least squares with adjustment for means and variances estimation for categorical variables

References

  1. Meyer IH. Prejudice, social stress, and mental health in lesbian, gay, and bisexual populations: conceptual issues and research evidence. Psychol Bull. 2003;129(5):674–97.

    Article  PubMed  PubMed Central  Google Scholar 

  2. International Lesbian, Gay, Bisexual, Trans and Intersex Association. State sponsored homophobia 2017: a world survey of sexual orientation laws: criminalisation, protection and recognition. Geneva: ILGA; 2017.

    Google Scholar 

  3. Pachankis JE. A transdiagnostic minority stress treatment approach for gay and bisexual men’s syndemic health conditions. Arch Sex Behav. 2015;44(7):1843–60.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Baral S, Sifakis F, Cleghorn F, Beyrer C. Elevated risk for HIV infection among men who have sex with men in low- and middle-income countries 2000–2006: a systematic review. PLoS Med. 2007 Dec;4(12). Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2100144/

  5. King M, Semlyen J, Tai SS, Killaspy H, Osborn D, Popelyuk D, et al. A systematic review of mental disorder, suicide, and deliberate self harm in lesbian, gay and bisexual people. BMC Psychiatry. 2008;18(8):70.

    Article  Google Scholar 

  6. McCabe SE, Bostwick WB, Hughes TL, West BT, Boyd CJ. The relationship between discrimination and substance use disorders among lesbian, gay, and bisexual adults in the United States. Am J Public Health. 2010;100(10):1946–52.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Human Rights Watch, PEMA-Kenya. The issue is violence: attacks on LGBT people on Kenya’s Coast. Mombasa: Human Rights Watch; 2015. Available from: https://www.hrw.org/report/2015/09/28/issue-violence/attackslgbt-people-kenyas-coast.

  8. Kenya Human Rights Commission. Nairobi: The Outlawed amongst Us; 2011. Available from: https://www.khrc.or.ke/mobile-publications/equality-and-anti-discrimination/70-the-outlawedamongst-us.html.

  9. Stahlman S, Grosso A, Ketende S, Sweitzer S, Mothopeng T, Taruberekera N, et al. Depression and social stigma among MSM in Lesotho: implications for HIV and sexually transmitted infection prevention. AIDS Behav. 2015;19(8):1460–9.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Schwartz SR, Nowak RG, Orazulike I, Keshinro B, Ake J, Kennedy S, et al. The immediate effect of the Same-Sex Marriage Prohibition Act on stigma, discrimination, and engagement on HIV prevention and treatment services in men who have sex with men in Nigeria: analysis of prospective data from the TRUST cohort. Lancet HIV. 2015;2(7):e299-306.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Zahn R, Grosso A, Scheibe A, Bekker L-G, Ketende S, Dausab F, et al. Human rights violations among men who have sex with men in Southern Africa: comparisons between legal contexts. PloS One. 2016;11(1):e0147156.

    Article  PubMed  PubMed Central  Google Scholar 

  12. WHO. Prevention and treatment of HIV and other sexually transmitted infections among men who have sex with men and transgender people. Geneva: World Health Organization; 2011 Jun [cited 2019 Jan 15]. Available from: https://www.who.int/hiv/pub/guidelines/msm_guidelines2011/en/

  13. UNAIDS. Global AIDS Update 2018. Geneva: Joint United Nations Programme on HIV/AIDS. 2018.

    Google Scholar 

  14. Meyer IH. Minority stress and mental health in gay men. J Health Soc Behav. 1995;36(1):38–56.

    Article  CAS  PubMed  Google Scholar 

  15. Krieger N, Smith K, Naishadham D, Hartman C, Barbeau EM. Experiences of discrimination: validity and reliability of a self-report measure for population health research on racism and health. Soc Sci Med 1982. 2005;61(7):1576–96.

    Google Scholar 

  16. Mayfield W. The development of an internalized homonegativity inventory for gay men. J Homosex. 2001;41(2):53–76.

    Article  CAS  PubMed  Google Scholar 

  17. Graham SM, Harper GW. Improving HIV prevention and care for African GBMSM. Lancet HIV. 2017;4(6):e234–6.

    Article  PubMed  Google Scholar 

  18. Neilands TB, Steward WT, Choi K-H. Assessment of stigma towards homosexuality in China: a study of men who have sex with men. Arch Sex Behav. 2008;37(5):838–44.

    Article  PubMed  Google Scholar 

  19. Díaz RM, Ayala G, Bein E, Henne J, Marin BV. The impact of homophobia, poverty, and racism on the mental health of gay and bisexual Latino men: findings from 3 US cities. Am J Public Health. 2001;91(6):927–32.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Chard AN, Finneran C, Sullivan PS, Stephenson R. Experiences of homophobia among gay and bisexual men: results from a cross-sectional study in seven countries. Cult Health Sex. 2015;17(10):1174–89.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Tucker A, Liht J, de Swardt G, Jobson G, Rebe K, McIntyre J, et al. An exploration into the role of depression and self-efficacy on township men who have sex with men’s ability to engage in safer sexual practices. AIDS Care. 2013;25(10):1227–35.

    Article  PubMed  Google Scholar 

  22. Secor AM, Wahome E, Micheni M, Rao D, Simoni JM, Sanders EJ, et al. Depression, substance abuse and stigma among men who have sex with men in coastal Kenya. AIDS Lond Engl. 2015;29(Suppl 3):S251-259.

    Article  Google Scholar 

  23. Korhonen C, Kimani M, Wahome E, Otieno F, Okall D, Bailey RC, et al. Depressive symptoms and problematic alcohol and other substance use in 1476 gay, bisexual, and other MSM at three research sites in Kenya. AIDS Lond Engl. 2018;32(11):1507–15.

    Article  Google Scholar 

  24. Doshi M, Macharia P, Mathenge J, Musyoki H, Amico KR, Battacharjee P, et al. Beyond biomedical and comorbidity approaches: exploring associations between affinity group membership, health and health seeking behaviour among MSM/MSW in Nairobi. Kenya Glob Public Health. 2020;15(7):968–84.

    Article  PubMed  Google Scholar 

  25. Sanders EJ, Okuku HS, Smith AD, Mwangome M, Wahome E, Fegan G, et al. High HIV-1 incidence, correlates of HIV-1 acquisition, and high viral loads following seroconversion among men who have sex with men in Coastal Kenya. AIDS Lond Engl. 2013;27(3):437–46.

    Article  Google Scholar 

  26. Sanders EJ, Graham SM, Okuku HS, van der Elst EM, Muhaari A, Davies A, et al. HIV-1 infection in high risk men who have sex with men in Mombasa. Kenya AIDS Lond Engl. 2007;21(18):2513–20.

    Article  Google Scholar 

  27. Graham SM, Micheni M, Kombo B, Van Der Elst EM, Mugo PM, Kivaya E, et al. Development and pilot testing of an intervention to promote care engagement and adherence among HIV-positive Kenyan MSM. AIDS Lond Engl. 2015;29(0 3):S241-9.

    Article  Google Scholar 

  28. Omoro SA, Fann JR, Weymuller EA, Macharia IM, Yueh B. Swahili translation and validation of the patient health questionnaire-9 depression scale in the Kenyan head and neck cancer patient population. Int J Psychiatry Med. 2006;36(3):367–81.

    Article  CAS  PubMed  Google Scholar 

  29. Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16(9):606–13.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  30. Saunders JB, Aasland OG, Babor TF, de la Fuente JR, Grant M. Development of the Alcohol Use Disorders Identification Test (AUDIT): WHO collaborative project on early detection of persons with harmful alcohol consumption–II. Addict Abingdon Engl. 1993;88(6):791–804.

    Article  CAS  Google Scholar 

  31. French MT, Roebuck MC, McGeary KA, Chitwood DD, McCoy CB. Using the drug abuse screening test (dast-10) to analyze health services utilization and cost for substance users in a community-based setting. Subst Use Misuse. 2001;36(6–7):927–43.

    Article  CAS  PubMed  Google Scholar 

  32. Kline RB. Principles and practice of structural equation modeling. 4th ed. New York: Guildford Press; 2016.

    Google Scholar 

  33. Brown TA. Confirmatory factor analysis for applied research, second edition. 2nd ed. New York: Guildord Press; 2015.

    Google Scholar 

  34. Comrey AL, Lee HB. A first course in factor analysis. Second ed. New York: Routledge; 2009.

  35. Klein R. Principles and practice of structural equation modeling. New York, NY: Guildford Press; 2016.

    Google Scholar 

  36. Rigdon EE. Demonstrating the effects of unmodeled random measurement error. Struct Equ Model Multidiscip J. 1994;1(4):375–80.

    Article  Google Scholar 

  37. Logie CH, Earnshaw V. Adapting and validating a scale to measure sexual stigma among lesbian, bisexual and queer women. PLoS One. 2015;10(2):e0116198.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Mason K, Ketende S, Peitzmeier S, Ceesay N, Logie C, Diouf D, et al. Stigma, human rights violations, health care access, and disclosure among men who have sex with men in the Gambia. J Hum Rights Pract. 2015;7(1):139–52.

    Article  Google Scholar 

  39. Roberts LL. Changing worldwide attitudes toward homosexuality: The influence of global and region-specific cultures, 1981–2012. Soc Sci Res. 2019;80:114–31.

    Article  PubMed  Google Scholar 

  40. Hatzenbuehler ML. Structural stigma: research evidence and implications for psychological science. Am Psychol. 2016;71(8):742–51.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Woodward EN, Banks RJ, Marks AK, Pantalone DW. Identifying resilience resources for HIV prevention among sexual minority men: a systematic review. AIDS Behav. 2017;21(10):2860–73.

    Article  PubMed  Google Scholar 

  42. Tucker A, Liht J, de Swardt G, Jobson G, Rebe K, McIntyre J, et al. Homophobic stigma, depression, self-efficacy and unprotected anal intercourse for peri-urban township men who have sex with men in Cape Town, South Africa: a cross-sectional association model. AIDS Care. 2014;26(7):882–9.

    Article  PubMed  Google Scholar 

  43. Newcomb ME, Mustanski B. Moderators of the relationship between internalized homophobia and risky sexual behavior in men who have sex with men: a meta-analysis. Arch Sex Behav. 2011;40(1):189–99.

    Article  PubMed  Google Scholar 

  44. Stahlman S, Bechtold K, Sweitzer S, Mothopeng T, Taruberekera N, Nkonyana J, et al. Sexual identity stigma and social support among men who have sex with men in Lesotho: a qualitative analysis. Reprod Health Matters. 2015;23(46):127–35.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

We thank the staff at the Sex Worker Outreach Programme (SWOP) and Health Options for Young Men on HIV/AIDS/STI (HOYMAS) in Nairobi and the KEMRI-Wellcome Trust Research Programme (KWTRP) in Mtwapa and Kilifi for their work on these studies. We also thank the study participants for their willingness to share their experiences in a research context.

Disclaimer

The views expressed in this publication are those of the authors only.

Funding

The KWTRP at the Centre for Geographical Medicine Research-Kilifi is supported by core funding from the Wellcome Trust (no. 203077/Z/16/Z) and infrastructure funding from the University of Washington (UW) Center for AIDS Research (AI027757). The South-to-South (S2S) study in Nairobi was supported through a grant from the Canadian Institutes of Health Research (CIHR operating grant no. HHP-131557). SMG and BPF are supported by the UW Developmental AIDS Research Center for Mental Health (P30 MH123248).

Author information

Authors and Affiliations

  1. Department of Epidemiology, University of Washington, Box 357236, Seattle, USA

    Christine J. Korhonen & Susan M. Graham

  2. Department of Psychology, University of Washington, Box 351525, Seattle, WA, 98195, USA

    Brian P. Flaherty

  3. Kenya Medical Research Institute-Wellcome Trust Research Programme, Kilifi, Kenya

    Elizabeth Wahome, Eduard J. Sanders & Susan M. Graham

  4. Health Options for Young Men on HIV/AIDS and STIs, Nairobi, Kenya

    Pascal Macharia & John Mathenge

  5. National AIDS and STI Control Programme, Ministry of Health, Nairobi, Kenya

    Helgar Musyoki

  6. Partners for Health and Development in Africa, Nairobi, Kenya

    Parinita Battacharjee & Joshua Kimani

  7. University of Manitoba, Winnipeg, Canada

    Parinita Battacharjee, Joshua Kimani, Monika Doshi & Robert R. Lorway

  8. Saath, Connecticut, USA

    Monika Doshi

  9. University of Oxford, Oxford, UK

    Eduard J. Sanders

Authors
  1. Christine J. Korhonen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Brian P. Flaherty
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Elizabeth Wahome
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Pascal Macharia
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Helgar Musyoki
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Parinita Battacharjee
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Joshua Kimani
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Monika Doshi
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. John Mathenge
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Robert R. Lorway
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Eduard J. Sanders
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Susan M. Graham
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

EJS, EW, RRL, MD, PM, HM, PB, JK, JM and SMG designed the parent studies and oversaw data collection. SMG, CJK, and BPF designed the analysis. CJK conducted the analysis and wrote the first draft of the manuscript. SMG, BPF, ES, MD, CJK, and RRL contributed to the interpretation of the results. All authors reviewed subsequent versions of the manuscript and approved the final version for submission.

Corresponding author

Correspondence to Christine J. Korhonen.

Ethics declarations

Ethics approval and consent to participate

The parent studies that collected the information analyzed here obtained written informed consent from all participants. This analysis was approved by the University of Washington Institutional Review Board.

Consent for publication

The authors provide consent for publication.

Competing interests

The authors declare they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Korhonen, C.J., Flaherty, B.P., Wahome, E. et al. Validity and reliability of the Neilands sexual stigma scale among Kenyan gay, bisexual, and other men who have sex with men. BMC Public Health 22, 754 (2022). https://doi.org/10.1186/s12889-022-13066-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12889-022-13066-3

Keywords

BMC Public Health

ISSN: 1471-2458

Contact us