- Research article
- Open Access
“Validation of a cyberbullying questionnaire as a screening tool for other forms of intimate-partner violence towards young women”
BMC Public Health volume 21, Article number: 1639 (2021)
The use of electronic media is widespread among young people and is a potential tool for the perpetration of intimate-partner violence (IPV) towards women. The aim of this study is to validate two questions focused on harassment and control by electronic tools (HCE-2) as a screening tool for the detection of IPV in young women.
The data source was the third Community of Madrid IPV survey in 2014. The screening tool consisted of two questions with five possible answers prepared by a group of experts. As the gold standard we used the definition of intimate partner violence based on a 26- question survey. The validity indices (with 95% confidence intervals) were compared between two age groups: 18–24 and 25–29 years.
Six hundred ninty-four women were sampled. The response rate was 68.7%, and 477 surveys were analyzed. The prevalence of IPV was 10.7% (95% CI: 8.2–13.8). HCE-2 was positive in 5.9% (95% CI: 4.1–8.4). The overall efficiency of the test was 93.5% (95% CI: 91.1–96.7), sensitivity 47.1% (95% CI: 33.7–60.8), specificity 99.1% (95% CI: 97.5–99.6), and positive predictive value 85.7% (95% CI: 67.1–94.6). The best validity indices of the questionnaire were observed in women aged 18 to 24 years: overall efficiency of the test 95.1% (95% CI: 92.6–97.7), sensitivity 62.5% (95% CI: 44.5–77.6), specificity 99.6% (95% CI: 97.0–99.9), and positive predictive value 95.2% (95% CI: 71.7–99.4).
The existing need to improve the detection of IPV in young women and the good validity indices observed here justify the recommendation of the HCE-2 questionnaire as a screening tool in young women.
Gender-based violence is a social and health problem widely described in the literature and is recognized as a violation of basic human rights, with psychological and physical consequences for both the victim and their environment [1, 2]. Despite the social changes that have occurred in recent decades, this type of violence is still present in all stages of life, with intimate-partner violence (IPV) being the most common form and young women being the most frequently affected demographic group . According to the national survey in Spain (10,171 women survey), 26.4% of women have suffered psychological violence from their partner or ex-partner over the course of their lives, and 9.5% have experienced it in the last year, while in women aged 16 to 24 years, these percentages are 38.3 and 21.1%, respectively . In addition to suffering violence more often, young women seem to be more vulnerable to its consequences .
There are many ways this violence is perpetrated, classically grouped into psychological, physical, and sexual violence. In recent years, electronic media have gained prominence in interpersonal communications, especially in youths, constituting a new possible mechanism for perpetrating violence . The different types of violence are not exclusive; they often coexist, and a correlation has been observed with cyberbullying in dating partners [6,7,8].
The identification of cases of IPV is fundamental both for surveillance and for an early and adequate approach that minimizes its consequences and facilitates access to specific resources. The Spanish Organic Law 1/2004  adopts measures to optimize the early detection of gender-based violence in a healthcare setting, however the screening tools studied have poorer validity indices in the young population [4, 10], which reflects the need to adapt screening to different stages of life. The Ministry of Health considers it necessary to develop tools for measuring cyber-dating abuse as a form of IPV in young people , on this line, one of the measures included in the national strategy for eradicating violence against women is to study cyberbullying as a new form of gender violence among young people and young couples .
The objective of this study is to validate two questions on the perceptions of harassment and control by electronic tools (HCE-2) as a population screening tool for IPV in youths.
This was a validation study of a screening questionnaire on IPV towards women based on a cross-sectional population-based study.
Study population and data collection
The source of information was the third survey to study the magnitude, trend, and health impact of IPV towards women in the Community of Madrid, 2014 . The data were collected between December 2013 and February 2014. The sampling frame was the Individual Health Card database, which allows access to the health system to almost all of the population. The sample was stratified via proportional affiliation to the strata determined by the crossing of three geographical areas, age groups (four groups) and country of birth (born in Spain or outside Spain). The information was collected through a computer-assisted telephone interview.
This study included women in the sample aged 18 to 29 who reported having had a partner or contact with a former partner of the opposite gender in the last year.
Definition of IPV
Cases of violence were defined by a questionnaire of 26 questions selected from the ENVEFF questionnaire (Enquête national sur le violences envers les femmes en France) for the detection of psychological and sexual violence and the CTS-1 (Conflict Tactics Scales) questionnaire for the detection of physical violence. These questionnaires were used as references in this study. The Spanish version was validated in 2004 in women in the Community of Madrid through an in-depth interview conducted by two trained psychologists. They found that this questionnaire showed a sensitivity for the detection of IPV of 80.4% (79.3–81.6) and a specificity of 90.0% (88.9–91.0) . Only one relationship (the most recent) was considered per participant in the study.
Definition of cyberbullying
To explore the perception of harassment and control by electronic tools by the couple, the HCE-2 questionnaire was designed. It consisted of two questions developed ad hoc by a group of experts, shown in Table 1, with five possible responses on a Likert scale. Cyberbullying was considered to be present in women who scored greater than or equal to 1, with a positive response of “sometimes”, “often” or “constantly/always/systematically” to at least one of the two questions.
Age was stratified in two groups (18–24 and 25–29 years). The country of birth of the woman and her partner was either Spain or outside of Spain. Maximum level of schooling attained, employment status, type of relationship (partner or ex-partner), living with the partner or not, and whether or not they had children were also surveyed.
The population prevalence of IPV in the year before the survey, the prevalence of cyberbullying, and their 95% confidence intervals (95% CIs) were estimated. Several validity indices of the cyberbullying questionnaire for the detection of IPV were calculated: sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), positive odds ratio (POR), and negative (NOR), the overall efficiency of the test (percentage of cases correctly classified), and their 95% CIs. For the comparison of qualitative variables, the chi-squared test . For all tests, statistical significance was accepted at the 0.05 level. The analysis was performed with the statistical program STATA version 15 (StataCorp, College Station, Texas, USA 2017).
The survey protocol was approved by the Ethics Committee for Clinical Research at La Princesa University Hospital in Madrid. All participants gave their verbal consent to participate at the beginning of the survey.
The overall response rate of the survey was 60.5% (women 18–70 years), with the highest response rate among women 18–24 years (68.7%) . The HCE-2 questionnaire was open to all women, without a filtering question, and all 477 women included in the analysis responded to it.
The sociodemographic characteristics of the young women according to age group are presented in Table 2. Significant differences were found between women aged 18–24 and 25–29 years in schooling level, employment status, and whether they had children. Among the youngest age group, most were students (34.7%), while in the group aged 25 to 29 years, the majority of women were employed (65.1%).
Regarding intimate relationships, in most cases the relationship with the current partner (82.8%) was explored, and in the rest with a former partner. The women aged 18–24 years lived with their partners less often than older women (19.4% vs. 63.2%), and young women had children less often than older women (10.5% vs. 25.8%).
The distribution of the responses to the harassment and control questions and their prevalence are shown in Table 3. In the sample, 51 cases of IPV were detected (prevalence 10.7%). The prevalence was higher among the youngest age group (11.9%; 95% CI: 8.6–16.4) than the older (9.1%; 95% CI: 5.-13.8), but this was not statistically significant.
The HCE-2 questionnaire was positive in 5.9% of women (95% CI: 4.1–8.4), that means nearly 6% of young women perceive a situation of harassment or control by their partner through electronic tools. When examining the two questions independently, there was a higher rate of positive responses to the control question (5.5%) than to the harassment question (3.4%). Among those who reported harassment by their partner, most responded “Sometimes” (2.1%), followed by “Constantly or always” (0.8%). Women who reported being controlled by their partners also responded more frequently “Sometimes” (3.6%) followed in this case by “Often” (1.0%).
The prevalence of cyberbullying was twice as high in the younger women (18–24 years) as in women aged 25–29 years (7.8% vs. 3.3%). This difference was most notable on the harassment question, with positive response rate of 5.2% in the younger group and 1.0% in the older group.
Female victims of cyberbullying were also classified as victims of IPV in 85.7% of cases. This percentage was higher in the group aged 18–24 years (95.2%); of these, only one woman out of the 28 who scored positive for cyberbullying was not classified as a victim of IPV.
The validity indices for the sample as a whole and by age group are shown in Table 4. Among women aged 18–24 years, the sensitivity, or probability of correctly classifying a victim of IPV through the questionnaire, was 62.5% (95% CI: 44.5–77.6). The specificity, or probability of correctly classifying a non-IPV woman, was 99.6% (95% CI: 97.0–99.9). The questionnaire presented a PPV of 95.2% (95% CI: 71.7–99.4) and a NPV of 95.1% (95% CI: 91.6–97.2). There was 147.5 times higher probability (POR) of presenting a positive result in the questionnaire among women who suffered from IPV than among those who did not suffer violence. The overall efficiency of the test, or probability of correctly classifying a woman as a victim of IPV or not, was 95.1% (95% CI: 92.6–97.7).
Among women aged 25–29 years, poor validity indices were observed. The sensitivity and specificity were 21.1% (95% CI: 7.9–45.5) and 98.4% (95% CI: 95.2–99.5), respectively. A PPV of 57.1% (95% CI: 20.8–87.1) and a NPV of 92.6% (95% CI: 88.0–95.5) were observed. The POR was 13.3, and the overall efficiency of the test was 91.4% (95% CI: 87.6–95.2).
This study explores the validity of a two-question questionnaire, HCE-2, which surveys the perception of harassment and control by electronic tools, as a screening tool for the detection of cases of IPV in young women. In the analysis, good validity indices were obtained, and these indices were better in the group of women aged 18–24 years, in which an overall test efficiency of 95.1% and a PPV of 95.2% were observed.
Cyberbullying within relationships has been described as a type of digital practice in which the aggressor exercises domination over the victim through harassing strategies that affect her privacy and intimacy . This work addresses cyberbullying from a gender perspective. Most of the studies reviewed analyze cyberbullying in the context of violence in general, aimed at the detecting both victims and perpetrators of both genders. This fact make it difficult to compare our results with others.
The use of electronic tools to perpetrate different acts of violence is relatively new. Whether electronic media incite violence or are a mere new avenue for it has been discussed in previous publications, but there are still discrepancies. Electronic media have certain characteristics that differentiate them from other forms of violence: their immediacy, their lack of geographical boundaries, and the possibility of communicating online . Electronic media are also heterogeneously distributed, with the young population using them the most . INE (National Statistics Institute) data from 2012 (the latest before this study) indicate that 95.3% of young women are frequent users of electronic media .
Discrepancies are also observed in terms of terminology and classification. Some authors consider harassment and control by electronic tools an independent type of IPV, while others consider it a subtype of psychological violence . Although there is no agreement on this matter, there appears to be an association between harassment and control by electronic tools in the couple and IPV towards women, called offline IPV. A study conducted in the United States in university students between 18 and 25 years of age observed a significant correlation between cases of cyberbullying within the couple and psychological, physical, and sexual violence . Specifically, 95% of the participants who suffered psychological violence from their partner also suffered it by electronic tools, and conversely, those who suffered harassment by electronic tools were 28 times as likely to report psychological violence from a partner as those who did not suffer harassment. These figures support the results obtained in our study, where 95.2% of women aged 18 to 24 years who suffered cyberbullying also met the criteria of IPV. In other studies, our results are in line with others [8, 18,19,20] showing a strong association between harassment and control by electronic tools and psychological partner violence.
Violence by electronic media could hinder self-perception of violence, since among young people, control and harassment are often confused with attention and caring. This perception is fostered by the idea of romantic love , and in turn, the normalization of these behaviors favors the onset of violence . However, other studies have shown that the negative consequences of IPV are present even when women are not perceived as victims of IPV .
The questions developed for our study have obtained good validity indices for the detection of IPV, especially in the age group of 18–24 years. Regarding scoring for the two questions, the response “rarely” was initially considered a positive score, but after observing a decrease in the overall efficiency of the questionnaire, it was given the same scoring as “never”. Recently, the short version of the Woman Abuse Screening Tool (WAST) has been validated as an IPV screening tool, in which, despite obtaining very good results, the need for improvement in detection in young populations is expressed . The screening test validated in this study presents better validity indices (overall test efficiency, specificity, PPV, and POR) than WAST when applied to women aged 18 to 29 years. On the other hand, this test presents slightly lower sensitivity and NPV, although both values are considerably better in the group of younger women (18–24 years). The brevity of this test gives it an advantage over other tests geared towards young people [4, 18].
Among the limitations of this study is the nonresponse bias because it could be expected that the prevalence of IPV among women who did not want to participate in the interview would differ from the prevalence in the women who did respond. The data was collected in 2014 and the rapid change in the use of social media may be considered when interpreting these results. There may also be selection bias, as we included only women with an individual health card, though this would be minimal, since it is issued to almost 100% of the population. Added to these limitations is that we took as the gold standard a definition based on self-reported information, instead of a specialized clinical interview, and we collected information only on the most recent partner of each woman in the case that there was more than one partner in the year before the interview. The biggest strengths of the test are its brevity and simplicity, which facilitate its rapid implementation and positive acceptance by women (response rate of 100% in our sample). Since 2017, the two questions analyzed have been included in the Noncommunicable Disease Risk-Factor Surveillance System that annually monitors behavior in young people (SIVFRENT-J) in the Community of Madrid.
Due to the need to improve the detection of IPV in young women and the good results of this exploratory study, it is recommended to consider cyberbullying to screen for other forms of violence in women between 18 and 24 years of age. It will be necessary to carry out more studies to ensure that the results obtained here are reliable.
Availability of data and materials
The General Directorate of Public Health of the Community of Madrid Health Service is the owner of this data base. They conducted the survey with the objective of epidemiological surveillance and research. The research group is part of the organization and did not need additional permission to access and use this data for research purposes. External researchers can request access to the data through ‘Portal de Transparencia’ based on the Ley 10/2019 de Transparencia y de Participación of the Community of Madrid through the following link. https://www.comunidad.madrid/transparencia/derecho-acceso-informacion-publica.
Intimate partner violence
Harassment and control by electronic tools questionnaire
Positive predictive value
Negative predictive value
Positive odds ratio
Negative odds ratio
Sonego M, Pichiule M, Gandarillas A, Polo C, Ordobás M. Mental health in girls and boys exposed to intimate partner violence. Public Health. 2018;164:26–9. https://doi.org/10.1016/j.puhe.2018.07.003.
Pichiule Castaneda M, Gandarillas Grande AM, Diez-Ganan L, Sonego M, Ordobas Gavin MA. Young people dating violence surveillance in Madrid, Spain. Rev Esp Salud Publica. 2014;88(5):639–52. https://doi.org/10.4321/S1135-57272014000500008.
Ministerio de Sanidad, Servicios Sociales e Igualdad. Macroencuesta de Violencia contra la Mujer 2015. NIPO: 680-15-029-6. Madrid; 2015. http://www.violenciagenero.igualdad.mpr.gob.es/violenciaEnCifras/estudios/colecciones/pdf/Libro_22_Macroencuesta2015.pdf. Accessed 22 Nov 2019.
García-Carpintero MÁ, Rodríguez-Santero J, Porcel-Gálvez AM. Diseño y validación de la escala para la detección de violencia en el noviazgo en jóvenes en la Universidad de Sevilla. Gac Sanit. 2018;32(2):121–8. https://doi.org/10.1016/j.gaceta.2017.09.006.
Flach RMD, Deslandes SF. Cyber dating abuse in affective and sexual relationships: a literature review. Cad Saude Publica. 2017;33(7):e00138516. https://www.researchgate.net/publication/319057731_Cyber_dating_abuse_in_affective_and_sexual_relationships_a_literature_review.
Marganski A, Melander L. Intimate partner violence victimization in the cyber and real world: examining the extent of cyber aggression experiences and its association with in-person dating violence. J Interpers Violence. 2018;33(7):1071–95. https://doi.org/10.1177/0886260515614283.
Borrajo E, Gámez-Guadix M, Calvete E. Justification beliefs of violence, myths about love and cyber dating abuse. Psicothema. 2015;27(4):327–33. https://doi.org/10.7334/psicothema2015.59.
Hinduja S, Patchin JW. Electronic Dating Violence A Brief Guide for Educators and Parents. 2011. https://cyberbullying.org/electronic_dating_violence_fact_sheet.pdf. Accessed 17 Nov 2019.
Ley Orgánica 1/2004, de 28 de diciembre, de Medidas de Protección Integral Contra La Violencia de Género. (Boletín Oficial del Estado, número 313, de 29/12/2004). https://www.boe.es/eli/es/lo/2004/12/28/1/con. Accessed 22 Nov 2019.
Pichiule Castañeda M, Gandarillas Grande A, Pires Alcaide M, Lasheras Lozano L, Ordobás GM. Validación de la versión corta del Woman Abuse Screening Tool (WAST) en población general. Gac Sanit. 2019;34(6):595–600. https://doi.org/10.1016/j.gaceta.2019.04.006.
Torres C, Robles JM, De Marco S. El Ciberacoso Como Forma de Ejercer La Violencia de Género En La Juventud: Un Riesgo En La Sociedad de La Información y Del Conocimiento. Delegación Del Gobierno Para La Violencia de Género; Ministerio de Sanidad, Servicios Sociales e Igualdad. Delegación del Gobierno para la Violencia de Género; 2014. http://www.violenciagenero.igualdad.mpr.gob.es/violenciaEnCifras/estudios/colecciones/pdf/Libro_18_Ciberacoso.pdf.
Ministerio de Sanidad, Servicios Sociales e Igualdad. Estrategia Nacional Para La Erradicación de La Violencia Contra La Mujer (2013-2016). NIPO: 680-13-107-0. Madrid; 2013. https://violenciagenero.igualdad.gob.es/planActuacion/estrategiaNacional/docs/EstrategiaNacionalCastellano.pdf. Accessed 8 Jan 2020.
Pichiule M, Gandarillas A, Ordobás M, Sonego M, Zorrilla B, Pires M. Violencia de Pareja Hacia Las Mujeres: 3o Encuesta Para El Estudio de La Magnitud, Tendencia e Impacto En Salud En La Comunidad de Madrid, 2014. Consejería de Sanidad. Dirección General de Atención Primaria. Documento Técnico de Salud Pública No138. Madrid; 2014. http://www.informesdesalud.sanidadmadrid.org/docs/VPM_19112014_definitivo_2_.pdf.
Zorrilla B, Morant C, Polo C. Validación de un cuestionario para la violencia de pareja hacia las mujeres. Gac Sanit. 2005;19(1):53.
Kirkwood BR, Sterne JAC. Essential Medical Statistics.; 2003.
Instituto Nacional de Estadística. Encuesta sobre equipamiento y Uso de Tecnologías de Información y Comunicación de los Hogares, 2012. https://www.ine.es/dyngs/INEbase/es/categoria.htm?c=Estadistica_P&cid=1254735576692. Accessed November 22, 2019.
Peskin MF, Markham CM, Shegog R, Temple JR, Baumler ER, Addy RC, et al. Prevalence and correlates of the perpetration of cyber dating abuse among early adolescents. J Youth Adolesc. 2017;46(2):358–75. https://doi.org/10.1007/s10964-016-0568-1.
Borrajo E, Gámez-Guadix M, Pereda N, Calvete E. The development and validation of the cyber dating abuse questionnaire among young couples. Comput Human Behav. 2015;48:358–65. https://doi.org/10.1016/j.chb.2015.01.063.
Cutbush S, Williams J, Miller S, Gibbs D C-SM. Electronic dating aggression among middle school students: demographic correlates and associations with other types of violence. 2012.
Zweig JM, Dank M, Yahner J, Lachman P. The rate of cyber dating abuse among teens and how it relates to other forms of teen dating violence. J Youth Adolesc. 2013;42(7):1063–77. https://doi.org/10.1007/s10964-013-9922-8.
Sonego M, Gandarillas A, Zorrilla B, Lasheras L, Pires M, Anes A, et al. Unperceived intimate partner violence and women’s health. Gac Sanit. 2013;27(5):440–6. https://doi.org/10.1016/j.gaceta.2012.11.009.
To Dr. Vicente Pastor y Aldeguer for his comments on the preliminary documents that gave rise to this manuscript; to all the professionals who participated in the design of the survey; and to all the women who responded to the third survey.
The survey was conducted with funds from the General Directorate of Public Health. Funding from the Foundation for Research and Biosanitary Innovation of Primary Care of the Madrid Health Service was provided for translation and publication expenses.
Ethics approval and consent to participate
The study protocol of the survey was evaluated and approved by the Ethics Committee for Clinical Research at La Princesa University Hospital in Madrid. All participants included in the study gave their consent to participate in the study whose main objective was to know the magnitude and evolution of IPV. This analysis is framed under the initial objectives of the study, that is why no additional ethics approval were needed for this analysis. Furthermore, the database used for the analysis had been previously anonymized and. The highest level of confidentiality was maintained. National data protection legislation was followed (Ley Orgánica 15/1999 de Protección de Datos de Carácter Personal).
Consent for publication
The authors declare no conflicts of interest.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
García, L.H., Castañeda, M.P., Lozano, L.L. et al. “Validation of a cyberbullying questionnaire as a screening tool for other forms of intimate-partner violence towards young women”. BMC Public Health 21, 1639 (2021). https://doi.org/10.1186/s12889-021-11646-3
- Cyber-dating abuse
- Gender-based violence
- Intimate-partner violence
- Health surveys
- Validation study
- Mass screening
- Young adult