Skip to main content
  • Research article
  • Open access
  • Published:

Overlap of traditional bullying and cyberbullying and correlates of bullying among Taiwanese adolescents: a cross-sectional study

Abstract

Background

Due to the rapid development of information and communication technologies, cyberbullying has emerged as a threat to adolescents. This study aimed to investigate the prevalence and correlates among profiles of traditional bullying, cyberbullying, and combined bullying among Taiwanese high school students.

Methods

This cross-sectional study employed two-stage cluster sampling in Taipei City, Taiwan. In total, 2028 high school students completed an anonymous questionnaire between March and May 2018. Nominal logistic regression analysis was performed, adjusting for clustering, to examine the correlates of each type-role category of bullying.

Results

The prevalence rates of cyberbullying, traditional bullying, and combined bullying were 9.9, 13.3, and 9.4%, respectively, indicating that one-third of students were involved in one of these types of bullying; 48.7% of those involved in cyberbullying also experienced traditional bullying, and 41.5% of those involved in traditional bullying also experienced cyberbullying. In any type of bullying, not only being a victim but also being a bully/bully-victim was significantly associated with at least one mental health problem (serious psychological distress, self-harm, or suicidal ideation), except in the case of cyberbullying bullies/bully-victims. Internet abuse and alcohol use were more concentrated among bullies/bully-victims than victims for all types of bullying, and a similar trend was observed among types of schools and school climates, suggesting that specific behavioural circumstances or school backgrounds are associated with bullying perpetration.

Conclusions

Bullying is a prevalent and complex phenomenon among adolescents in Taiwan, where traditional bullying and cyberbullying frequently overlap and are likely to occur against specific backgrounds. These facts should be taken into account in future bullying prevention and support programmes in Taiwan.

Peer Review reports

Background

Bullying is a significant public health concern affecting the well-being of adolescents. Currently, as many as 246 million adolescents are estimated to suffer from school violence or bullying worldwide [1]. Bullying has a wide range of adverse health impacts for adolescents, such as depression [2], suicidal ideation, and suicidal behaviours [3].

With the rapid development and dissemination of information and communication technologies (ICTs), many adolescents use the internet and social networking services (SNSs) [4], which increases the opportunities for cyberbullying [5, 6]. Cyberbullying is defined as “bullying and harassment of others by means of new electronic technologies, primarily mobile phones and the internet” [7]. Compared with traditional bullying, cyberbullying has a unique nature with respect to publicity, anonymity, and the lack of supervision [8], which can lead to substantial psychological and psychiatric problems among victims [9, 10]. Furthermore, cyberbullying sometimes overlaps with traditional bullying and potentially leaves profound health impacts on victims. Previous studies have documented that adolescents exposed to two types of bullying are likely to suffer from higher levels of psychological distress than those involved in a single type of bullying [9, 11].

To date, most cyberbullying studies have been performed in Western societies and investigated cyberbullying’s prevalence [12, 13], its overlap with traditional bullying [9, 14,15,16,17,18,19], and the risk factors associated with it [13, 20, 21]. However, the results are inconsistent regarding the extent of overlap between cyberbullying and traditional bullying: some studies [9, 14, 15, 19] indicated wide-ranging overlap, while others [17, 18, 22] reported a more limited overlap. Although cyberbullying is a complex social phenomenon, few studies have attempted to understand its correlates from an ecological point of view [21, 23].

Bullying is an issue of interpersonal relationships. Since Western and Asian societies differ in the nature of interpersonal relationships, as represented by individualism and collectivism, respectively, it is possible that the nature of cyberbullying may also differ between these two societies. However, cyberbullying studies have only recently started to be conducted in Asian countries, such as China [24], Hong Kong [25], and South Korea [26], and most are concentrated within the last five years. In Taiwan, only one up-to-date study on the relationship between cyberbullying and traditional bullying was conducted, in 2010 [27].

Given this background and the explosive expansion of SNS use among Taiwanese adolescents in the last decade, this study aims to update the information on cyberbullying among high school students in Taiwan. It pays special attention to classifying bullying into traditional bullying, cyberbullying, or a combination of the two and comparing the correlate profiles from ecological points of view. These issues have never been explored in Asia, including Taiwan.

Methods

Study design, setting and participants

A cross-sectional study design was adopted. The target population consisted of high school students currently enrolled in grades 10 and 11 in Taipei City, Taiwan. Two-stage cluster sampling was performed. In the first stage, 30 high schools were randomly selected from a list of 67 high schools, and 22 schools (73.3%) decided to participate. Non-participation reasons were no responses and time constraints.

In the second stage, 2 classes were randomly selected from grades 10 and 11 of each school, and 3270 students were eligible to participate in this study. The number of attending participants between March and May in 2018 determined the sample size.

Data collection

An anonymous paper-based questionnaire was used for data collection. Because of the sensitivity of the research topic, the participants were asked to complete the anonymous paper-based questionnaire at home to protect their privacy and avoid peer pressure. The structured questionnaire included the following variables: (1) bullying: traditional bullying and cyberbullying; (2) individual factors: demographic factors, academic level, internet usage time, internet addiction, substance use, and psychological and psychiatric factors; (3) family factors: living situation, parental internet supervision, and number of days eating dinner with family per week; and (4) school/social factors: type of school, school climate, and perceived social support. In this study, traditional and cyberbullying were dependent variables, and the remaining variables were independent variables.

Measures

Survey instrument

The questionnaire in this study was developed based on the results of our prior qualitative study in 2016 [28] as well as a careful review of the international literature that included Taiwan [12, 27, 29,30,31,32,33,34,35,36] (the detailed questionnaire please see Additional file 1). We conducted two pilot studies (unpublished works) to improve the reliability and face validity of the questionnaire. The first phase pilot study was conducted in two high schools with 58 student participants recruited through convenience sampling in June 2017. Since some questions showed poor reliability and were found to be difficult to understand, we modified the questionnaire and tested it in the second phase of the pilot study with 89 students from two high schools recruited through convenience sampling from October to November 2017. This study showed that the test-retest reliability values (1-week interval) of the questionnaire measured by means of intraclass correlation coefficients (ICCs) were 0.48 and 0.75 for the victimisation and perpetration of traditional bullying, respectively, and 0.54 and 0.60 for the victimisation and perpetration of cyberbullying. In addition, other study variables showed Kappa coefficients between 0.51 and 1.00 for categorical variables and ICCs between 0.75 and 0.93 for continuous variables. These results demonstrated moderate to excellent reliability of the questionnaire [37, 38].

Traditional bullying

The revised Olweus Bully/Victim Questionnaire [29] was adopted to measure both victimisation and perpetration of traditional bullying. The participants were first asked how frequently they had experienced traditional victimisation in the previous 2 months. The following questions were included: “How often have other student(s) (1) called you mean names, made fun of you or teased you in a hurtful way; (2) excluded you from their group of friends or completely ignored you; (3) hit, kicked, pushed or shoved you; or (4) told lies or spread false rumours about you and tried to make others dislike you?” Then, the participants were asked how often they had perpetrated the above behaviours towards others. Each item was evaluated on a 5-point scale as follows: “hasn’t happened”, “once or twice”, “2–3 times a month”, “about once a week”, and “several times a week”. The participants who answered “once or twice” or more frequently to any of the items related to traditional victimisation were categorised as victims of traditional bullying. Similarly, the participants who answered “once or twice” or more frequently to any questions related to traditional bullying perpetration were categorised as bullies involved in traditional bullying. The participants who were simultaneously victims and bullies were categorised as bully-victims of traditional bullying. In this study, Cronbach’s alphas were 0.67 for victimisation and 0.71 for perpetration.

Cyberbullying

The questions related to cyberbullying were based on a previous study performed in Taiwan [27] and our qualitative study findings in 2016 [28]. The questionnaire included seven items related to cyberbullying victimisation and perpetration. The participants were asked how frequently they had experienced cyber victimisation in the previous 2 months: “How often has someone (1) made or posted rude comments to or about you online; (2) posted embarrassing pictures or videos of you online; (3) spread rumours about you online; (4) posted your personal information online; (5) insulted you publicly online; (6) made threatening comments to hurt you online; or (7) excluded or ignored you online on purpose?” Subsequently, they were asked how often they had perpetrated the above seven behaviours towards others. Each item was evaluated on a 5-point scale as follows: “hasn’t happened”, “once or twice”, “2–3 times a month”, “about once a week”, and “several times a week”. The participants who answered “once or twice” or more frequently to any questions related to cyber victimisation were categorised as victims of cyberbullying. Similarly, the participants who answered “once or twice” or more frequently to any questions related to cyberbullying perpetration were categorised as cyberbullies. The participants who were simultaneously victims and bullies were categorised as bully-victims involved in cyberbullying. Cronbach’s alphas were 0.70 for victimisation and 0.66 for perpetration.

Individual factors

Demographic factors

The participants were asked about their age and gender.

Academic level

To measure academic level, the participants were asked, “How do you rate your academic performance in class?” The responses included “the top few”, “above average”, “around average”, “below average”, and “I don’t know”. The responses were recoded into “above average” and “average or below average” for analysis.

Internet usage time

The participants were asked the following question: “On an average school day, how many hours do you play computer games or smartphone games or use a computer for something that is not school work? (Count time spent on devices such as an iPad or other tablet, a smartphone, texting apps, YouTube, Instagram, Facebook, LINE, WhatsApp, or other social media)” [30]. The responses included “0 hours per day”, “less than 1 hour per day”, “between 1 and 2 hours per day”, “between 2 and 3 hours per day”, “between 3 and 4 hours per day”, “between 4 and 5 hours per day”, and “more than 5 hours per day”. The responses were categorised as “less than 3 hours per day” or “3 hours or more per day” for the analysis.

Internet addiction

Young’s Internet Addiction Diagnostic Questionnaire [31] was adopted to measure internet addiction. This scale contains eight items answered with “Yes” or “No” responses. The responses were recorded as “no addiction” (0–2 items) or “addiction” (3–8 items). Kuder-Richardson formula 20 was 0.69 in this study.

Substance use (smoking and alcohol use)

The participants were asked the following questions: “During the past 30 days, on how many days did you smoke a cigarette?” [30] and “During the past 30 days, on how many days did you use alcohol?” The responses included “0 days”, “1 or 2 days”, “3 to 5 days”, “6 to 9 days”, “10 to 19 days”, “20 to 29 days”, and “All 30 days” [30]. The responses were recoded as “Yes” (other options) or “No” (0 days) for analysis.

Psychological and psychiatric factors—self-esteem, psychological distress, self-harm, and suicidal ideation

Self-esteem was assessed by the Rosenberg Self-Esteem Scale [32], which contains ten items that measure individuals’ self-esteem (Cronbach’s alpha was 0.87 in this study). The short version of the Kessler Psychological Distress Scale (six items) [33] was used to assess the psychological distress of the participants (Cronbach’s alpha was 0.82 in this study). To measure self-harm and suicidal ideation, the participants were asked the following questions: “Have you ever self-harmed in the past 30 days?” and “Have you ever seriously considered attempting suicide in the past 30 days?”

Family factors

Living situation

The participants were asked whether they lived with both parents. The responses included “Yes, living with both parents”, “No, living with a single parent”, or “No, living with others”.

Parental internet supervision

The participants were asked whether their parents or guardians supervised their internet use. The responses included “Yes” and “No”.

Dinner days with family

To examine how frequently they ate dinner with their parents, the participants were asked the following: “During an average week, how many days do you eat evening meals with your family (0 to 7 days)?” [34]. The responses were recorded as “0–4 times” or “5–7 times”.

School/social factors

Type of schools

The participants were recruited from academic high schools and vocational high schools.

School climate

The school climate was assessed using nine items from the California School Climate and Safety Survey (CSCSS) [12, 35, 39, 40]. Each item was evaluated on a 5-point Likert scale ranging from “strongly disagree” (1) to “strongly agree” (5). The total scores ranged from 9 to 45, with higher scores indicating a perception of a positive school climate. In this study, Cronbach’s alpha was 0.89.

Perceived social support

The Multidimensional Scale of Perceived Social Support (MSPSS) [36] was used in the current study. The MSPSS includes 12 items that measure perceived social support from family, friends, and a significant other. Each item was evaluated on a 7-point Likert scale ranging from “very strongly disagree” (1) to “very strongly agree” (7). The total scores were aggregated and then divided by 12. The scores ranged from 1 to 7, with higher scores indicating higher social support. Cronbach’s alpha was 0.91 in this study.

Data analyses

The data were statistically analysed using IBM SPSS Statistics software version 22 (PASW) for Windows (SPSS, Inc., Chicago, Illinois, USA). Univariate analysis was performed to examine the descriptive statistics (central tendency, dispersion, frequency distribution table, etc.) of all study variables.

Distribution of the participants by type of bullying and role in bullying

The participants were classified as bullies, victims, bully-victims, or uninvolved for cyberbullying and traditional bullying. Participants who had been involved in both types of bullying were grouped into the “combined bullying group”. The prevalence rates of cyberbullying, traditional bullying and their combination were assessed in this study.

Characteristics of participants by type of bullying and role in bullying

Since the characteristics of the bully-victims were much more similar to those of the bullies than those of the victims, bully-victims and bullies were collapsed into the category of “bullies/bully-victims”. The participants placed in the “involved group” represented students who had played any role in any type of bullying, as opposed to students who did not play any role in any type of bullying (uninvolved group). Bivariate analyses of the involved group and the uninvolved group were performed using the chi-square test.

Correlated profiles by the type of bullying and role in bullying

Multinomial logistic regressions were performed to examine the variables associated with bullying roles (with the uninvolved group as a reference). Considering the effects of clustering by schools and classrooms, univariate and multinomial logistic regressions were performed using the SPSS Complex Samples module to correct the estimates of standard errors and significance tests on the regression. In this study, missing values for each variable were less than 2%, and listwise deletion was performed to address missing data.

The analysis was performed in the following steps to build a model for multinomial logistic regression. First, univariate logistic regression was performed as a pre-selection strategy to test all variables. Variables associated with bullying (P level less than 0.2) were considered candidates for inclusion in multinomial logistic regressions [41]. In this step, age, self-esteem, academic level, living situation, parental internet supervision, and perceived social support were not significant at the 0.2 level.

Second, the first multinomial logistic regression was performed using all variables the identified by the first step. According to this model, the variables were examined for significance using the P-value (< 0.05) determine by Wald statistics [41]. Internet usage time (P = 0.265), smoking (P = 0.409), suicidal ideation (P = 0.086), and family dinner days (P = 0.165) were not significant at the 0.05 level. Considering that suicidal ideation is epidemiologically important [3, 42] to bullying, it was not eliminated from the final model.

Based on these selective strategies, gender, internet addiction, alcohol use, self-harm, suicidal ideation, types of school and school climate were included as independent variables in the final model. In addition, collinearity diagnostics were assessed among independent variables to take into account multicollinearity in the final model. The variance inflation factor (VIF) values were under two for all variables, indicating that multicollinearity was not a concern in the final model.

Results

Of the 3270 eligible students, 2111 participated in the survey (response rate = 64.5%). Of the 2111 returned questionnaires, we excluded invalid questionnaires based on the following criteria: (1) response bias: the participants completed the questionnaires by filling in the same answer repeatedly or filling in answers according to a pattern; (2) incomplete questionnaires; and (3) missing values for the outcome variables: participants submitted questionnaires with incomplete information for the traditional bullying and cyberbullying items. Finally, 2028 questionnaires were analysed in this study, with an effective response rate of 62.0%.

Prevalence and overlap of cyberbullying and traditional bullying

Overall, 32.6% (661/2028) of the participants reported they had been involved in bullying. The prevalence rates of cyberbullying and traditional bullying were 19.3% (392/2028) and 22.7% (460/2028), respectively. However, considering the overlap between the two types of bullying, the prevalence rates of cyberbullying, traditional bullying and combined bullying were 9.9% (201/2028), 13.3% (269/2028), and 9.4% (191/2028), respectively. In addition, 48.7% of the participants involved in cyberbullying had experienced traditional bullying, while 41.5% of those involved in traditional bullying had experienced cyberbullying.

Distribution of the participants by type of bullying and role in bullying

The distributions of cyberbullying, traditional bullying, and combined bullying by bullying roles are shown in Table 1. Of those who were involved in bullying, 40.7% were involved traditional bullying, followed by cyberbullying (30.4%) and combined bullying (28.9%). Regarding the role in bullying, victims represented the largest population (47.9%), followed by bully-victims (34.6%) and bullies (17.5%). A similar pattern was observed for cyberbullying and traditional bullying; however, it was most prominent in cyberbullying, in which 67.7% (136/201) of the sample were victims. Similarly, of the participants involved in traditional bullying, 45.4% (122/269) were victims, followed by bully-victims (29.7%) and bullies (24.9%).

Table 1 Role distribution by type of bullying

Characteristics of participants by type of bullying and role in bullying

Table 2 describes the characteristics of participants by type-role categories of bullying.

Table 2 Distribution of individual, familial and school/social factors by type-role categories of bullying

Individual factors

The age of the participants ranged from 14 to 20 years, with a mean age of 16.2 (SD 0.71). Gender distribution varied according to the type-role category of bullying: the roles of victims of cyberbullying and combined bullying were dominated by women (61.0 and 70.7%, respectively), while the roles of bullies/bully-victims of traditional bullying were dominated by men (68.7%). Self-reported academic level was not related to any type-role category of bullying.

The time of internet use was generally greater among the students involved in all type-role categories of bullying compared to that of students who were uninvolved in bullying. The proportion of students using the internet 3 hours or more a day was significantly higher in the involved group (48.9%) than in the uninvolved group (40.9%). A similar pattern was observed for internet addiction, albeit with greater proportions (64.6% in the involved group vs. 52.7% in the uninvolved group).

Smoking was generally low among students (4.2% overall). However, there was a clear pattern showing that the proportion of students who smoked was higher (approximately 10%) in the bully/bully-victim groups for all types of bullying, while the proportion among victims ranged from 0 to 3.3%, close to or even lower than that of the uninvolved group (3.0%). Alcohol use was much more prevalent (25.3% overall) than smoking but showed a similar pattern of concentration, being more prevalent in the bully/bully-victim groups than in the victim groups.

Mental health problems were generally more prevalent in the involved group than in the uninvolved group. The proportions of students who experienced low self-esteem (below 15 points), serious psychological distress (13 points or more), self-harm, and suicidal ideation were all significantly greater in the involved group than the uninvolved group (77.3% vs. 72.6%, 42.8% vs. 25.2%, 11.0% vs. 4.3%, and 11.6% vs. 4.7%, respectively). Students with low self-esteem were most prevalent among the group of victims of traditional bullying, and serious psychological distress, self-harm, and suicidal ideation were most prevalent among the groups of combined bullying, except for self-harm in the bully/bully-victim group. Students experiencing self-harm and suicidal ideation were least prevalent among the cyberbullying groups of.

Family factors

With regard to living situations and parental internet supervision, no significant difference was observed between the involved and uninvolved groups. However, the proportion of the students who had dinner with their family four times or less per week was generally greater among all type-role categories of bullying, with the difference between involved and uninvolved groups being statistically significant.

School/social factors

Irrespective of the type of bullying, the proportion of vocational high school students in the bully/bully-victim group was at least twice as large as that than in the victim group. On the other hand, negative school climate (32 points or less) was generally more prevalent in all type-role categories of bullying (35.4% overall) than in the uninvolved group (22.2%), with a particular concentration (approximately 45%) among subgroups of combined bullying. The number of students with a high level of social support (5.1 points or more) was lower in all type-role categories of bullying (52.0% overall) than in the uninvolved group (59.2%).

Correlate profiles by the type and role of bullying

Table 3 shows the results of the multinomial logistic regression analysis using the Complex Samples module of SPSS with the uninvolved group as a reference. From this analysis, being a victim of traditional bullying was found to be significantly associated with serious psychological distress (OR 1.74) and suicidal ideation (OR 2.34), suggesting that this type of bullying has a potent mental health impact on victims that may lead even to suicide. Being a bully/bully-victim of traditional bullying was also associated with psychological distress (OR 1.91) and self-harm (OR 4.01) as well as being male (OR 2.80), being addicted to the internet (OR 1.46), engaging in alcohol use (OR 1.88), being a vocational school student (OR 2.43), and having a negative school climate (OR 1.55) with statistical significance. Such findings suggested that students with such demographic and behavioural backgrounds and educational environments were more likely to be bullies/bully-victims of traditional bullying.

Table 3 Multivariate correlates by type-role category of bullying with uninvolved group as a reference

In cyberbullying, being a victim was significantly associated with alcohol use (OR 1.68) and serious psychological distress (OR 1.98) but not with suicidal ideation, while being a bully/bully-victim was significantly associated with alcohol use (OR 1.87) and negative school climate (OR 1.95).

In combined bullying, being a victim was significantly associated with internet addiction (OR 2.60) and negative school climate (OR 2.69) and strongly associated with self-harm (OR 3.55), whereas being a bully/bully-victim showed, like traditional bullying, a broad correlate profile associated with psychological distress (OR 2.08) and suicidal ideation (OR 2.43) as well as with being male (OR 1.79), experiencing internet addiction (OR 2.61), using alcohol (OR 2.90), being a vocational school student (OR 1.83), and experiencing a negative school climate (OR 2.58). These findings suggest that the background/environmental factors of bullies/bully-victims are similar to those of traditional bullying, but that students in this role category likely have more serious mental health situations than those in the traditional bullying category.

Discussion

This study provides updated information on the current situation of cyberbullying, traditional bullying, and their overlap (combined bullying) among Taiwanese high school students in Taipei. We compared the correlate profiles across the type-role categories of bullying from an ecological perspective for the first time in Asia, specifically Taiwan.

Prevalence of cyberbullying and traditional bullying

Our study revealed that 9.9, 13.3, and 9.4% of the participants were involved in cyberbullying, traditional bullying, and combined bullying, respectively; that is, nearly one-third of all participants were involved in bullying. Additionally, when overlap (combined bullying) was considered, 19.3 and 22.7% of the participants experienced cyberbullying and traditional bullying, respectively. These prevalence rates and their relative predominance are similar to the results of a meta-analysis of 80 papers published between 2007 and 2013 [43], which showed that the prevalence rates were approximately 15 and 35% for cyberbullying and traditional bullying, respectively, for both perpetration and victimisation. In more recent studies conducted in East Asia, the pattern of relative predominance of traditional bullying over cyberbullying has also been reported in studies in China [44] and South Korea [45]. A study from China demonstrated that the prevalence rates of victimisation were 43.0 and 23.0% for traditional bullying and cyberbullying, respectively [44]. Furthermore, a Korean study showed that the prevalence rates of victimisation were 18.1, 12.8 and 3.5% for relational, verbal and physical bullying, respectively, and 5.6% for cyberbullying [45].

However, our results were not consistent with a previous study in Taipei in 2010 among 10th-grade high school students. That study reported that cyberbullying was more prevalent than traditional bullying (35.4% vs. 23.8%), though the prevalence of traditional bullying was similar to our data [27]. This discrepancy may be attributed to the difference in the years when the studies were conducted (2010 vs. 2018), the time frame of reference with regard to bullying experience (1 year vs. 2 months), the difference in response rates (80% vs. 62.0%), the partial difference in the question items about cyberbullying, or the decline in cyberbullying over time. The last possibility was suggested by a recent study in China that reported a decline in both cyberbullying and traditional bullying from 2016 to 2017 [44].

Overlap between traditional bullying and cyberbullying

To date, only a few studies have reported the extent of overlap between cyberbullying and traditional bullying. Our study showed that 48.7% of the students involved in cyberbullying were also involved in traditional bullying, and 41.5% of those involved in traditional bullying were also involved in cyberbullying. Previous studies in Western societies have reported such an overlap to different extents. In the United States, among youth involved in cyberbullying, 36–56% experienced traditional bullying, depending on the role [18, 46]. Another study among high school students in the United States, albeit only among victims, showed that 59.7% of students involved in cyberbullying were also involved in traditional bullying, while 36.3% of students involved in traditional bullying were also involved in cyberbullying [9]. Other studies reported more pronounced overlap: over 80% of cyberbullied youth were also involved in traditional bullying in Norway and the United States [15, 19]. No information has been available about bullying overlap in East Asia to date, except for a study in Taiwan [27] that suggested the overlap only in the form of odds ratios. Possible reasons for the difference in the overlap rate may include socio-cultural differences in what people consider bullying. Whatever the reason, however, it is important to note that approximately half or more adolescents involved in bullying were involved in both types of bullying, which could lead to serious mental problems, as will be discussed later. The possibilities of such an overlap should be carefully examined when determining how to support adolescents involved in bullying.

Role distribution in bullying

Our study showed that role distribution differs by the type of bullying. Though the most common role in all types of bullying was the victim, followed by the bully-victim role and then the bully role, this pattern was most prominent in cyberbullying, where victims filled two-thirds of the roles. Our results related to cyberbullying are consistent with the findings of previous studies [17, 27], probably reflecting the fact that compared with traditional bullying, a limited number of perpetrators can harm many people simultaneously in cyberbullying [8, 47, 48]. Regarding the role in bullying, it is also important to note that among the students involved in cyberbullying or traditional bullying, approximately 20–30% are bully-victims; that is, they had experienced both being a bully and a victim. This may mean that bullying is a dynamic phenomenon in which the role of bullying and victims can change over time depending on changes in the relative balance of power, as previously suggested [49, 50].

Correlates of bullying

Though a direct comparison with previous studies is not possible because of the difference in the type and role classification of bullying, many of the major findings on the correlate profile of bullying are consistent with those of previous studies. For example, previous studies showed that traditional bullying victims were at high risk of suicidal ideation [51, 52], whereas cyberbullying victims were more likely to experience alcohol use [34] and psychological distress [53]. Regarding combined bullying victims, a region-wide study in the United States among high school students showed that they were at an enhanced risk of self-harm compared with victims of either traditional bullying or cyberbullying alone [9]. Their study also showed that victims of combined bullying were at an elevated risk of suicidal ideation and attempts, which was not identified in our study. Our study showed that bullies/bully-victims of traditional bullying were more likely to be involved in alcohol use and to have psychiatric problems. These findings may be related to a previous observation that adolescents who used alcohol [54] and had psychiatric problems [55] were more likely to be bullying perpetrators.

Notably, being a bully/bully-victim was associated with more specific background or environment in cases of traditional and combined bullying than in cyberbullying. Bullies/bully- victims in traditional and combined bullying were more likely to be male, have an internet addiction, drink, be students at a vocational school, and experience a negative school climate. An increased risk of vocational school students becoming bullies and bully-victims has also been reported in a previous study in Taiwan [56], suggesting that the peer environments of vocational schools may predispose students to bullying perpetration.

From these comparisons of correlate profiles between traditional and combined bullying, it can be suggested that bullying perpetration is more likely to occur among students who have behavioural problems and/or are in a specific school environment. Additionally, the similarities in these backgrounds between combined and traditional bullying suggest that combined bullying is more likely traditional bullying superimposed by cyberbullying rather than vice versa.

Regarding bullies and bully-victims of cyberbullying, several risk factors were identified in previous studies, including lower self-esteem [57, 58], internet addiction [59], depression [27, 58], suicidal ideation [60], and a low sense of belonging to school [25]. The numbers of bullies/bully-victims with internet addiction and a history of self-harm did not reach statistical significance, probably due to the limited sample size. In Taiwan, studies with larger sample sizes are clearly needed to obtain a clear correlate profile of bullies and bully-victims of cyberbullying.

Finally, it is important to note that both victims and bullies/bully-victims were strongly associated with mental or psychological problems. This suggests the importance of designing and developing prevention and support programmes addressing not only victims but also bullies and bully-victims to solve the problem of bullying among adolescents.

Our study has several limitations. First, its cross-sectional nature does not allow causal inferences or conclusions regarding the temporal sequence of the events to be drawn [61]. Second, since the response rate was only 62%, there could be selection bias between the students who participated and those who did not participate in the study. Third, as all data were self-reported by the students, social desirability bias and recall bias could not be avoided, though we made efforts to minimise them by making the questionnaire anonymous [62], allowing students to complete it at home to avoid peer pressure, and restricting the recall time frame to 2 months rather than 1 year. Fourth, and related to the response rate, the total sample size was not large enough to allow a sufficient sample size for subgroup analyses [17]. Fifth, although we developed a questionnaire based on our qualitative study and careful investigation of previous studies, our results were not directly comparable with those of other studies because of the difference in the items or time frame of questions on bullying. From these considerations, a standard questionnaire should be developed at least in the same country or within similar cultural settings. Additionally, a longitudinal study should be performed to make causal inferences and to clarify how bullying develops and overlaps over time with a large sample size that allows more precise subgroup analysis.

Conclusions

This study showed that bullying is prevalent among high school students to the extent that as many as one-third of all students participating in the study were involved in traditional bullying, cyberbullying, and combined bullying. Not only victims but also bullies/bully-victims were associated with serious mental and psychological problems. It also suggested that bullying perpetration in traditional and combined bullying is associated with specific behavioural backgrounds and school environment.

These results may inform public policy and future prevention or support programmes for bullying among Taiwanese adolescents. First, greater priority should be given to measures to address bullying since one-third of all students are involved in it. Second, support should be provided not only to victims but also to bullies/bully-victims since both are associated with serious mental or psychological problems. Third, it should be assumed that bullying is a complex phenomenon since almost half of the students who are involved in one type of bullying are also involved in another. Fourth, students’ behavioural background and school environment should be taken into account for effective prevention of bullying.

Availability of data and materials

The datasets generated and analysed during the current study are not publicly available because informed consent was not obtained for data sharing. Data are, however, available from the authors upon reasonable request.

Abbreviations

AOR:

Adjusted odds ratio

CI:

Confidence interval

ICCs:

Intraclass correlation coefficients

ICTs:

Information and communication technologies

SD:

Standard deviation

SNSs:

Social networking services

VIF:

Variance inflation factor

References

  1. United Nations Educational, Scientific and Cultural Organization (UNESCO). School Violence and Bullying: Global Status Report, 13 January 2017. http://unesdoc.unesco.org/images/0024/002469/246970e.pdf. Accessed 18 Apr 2017.

  2. Kaltiala-Heino R, Rimpelä M, Rantanen P, Rimpelä A. Bullying at school—an indicator of adolescents at risk for mental disorders. J Adolesc. 2000, 23(6):661–674. doi: 10.1006/jado.2000.0351.

    Article  CAS  Google Scholar 

  3. Holt MK, Vivolo-Kantor AM, Polanin JR, Holland KM, DeGue S, Matjasko JL, Wolfe M, Reid G. Bullying and suicidal ideation and behaviors: a meta-analysis. Pediatrics. 2015;135(2):e496–509. https://doi.org/10.1542/peds.2014-1864.

    Article  Google Scholar 

  4. Lenhart, A., Pew Research Center. (2015). Teens, Social Media & Technology Overview 2015. http://www.pewinternet.org/2015/04/09/teens-social-media-technology-2015/. Accessed 23 Apr 2018.

  5. Kessel Schneider S, O'Donnell L, Smith E. Trends in cyberbullying and school bullying victimization in a regional census of high school students, 2006–-2012. J Sch Health. 2015;85(9):611–20. https://doi.org/10.1111/josh.12290.

    Article  PubMed  Google Scholar 

  6. Livingstone S, Haddon L, Hasebrink U, Ólafsson K, O’Neill B, Smahel D, Staksrud E. EU Kids Online–Findings, methods, recommendations. LSE, London: EU Kids Online. http://lsedesignunit com/EUKidsOnline 2014. Accessed 10 Oct 2018.

  7. Smith PK, Steffgen G, Sittichai R. The nature of cyberbullying, and an international network. In: Smith PK, Steffgen G, editors. Cyberbullying through the new media: Findings from an international network. London: Psychology Press; 2013. p. 3–19.

    Chapter  Google Scholar 

  8. Patchin JW, Hinduja S. Bullies move beyond the schoolyard a preliminary look at cyberbullying. Youth Violence Juv Justice. 2006;4(2):148–69. https://doi.org/10.1177/1541204006286288.

    Article  Google Scholar 

  9. Schneider SK, O'donnell L, Stueve A, Coulter RW. Cyberbullying, school bullying, and psychological distress: A regional census of high school students. Am J Public Health. 2012;102(1):171–7. https://doi.org/10.2105/AJPH.2011.300308.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Sourander A, Klomek AB, Ikonen M, Lindroos J, Luntamo T, Koskelainen M, Ristkari T, Helenius H. Psychosocial risk factors associated with cyberbullying among adolescents: A population-based study. Arch Gen Psychiatry. 2010;67(7):720–8. https://doi.org/10.1001/archgenpsychiatry.2010.79.

    Article  PubMed  Google Scholar 

  11. Messias E, Kindrick K, Castro J. School bullying, cyberbullying, or both: correlates of teen suicidality in the 2011 CDC Youth Risk Behavior Survey. Compr Psychiatry. 2014;55(5):1063–8. https://doi.org/10.1016/j.comppsych.2014.02.005.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Williams KR, Guerra NG. Prevalence and predictors of internet bullying. J Adolesc Health. 2007;41(6):S14–21. https://doi.org/10.1016/j.jadohealth.2007.08.018.

    Article  PubMed  Google Scholar 

  13. Cappadocia MC, Craig WM, Pepler D. Cyberbullying: Prevalence, stability, and risk factors during adolescence. Can J Sch Psychol. 2013;28(2):171–92. https://doi.org/10.1177/0829573513491212.

    Article  Google Scholar 

  14. Smith PK, Mahdavi J, Carvalho M, Fisher S, Russell S, Tippett N. Cyberbullying: Its nature and impact in secondary school pupils. J Child Psychol Psychiatry. 2008;49(4):376–85. https://doi.org/10.1111/j.1469-7610.2007.01846.x.

    Article  PubMed  Google Scholar 

  15. Olweus D. Cyberbullying: An overrated phenomenon? Eur J Dev Psychol. 2012;9(5):520–38. https://doi.org/10.1080/17405629.2012.682358.

    Article  Google Scholar 

  16. Dehue F, Bolman C, Vollink T, Pouwelse M. Cyberbullying and traditional bullying in relation to adolescents’ perception of parenting. J Cyber Ther Rehabil. 2012;5(1):25–34.

    Google Scholar 

  17. Kubiszewski V, Fontaine R, Potard C, Auzoult L. Does cyberbullying overlap with school bullying when taking modality of involvement into account? Comput Human Behav. 2015;43:49–57. https://doi.org/10.1016/j.chb.2014.10.049.

    Article  Google Scholar 

  18. Ybarra ML, Diener-West M, Leaf PJ. Examining the overlap in Internet harassment and school bullying: Implications for school intervention. J Adolesc Health. 2007;41(6):S42–50. https://doi.org/10.1016/j.jadohealth.2007.09.004.

    Article  PubMed  Google Scholar 

  19. Raskauskas J, Stoltz AD. Involvement in traditional and electronic bullying among adolescents. Dev Psychol. 2007;43(3):564. https://doi.org/10.1037/0012-1649.43.3.564.

    Article  PubMed  Google Scholar 

  20. Mishna F, Khoury-Kassabri M, Gadalla T, Daciuk J. Risk factors for involvement in cyber bullying: Victims, bullies and bully–victims. Child Youth Serv Rev. 2012;34(1):63–70. https://doi.org/10.1016/j.childyouth.2011.08.032.

    Article  Google Scholar 

  21. Fanti KA, Demetriou AG, Hawa VV. A longitudinal study of cyberbullying: Examining risk and protective factors. Eur J Dev Psychol. 2012;9(2):168–81. https://doi.org/10.1080/17405629.2011.643169.

    Article  Google Scholar 

  22. Låftman SB, Modin B, Östberg V. Cyberbullying and subjective health: A large-scale study of students in Stockholm. Sweden. Child Youth Serv Rev. 2013;35(1):112–9. https://doi.org/10.1016/j.childyouth.2012.10.020.

    Article  Google Scholar 

  23. Papatraianou LH, Levine D, West D. Resilience in the face of cyberbullying: An ecological perspective on young people’s experiences of online adversity. Pastor Care Educ. 2014;32(4):264–83. https://doi.org/10.1080/02643944.2014.974661.

    Article  Google Scholar 

  24. Zhou Z, Tang H, Tian Y, Wei H, Zhang F, Morrison CM. Cyberbullying and its risk factors among Chinese high school students. Sch Psychol Int. 2013;34(6):630–47. https://doi.org/10.1177/0143034313479692.

    Article  Google Scholar 

  25. Wong DS, Chan HCO, Cheng CH. Cyberbullying perpetration and victimization among adolescents in Hong Kong. Child Youth Serv Rev. 2014;36:133–40. https://doi.org/10.1016/j.childyouth.2013.11.006.

    Article  Google Scholar 

  26. Lee C, Shin N. Prevalence of cyberbullying and predictors of cyberbullying perpetration among Korean adolescents. Comput Human Behav. 2017;68:352–8. https://doi.org/10.1016/j.chb.2016.11.047.

    Article  Google Scholar 

  27. Chang FC, Lee CM, Chiu CH, Hsi WY, Huang TF, Pan YC. Relationships among cyberbullying, school bullying, and mental health in Taiwanese adolescents. J Sch Health. 2013;83(6):454–62. https://doi.org/10.1111/josh.12050.

    Article  PubMed  Google Scholar 

  28. Wang C-W, Musumari PM, Techasrivichien T, Suguimoto SP, Chan C-C, Ono-Kihara M, Kihara M. Nakayama T: “I felt angry, but I couldn’t do anything about it”: a qualitative study of cyberbullying among Taiwanese high school students. BMC public health. 2019;19(1):654. https://doi.org/10.1186/s12889-019-7005-9.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Olweus D. The revised Olweus bully/victim questionnaire: University of Bergen, Research Center for Health Promotion; 1996.

  30. Center for Disease Control and Prevention. 2017 State and Local Youth Risk Behavior Survey Questionnaire. https://www.cdc.gov/healthyyouth/data/yrbs/pdf/2017/2017_yrbs_standard_hs_questionnaire.pdf. Accessed May 31 2017.

  31. Young KS. Internet addiction. A new clinical phenomenon and its consequences. Am Behav Sci. 2004;48(4):402–15. https://doi.org/10.1177/0002764204270278.

    Article  Google Scholar 

  32. Rosenberg M. Society and the adolescent self-image. 1965. https://doi.org/10.1515/9781400876136.

  33. Kessler RC, Barker PR, Colpe LJ, Epstein JF, Gfroerer JC, Hiripi E, Howes MJ, Normand S-LT, Manderscheid RW, Walters EE. Screening for serious mental illness in the general population. Arch Gen Psychiatry. 2003;60(2):184–9. https://doi.org/10.1001/archpsyc.60.2.184.

    Article  PubMed  Google Scholar 

  34. Elgar FJ, Napoletano A, Saul G, Dirks MA, Craig W, Poteat VP, Holt M, Koenig BW. Cyberbullying victimization and mental health in adolescents and the moderating role of family dinners. JAMA Pediatr. 2014;168(11):1015–22. https://doi.org/10.1001/jamapediatrics.2014.1223.

    Article  PubMed  Google Scholar 

  35. Furlong MJ, Greif JL, Bates MP, Whipple AD, Jimenez TC, Morrison R. Development of the California school climate and safety survey-short form. Psychol Sch. 2005;42(2):137–49. https://doi.org/10.1002/pits.20053.

    Article  Google Scholar 

  36. Zimet GD, Dahlem NW, Zimet SG, Farley GK. The multidimensional scale of perceived social support. J Pers Assess. 1988;52(1):30–41. https://doi.org/10.1207/s15327752jpa5201_2.

    Article  Google Scholar 

  37. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977:159–74. https://doi.org/10.2307/2529310.

    Article  CAS  Google Scholar 

  38. Cicchetti DV. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol Assess. 1994;6(4):284. https://doi.org/10.1037/1040-3590.6.4.284.

    Article  Google Scholar 

  39. Wei H-S, Williams JH, Chen J-K, Chang H-Y. The effects of individual characteristics, teacher practice, and school organizational factors on students' bullying: A multilevel analysis of public middle schools in Taiwan. Child Youth Serv Rev. 2010;32(1):137–43. https://doi.org/10.1016/j.childyouth.2009.08.004.

    Article  Google Scholar 

  40. Astor RA, Benbenishty R, Vinokur AD, Zeira A. Arab and Jewish elementary school students' perceptions of fear and school violence: Understanding the influence of school context. Br J Educ Psychol. 2006;76(1):91–118. https://doi.org/10.1348/000709905X37307.

    Article  PubMed  Google Scholar 

  41. Hosmer Jr DW, Lemeshow S, Sturdivant RX. Applied logistic regression. 3rd ed. Hoboken (N.J.):Wiley; 2013.

    Book  Google Scholar 

  42. Klomek AB, Marrocco F, Kleinman M, Schonfeld IS, Gould MS. Bullying, depression, and suicidality in adolescents. J Am Acad Child Adolesc Psychiatry. 2007;46(1):40–9. https://doi.org/10.1097/01.chi.0000242237.84925.18.

    Article  Google Scholar 

  43. Modecki KL, Minchin J, Harbaugh AG, Guerra NG, Runions KC. Bullying prevalence across contexts: A meta-analysis measuring cyber and traditional bullying. J Adolesc Health. 2014;55(5):602–11. https://doi.org/10.1016/j.jadohealth.2014.06.007.

    Article  PubMed  Google Scholar 

  44. Chu X-W, Fan C-Y, Liu Q-Q, Zhou Z-K. Stability and change of bullying roles in the traditional and virtual contexts: a three-wave longitudinal study in Chinese early adolescents. J Youth Adolesc. 2018:1–17. https://doi.org/10.1007/s10964-018-0908-4.

    Article  Google Scholar 

  45. Yun I, Kim S-G. Bullying among South Korean adolescents: prevalence and association with psychological adjustment. Violence Vict. 2016;31(1):167. https://doi.org/10.1891/0886-6708.VV-D-13-00138.

    Article  PubMed  Google Scholar 

  46. Ybarra ML, Mitchell KJ. Online aggressor/targets, aggressors, and targets: A comparison of associated youth characteristics. J Child Psychol Psychiatry. 2004;45(7):1308–16. https://doi.org/10.1111/j.1469-7610.2004.00328.x.

    Article  PubMed  Google Scholar 

  47. Ovejero A, Yubero S, Larrañaga E, Moral MdlV. Cyberbullying: Definitions and facts from a psychosocial perspective. In: Cyberbullying across the globe. edn. Edited by Navarro R, Yubero, Santiago, Larrañaga, Elisa. Switzerland: Springer; 2016: 1–-31.

    Google Scholar 

  48. Kowalski RM, Giumetti GW, Schroeder AN, Lattanner MR. Bullying in the digital age: A critical review and meta-analysis of cyberbullying research among youth. Psychol Bull. 2014;140(4):1073. https://doi.org/10.1037/a0035618.

    Article  PubMed  Google Scholar 

  49. Barker ED, Arseneault L, Brendgen M, Fontaine N, Maughan B. Joint development of bullying and victimization in adolescence: Relations to delinquency and self-harm. J Am Acad Child Adolesc Psychiatry. 2008;47(9):1030–8. https://doi.org/10.1097/CHI.ObO13e31817eec98.

    Article  PubMed  Google Scholar 

  50. Haltigan JD, Vaillancourt T. Joint trajectories of bullying and peer victimization across elementary and middle school and associations with symptoms of psychopathology. Dev Psychol. 2014;50(11):2426. https://doi.org/10.1037/a0038030.

    Article  PubMed  Google Scholar 

  51. Geoffroy M-C, Boivin M, Arseneault L, Turecki G, Vitaro F, Brendgen M, Renaud J, Séguin JR, Tremblay RE, Côté SM. Associations between peer victimization and suicidal ideation and suicide attempt during adolescence: results from a prospective population-based birth cohort. J Am Acad Child Adolesc Psychiatry. 2016;55(2):99–105. https://doi.org/10.1016/j.jaac.2015.11.010.

    Article  PubMed  Google Scholar 

  52. Sampasa-Kanyinga H, Roumeliotis P, Xu H. Associations between cyberbullying and school bullying victimization and suicidal ideation, plans and attempts among Canadian schoolchildren. PLoS One. 2014;9(7):e102145. https://doi.org/10.1371/journal.pone.0102145.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  53. Kim S, Kimber M, Boyle MH, Georgiades K. Sex Differences in the Association Between Cyberbullying Victimization and Mental Health, Substance Use, and Suicidal Ideation in Adolescents. Can J Psychiatry. 2018;0706743718777397. https://doi.org/10.1177/0706743718777397.

    Article  Google Scholar 

  54. Radliff KM, Wheaton JE, Robinson K, Morris J. Illuminating the relationship between bullying and substance use among middle and high school youth. Addict Behav. 2012;37(4):569–72. https://doi.org/10.1016/j.addbeh.2012.01.001.

    Article  PubMed  Google Scholar 

  55. Kumpulainen K, Räsänen E, Puura K. Psychiatric disorders and the use of mental health services among children involved in bullying. Aggress Behav. 2001;27(2):102–10. https://doi.org/10.1002/ab.3.

    Article  Google Scholar 

  56. Chen J-K, Avi AR. The perpetration of school violence in Taiwan: An analysis of gender, grade level and school type. Sch Psychol Int. 2009;30(6):568–84. https://doi.org/10.1177/0143034309107076.

    Article  Google Scholar 

  57. Patchin JW, Hinduja S. Cyberbullying and self-esteem*. J Sch Health. 2010;80(12):614–21. https://doi.org/10.1111/j.1746-1561.2010.00548.x.

    Article  PubMed  Google Scholar 

  58. Yang S-J, Stewart R, Kim J-M, Kim S-W, Shin I-S, Dewey ME, Maskey S, Yoon J-S. Differences in predictors of traditional and cyber-bullying: a 2-year longitudinal study in Korean school children. Eur Child Adolesc Psychiatry. 2013;22(5):309–18. https://doi.org/10.1007/s00787-012-0374-6.

    Article  PubMed  Google Scholar 

  59. Chang F-C, Chiu C-H, Miao N-F, Chen P-H, Lee C-M, Chiang J-T, Pan Y-C. The relationship between parental mediation and Internet addiction among adolescents, and the association with cyberbullying and depression. Compr Psychiatry. 2015;57:21–8. https://doi.org/10.1016/j.comppsych.2014.11.013.

    Article  PubMed  Google Scholar 

  60. Hinduja S, Patchin JW. Bullying, cyberbullying, and suicide. Arch Suicide Res. 2010;14(3):206–21. https://doi.org/10.1080/13811118.2010.494133.

    Article  PubMed  Google Scholar 

  61. Mann C. Observational research methods. Research design II: cohort, cross sectional, and case-control studies. Emerg Med J. 2003;20(1):54–60. https://doi.org/10.1136/emj.20.1.54.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  62. Joinson A. Social desirability, anonymity, and Internet-based questionnaires. Behav Res Methods Instrum Comput. 1999;31(3):433–8. https://doi.org/10.3758/BF03200723.

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgements

We appreciate the contribution and cooperation of all participants and school teachers in this study and the help from the Department of Education, Taipei City Government.

Funding

This study was supported by 2017 The Students Oversea Research Grant, Kyoto University. The funder had no role in study design, data collection and analysis, interpretation of data, or preparation of the manuscript.

Author information

Authors and Affiliations

Authors

Contributions

CW, MOK and MK conceived the study design. CW and CC carried out the study. CW and MK analysed the data. CW and PM drafted the manuscript, which was edited by TT, SS, YT, MK and TN. MOK and CC helped to supervise the entire process of the study. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Chia-Wen Wang.

Ethics declarations

Ethics approval and consent to participate

This study was approved by the Kyoto University Graduate School and Faculty of Medicine Ethics Committee (R1327–1) and the Research Ethics Committee of National Taiwan University Hospital (201601074RIND).

Prior to the survey, eligible students were asked to grant written informed consent and provide written informed consent from their parents/guardians to participate in the survey. All participants and their guardians received information about the study purpose, its strict confidentiality and the voluntary nature of their participation.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1.

Questionnaire. The questionnaire which was developed for this study.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, CW., Musumari, P.M., Techasrivichien, T. et al. Overlap of traditional bullying and cyberbullying and correlates of bullying among Taiwanese adolescents: a cross-sectional study. BMC Public Health 19, 1756 (2019). https://doi.org/10.1186/s12889-019-8116-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12889-019-8116-z

Keywords