Quality and accuracy of gastric cancer related videos in social media videos platforms
BMC Public Health volume 22, Article number: 2025 (2022)
Gastric cancer is a major public health problem worldwide. Social media has affected public’s daily lives in ways no one ever thought possible. Both TikoTok and its Chinese version Douyin are the most popular short video posting platform. This study aimed to evaluate the quality, accuracy, and completeness of videos for gastric cancer on TikTok and Douyin.
The terms “gastric cancer” was searched on TikTok in both English and Japanese, and on Douyin in Chinese. The first 100 videos in three languages (website’s default setting) were checked. QUality Evaluation Scoring Tool (QUEST) and DISCERN as the instrument for assessing the quality of the information in each video. Content was analysed under six categories (aetiology, anatomy, symptoms, preventions, treatments, and prognosis). The educational value and completeness were evaluated with a checklist developed by the researchers.
A total of 78 videos in English, 63 in Japanese, and 99 in Chinese were analyzed. The types of sources were as follows: 6.4% in English, 4.8% in Japanese, and 57.6% in Chinese for health professionals; 93.6% in English, 95.2% in Japanese, and 3.0% in Chinese for private users; none in English and Japanese, but 39.4% in Chinese for other sources. In all, 20.5% in English, 17.5% in Japanese, and 93.9% in Chinese of videos had useful information about gastric cancer. Among the useful videos, the videos published in Chinese had the highest QUEST(p < 0.05) and DISCERN scores(p < 0.05), followed by those published in Japanese. Among the educational videos, prognosis in English (37.5%), symptoms in Japanese (54.5%), and prevention in Chinese (47.3%) were the most frequently covered topic.
TikTok in English and Japanese might not fully meet the gastric cancer information needs of public, but Douyin in Chinese was the opposite.
With more than 1 million new cases and 769,000 deaths worldwide, gastric cancer was the fifth most frequent cancer and fourth in cancer-related deaths in 2020 . The incidence of gastric cancer mortality was 37.5% in Japan  and 39.9% in the United States  compared with 48.6% in China .
Social media has affected the public’s daily lives in ways that no one ever thought possible. In July 2021, there were a reported 4.48 billion social media users, equating to more than 57 percent of the total global population . Social media platforms, constituting a powerful means of communication, are increasingly used for health information dissemination. TikTok is one of the most popular social media platforms with more than 1.1 billion monthly active users, 130 million of whom are in the United States . However, TikTok cannot be used in China because of internet censorship. Douyin, the Chinese version of TikTok, has averaged more than 600 million daily active users . Douyin is the most popular short video platform in mainland China. TikTok for global users and Douyin for Chinese users offer the same features and tools.
As the fastest-growing social media applications, their potential as educational tools for health-related content cannot be overlooked. Several studies document health-related topics that can be found on the sites, such as recovering from eating disorders , sex education  and cancer treatment [9, 10]. However, videos posted on social media are not peer‐reviewed and are commonly ranked according to popularity. Like other social media platforms, the spread of misinformation is a concern on TikTok . Misinformation can confuse the public about diseases and dissuade patients from pursuing treatment. A few studies document the spread of public health-related misinformation on the topics of COVID-19 , vaccines  and other diseases, such as prostate cancer . A recent study showed that misinformation regarding COVID-19 has undermined public health efforts to control the novel coronavirus .
To date, the characteristics of TikTok videos focusing on gastric cancer are unknown. Therefore, this study aims to assess the content, accuracy, and completeness of social media about gastric cancer on TikTok in multiple countries. We also want to share our thoughts on important future directions for managing social media for gastric cancer.
Materials and methods
We queried the TikTok and Douyin mobile application on August 17, 2021, to locate videos that included any information about gastric cancer. The keyword “gastric cancer” was searched on TikTok in both English and Japanese and on Douyin in Chinese to identify related video clips. The results were sorted according to the applications’ proprietary search algorithm. The first 100 most popular videos were gathered and analyzed. The languages were limited to English and Japanese in TikTok and Chinese in Doyin. Videos that were duplicated, had no sound and were not directly related to gastric cancer were excluded.
Each video was assessed for content quality by two independent gastroenterological surgeons. All coders had studied in Japan at least one year and had sufficient experience in the diagnosis and management of gastric cancer. Any disagreements were discussed until a consensus was reached. The videos were further categorized as useful or useless according to educational content. Useful definitions contained scientifically correct information such as etiology, anatomy, symptoms, prevention, treatment, or prognosis. Useless definitions only addressed personal experience or testimony without any scientific content.
We employed the Quality Evaluation Scoring Tool (QUEST) and DISCERN as the instruments for assessing the quality of the information in each video. The QUEST has been confirmed to be a valid, reliable appraisal tool for websites . It has a scoring matrix and range of possible total scores of 0–28 with a higher score indicating better quality. DISCERN has been one of the most widely adopted instruments for assessing the quality of health information . It consisted of 16 questions in total, with each question scored from 1 to 5 points. Questions were divided into three sections: reliability (questions 1–8), quality information about treatment options (questions 9–15), and overall score (question 16).
To date, there are no validated tools for assessing the video content of gastric cancer. We developed a completeness checklist for evaluating gastric cancer video quality as shown in Table 1. The six categories cover most aspects of gastric cancer from etiology and treatment to prognosis. We first applied the completeness score in our previous study about internet videos and colorectal cancer . The completeness score compared with that of a previous study that contained the same six categories, but the details were slightly different according to the different types of cancer.
Statistical analysis was performed with SPSS Version 23 software. Data were summarized as frequencies (n) and percentages (%) for categorical variables and means or medians (standard deviations or ranges) for continuous and ordinal variables, respectively. The one‐way ANOVA was used to compare the differences between the groups. A p value less than 0.05 was considered significant.
Video selection process
More than 100 videos were presented in the results using English and Chinese keywords. However, only 70 videos were presented in the search result after inputting the Japanese keywords. Finally, we retrieved a total of 270 videos in the three languages. Of the 270 videos screened, 240 videos met the inclusion criteria. The video selection and analysis process are shown in Fig. 1.
The characteristics of the included videos are shown in Table 2. The mean length of duration for the videos was 30 s (9–80 s) in English, 35 s (9–60 s) in Japanese and 51 s (9–405 s) in Chinese. The mean video age was 134 days (5 to 528 days) in English, 180 days (11 to 1079 days) in Japanese, and 101 days (1 to 727 days) in Chinese. A total of 93.6% of the videos were in English and 95.2% in Japanese; they were uploaded on TikTok by private users. However, only 3% of private Chinese users uploaded their videos. Health professionals contributed the most videos in Chinese, accounting for approximately 57.6%. Among the useful videos, the videos published in Chinese had the highest QUEST (p < 0.05) and DISCERN scores (p < 0.05), followed by those published in Japanese.
The 270 included videos were categorized as useful and useless according to educational content (Table 2). The percentage of videos containing useful information was 20.5% in English, 17.5% in Japanese, and 93.9% in Chinese. Many videos were amateur videos about personal experience/testimony (56.4% in English and 41.3% in Japanese).
Useful videos were analyzed based on the educational information they contained (Table 3). In all the categories, the most frequently covered topic was prognosis (37.5%) in English, symptoms (54.5%) in Japanese, and preventative measures (47.3%) in Chinese. Table 4 shows the information completeness scores. The videos published by the health professionals had the highest total QUEST (p < 0.05) and DISCERN (p < 0.05) scores in Chinese. Videos by health professionals were significantly more complete than those posted by private users in all languages.
The use of video broadcasting sites as a source of information about malignant tumors, such as colorectal cancer , thyroid cancer , larynx cancer  and skin cancer , has been evaluated. Many studies have reported that video broadcast sites have positive and negative effects on health information dissemination. Some videos can provide useful information for surgery education [22, 23]. Videos may also promote misleading information, such as promoting -anorexia as a healthy lifestyle  and describing ineffective or potentially dangerous natural therapies for gallstone disease . Not only were audience members attempting therapies that might be harmful, but they were not going in for proven therapies, which could lead to other complications.
TikTok, known in China as Douyin (literally “shaking sound” in Chinese), is a video-sharing platform and social networking service. TikTok and Douyin have almost the same user interface but no access to each other’s content. Since its launch in 2016, TikTok/Douyin has rapidly gained popularity worldwide.
There are huge differences in the global distribution of morbidity and mortality associated with gastric cancer. Half of the incidence of gastric cancer has been reported in East Asian countries, especially in Japan and China. The mortality from gastric cancer in Japan and China 'ranks first among all cancers. Japan’s is leading the way in the prevention, diagnosis and treatment of gastric cancer worldwide, which is considered a good example for Chinese doctors to follow. There are some differences in gastric cancer between the two countries. The 5-year survival of gastric cancer in China is low because more than 80% of patients are diagnosed at an advanced stage . However, due to the national program for gastric cancer screening, the rate of diagnosis and treatment of early gastric cancer in Japan is 70% . In this study, we also want to explore the difference between the contents in the two countries. The Japanese and Chinese keywords were searched in the video platforms.
Private users represent the greatest number of sources in English and Japanese. The contents were mainly about personal experiences regarding surgical procedures or hospital stays. Content concerning self-motivation or supportive families was found in some English and Japanese videos but not in Chinese videos. Patients in these developed countries were more optimistic than those in China. The Chinese videos uploaded by private users accounted for only 3%. Chinese cancer patients have a higher risk of anxiety and depression with cancer . More than half of the patients in China did not know their exact diagnosis before chemotherapy . In China, when disclosing a life-threatening diagnosis such as cancer to a patient, the “family consent for disclosure” approach is adopted by physicians . Our results also show that English-speaking and Japanese doctors contribute fewer videos to the platforms. Some studies reported the use of other video-based platforms (e.g., Vimeo and YouTube) for medical education [31, 32]. Doctors in the United States and Japan may use such social media platforms to disseminate health information [33, 34]. They frequently experience intense and stressful work [35, 36] and tend to experience burnout, which may be the other reason for the result. Health professionals contributed the most videos in Chinese. Chinese patients prefer specialist hospitals and large hospitals, as measured by the number of beds and surgeries . With the increasing popularity of Web 2.0 technologies, people are seeking health information online more frequently. Both the effort and reputation of physicians online contribute to the increased number of patient consultations . To attract more patients, Chinese doctors are focusing on social media to extend their influence.
When video content was analyzed, the most popular video topics were prognoses in English, symptoms in Japanese, and preventative measures in Chinese. This may indicate that prognosis was the most important aspect for most English-speaking uploaders. The incidence of gastric cancer is steadily declining in Europe and the United States, and the overall five-year survival rate is 31% . Most uploaders were private users who were more concerned about the prognosis. The aspect of symptoms is the most covered topic among Japanese individuals, which may be related to early cancer screening and the popularization of disease knowledge among the public in Japan. China has a great burden of gastric cancer, and the diagnosis rate of early-stage disease is relatively low. Awareness of the disease is essential for screening and early detection. The aspect of gastric cancer prevention has garnered increasing attention recently in China.
The average scores for completeness in our study were not high. Most of the analyzed videos only included one or two categories. It has been reported that videos with longer durations and higher video power indices seem to be associated with higher quality scores [19, 40]. Videos on TikTok are limited to 3 min. Due to the short length of videos, it is impossible to expect each video to comprehensively cover all aspects of gastric cancer; therefore, individuals will view videos that do not contain important and valuable content. However, recent research suggests that TikTok has great potential in conveying important public health messages to various segments of the population. Some videos can provide useful resources for information dissemination for chronic disease management  and personal protection . Our results indicated that videos from health professionals have significantly higher completeness scores than those posted by private users. Studies on other video platforms, such as YouTube, also showed that the overall quality of the cancer videos was poor . Health care professionals should be encouraged to upload cancer-related videos with accurate information to encourage patients to screen and direct them appropriately [43, 44]. Patients are increasingly turning to social media for health information, where most TikTok videos are posted by laypeople. The study illustrates that professionals should contribute more high-quality videos and leverage the power of this social media channel as a public information source.
There are limitations to our study. First, We only use QUEST and DISCERN to assess the quality of included videos. However, we encourage more studies using a variety of instruments to triangulate the validity of these findings in the future. Second we only used “gastric cancer” without including “stomach cancer” or “stomach neoplasm” to search videos on TikTok which may led miss some appropriate videos. Third, we only selected TikTok to analyze gastric cancer videos, given that it is reported as the most popular social media app. There are other platforms such as YouTube and Vimeo, etc. And content in other platforms may show different results and conclusions. Fourth, This study only comprises a snapshot of information when the study data were collected and may change due to new videos being uploaded or removed with time.
Despite these limitations and delimitations, this study is one of the first to describe how TikTok is being used to disseminate information about gastric cancer. TikTok has great potential in conveying important health messages to public due to its widespread reach, but its limitations are also obvious, including too short videos containing not enough information, issues with unchecked spread of misinformation, difficulty identifying source credibility. TikTok in English and Japanese might not fully meet the gastric cancer information needs of public, but Douyin in Chinese was the opposite. Patients should remain cautious and selective when watching gastric cancer videos on TikTok. If patients want to seek useful information, it is better to seek videos uploaded by health professionals. It is necessary that healthcare professionals and academic institutions apply the characteristics of highly viewed video and think useful methods to solve the variable quality of information uploaded on TikTok. Content creators should be encouraged to direct public to evidence-based resources from health professionals and institutions. To maximize the potential of video-based information and minimize the quantity misleading or unhelpful information, multilateral efforts between healthcare professors, governments and social media platforms are needed.
Availability of data and materials
The datasets used and/or analysed during the current study available from the corresponding author on reasonable request.
Sung H, Ferlay J, Siegel RL, et al. Global Cancer Statistics 2020: GLOBOCAN Estimates of Incidence and Mortality Worldwide for 36 Cancers in 185 Countries. CA Cancer J Clin. 2021;71:209–49.
Research FfPoC. CANCER STATISTICS IN JAPAN 2021. Foundation for Promotion of Cancer Research 2021. https://ganjoho.jp/public/qa_links/report/statistics/2021_en.html. Accessed 2021–10–12 2021.
Siegel RL, Miller KD, Jemal A. Cancer statistics, 2020. CA Cancer J Clin. 2020;70:7–30.
Cao W, Chen HD, Yu YW, et al. Changing profiles of cancer burden worldwide and in China: a secondary analysis of the global cancer statistics 2020. Chin Med J (Engl). 2021;134:783–91.
TikTok Statistics – Updated June 2021. https://wallaroomedia.com/blog/social-media/tiktok-statistics/. Accessed 24 Sept 2021.
Douyin averages more than 600 million daily active users in Q1. 2021. https://cntechpost.com/2021/03/29/douyin-averages-more-than-600-million-daily-active-users-in-q1/. Accessed 2021–10–3 CnTechPost.
Herrick SSC, Hallward L, Duncan LR. “This is just how I cope”: An inductive thematic analysis of eating disorder recovery content created and shared on TikTok using #EDrecovery. Int J Eat Disord. 2021;54:516–26.
Fowler LR, Schoen L, Smith HS, et al. Sex Education on TikTok: A Content Analysis of Themes. Health Promot Pract 2021:15248399211031536.
Xue X, Yang X, Xu W, et al. TikTok as an Information Hodgepodge: Evaluation of the Quality and Reliability of Genitourinary Cancers Related Content. Front Oncol. 2022;12: 789956.
De La Garza H, Maymone MBC, Vashi NA. Impact of Social Media on Skin Cancer Prevention. Int J Environ Res Public Health 2021;18.
Marquez A. TikTok to warn users about sharing misleading content. nbcnews; 2021. https://www.nbcnews.com/tech/tech-news/tiktok-warn-users-about-sharing-misleading-content-n1256668. Accessed 30 July 2022.
Basch CH, Meleo-Erwin Z, Fera J, et al. A global pandemic in the time of viral memes: COVID-19 vaccine misinformation and disinformation on TikTok. Hum Vaccin Immunother. 2021;17:2373–7.
Xu AJ, Taylor J, Gao T, et al. TikTok and prostate cancer: misinformation and quality of information using validated questionnaires. BJU Int. 2021;128:435–7.
WS Chou A Gaysynsky RC Vanderpool 2021 The COVID-19 Misinfodemic: Moving Beyond Fact-Checking Health EducBehav 48 1 9 13
Robillard JM, Jun JH, Lai JA, et al. The QUEST for quality online health information: validation of a short quantitative tool. BMC Med Inform Decis Mak. 2018;18:87.
Charnock D, Shepperd S, Needham G, et al. DISCERN: an instrument for judging the quality of written consumer health information on treatment choices. J Epidemiol Community Health. 1999;53:105–11.
Zhang S, Yang Y, Yan D, et al. Internet videos and colorectal cancer in mainland China: a content analysis. BMC Med Inform Decis Mak. 2018;18:129.
Sahin AN, Sahin AS, Schwenter F, et al. YouTube Videos as a Source of Information on Colorectal Cancer: What Do Our Patients Learn? J Cancer Educ. 2019;34:1160–6.
Aydin MA, Akyol H. Quality of information available on YouTube videos pertaining to thyroid cancer. J Cancer Educ. 2020;35:599–605 Brar J, Ferdous M, Abedin T, Turin TC. Online Information for Colorectal Cancer Screening: A Content Analysis of YouTube Videos. J Cancer Educ. 2021;36(4):826-831.
Enver N, Doruk C, Kara H, et al. YouTube as an information source for larynx cancer: a systematic review of video content. Eur Arch Otorhinolaryngol. 2020;277:2061–9.
Mamo A, Szeto MD, Mirhossaini R, et al. Tetrahydrocannabinol and Skin Cancer: Analysis of YouTube Videos. JMIR Dermatol. 2021;4: e26564.
Zhang S, Fukunaga T, Oka S, et al. Concerns of quality, utility, and reliability of laparoscopic gastrectomy for gastric cancer in public video sharing platform. Ann Transl Med. 2020;8:196.
Toolabi K, Parsaei R, Elyasinia F, et al. Reliability and Educational Value of Laparoscopic Sleeve Gastrectomy Surgery Videos on YouTube. Obes Surg. 2019;29:2806–13.
Syed-Abdul S, Fernandez-Luque L, Jian WS, et al. Misleading health-related information promoted through video-based social media: anorexia on YouTube. J Med Internet Res. 2013;15: e30.
Lee JS, Seo HS, Hong TH. YouTube as a source of patient information on gallstone disease. World J Gastroenterol. 2014;20:4066–70.
Zong L, Abe M, Seto Y, et al. The challenge of screening for early gastric cancer in China. Lancet. 2016;388:2606.
Hatta W, Gotoda T, Koike T, et al. History and future perspectives in Japanese guidelines for endoscopic resection of early gastric cancer. Dig Endosc. 2020;32:180–90.
Li X, Zhao M, Dong X, et al. Irrational beliefs surrounding the diagnosis of breast cancer in young Chinese women: An observational study. Medicine (Baltimore). 2021;100: e25024.
Liu Y, Yang J, Huo D, et al. Disclosure of cancer diagnosis in China: the incidence, patients’ situation, and different preferences between patients and their family members and related influence factors. Cancer Manag Res. 2018;10:2173–81.
Jie B, Qiu Y, Feng ZZ, et al. Impact of disclosure of diagnosis and patient autonomy on quality of life and illness perceptions in Chinese patients with liver cancer. Psychooncology. 2016;25:927–32.
Cilio S, Collà Ruvolo C, Turco C, et al. Analysis of quality information provided by “Dr. YouTubeTM” on Phimosis. Int J Impot Res. 2022. https://doi.org/10.1038/s41443-022-00557-5, https://www.nature.com/articles/s41443-022-00557-5.
Capece M, Di Giovanni A, Cirigliano L, et al. YouTube as a source of information on penile prosthesis. Andrologia. 2022;54(1): e14246.
Narain AS, Dhayalan A, Weinberg M, et al. Social Media Utilization Among Shoulder and Elbow Surgeons. J Am Acad Orthop Surg. 2021;29:123–30.
Shlobin NA, Hoffman SC, Clark JR, et al. Social Media in Neurosurgery: A Systematic Review. World Neurosurg. 2021;149:38–50.
Efforts needed to reduce doctors' working hours. The japan times; 2019. https://www.japantimes.co.jp/opinion/2019/01/31/editorials/efforts-needed-reduce-doctors-working-hours/. Accessed 30 July 2022.
Reith TP. Burnout in United States Healthcare Professionals: A Narrative Review. Cureus. 2018;10: e3681.
Hu L, Ding H, Liu S, et al. Influence of patient and hospital characteristics on inpatient satisfaction in China’s tertiary hospitals: A cross-sectional study. Health Expect. 2020;23:115–24.
Deng Z, Hong Z, Zhang W, et al. The Effect of Online Effort and Reputation of Physicians on Patients’ Choice: 3-Wave Data Analysis of China’s Good Doctor Website. J Med Internet Res. 2019;21: e10170.
Rawla P, Barsouk A. Epidemiology of gastric cancer: global trends, risk factors and prevention. Prz Gastroenterol. 2019;14:26–38.
Song S, Xue X, Zhao YC, et al. Short-Video Apps as a Health Information Source for Chronic Obstructive Pulmonary Disease: Information Quality Assessment of TikTok Videos. J Med Internet Res. 2021;23: e28318.
Basch CH, Fera J, Pierce I, et al. Promoting Mask Use on TikTok: Descriptive. Cross-sectional Study JMIR Public Health Surveill. 2021;7: e26392.
Di Bello F, Colla Ruvolo C, Cilio S, et al. Testicular cancer and YouTube: What do you expect from a social media platform? Int J Urol. 2022;29(7):685–91.
Yurdaisik I. Analysis of the Most Viewed First 50 Videos on YouTube about Breast Cancer. Biomed Res Int. 2020;25(2020):2750148.
Enver N, Doruk C, Kara H, Gürol E, Incaz S, Mamadova U. YouTube™ as an information source for larynx cancer: a systematic review of video content. Eur Arch Otorhinolaryngol. 2020;277(7):2061–9.
The study was supported by Key Characteristic Disease Construction Project of Pudong Health Commission of Shanghai (No. PWZzb2017-05), Innovation Fund of Science and Technology Committee in Shanghai Pudong New Area (Nos. PKJ2016-Y60), National Natural Science Foundation of China (Nos. 81871953) and Jiangxi Youth Science Fund (Nos. 20171BAB215043).
Ethics approval and consent to participate
This study did not require approval by the local Research Ethics Board as it involved publicly available data only.
Consent for publication
The authors have no conflicts of interest to disclose.
About this article
Cite this article
Hu, Rh., Zhang, Hb., Yuan, B. et al. Quality and accuracy of gastric cancer related videos in social media videos platforms. BMC Public Health 22, 2025 (2022). https://doi.org/10.1186/s12889-022-14417-w