|Year : 2018 | Volume
| Issue : 12 | Page : 1651-1655
Evaluation of the content, quality, reliability and accuracy of YouTube videos regarding endotracheal intubation techniques
Loma Linda University School of Medicine, Loma Linda, CA, USA
|Date of Acceptance||23-Aug-2018|
|Date of Web Publication||18-Dec-2018|
Dr. Umut OCAK
Loma Linda University School of Medicine, Risley Hall, 11041 Campus Street, Loma Linda, CA, 92350
Source of Support: None, Conflict of Interest: None
| Abstract|| |
Background: Today, the internet is widely used to obtain any type of information. The use of internet may facilitate healthcare professionals' education as well. Objectives: We aimed to evaluate the content, accuracy, reliability and quality of YouTube videos regarding intubation, one of the most important skills for healthcare professionals. Materials and Methods: Of the 54,000 videos found using the keyword ‘intubation’, the first 50 were included in the study. The sources were divided into three categories: academicians, healthcare professionals and medical. The view ratio, like ratio, and video power index were used to determine the popularity while Journal of American Medical Association (JAMA) benchmark criteria were used for reliability. The extent of the information was evaluated based on the scoring system provided by us. Results: The majority of the videos were uploaded by healthcare professionals (92%) including academicians. Twenty-seven (54%) videos had training purposes. The information point was highest in the academic group (4.6 ± 2.7); however, there was no significance between groups (P = 0.2). The mean JAMA score was highest in the academic group (1.9 ± 0.8), with a statistical significance (P = 0.00055). The JAMA score and information points were significantly higher in training videos compared to non-training videos (p=<0.001 and P = 0.003, respectively). Popularity ratios were similar between groups. Conclusion: Videos regarding medical skills should be accurate. Information on YouTube regarding intubation is limited and is of low quality. The establishment of an organization authorized to evaluate the content, quality, accuracy and reliability of the information on the internet regarding medical skills is warranted.
Keywords: Information, internet, intubation, video, YouTube
|How to cite this article:|
OCAK U. Evaluation of the content, quality, reliability and accuracy of YouTube videos regarding endotracheal intubation techniques. Niger J Clin Pract 2018;21:1651-5
|How to cite this URL:|
OCAK U. Evaluation of the content, quality, reliability and accuracy of YouTube videos regarding endotracheal intubation techniques. Niger J Clin Pract [serial online] 2018 [cited 2020 May 30];21:1651-5. Available from: http://www.njcponline.com/text.asp?2018/21/12/1651/247672
| Introduction|| |
Airway management is one of the most important skills for healthcare professionals, as failures in securing the airway properly may result in devastating consequences, including death or severe disability of the patient. Emergency endotracheal intubation is indicated in any situation whereby maintaining the airway patency is mandatory. Additionally, the airway should be secured in patients who tend to aspirate or in whom ventilation or oxygenation has failed. Oftentimes, anticipating a deteriorating course may also cause the physician to have the patient intubated before the eventual respiratory failure occurs.
At the present time, the internet is widely used to obtain any type of information regarding daily life and professions. The use of the internet may help healthcare professionals attain uninterrupted education with updated data of various clinical scenarios while providing both visual and auditory information. Similarly, online educational videos targeting patients or patient sourced videos sharing their experiences are available. Recently, YouTube has been growing in popularity among internet users as visual data are considered more attractive compared to written information. However, the accuracy and reliability of these data gathered from the internet is controversial as the videos published on YouTube neither go through an editorial assessment nor are they under the surveillance of an authorized organization. Moreover, most of the videos do not mention the authors and institutions that are responsible for the provided data. Consequently, academic studies analyzing YouTube videos' contents and reliability have been increasing recently.
In the present study, we aimed to evaluate the content, accuracy, reliability and quality of YouTube videos under the heading of ‘intubation’.
| Materials and Methods|| |
The YouTube search engine (YouTube© www.youtube.com) was searched using the keyword ‘intubation’ on April 26, 2018. Of the 54,000 videos found, the first 50 which were in English were included in the study for evaluation after filtering the videos as ‘most related’. Repetitive videos were counted only once. The videos that were not related with intubation or that were in a language other than English, and commercial videos were excluded from the study. The sources of the videos were divided into three categories as follows: academic (recorded or uploaded by an academic physician or by a person who is part of an academic institution), healthcare professionals (attending physicians, nurses, paramedics, etc.), and medical (from health-related websites). The following characteristics of the videos were recorded: target population (healthcare professionals vs. patients), subjects (human/mannequin/cadaver/animation), presence of an actual scene from clinical practice, specific issues (difficult intubation, awake intubation, retrograde intubation, use of bougie or laryngeal mask, video-assisted intubation), and intubation type (orotracheal/nasotracheal) as well as duration, number of views, publication date, number of comments, number of likes and dislikes. The following formulas were used to determine the popularity of the videos: the view ratio (number of views/number of days since upload), like ratio (number of likes X 100/number of likes + number of dislikes), and video power index (like ratio X view ratio/100). The reliability of the data provided by the videos was evaluated based on the Journal of American Medical Association (JAMA) benchmark criteria, as previously described.
The videos were also scored between 0 and 15 points according to the extent and elaboration of the information provided by them. Each theme from the information category received 0 or 1 points depending on the presence or absence of the relevant information. The themes of the information recording system are summarized in [Table 1].
IBM SPSS Statistics software, version 20.0 (IBM Corp., Armonk, NY, USA) was used for statistical evaluation. Descriptive statistics are given as number of units (n), percentage (%), and mean ± standard deviation (STD). T-test and one-way ANOVA were used in comparison of the categorical data. P < 0.05 was considered statistically significant.
| Results|| |
The mean duration of overall videos was 313 ± 278 seconds. The total number of views was 6.379.007 and the average number of views was 1358 ± 8698. The mean number of days since publication was 1510 ± 1032 days, with a mean view ratio of 104.5 ± 223.9. The number of comments, likes and dislikes was 1,146 (mean 22.9 ± 37.4), 15,749 (mean 315 ± 506.9) and 1,257 (mean 25.1 ± 33.6), respectively. The mean like ratio was 90.7 ± 9.8 and the mean video power index was 95 ± 199.2. The mean JAMA score of overall videos was 1.46 ± 0.8.
The majority of the videos were uploaded by healthcare professionals (n = 46, 92%) including academicians. Among these, 21 (42%) were uploaded by the academic group while 25 (50%) were uploaded by other healthcare professions including attending physicians, nurses, and paramedics. Twenty-seven (54%) of the overall videos had training purposes. Among these, 23 were aimed at physicians' training while 2 were aimed at nurses' and 2 were aimed at paramedics' training. Four (8%) of the videos were uploaded by the group named as ‘medical’ which refers to healthcare related websites in our study. Forty-nine (98%) of the videos targeted healthcare professionals while only (2%) one of the videos focused on patients' education. Thirty-six (72%) of the videos used humans as subjects and demonstrated an actual clinical scene from daily practices (operation room, emergency service, intensive care unit, etc.). Fifteen of the videos were presenting information about specific issues such as difficult intubation (n = 3, 6%), awake intubation (n = 2, 4%), intubation with bougie (n = 3, 6%), intubation with laryngeal mask (n = 1, 2%), video-assisted intubation (n = 4, 8%), and retrograde intubation (n = 2, 4%). The general characteristics of the intubation videos are presented in [Table 2].
The average point of information of the videos was 3.9 ± 2.4. There was no statistical difference between the average points of the videos published by the academic group (n = 21; 4.6 ± 2.7), healthcare professionals (3.3 ± 2.3; n = 25) and medical group (3.75 ± 1.5; n = 4) (P = 0.2). The total number of views of videos uploaded by the academic group, healthcare professionals and medical group was 2,502,453 (mean 119,164.4 ± 192,957.9), 3,098,580 (mean 123,943.2 ± 129,222.58), and 777,974 (mean 194,493.5 ± 131,887.2), respectively. There was no statistical difference between the number of views (P = 0.68) and view ratios (P = 0.74) of the groups according to the source.
The mean JAMA score which was accepted as the criteria for accuracy and reliability of the medical information retrieved through the videos was 1.9 ± 0.8, 1.1 ± 0.5, and 1.5 ± 0.6 in the academic group, healthcare professionals group and medical group, respectively. The JAMA score was significantly higher in the academic group (P = 0.00055). Similarly, the information point was highest in the academic group (4.6 ± 2.7); however, there was no statistical difference between the groups in this category (P = 0.2). Moreover, the JAMA score and information points were significantly higher in the videos recorded and published with the purpose of healthcare professionals' training compared to non-training videos (p=<0.001 and P = 0.003, respectively). The distribution of popularity and reliability characteristics of the intubation videos according to the source and training purposes are summarized in [Table 3] and [Table 4], respectively. The distribution of the videos based on the themes of the information scoring system is presented in [Figure 1].
|Table 3: Distribution of the popularity and reliability characteristics of intubation videos according to source|
Click here to view
|Table 4: Distribution of the popularity and reliability characteristics of training and nontraining intubation videos|
Click here to view
|Figure 1: Distribution of the videos based on the themes of the information scoring system|
Click here to view
| Discussion|| |
Today, reliable information provided by the internet that is similar to that provided by physicians at clinics might help improve patients' satisfaction and trust in their healthcare provider, since increasing numbers of patients are ‘googling’ and ‘youtubing’ even a negligible symptom prior to doctor's visit. Similarly, educational videos targeting students including physicians, nurses or paramedics may improve their learning outcomes as well as medical skills, as educational videos are reported to be superior to skill demonstrations. Thus, visual and auditory input provided by video education may contribute significantly to the quality of education of future healthcare providers.
YouTube, a colossal web-based video source, has access to more than a billion people worldwide since one out of every three internet users is reported to watch videos for hours every day. Despite the early intent of fun, YouTube has gained significant popularity regarding health-related topics due to the ease of access by both patients and health care professionals. As a result, studies focusing on the reliability and accuracy of health-related YouTube videos are increasing due to the lack of control by an organization authorized to examine the source and content of the videos uploaded. However, the results of these studies are inconsistent depending on the area of interest. The majority of these studies have reported the data provided by YouTube videos as poor, inadequate and unverified.,, Moreover, patient sourced videos were found to be less informative. while videos provided by healthcare professions were found to be more informative.
Airway management and, thus, tracheal intubation, is a critical maneuver in saving lives which should be known and practiced properly. However, intubation should not be perceived as just inserting a tube. Correct knowledge regarding the necessity of the procedure, how to prepare the patient with correct positioning and adequate preintubation oxygenation as well as appropriate sedation, equipment including proper tube and laryngoscope blade, how to confirm the placement and what to do in cases of failure, how to secure the tube and when to stop is the key to successful intubation when trying to save the patient and not to harm. Despite the initial aim of this study of searching the reliability of videos on YouTube regarding intubation, we elected to proceed with assessing the educational quality of the videos after noticing that almost all the videos were targeting healthcare professionals.
In the present study, we found that 50% of the videos were uploaded by healthcare professionals including attending physicians, nurses, and paramedics while 42% of the videos were uploaded by academicians. All the videos, except the one for patient education, targeted healthcare professionals and 54% of them had obviously training purposes while the rest were only demonstrating daily practices. The JAMA score which is currently used as an indicator of reliability was significantly higher in the videos of academic sources and in the videos with training purposes compared to those of other groups. Although the information points based on the scale provided by us were very low in overall videos, thankfully, training videos received significantly higher points compared to non-training videos. However, the mean information point was as low as 4.7 in the training videos, showing that even training videos did not provide two thirds of the knowledge that a healthcare professional should have regarding intubation according to our scoring system. There was no significant difference between the videos by academic group, healthcare professionals and medical group in terms of information points. Formulas regarding the popularity of the videos such as view ratio, like ratio, and video power index were similar between groups according to the source and training purposes. We can interpret this data as videos targeting healthcare professionals are watched equally regardless of the source and aims of training. Practice related visual information was the most commonly provided information by the intubation videos in our study (n = 43, 86%). Unfortunately, crucial information such as positioning and preintubation oxygenation of the patient, relevant anatomy and equipment, tricks for success such as external compression of the thyroid cartilage and dealing with malposition of the tube or failure of inserting the tube were the points of less than 50% of the videos.
As a result, we speculate that videos regarding specific medical skills have the responsibility to be accurate since written information which can be accessed by textbooks, blended in with visual information which can be accessed by videos may help improve the imagination, understanding, and comprehension of healthcare professionals and accelerate the learning curve. Contrarily, inappropriate, wrong or inadequate information may be hard to fix once it is assimilated by clear minds. Thus, we strongly suggest the constitution of a qualified organization authorized to review health-related videos prior to their upload similar to the editorial process applied to written scientific reports. Similarly, the establishment of a reliable site could be another option for individuals who want to view videos regarding medical skills. Healthcare professionals and patients should be informed about the presence of such an assessment criterion or an authentic site which then in turn will let them know which videos they can trust.
There are several limitations in this study. First, the first 50 videos that met our search criteria using the keyword ‘intubation’ were included in the study, which might be perceived as a major limitation. However, as most internet users are reported to pay attention to the first two pages of online search results and evaluating all the information regarding intubation was not the main purpose of this study, we filtered the search results and evaluated the first 50 ‘most related’ videos regarding intubation. Second, search results may differ according to the geographical location of the researcher. Search results may also change according to the time of search since there is continuous uploading of extremely high numbers of videos. Third, our study included only the videos which were returned upon searching the word ‘intubation’ and did not include other terminology such as airway management, which is also related with intubation. However, such a search would affect and direct the main purpose of our study regarding the evaluation of videos related to intubation by hitting alternative videos such as tracheostomy, ventilation, first aid procedures, etc.
| Conclusion|| |
YouTube videos are gaining popularity among both patients and healthcare professionals. The results of our study showed that YouTube videos are not providing adequate and qualified information about intubation despite the high number of videos provided by academicians and videos with training purposes. Thus, we conclude that control mechanisms evaluating the videos regarding medical skills in terms of content, quality, accuracy and reliability of the information are highly warranted.
Financial support and sponsorship
Conflicts of interest
There are no conflicts of interest.
| References|| |
Reynolds SF, Heffner J. Airway management of the critically ill patient: Rapid-sequence intubation. Chest 2005;127:1397-412.
Desai T, Shariff A, Dhingra V, Minhas D, Eure M, Kats M, et al.
Is content really king? An objective analysis of the public's response to medical videos on youTube. PLoS One 2013;8:e82469.
Silberg WM, Lundberg GD, Musacchio RA. Assessing, controlling, and assuring the quality of medical information on the internet: Caveant lector et viewor – Let the reader and viewer beware. JAMA 1997;277:1244-5.
Sechrest RC. The internet and the physician-patient relationship. Clin Orthop Relat Res 2010;468:2566-71.
Hungerford DS. Internet access produces misinformed patients: Managing the confusion. Orthopedics 2009;32. pii: orthosupersite.com/view.asp?rID=42830.
Romanov K, Nevgi A. Do medical students watch video clips in eLearning and do these facilitate learning? Med Teach 2007;29:484-8.
Alameddine MB, Englesbe MJ, Waits SA. A video-based coaching intervention to improve surgical skill in fourth-year medical students. J Surg Educ 2018. pii: S1931-7204(17) 30730-4.
Chuang YH, Lai FC, Chang CC, Wan HT. Effects of a skill demonstration video delivered by smartphone on facilitating nursing students' skill competencies and self-confidence: A randomized controlled trial study. Nurse Educ Today 2018;66:63-8.
Pilieci SN, Salim SY, Heffernan DS, Itani KM, Khadaroo RG. A randomized controlled trial of video education versus skill demonstration: Which is more effective in teaching sterile surgical technique? Surg Infect (Larchmt) 2018;19:303-12.
Brooks FM, Lawrence H, Jones A, McCarthy MJ. YouTube™ as a source of patient information for lumbar discectomy. Ann R Coll Surg Engl 2014;96:144-6.
Madathil KC, Rivera-Rodriguez AJ, Greenstein JS, Gramopadhye AK. Healthcare information on YouTube: A systematic review. Health Informatics J 2015;21:173-94.
Garg N, Venkatraman A, Pandey A, Kumar N. YouTube as a source of information on dialysis: A content analysis. Nephrology (Carlton) 2015;20:315-20.
Rössler B, Lahner D, Schebesta K, Chiari A, Plöchl W. Medical information on the internet: Quality assessment of lumbar puncture and neuroaxial block techniques on YouTube. Clin Neurol Neurosurg 2012;114:655-8.
Bezner SK, Hodgman EI, Diesen DL, Clayton JT, Minkes RK, Langer JC, et al.
Pediatric surgery on YouTube™: Is the truth out there? J Pediatr Surg 2014;49:586-9.
[Table 1], [Table 2], [Table 3], [Table 4]