Resident Education in Laryngeal Stroboscopy: Part II—Evaluation of a Multimedia Training Module

Published:January 13, 2020DOI:



      To evaluate the efficacy of a web-based training module for teaching interpretation of laryngeal stroboscopy in a cohort of otolaryngology residents.

      Study Design

      Randomized controlled trial.


      Academic tertiary center.

      Subjects and Methods

      Residents from three training programs were invited to complete an assessment consisting of a survey and five stroboscopic exams. Subsequently, participants were randomized to receive teaching materials in the form of (1) a handout (HO) or (2) a multimedia module (MM) and asked to complete a post-training assessment. Responses were compared to responses provided by three fellowship-trained laryngologists.


      Thirty-five of 47 invited residents (74.4%) completed both assessments. Overall mean postassessment scores were 64.3% ± 7.0, with the MM group (67.0% ± 7.6, n = 17) scoring higher (P = 0.03) than the HO (61.6% ± 5.4, n = 18) cohort. Postassessment scores did not differ by postgraduate year (P = 0.75) or institution (P = 0.17). Paired analysis demonstrated an overall mean improvement of 7.4% in the handout (HO) cohort (P = 0.03) and 10.3% in the MM cohort (P = 0.0006). Subset analysis demonstrated higher scores for the MM cohort for perceptual voice evaluation (HO = 68.8% ± 11.0; MM = 77.3% ± 10.6, P = 0.03) and stroboscopy-specific items (HO = 55.5% ± 8.2; MM = 61.9% ± 10.8, P = 0.06). On a five-point Likert scale, residents reported improved confidence in stroboscopy interpretation (P < 0.0001), irrespective of cohort (P = 0.62). Residents rated the MM (median = 5) more favorably as a teaching tool compared to the HO (median = 4, P = 0.001).


      Use of both the written HO and MM module improved scores and confidence in interpreting laryngeal stroboscopy. The MM was more effective in perceptual voice evaluation and stroboscopy-specific items. The MM was also rated more favorably by residents and may be an ideal adjunct modality for teaching stroboscopy.

      Key Words

      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'


      Subscribe to Journal of Voice
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect


        • Jokinen E
        • Mikkola TS
        • Harkki P
        Evaluation of a web course on the basics of gynecological laparoscopy in resident training.
        J Surg Educ. 2017; 74: 717-723
        • Hearty T
        • Maizels M
        • Pring M
        • et al.
        Orthopaedic resident preparedness for closed reduction and pinning of pediatric supracondylar fractures is improved by e-learning: a multisite randomized controlled study.
        J Bone Joint Surg Am. 2013; 95: e1261-e1267
        • Hindle A
        • Cheng J
        • Thabane L
        • et al.
        Web-based learning for emergency airway management in anesthesia residency training.
        Anesthesiol Res Pract. 2015; 2015971406
        • Mitchell JD
        • Mahmood F
        • Wong V
        • et al.
        Teaching concepts of transesophageal echocardiography via web-based modules.
        J Cardiothorac Vasc Anesth. 2015; 29: 402-409
        • American Board of Otolaryngology
        Otolaryngology Head and Neck Surgery Comprehensive Core Curriculum (October 2017).
        2018 (July 29)
        • Jones J.W.
        • Perryman M.
        • Judge P.
        • et al.
        Resident education in laryngeal stroboscopy and perceptual voice evaluation: an assessment.
        J Voice. 2018; ([Epub ahead of print])
        • Whitson BA
        • Hoang CD
        • Jie T
        • et al.
        Technology-enhanced interactive surgical education.
        J Surg Res. 2006; 136: 13-18
        • Poburka BJ
        • Bless DM
        A multi-media, computer-based method for stroboscopy rating training.
        J Voice. 1998; 12: 513-526
        • Harris PA
        • Taylor R
        • Thielke R
        • et al.
        Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support.
        J Biomed Inform. 2009; 42: 377-381
        • Hirano M
        Clinical Examination of Voice.
        1st ed. Springer, Berlin, Heidelberg, New York1981
        • Hayes A
        • Krippendorff K
        Answering the call for a standard reliability measure for coding data.
        Commun Methods Meas. 2007; 1: 77-89
        • Krippendorff K
        Reliability in content analysis.
        Human Comm Res. 2004; 30: 411-433
        • Krippendorff K
        Content Analysis: An Introduction to Its Methodology.
        Sage Publications, London1980
        • Altman G
        Practical Statistics for Medical Research.
        Chapman and Hall, London1991
        • Tarpada SP
        • Hsueh WD
        • Gibber MJ
        Resident and student education in otolaryngology: a 10-year update on e-learning.
        Laryngoscope. 2017; 127: E219-e224
        • Sataloff RT
        • Spiegel JR
        • Hawkshaw MJ
        Strobovideolaryngoscopy: results and clinical value.
        Ann Otol Rhinol Laryngol. 1991; 100: 725-727
        • Remacle M
        The contribution of videostroboscopy in daily ENT practice.
        Acta Otorhinolaryngol Belg. 1996; 50: 265-281
        • Bonilha HS
        • Focht KL
        • Martin-Harris B
        Rater methodology for stroboscopy: a systematic review.
        J Voice. 2015; 29: 101-108
        • Webb AL
        • Carding PN
        • Deary IJ
        • et al.
        The reliability of three perceptual evaluation scales for dysphonia.
        Eur Arch Otorhinolaryngol. 2004; 261: 429-434
        • Kreiman J
        • Gerratt BR
        • Precoda K
        Listener experience and perception of voice quality.
        J Speech Hear Res. 1990; 33: 103-115
        • Bassich CJ
        • Ludlow CL
        The use of perceptual methods by new clinicians for assessing voice quality.
        J Speech Hear Disord. 1986; 51: 125-133
        • De Bodt MS
        • Wuyts FL
        • Van de Heyning PH
        • et al.
        Test-retest study of the GRBAS scale: influence of experience and professional background on perceptual rating of voice quality.
        J Voice. 1997; 11: 74-80