Summary
Objective
This study proposes a new computational framework for automated spatial segmentation
of the vocal fold edges in high-speed videoendoscopy (HSV) data during connected speech.
This spatio-temporal analytic representation of the vocal folds enables the HSV-based
measurement of the glottal area waveform and other vibratory characteristics in the
context of running speech.
Methods
HSV data were obtained from a vocally normal adult during production of the “Rainbow
Passage.” An algorithm based on an active contour modeling approach was developed
for the analysis of HSV data. The algorithm was applied on a series of HSV kymograms
at different intersections of the vocal folds to detect the edges of the vibrating
vocal folds across the frames. This edge detection method follows a set of deformation
rules for the active contours to capture the edges of the vocal folds through an energy
optimization procedure. The detected edges in the kymograms were then registered back
to the HSV frames. Subsequently, the glottal area waveform was calculated based on
the area of the glottis enclosed by the vocal fold edges in each frame.
Results
The developed algorithm successfully captured the edges of the vocal folds in the
HSV kymograms. This method led to an automated measurement of the glottal area waveform
from the HSV frames during vocalizations in connected speech.
Conclusion
The proposed algorithm serves as an automated method for spatial segmentation of the
vocal folds in HSV data in connected speech. This study is one of the initial steps
toward developing HSV-based measures to study vocal fold vibratory characteristics
and voice production mechanisms in norm and disorder in the context of connected speech.
Key words
To read this article in full you will need to make a payment
Purchase one-time access:
Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online accessOne-time access price info
- For academic or personal research use, select 'Academic and Personal'
- For corporate R&D use, select 'Corporate R&D Professionals'
Subscribe:
Subscribe to Journal of VoiceAlready a print subscriber? Claim online access
Already an online subscriber? Sign in
Register: Create an account
Institutional Access: Sign in to ScienceDirect
REFERENCES
- Imaging of the Neck and Head.2nd ed. Thieme, Stuttgart2005
- Perceptual and acoustic assessment of voice pathology and the efficacy of endolaryngeal phonomicrosurgery.J Voice. 2005; 19: 138-145
- Advances in laryngeal imaging.Eur Arch Otorhinolaryngol. 2009; 266: 1509-1520
- Laryngeal imaging.Operat Techn Otolaryngol Head Neck Surg. 2019; 30: 237-242
- Stroboscopy–a pertinent laryngological examination.J Otolaryngol. 1985; 14: 151-157
- Videostroboscopic evaluation of the larynx.Ear Nose Throat J. 1987; 66: 289-296
- Aerodynamic and stroboscopic findings before and after microlaryngeal phonosurgery.J Voice. 1994; 8: 186-194
- Clinical Voice Pathology: Theory and Management.Plural Publishing, San Diego, CA2000
- Prospective functional voice assessment in patients undergoing thyroid surgery.Ann Surg. 2002; 236: 823-832
- Voice assessment: updates on perceptual, acoustic, aerodynamic, and endoscopic imaging methods.Curr Opin Otol Head Neck Surg. 2008; 16: 211-215
- Clinical Voice Disorders.Thieme, New York, NY2011
- Comparison of high-speed digital imaging with stroboscopy for laryngeal imaging of glottal disorders.Ann Otol Rhinol Laryngol. 2008; 117: 413-424
- Comparison of videostroboscopy and high-speed videoendoscopy in evaluation of supraglottic phonation.Ann Otol Rhinol Laryngol. 2016; 125: 829-837
- Laryngeal high-speed videoendoscopy.Laryngeal Evaluation: Indirect Laryngoscopy to High-Speed Digital Imaging. Thieme Medical Publishers, New York2010: 243-270
- Clinical feasibility of high-speed videoendoscopy.Perspectives on Voice and Voice Disorders. 2007; 17: 12-16
- Clinical implementation of laryngeal high-speed videoendoscopy: challenges and evolution.Folia Phoniatr et Logop. 2007; 60: 33-44
- Temporal segmentation for laryngeal high-speed videoendoscopy in connected speech.J Voice. 2018; 32: 256.e1-256.e12
- Observation and analysis of in vivo vocal fold tissue instabilities produced by nonlinear source-filter coupling: a case study.J Acoust Soc Am. 2011; 129: 326-339
- Integration of Transnasal Fiberoptic High-Speed Videoendoscopy With Time-Synchronized Recordings of Vocal Function, Innormal & Abnormal Vocal Folds Kinematics: High Speed Digital Phonoscopy (HSDP), Optical Coherence Tomography (OCT) & Narrow Band Imaging. 12. Pacific Voice & Speech Foundation, San Fransisco, CA2015: 105-114
- A method for analysis of the vocal fold vibrations in connected speech using laryngeal imaging.in: Manfredi C Proceedings of the 10th International Workshop on Models and Analysis of Vocal Emissions for Biomedical Applications MAVEBA, Firenze, Italy Firenze University Press, 2017
- Studying vocal fold non-stationary behavior during connected speech using high-speed videoendoscopy.J Acoust Soc Am. 2018; 144 (1766-1766)
- Muscle misuse voice disorders: description and classification.Acta oto-laryngologica. 1993; 113: 428-434
- Analysing vocal quality of connected speech using Kay's computerized speech lab: a preliminary finding.Clin Linguist Phon. 2000; 14: 295-305
- Acoustic and perceptual parameters relating to connected speech are more reliable measures of hoarseness than parameters relating to sustained vowels.J Oto-Rhino-Laryngol Relat Spec. 2004; 66: 70-73
- Task specificity in adductor spasmodic dysphonia versus muscle tension dysphonia.Laryngoscope. 2005; 115: 311-316
- Toward improved ecological validity in the acoustic measurement of overall voice quality: combining continuous speech and sustained vowels.J Voice. 2010; 24: 540-555
- The acoustic assessment of voice in continuous speech.SIG 3 Perspect Voice Voice Disord. 2012; 22: 57-63
- Glottal attack and offset time during connected speech in adductor spasmodic dysphonia.in: Virtual Voice Symposium: Care of the Professional Voice, Philadelphia2020
- Glottal attack time in connected speech.in: The 11th International Conference on Voice Physiology and Biomechanics ICVPB, East Lansing, MI2018
- Investigation of high-speed videoendoscopy during connected speech in norm and neurogenic voice disorder.in: Michigan Speech-Language-Hearing Association (MSHA) Annual Conference, East Lansing, MI2019
- Automatic segmentation of high speed video images of vocal folds.J Appl Math. 2014; 2014: 1-16
- Clinically evaluated procedure for the reconstruction of vocal fold vibrations from endoscopic digital high-speed videos.Med Image Anal. 2007; 11: 400-413
- Automated measurement of vocal fold vibratory asymmetry from high-speed videoendoscopy recordings.J Speech Lang Hear Res. 2011; 54: 47-54
- Automatic glottal segmentation using local-based active contours and application to glottovibrography.Speech Commun. 2012; 54: 641-654
- Segmentation of laryngeal high-speed videoendoscopy in temporal domain using paired active contours.in: Manfredi C Proceedings of the 10th International Workshop on Models and Analysis of VocaL Emissions for Biomedical Applications MAVEBA, Firenze, Italy Firenze University Press, 2009
- Automatic tracing of vocal-fold motion from high-speed digital images.IEEE Transact Biomed Eng. 2006; 53: 1394-1400
- Functional analysis of voice using simultaneous high-speed imaging and acoustic recordings.J Voice. 2007; 21: 604-616
- Voice production mechanisms following phonosurgical treatment of early glottic cancer.Ann Otol Rhinol Laryngol. 2010; 119: 1-9
- Glottis segmentation with a high-speed glottography: a fullyautomatic method.in: 3rd Adv. Voice Funct. Assess. Int. Workshop. 2009
- Snake based automatic tracing of vocal-fold motion from high-speed digital images.in: IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP’12). 2012
- Efficient and effective extraction of vocal fold vibratory patterns from high-speed digital imaging.J Voice. 2010; 24: 21-29
- Active contour model based on local and global intensity information for medical image segmentation.Neurocomputing. 2016; 186: 107-118
- Edge detection algorithms vs-active contour for sketch matching: comparative study.Res J Appl Sci Eng Technol. 2015; 11: 759-764
- Active contour models.Int J Comput Vision. 1988; 1: 321-331
- Objective vocal fold vibration assessment from videokymographic images.Biomed Signal Process Control. 2006; 1: 129-136
- Experimental investigation on minimum frame rate requirements of high-speed videoendoscopy for clinical voice assessment.Biomed Signal Process Control. 2015; 17: 21-28
- Endoscope motion compensation for laryngeal high-speed videoendoscopy.J Voice. 2005; 19: 485-496
- Methods for objective assessment of high-speed videoendoscopy.Proc Adv Quant Laryngol. 2003; : 1-16
- Using dynamic programming for solving variational problems in vision.IEEE Transact Pattern Analysis Mach Intellig. 1990; 12: 855-867
- Automatic high-speed video glottis segmentation using salient regions and 3D geodesic active contours.Ann Br Mach Vision Assoc. 2015; 2015: 1-15
- Tracing vocal fold vibrations using level set segmentation method.Int J Numer Methods Biomed Eng. 2015; 31: e02715https://doi.org/10.1002/cnm
Article info
Publication history
Published online: November 27, 2020
Accepted:
October 23,
2020
Footnotes
Declaration of Interest: The authors declare that they have no conflict of interest.
Submission Declaration and Verification: The work described has not been published previously. Portions of this work have been presented at the 47th Annual Symposium: Care of the Professional Voice, Philadelphia, PA, May 30-June 3, 2018, and the Virtual Voice Symposium: Care of the Professional Voice, May 27-31, 2020. This manuscript is not under consideration for publication elsewhere, its publication is approved by all authors and tacitly or explicitly by the responsible authorities where the work was carried out, and if accepted, it will not be published elsewhere in the same form, in English or in any other language, including electronically without the written consent of the copyright-holder.
Identification
Copyright
© 2020 The Voice Foundation. Published by Elsevier Inc. All rights reserved.
