Research Article| Volume 37, ISSUE 1, P142.e5-142.e12, January 2023

Download started.


The usefulness of multi voice evaluation: Development of a model for predicting a degree of dysphonia

  • YeonWoo Lee
    Department of Otorhinolaryngology-Head and Neck Surgery and Biomedical Research Institute, Pusan National University Hospital, Busan, Republic of Korea
    Search for articles by this author
  • HeeJune Park
    Deptartment of Speech and Hearing Therapy, Catholic University of Pusan, Busan, Republic of Korea
    Search for articles by this author
  • Inho Bae
    Deptartment of Speech-Language Pathology, Kosin University, Busan, Republic of Korea
    Search for articles by this author
  • GeunHyo Kim
    Address correspondence and reprint requests to GeunHyo Kim, PhD, Department of Otorhinolaryngology-Head and Neck Surgery and Biomedical Research Institute, Pusan National University Hospital, 179, Gudeok-ro, Seo-gu, Busan, Republic of Korea.
    Department of Otorhinolaryngology-Head and Neck Surgery and Biomedical Research Institute, Pusan National University Hospital, Busan, Republic of Korea
    Search for articles by this author
Published:November 13, 2020DOI:



      The purposes of this study were (1) to analyze the usefulness of self-report questionnaires, acoustic analysis, and auditory perceptual assessment for screening voice problems; and (2) to develop a new model for predicting a comprehensive voice severity using multi-assessment.


      A total of 306 voice samples were analyzed in this study (typical group, n = 72; dysphonia group, n = 234). We performed a receiver operating characteristic analysis to determine the cutoff values of auditory perceptual assessments (visual analog scale), acoustic parameters (spectral- and cepstral-based analyses), and self-report questionnaires for screening voice disorders. We also performed a stepwise multiple regression analysis to verify which combination of parameters (acoustic parameters, and self-report questionnaires) could best predict perceived voice severity.


      We verified that most of the variables analyzed were useful for voice evaluation, and found to be useful for screening voice problems. Of these, a five-variable model was a useful to predict perceived voice severity (mean R2 = .807). The five-variable model consisted of acoustic parameters based on cepstral analysis (cepstral peak prominences in connected speech and sustained vowel task, and low versus high-frequency spectral energy ratio in connected speech task) and self-report questionnaires (total score of the Voice Handicap Index, and rumination score of the Voice Catastrophization Index).


      We verified that most of the variables were useful for screening dysphonia and five-variable model was a useful to predict perceived voice severity. The five-variable model could be used as an objective criterion for predicting voice severity.

      Key Words

      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'


      Subscribe to Journal of Voice
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect


        • Bhuta T
        • Patrick L
        • Garnett JD
        Perceptual evaluation of voice quality and its correlation with acoustic measurements.
        J. Voice. 2004; 18: 299-304
        • Lee Y
        • Kim G
        • Sohn K
        • et al.
        The usefulness of auditory perceptual assessment and acoustic analysis as a screening test for voice problems.
        Folia Phoniatr. Logop. 2019; (in press): 1-8
        • Awan SN
        • Roy N
        • Zhang D
        • et al.
        Validation of the cepstral spectral index of dysphonia (CSID) as a screening tool for voice disorders: development of clinical cutoff scores.
        J. Voice. 2016; 30: 130-144
        • Choi SH
        • Choi C-H
        The utility of perturbation, non-linear dynamic, and Cepstrum measures of dysphonia according to Signal Typing.
        Phonetics and Speech Sciences. 2014; 6: 63-72
        • Yamasaki R
        • Madazio G
        • Leão SH
        • et al.
        Auditory-perceptual evaluation of normal and dysphonic voices using the voice deviation scale.
        J. Voice. 2017; 31: 67-71
        • Kempster GB
        • Gerratt BR
        • Abbott KV
        • et al.
        Consensus auditory-perceptual evaluation of voice: development of a standardized clinical protocol.
        Am. J. Speech Lang. Pathol. 2009; 18: 124-132
        • De Bodt MS
        • Wuyts FL
        • Van de Heyning PH
        • et al.
        Test-retest study of the GRBAS scale: influence of experience and professional background on perceptual rating of voice quality.
        J. Voice. 1997; 11: 74-80
        • Gerratt BR
        • Kreiman J
        • Antonanzas-Barroso N
        • et al.
        Comparing internal and external standards in voice quality judgments.
        J. Speech Lang. Hear. Res. 1993; 36: 14-20
        • Kreiman J
        • Gerratt BR
        • Kempster GB
        • et al.
        Perceptual evaluation of voice quality: review, tutorial, and a framework for future research.
        J. Speech Lang. Hear. Res. 1993; 36: 21-40
        • Jacobson BH
        • Johnson A
        • Grywalski C
        • et al.
        The voice handicap index (VHI): development and validation.
        Am. J. Speech Lang. Pathol. 1997; 6: 66-70
        • Hogikyan ND
        • Sethuraman G
        Validation of an instrument to measure voice-related quality of life (V-RQOL).
        J. Voice. 1999; 13: 557-569
        • Deary IJ
        • Wilson JA
        • Carding PN
        • et al.
        VoiSS: a patient-derived voice symptom scale.
        J. Psychosom. Res. 2003; 54: 483-489
        • Shoffel-Havakuk H
        • Chau S
        • Hapner ER
        • et al.
        Development and validation of the voice catastrophization index.
        J. Voice. 2019; 33: 232-238
        • Leung L
        Pain catastrophizing: an updated review.
        Indian J Psychol Med. 2012; 34: 204
        • Spanos NP
        • Radtke-Bodorik HL
        • Ferguson JD
        • et al.
        The effects of hypnotic susceptibility, suggestions for analgesia, and the utilization of cognitive strategies on the reduction of pain.
        J. Abnorm. Psychol. 1979; 88: 282
        • Chaves JF
        • Brown JM
        Spontaneous cognitive strategies for the control of clinical pain and stress.
        J. Behav. Med. 1987; 10: 263-276
        • Rosenstiel AK
        • Keefe FJ
        The use of coping strategies in chronic low back pain patients: relationship to patient characteristics and current adjustment.
        Pain. 1983; 17: 33-44
        • Lee YW
        • Kim GH
        • Bae IH
        • et al.
        Korean Voice Catastrophization Index (K-VCI): Validation of the Voice Catastrophization Index for Koreans.
        J. Voice. 2019; (in press)
        • Awan SN
        • Roy N
        Acoustic prediction of voice type in women with functional dysphonia.
        J. Voice. 2005; 19: 268-282
        • Awan SN
        • Roy N
        • Dromey C
        Estimating dysphonia severity in continuous speech: application of a multi-parameter spectral/cepstral model.
        Clin. Linguist. Phon. 2009; 23: 825-841
        • Awan SN
        • Roy N
        • Jetté ME
        • et al.
        Quantifying dysphonia severity using a spectral/cepstral-based acoustic index: comparisons with auditory-perceptual judgements from the CAPE-V.
        Clin. Linguist. Phon. 2010; 24: 742-758
        • Awan SN
        • Solomon NP
        • Helou LB
        • et al.
        Spectral-cepstral estimation of dysphonia severity: external validation.
        Ann Otol Rhinol Laryngol. 2013; 122: 40-48
        • Peterson EA
        • Roy N
        • Awan SN
        • et al.
        Toward validation of the cepstral spectral index of dysphonia (CSID) as an objective treatment outcomes measure.
        J. Voice. 2013; 27: 401-410
        • Awan SN
        The voice diagnostic protocol: A practical guide to the diagnosis of voice disorders.
        Aspen Pub, 2001
        • Awan SN
        • Roy N
        Toward the development of an objective index of dysphonia severity: a four‐factor acoustic model.
        Clin. Linguist. Phon. 2006; 20: 35-49
        • Wolfe VI
        • Martin DP
        • Palmer CI
        Perception of dysphonic voice quality by naive listeners.
        J. Speech Lang. Hear. Res. 2000; 43: 697-705
        • Hartl DM
        • Hans S
        • Vaissière J
        • et al.
        Objective voice quality analysis before and after onset of unilateral vocal fold paralysis.
        J. Voice. 2001; 15: 351-361
        • Heman-Ackah YD
        • Michael DD
        • Goding Jr, GS
        The relationship between cepstral peak prominence and selected parameters of dysphonia.
        J. Voice. 2002; 16: 20-27
        • Kim G-H
        • Lee Y-W
        • Bae I-H
        • et al.
        Validation of the acoustic voice quality index in the Korean language.
        J. Voice. 2019; 33: 948-e1
        • Maryn Y
        • Kim H-T
        • Kim J
        Auditory-perceptual and acoustic methods in measuring dysphonia severity of Korean speech.
        J. Voice. 2016; 30: 587-594
        • Yun Y
        • Kim H
        • Son Y
        • et al.
        Validation of the Korean Voice Handicap Index (K-VHI) and the clinical usefulness of Korean VHI-10.
        Korean Journal of Communication Disorders. 2008; 13: 216-241
        • Kim J-O
        • Lim S-E
        • Park S-Y
        • et al.
        Validity and reliability of Korean-version of voice handicap index and voice-related quality of life.
        Speech Sciences. 2007; 14: 111-125
        • Lee YW
        • Kim GH
        • Bae IH
        • et al.
        The cut-off analysis using visual analogue scale and cepstral assessments on severity of voice disorder.
        Logoped Phoniatr Vocol. 2018; 43: 175-180
        • Chan KM
        • Yiu EM
        The effect of anchors and training on the reliability of perceptual voice evaluation.
        J. Speech Lang. Hear. Res. 2002; 45: 111-126
        • Greiner M
        • Pfeiffer D
        • Smith R
        Principles and practical application of the receiver-operating characteristic analysis for diagnostic tests.
        Prev. Vet. Med. 2000; 45: 23-41
        • Kumar BR
        • Bhat JS
        • Prasad N
        Cepstral analysis of voice in persons with vocal nodules.
        J. Voice. 2010; 24: 651-653
        • Dejonckere P
        • Wieneke G
        Cepstra of normal and pathological voices: Correlation with acoustic, aerodynamic and perceptual data.
        Advances in clinical phonetics. 1996; 6: 217-226
        • Brinca LF
        • Batista APF
        • Tavares AI
        • et al.
        Use of cepstral analyses for differentiating normal from dysphonic voices: A comparative study of connected speech versus sustained vowel in European Portuguese female speakers.
        J. Voice. 2014; 28: 282-286
        • Lowell SY
        • Colton RH
        • Kelley RT
        • et al.
        Spectral-and cepstral-based measures during continuous speech: capacity to distinguish dysphonia and consistency within a speaker.
        J. Voice. 2011; 25: e223-e232
        • Lee JM
        • Roy N
        • Peterson E
        • et al.
        Comparison of two multiparameter acoustic indices of dysphonia severity: the Acoustic Voice Quality Index and Cepstral Spectral Index of dysphonia.
        J. Voice. 2018; 32: 515.e1-515.e13
        • Lowell SY
        • Colton RH
        • Kelley RT
        • et al.
        Predictive value and discriminant capacity of cepstral-and spectral-based measures during continuous speech.
        J. Voice. 2013; 27: 393-400
        • Watts CR
        • Awan SN
        Use of spectral/cepstral analyses for differentiating normal from hypofunctional voices in sustained vowel and continuous speech contexts.
        J. Speech Lang. Hear. Res. 2011; 54: 1525-1537
        • Awan SN
        • Roy N
        • Cohen SM
        Exploring the relationship between spectral and cepstral measures of voice and the Voice Handicap Index (VHI).
        J. Voice. 2014; 28: 430-439
        • Niebudek-Bogusz E
        • Kuzańska A
        • Woznicka E
        • et al.
        Assessment of the voice handicap index as a screening tool in dysphonic patients.
        Folia Phoniatr. Logop. 2011; 63: 269-272
        • Gräßel E
        • Hoppe U
        • Rosanowski F
        Graduierung des Voice-Handicap-Index.
        HNO. 2008; 56: 1221-1228
        • Ohlsson A-C
        • Dotevall H
        Voice handicap index in Swedish.
        Logoped Phoniatr Vocol. 2009; 34: 60-66
      1. Morawska J, Niebudek-Bogusz E, Wiktorowicz J, et al. Screening value of V-RQOL in the evaluation of occupational voice disorders. 2017.

        • Moradi N
        • Pourshahbaz A
        • Soltani M
        • et al.
        Cutoff point at voice handicap index used to screen voice disorders among persian speakers.
        J. Voice. 2013; 27: 130.e1-130.e5
        • Günther S
        • Rasch T
        • Klotz M
        • et al.
        Determination of subjective impairment in dysphonia. A methodological comparison.
        HNO. 2005; 53: 895-900
        • Franic DM
        • Bramlett RE
        • Bothe AC
        Psychometric evaluation of disease specific quality of life instruments in voice disorders.
        J. Voice. 2005; 19: 300-315
        • Ahmadi A
        • Faham M
        • Hosseinifar S
        • et al.
        Translation and validation of the voice catastrophization index for Persian-speaking patients with dysphonia.
        Folia Phoniatr. Logop. 2020; 72: 341-350
        • Willinger U
        • Völkl-Kernstock S
        • Aschauer HN
        Marked depression and anxiety in patients with functional dysphonia.
        Psychiatry Res. 2005; 134: 85-91
        • House A
        • Andrews HB
        The psychiatric and social characteristics of patients with functional dysphonia.
        J. Psychosom. Res. 1987; 31: 483-490