« Back Journal of Voice

Article in Press

Comparison of Rater’s Reliability on Perceptual Evaluation of Different Types of Voice Sample

  • Thomas Law

      Affiliations

    • Department of Otorhinolaryngology, Head & Neck Surgery, The Chinese University of Hong Kong, Sha Tin, New Territories, Hong Kong, China
    • Corresponding Author InformationAddress correspondence and reprint requests to Thomas Law, Department of Otorhinolaryngology, Head & Neck Surgery, Level 6, Clinical Science Building, Prince of Wales Hospital, The Chinese University of Hong Kong, Sha Tin, New Territories, Hong Kong.
    • ,
  • Jean H. Kim

      Affiliations

    • School of Public Health & Primary Care, The Chinese University of Hong Kong, Sha Tin, New Territories, Hong Kong, China
    • ,
  • Kathy Y. Lee

      Affiliations

    • Department of Otorhinolaryngology, Head & Neck Surgery, The Chinese University of Hong Kong, Sha Tin, New Territories, Hong Kong, China
    • ,
  • Eric C. Tang

      Affiliations

    • Department of Ear, Nose and Throat, United Christian Hospital, Hospital Authority, Sha Tin, New Territories, Hong Kong, China
    • ,
  • Joffee H. Lam

      Affiliations

    • Department of Otorhinolaryngology, Head & Neck Surgery, The Chinese University of Hong Kong, Sha Tin, New Territories, Hong Kong, China
    • ,
  • Andrew C. van Hasselt

      Affiliations

    • Department of Otorhinolaryngology, Head & Neck Surgery, The Chinese University of Hong Kong, Sha Tin, New Territories, Hong Kong, China
    • ,
  • Michael C. Tong

      Affiliations

    • Department of Otorhinolaryngology, Head & Neck Surgery, The Chinese University of Hong Kong, Sha Tin, New Territories, Hong Kong, China

,Accepted 5 August 2011. Published online 13 January 2012 Corrected Proof

References 

  1. Kreiman J, Gerratt BR, Kempster GB, Erman A, Berke GS. Perceptual evaluation of voice quality: review, tutorial, and a framework for future research. J Speech Hear Res. 1993;36:21–40
  2. Oates J. Auditory-perceptual evaluation of disordered voice quality: pros, cons and future directions. Folia Phoniatr Logop. 2009;61:49–56
  3. Zraick RI, Wendel K, Smith-Olinde L. The effect of speaking task on perceptual judgement of the severity of dysphonic voice. J Voice. 2005;19:574–581
  4. Carding P, Carlson E, Epstein R, Mathieson L, Shewell C. Formal perceptual evaluation of voice quality in the United Kingdom. Logoped Phoniatr Vocol. 2000;25:133–138
  5. Yu P, Revis J, Wuyts FL, Zanaret M, Giovanni A. Correlation of instrumental voice evaluation with perceptual voice analysis using a modified visual analog scale. Folia Phoniatr Logop. 2002;54:271–281
  6. Munoz J, Mendoza E, Fresneda MD, Carballo G. Perceptual analysis in difference voice samples: agreement and reliability. Percept Mot Skills. 2002;94:1187–1195
  7. Kempster GB, Gerratt BR, Verdonlini KA, Barkmeier-Kraemer J, Hillman RE. Consensus auditory-perceptual evaluation of voice: development of a standardized clinical protocol. Am J Speech Lang Pathol. 2009;18:124–132
  8. de Krom G. Consistency and reliability of voice quality ratings for different types of speech fragments. J Speech Hear Res. 1994;37:985–1000
  9. Revis J, Giovanni A, Wuyts FL, Triglia J. Comparison of different voice samples for perceptual analysis. Folia Phoniatr Logop. 1999;51:108–116
  10. Bele IV. Reliability in perceptual analysis of voice quality. J Voice. 2004;19:555–573
  11. Bassich CJ, Ludlow CL. The use of perceptual methods by new clinicians for assessing voice quality. J Speech Hear Disord. 1986;51:125–133
  12. Poletto CJ, Verdun LP, Strominger R, Ludlow CL. Correspondence between laryngeal vocal fold movement and muscle activity during speech and nonspeech gestures. J Appl Physiol. 2004;97:858–866
  13. Roy N, Gouse M, Mauszycki SC, Merrill RM, Smith ME. Task specificity in adductor spasmodic dysphonia versus muscle tension dysphonia. Laryngoscope. 2005;115:311–316
  14. Parsa V, Jamieson DG. Acoustic discrimination of pathological voice: sustained vowels versus continuous speech. J Speech Lang Hear Res. 2001;44:327–339
  15. Law T, Lee K-Y, Lam J-H, van Hasselt CA, Tong M-C. The construction of the Cantonese perceptual evaluation of voice (CanPEV): the content validation process. In: The 4th World Voice Congress Proceedings. Seoul, Korea: World Voice Consortium; 2010;159
  16. Carding PN, Horsley IA, Docherty GJ. A study of the effectiveness of voice therapy in the treatment of 45 patients with nonorganic dysphonia. J Voice. 1999;13:72–104
  17. Gillivan-Murphy P, Drinnan MJ, O’Dwyer TP, Ridha H, Carding P. The effectiveness of a voice treatment approach for teacher with self-reported voice problems. J Voice. 2006;20:423–431
  18. MacKenzie K, Millar A, Wilson JA, Sellars C, Deary IJ. Is voice therapy an effective treatment for dysphonia? A randomised controlled trial. BMJ. 2001;323:1–6
  19. Eadie TL, Doyle PC. Classification of dysphonic voice: acoustic and auditory-perceptual measures. J Voice. 2005;19:1–14
  20. Yaffee RA. Enhancement of reliability analysis: application of ICC with SPSS/Windows v.8. Available at: http://www.nyu.edu/its/statistics/Docs/intracls.html. Last accessed January 30, 2009.
  21. De Bodt MS, Wuyts FL, Van de Heyning PH, Croux C. Test-retest study of the GRBAS scale: influence of experience and professional background on perceptual rating of voice quality. J Voice. 1997;11:74–80
  22. Bonett DG. Sample size requirements for estimating intraclass correlations with desired precision. Stat Med. 2002;21:1331–1335
  23. Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979;86:420–428
  24. Portney LS, Watkins MP. Foundations of Clinical Research: Applications to Practice. 2nd ed. Upper Saddle River, NJ: Prentice-Hall; 2000;
  25. Norman G, Streiner D. Biostatistics: The Bare Essentials. 3rd ed. Hamilton, Ontario: BC Decker Inc; 2008;
  26. Yiu E-M. Clinical voice assessment and therapy: a Hong Kong perspective. In:  Yiu E-M editors. Volume 1: Assessment of Voice Disorders. Hong Kong: The University of Hong Kong; 2001;
  27. Awan SN, Lawson LL. The effect of anchor modality on the reliability of vocal severity ratings. J Voice. 2009;23:341–352
  28. Gerratt BR, Kreiman J, Antonanzas-Barroso N, Berke GS. Comparing internal and external standards in voice quality judgements. J Speech Hear Res. 1993;36:14–20
  29. Chan KMK, Yiu EM. The effect of anchors and training in the reliability of perceptual voice evaluation. J Speech Lang Hear Res. 2002;45:116–126
  30. Bauer RS, Benedict PK. Modern Cantonese Phonology. Berlin, Germany: Mouton de Gruyter; 1997;
  31. Yamaguchi H, Shrivastav R, Andrews ML, Niimi S. A comparison of voice quality made by Japanese and American listeners using the GRBAS scale. Folia Phoniatr Logop. 2003;55:147–157
  32. Yiu EM, Murdoch B, Hird K, Lau P, Ho EM. Cultural and language differences in voice quality perception: a preliminary investigation using synthesized signals. Folia Phoniat Logop. 2008;60:107–119

PII: S0892-1997(11)00125-1

doi: 10.1016/j.jvoice.2011.08.003

« Back Journal of Voice

Article in Press

Article Tools

* Image Usage & Resolution