Advertisement

Validation of the Self-assessment of Communication Competence (SACCom) in Brazilian Portuguese Through Item Response Theory

  • Vanessa Veis Ribeiro
    Correspondence
    Address correspondence and reprint requests to Vanessa Veis Ribeiro, Universidade de Brasília – UnB, Speech-Language Pathology Course, Campus Universitário, Centro Metropolitano, Ceilândia Sul, Brasília, Distrito Federal, Brazil, 72220-275.
    Affiliations
    Speech-Language Pathology Course, Universidade de Brasília - UnB. Campus Universitário, Centro Metropolitano, Brasília, Distrito Federal, Brazil
    Search for articles by this author
  • Marcos Antonio da Cunha Santos
    Affiliations
    Statistical Department, Universidade Federal de Minas Gerais - UFMG. Pampulha, Belo Horizonte, Minas Gerais, Brazil
    Search for articles by this author
  • Anna Alice Figueiredo de Almeida
    Affiliations
    Speech-Language Pathology Department, Universidade Federal da Paraíba - UFPB. Cidade Universitária, Conjunto Presidente Castelo Branco III, João Pessoa, Paraíba, Brazil
    Search for articles by this author
  • Mara Behlau
    Affiliations
    Speech-Language Pathology Department, Universidade Federal de São Paulo – UNIFESP and Centro de Estudos da Voz – CEV, São Paulo, Brazil
    Search for articles by this author
Published:September 07, 2022DOI:https://doi.org/10.1016/j.jvoice.2022.07.013

      Summary

      Objective

      To evaluate the validity of the Self-assessment of Communication Competence – SACCom by analyzing the communication competency of adult individuals using the item response theory (IRT).

      Methods

      Overall, 778 individuals who responded to SACCom participated in this study. The initial version consisted of 20 polytomous items regarding communication skills. Polytomous answer keys to each item were ordered as follows: 1 - no, 2 - more or less, and 3 - yes. The IRT and the gradual response model, a 2-parameter logistic model for polytomous items, were used for validation.

      Results

      Due to problems in the preliminary analysis using the item characteristic curve (ICC), answer keys to SACCom items were reorganized in an ordinal dichotomous way. Response 1 was coded as 0 - no, while responses 2 and 3 were coded as 1 - yes. Item 9 of the ICC was problematic and did not add information to the instrument; hence, this item was excluded. SACCom, in its dichotomous format with 19 items, was unidimensional according to the eigenvalues graph and tetrachoric correlation analysis. The Cronbach's alpha coefficient showed an internal consistency value of 0.711. All item-total correlations were greater than 0.284. Item discrimination parameters ranged from a = 0.563 to a = 1.505, and the difficulty of the items ranged between b = –2.725 and b = 0.612. The likelihood ratio test showed that the model without restrictions best fit the data. ICC gleaned more information for individuals with lower communication skills.

      Conclusion

      The 19-item, dichotomous SACCom is valid for the analysis of communication skills according to the IRT.

      Key words

      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Journal of Voice
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      REFERENCES

        • Brasil Presidência da República
        • Casal Civil S para AJ
        Lei No6.965, de 9 Dezembro de 1981.
        Dispõe Sobre a Regulamentação Da Profissão de Fonoaudiólogo, e Determina Outras Providências. 1981
        • Schwartz K.
        From clinic to conference room. speech-language pathology in the corporate sector.
        ASHA. 1995; 37: 43-46
        • Behlau M
        • Madazio G.
        Abordagem fonoaudiológica no aprimoramento da comunicação em público.
        in: Lopes L Moreti F Zambon F Vaiano T Fundamentos e Atualidades Em Voz Profissional. Thieme, 2020: 107-116
        • Ruben RJ.
        Redefining the survival of the fittest: communication disorders in the 21st century.
        Laryngoscope. 2000; 110 (241-241)https://doi.org/10.1097/00005537-200002010-00010
        • Neiva TMA
        • Gama ACC
        • Teixeira LC.
        Expressividade vocal e corporal para falar bem no telejornalismo: resultados de treinamento.
        Rev CEFAC. 2016; 18: 498-507https://doi.org/10.1590/1982-021620161829415
        • Christensen B.
        corporate speech-language pathology: is it right for you?.
        ASHA Lead. 2006; 11: 14-25https://doi.org/10.1044/leader.FTR3.11012006.14
        • Pedrotti CA
        • Behlau M.
        Recursos comunicativos de executivos e profissionais em função operacional.
        CoDAS. 2017; 29https://doi.org/10.1590/2317-1782/20172015217
        • Eadie TL
        • Yorkston KM
        • Klasner ER
        • et al.
        Measuring communicative participation: a review of self-report instruments in speech-language pathology.
        Am J Speech-Language Pathol. 2006; 15: 307-320https://doi.org/10.1044/1058-0360(2006/030
        • Behlau M.
        Teste de Autoavaliação da Competência Comunicativa. Centro de Estudos da Voz.
        2002 (Published)
        • Baker FB.
        The Basics of Item Response Theory.
        ERIC Clearinghouse on Assessment and Evaluation. 2001; 1
        • Paulinelli BR
        • Gama ACC
        • Behlau M.
        Validação do Questionário de Performance Vocal no Brasil.
        Rev da Soc Bras Fonoaudiol. 2012; 17: 85-91https://doi.org/10.1590/S1516-80342012000100016
        • Behlau M
        • Madazio G
        • Moreti F
        • et al.
        Efficiency and cutoff values of self-assessment instruments on the impact of a voice problem.
        J Voice. 2016; 30: 506.e9-506.e18https://doi.org/10.1016/j.jvoice.2015.05.022
        • Moreti F
        • Zambon F
        • Oliveira G
        • et al.
        Cross-cultural adaptation, validation, and cutoff values of the Brazilian version of the voice symptom scale—VoiSS.
        J Voice. 2014; 28: 458-468https://doi.org/10.1016/j.jvoice.2013.11.009
        • Behlau M
        • Alves dos Santos L de M
        • Oliveira G.
        Cross-cultural adaptation and validation of the voice handicap index into Brazilian portuguese.
        J Voice. 2011; 25: 354-359https://doi.org/10.1016/j.jvoice.2009.09.007
        • Costa T
        • Oliveira G
        • Behlau M.
        Validation of the voice handicap index: 10 (VHI-10) to the Brazilian portuguese.
        CoDAS. 2013; 25: 482-485https://doi.org/10.1590/S2317-17822013000500013
      1. Behlau M, Oliveira G, Santos L de MA dos, et al. Validação no Brasil de protocolos de auto-avaliação do impacto de uma disfonia. pró-fono rev atualização científica. 2009;21:326-332. doi:10.1590/S0104-56872009000400011

        • Zambon F
        • Moreti F
        • Ribeiro VV
        • et al.
        Vocal fatigue index: validation and cutoff values of the Brazilian version.
        J Voice. 2022; 36 (Published online): 434.e17-434.e24https://doi.org/10.1016/j.jvoice.2020.06.018
        • de Assis Moura Ghirardi AC
        • Piccolotto Ferreira L
        • Pimentel Pinto Giannini S
        • et al.
        Screening index for voice disorder (SIVD): development and validation.
        J Voice. 2013; 27: 195-200https://doi.org/10.1016/j.jvoice.2012.11.004
        • Pernambuco LDA
        • Espelt A
        • Magalhães Júnior HV
        • et al.
        Screening for voice disorders in older adults (rastreamento de alterações vocais em idosos—ravi)—part i: validity evidence based on test content and response processes.
        J Voice. 2016; 30: 246.e9-246.e17https://doi.org/10.1016/j.jvoice.2015.04.008
        • Aaronson N
        • Alonso J
        • Burnam A
        • et al.
        Scientific advisory committee of medical outcomes trust. assessing health status and quality of life instruments: attributes and review criteria.
        Qual Life Res. 2002; 11: 193-205
        • Pernambuco L
        • Espelt A
        • Magalhães Junior HV
        • et al.
        Recommendations for elaboration, transcultural adaptation and validation process of tests in speech, hearing and language pathology.
        CoDAS. 2017; 29e20160217https://doi.org/10.1590/2317-1782/20172016217
        • Pasquali L.
        Teoria de resposta ao item: teoria, procedimentos e aplicações.
        Appris. 2018;
        • Branski RC
        • Cukier-Blaj S
        • Pusic A
        • et al.
        Measuring quality of life in dysphonic patients: a systematic review of content development in patient-reported outcomes measures.
        J Voice. 2010; 24: 193-198https://doi.org/10.1016/j.jvoice.2008.05.006
        • Naderifar E
        • Moradi N
        • Farzadi F
        • et al.
        Cross-cultural adaptation and validation of the vocal fatigue index into persian.
        J Voice. August 2019; (Published online): 1-7https://doi.org/10.1016/j.jvoice.2018.07.024
        • Deary IJ
        • Wilson JA
        • Carding PN
        • et al.
        From dysphonia to dysphoria: mokken scaling shows a strong, reliable hierarchy of voice symptoms in the voice symptom scale questionnaire.
        J Psychosom Res. 2010; 68: 67-71https://doi.org/10.1016/j.jpsychores.2009.06.008
        • Bogaardt HCA
        • Hakkesteegt MM
        • Grolman W
        • et al.
        Validation of the voice handicap index using rasch analysis.
        J Voice. 2007; 21: 337-344https://doi.org/10.1016/j.jvoice.2005.09.007
        • Couto G
        • Primi R.
        Item response theory (ITR): elementary concepts for dicotomic items models.
        Bol Psicol. 2011; 62: 1-15
        • Pasquali L
        • Primi R.
        basic theory of item response theory - IRT.
        Aval Psicol. 2003; 2: 99-110https://doi.org/10.22347/2175-2753v1i2.38
        • Rizopoulos D.
        ltm: an R package for latent variable modeling and item response theory analyses.
        J Stat Softw. 2006; 17: 1-25https://doi.org/10.18637/jss.v017.i05
        • Tsvetkov D
        • Hristov L.
        Computer implementation of mmle/em algorithm for two-parametric logistic model.
        in: CompSysTech Proceedings of the 4th international conference conference on Computer systems and technologies: e-Learning. 4. CompSysTech, 2003: 661-666
        • Bunch G.
        Immigrants students, English language proficiency and transitions from high school to community college.
        in: Wiley TG Lee JS Rumberger RW The Education of Language Minorities Immigrants in the United States. Multilingual Matters, Bristol, UK2009
        • Patel RR
        • Awan SN
        • Barkmeier-Kraemer J
        • et al.
        Recommended protocols for instrumental assessment of voice: american speech-language-hearing association expert panel to develop a protocol for instrumental assessment of vocal function.
        Am J Speech-Language Pathol. 2018; 27: 887-905https://doi.org/10.1044/2018_AJSLP-17-0009
        • Mingoti SA.
        Análise de Dados Através de Métodos de Estatística Multivariada: Uma Abordagem Aplicada.
        UFMG, Belo Horizonte, MG, Brazil2005
        • JFH
        • Black WC
        • Babin BJ
        • Anderson RE
        • Tatham RL
        Análise Multivariada de Dados.
        6th ed. Bookman, Porto Alegre, RS, Brazil2009
        • Landis J
        • Koch G.
        The measurement of observer agreement for categorical data.
        Biometrics. 1977; 33: 159-174
        • Hambleton RK
        • Swaminathan H
        • Rogers HJ.
        Fundamentals of a Item Responde Theory.
        Sage Publication, Newbury Park, CA1991
        • Cronbach LJ.
        Coefficient alpha and the internal structure of tests.
        Psychometrika. 1951; 16: 297-334https://doi.org/10.1007/BF02310555
        • Harshman EF
        • Harshman CL
        Communicating with employees: building on an ethical foundation.
        J Bus Ethics. 1999; 19: 3-19
        • Martins V.
        Seja Assertivo.
        Alta Books, Rio de Janeiro, RJ, Brazil2015
        • Cialdini R.
        Influence: the psychology of Persuasion.
        HarperBusiness. 2020; Expanded
        • Davenport T
        • Beck J.
        The Attention Economy: Understanding the New Currency of Business.
        Harvard Business School Press, 2001
        • Rock D.
        Your Brain at Work: Strategies for Overcoming Distraction, Regaining Focus, and Working Smarter All Day Long.
        HarperBusiness;. 2009;
        • Chomsky M.
        Aspects of the Theory of Syntax.
        MIT Press, Cambridge, MA, USA1965
        • Peters T.
        The Brand You 50: Fifty Ways to Transform Yourself from an “Employee” into a Brand That Shouts Distinction, Commitment, and Passion!.
        Knopf, 1999
        • Duncan T
        • Moriarty SE.
        A communication-based marketing model for managing relationships.
        J Mark. 1998; 62: 1https://doi.org/10.2307/1252157
        • Wiener JL
        • LaForge RW
        • Goolsby JR.
        Personal Communication in marketing: an examination of self-interest contingency relationships.
        J Mark Res. 1990; 27: 227https://doi.org/10.2307/3172849
        • Hancock AB
        • Rubin BA.
        Influence of communication partner's gender on language.
        J Lang Soc Psychol. 2015; 34: 46-64https://doi.org/10.1177/0261927X14533197