<?xml version="1.0" encoding="ISO-8859-1"?><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
<front>
<journal-meta>
<journal-id>0103-6831</journal-id>
<journal-title><![CDATA[Estudos em Avaliação Educacional]]></journal-title>
<abbrev-journal-title><![CDATA[Est. Aval. Educ.]]></abbrev-journal-title>
<issn>0103-6831</issn>
<publisher>
<publisher-name><![CDATA[Fundação Carlos Chagas]]></publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id>S0103-68312023000100125</article-id>
<article-id pub-id-type="doi">10.18222/eae.v34.9951</article-id>
<title-group>
<article-title xml:lang="pt"><![CDATA[RELAÇÃO ENTRE A COMPETÊNCIA E A EXPERIÊNCIA EM AVALIAÇÃO DOS AVALIADORES DO SINAES]]></article-title>
<article-title xml:lang="es"><![CDATA[RELACIÓN ENTRE COMPETENCIA Y EXPERIENCIA SEGÚN LA EVALUACIÓN DE LOS EVALUADORES DEL SINAES]]></article-title>
<article-title xml:lang="en"><![CDATA[RELATIONSHIP BETWEEN SINAES EVALUATORS&#8217; COMPETENCE AND EXPERIENCE IN EVALUATION]]></article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name>
<surname><![CDATA[CASTRO]]></surname>
<given-names><![CDATA[LUIS CARLOS DA SILVA]]></given-names>
</name>
<xref ref-type="aff" rid="Aff"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname><![CDATA[PAIXÃO]]></surname>
<given-names><![CDATA[ROBERTO BRAZILEIRO]]></given-names>
</name>
<xref ref-type="aff" rid="Aff"/>
</contrib>
</contrib-group>
<aff id="Af1">
<institution><![CDATA[,Universidade Federal da Bahia  ]]></institution>
<addr-line><![CDATA[Salvador BA]]></addr-line>
<country>Brazil</country>
</aff>
<aff id="Af2">
<institution><![CDATA[,Universidade Federal da Bahia  ]]></institution>
<addr-line><![CDATA[Salvador BA]]></addr-line>
<country>Brazil</country>
</aff>
<pub-date pub-type="pub">
<day>00</day>
<month>00</month>
<year>2023</year>
</pub-date>
<pub-date pub-type="epub">
<day>00</day>
<month>00</month>
<year>2023</year>
</pub-date>
<volume>34</volume>
<copyright-statement/>
<copyright-year/>
<self-uri xlink:href="http://educa.fcc.org.br/scielo.php?script=sci_arttext&amp;pid=S0103-68312023000100125&amp;lng=en&amp;nrm=iso"></self-uri><self-uri xlink:href="http://educa.fcc.org.br/scielo.php?script=sci_abstract&amp;pid=S0103-68312023000100125&amp;lng=en&amp;nrm=iso"></self-uri><self-uri xlink:href="http://educa.fcc.org.br/scielo.php?script=sci_pdf&amp;pid=S0103-68312023000100125&amp;lng=en&amp;nrm=iso"></self-uri><abstract abstract-type="short" xml:lang="pt"><p><![CDATA[RESUMO Este estudo busca analisar a relação entre a competência e a experiência em avaliação dos avaliadores do Sistema Nacional de Avaliação da Educação Superior (Sinaes). Foi feita uma pesquisa Delphi para listar as competências em avaliação consideradas mais adequadas ao contexto do Sinaes. Na sequência foi realizada uma survey para identificar a experiência em avaliação e a autoavaliação deles sobre o desenvolvimento de suas competências. Os dados empíricos evidenciaram que, em todas as dimensões teóricas de competências, quanto maior a quantidade de avaliações feitas, maior o nível de desenvolvimento dessas competências. Recomenda-se que avaliadores mais experientes trabalhem em parceria com outros menos experientes, a fim de desenvolver as competências em avaliação.]]></p></abstract>
<abstract abstract-type="short" xml:lang="es"><p><![CDATA[RESUMEN Este estudio intenta analizar la relación entre la competencia y la experiencia en evaluación de los evaluadores do Sistema Nacional de Avaliação da Educação Superior [Sistema Nacional de Evaluación de la Educación Superior] (Sinaes). Se efectuó una pesquisa Delphi para presentar las competencias en evaluación consideradas más adecuadas al contexto del Sinaes. Después de ello se llevó a cabo una survey para identificar su experiencia en evaluación y su autoevaluación sobre el desarrollo de sus competencias. Los datos empíricos pusieron de manifiesto que, en todas las dimensiones teóricas de competencias, cuanto mayor es la cantidad de evaluaciones realizadas, mayor el nivel de desarrollo de dichas competencias. Se recomienda que los evaluadores más experimentados trabajen junto con otros menos experimentados, con el propósito de desarrollar las competencias en evaluación.]]></p></abstract>
<abstract abstract-type="short" xml:lang="en"><p><![CDATA[ABSTRACT This study seeks to analyze the relationship between the competence and experience in evaluation of the Sistema Nacional de Avaliação da Educação Superior [National System for the Evaluation of Higher Education evaluators] (Sinaes). A Delphi study was carried out to list the evaluation competencies considered most appropriate to the context of the Sinaes. A survey was then carried out to identify their experience in evaluation and their self-assessment of the development of their competences. The empirical data showed that in all the theoretical dimensions of competences the greater the number of assessments carried out, the greater the level of development of these competences. It is recommended that more experienced evaluators work in partnership with less experienced ones in order to develop evaluation competencies.]]></p></abstract>
<kwd-group>
<kwd lng="pt"><![CDATA[AVALIAÇÃO]]></kwd>
<kwd lng="pt"><![CDATA[COMPETÊNCIAS]]></kwd>
<kwd lng="pt"><![CDATA[EXPERIÊNCIA]]></kwd>
<kwd lng="pt"><![CDATA[SINAES]]></kwd>
<kwd lng="es"><![CDATA[EVALUACIÓN]]></kwd>
<kwd lng="es"><![CDATA[COMPETENCIAS]]></kwd>
<kwd lng="es"><![CDATA[EXPERIENCIA]]></kwd>
<kwd lng="es"><![CDATA[SINAES]]></kwd>
<kwd lng="en"><![CDATA[EVALUATION]]></kwd>
<kwd lng="en"><![CDATA[COMPETENCIES]]></kwd>
<kwd lng="en"><![CDATA[EXPERIENCE]]></kwd>
<kwd lng="en"><![CDATA[SINAES]]></kwd>
</kwd-group>
</article-meta>
</front><back>
<ref-list>
<ref id="B1">
<nlm-citation citation-type="book">
<collab>American Evaluation Society (AEA)</collab>
<source><![CDATA[The 2018 AEA-evaluator competencies]]></source>
<year>2018</year>
<publisher-name><![CDATA[AEA]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B2">
<nlm-citation citation-type="book">
<collab>Aotearoa New Zealand Evaluation Association (Anzea)</collab>
<source><![CDATA[Evaluator competencies]]></source>
<year>2011</year>
<publisher-name><![CDATA[Anzea]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B3">
<nlm-citation citation-type="book">
<collab>Australasian Evaluation Society (AES)</collab>
<source><![CDATA[Evaluator&#8217;s Professional Learning Competency Framework]]></source>
<year>2013</year>
<publisher-name><![CDATA[AES]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B4">
<nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Badalos]]></surname>
<given-names><![CDATA[D. L.]]></given-names>
</name>
</person-group>
<source><![CDATA[Measurement theory and applications for the social sciences]]></source>
<year>2018</year>
<publisher-name><![CDATA[Guilford]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B5">
<nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Brown]]></surname>
<given-names><![CDATA[T. A.]]></given-names>
</name>
</person-group>
<source><![CDATA[Confirmatory factor analysis for applied research]]></source>
<year>2006</year>
<publisher-name><![CDATA[Guilford]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B6">
<nlm-citation citation-type="book">
<collab>Canadian Evaluation Society (CES)</collab>
<source><![CDATA[Competencies for Canadian evaluation practice]]></source>
<year>2018</year>
<publisher-name><![CDATA[CES]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B7">
<nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Castro]]></surname>
<given-names><![CDATA[L. C. da S.]]></given-names>
</name>
</person-group>
<source><![CDATA[Competências e experiência em avaliação: Uma análise dos avaliadores externos do Sinaes]]></source>
<year>2021</year>
<publisher-name><![CDATA[Universidade Federal da Bahia]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B8">
<nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Dalkey]]></surname>
<given-names><![CDATA[N.]]></given-names>
</name>
<name>
<surname><![CDATA[Helmer]]></surname>
<given-names><![CDATA[O.]]></given-names>
</name>
</person-group>
<source><![CDATA[An experimental application of the Delphi method to the use of experts]]></source>
<year>1962</year>
<publisher-name><![CDATA[The Rand Corporation]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B9">
<nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Daniel]]></surname>
<given-names><![CDATA[W. W.]]></given-names>
</name>
</person-group>
<source><![CDATA[Aplied nonparametric statistics]]></source>
<year>2000</year>
<edition>2nd</edition>
<publisher-name><![CDATA[Cengage Learning]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B10">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Deng]]></surname>
<given-names><![CDATA[L.]]></given-names>
</name>
<name>
<surname><![CDATA[Chan]]></surname>
<given-names><![CDATA[W.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Testing the difference between reliability coefficients Alpha and Omega]]></article-title>
<source><![CDATA[Educational and Psychological Measurement]]></source>
<year>2017</year>
<volume>77</volume>
<numero>2</numero>
<issue>2</issue>
<page-range>185-203</page-range></nlm-citation>
</ref>
<ref id="B11">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Diaz]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
<name>
<surname><![CDATA[Chaudhary]]></surname>
<given-names><![CDATA[A. K.]]></given-names>
</name>
<name>
<surname><![CDATA[Jayaratne]]></surname>
<given-names><![CDATA[K. S. U.]]></given-names>
</name>
<name>
<surname><![CDATA[Assan]]></surname>
<given-names><![CDATA[E.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Expanding evaluator competency research: Exploring competencies for program evaluation using the context of non-formal education]]></article-title>
<source><![CDATA[Evaluation and Program Planning]]></source>
<year>2020</year>
<volume>79</volume>
<page-range>Article e101790</page-range></nlm-citation>
</ref>
<ref id="B12">
<nlm-citation citation-type="">
<collab>Diretoria de Avaliação da Educação Superior (Daes)</collab>
<source><![CDATA[Pedido de informação ao Inep registrado sob o protocolo n. 23546-060999/2021]]></source>
<year>2021</year>
</nlm-citation>
</ref>
<ref id="B13">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Distefano]]></surname>
<given-names><![CDATA[C.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[The impact of categorization with confirmatory factor analysis]]></article-title>
<source><![CDATA[Structural Equation Modeling]]></source>
<year>2002</year>
<volume>9</volume>
<numero>3</numero>
<issue>3</issue>
<page-range>327-46</page-range></nlm-citation>
</ref>
<ref id="B14">
<nlm-citation citation-type="book">
<collab>European Evaluation Society (EES)</collab>
<source><![CDATA[EES Evaluation Capabilities Framework]]></source>
<year>2011</year>
<publisher-name><![CDATA[EES]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B15">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Flora]]></surname>
<given-names><![CDATA[D. B.]]></given-names>
</name>
<name>
<surname><![CDATA[Curran]]></surname>
<given-names><![CDATA[P. J.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data]]></article-title>
<source><![CDATA[Psychological Methods]]></source>
<year>2004</year>
<volume>9</volume>
<numero>4</numero>
<issue>4</issue>
<page-range>466-91</page-range></nlm-citation>
</ref>
<ref id="B16">
<nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Hair]]></surname>
<given-names><![CDATA[J. F.]]></given-names>
</name>
<name>
<surname><![CDATA[Black]]></surname>
<given-names><![CDATA[W. C.]]></given-names>
</name>
<name>
<surname><![CDATA[Babin]]></surname>
<given-names><![CDATA[B. J.]]></given-names>
</name>
<name>
<surname><![CDATA[Anderson]]></surname>
<given-names><![CDATA[R. E]]></given-names>
</name>
</person-group>
<source><![CDATA[Análise multivariada de dados]]></source>
<year>2009</year>
<edition>6a</edition>
<publisher-name><![CDATA[Bookman]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B17">
<nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Halaydna]]></surname>
<given-names><![CDATA[T. M.]]></given-names>
</name>
<name>
<surname><![CDATA[Rodriguez]]></surname>
<given-names><![CDATA[M. C.]]></given-names>
</name>
</person-group>
<source><![CDATA[Developing and validating test items]]></source>
<year>2013</year>
<publisher-name><![CDATA[Routledge]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B18">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Hsu]]></surname>
<given-names><![CDATA[C.-C.]]></given-names>
</name>
<name>
<surname><![CDATA[Sandford]]></surname>
<given-names><![CDATA[B. A.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[The Delphi technique: Making sense of consensus]]></article-title>
<source><![CDATA[Practical Assessment, Research and Evaluation]]></source>
<year>2007</year>
<volume>12</volume>
<numero>Article 10</numero>
<issue>Article 10</issue>
</nlm-citation>
</ref>
<ref id="B19">
<nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Kaesbauer]]></surname>
<given-names><![CDATA[S. A. M.]]></given-names>
</name>
</person-group>
<source><![CDATA[Teaching evaluator competencies: An examination of doctoral programs]]></source>
<year>2012</year>
<publisher-name><![CDATA[University of Tennessee]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B20">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[King]]></surname>
<given-names><![CDATA[J. A.]]></given-names>
</name>
<name>
<surname><![CDATA[Stevahn]]></surname>
<given-names><![CDATA[L.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Competencies for program evaluators in light of adaptive action: What? So what? Now what? Competencies for Program Evaluators in Light of Adaptive Action]]></article-title>
<source><![CDATA[New Directions for Evaluation]]></source>
<year>2015</year>
<numero>145</numero>
<issue>145</issue>
<page-range>21-37</page-range></nlm-citation>
</ref>
<ref id="B21">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[King]]></surname>
<given-names><![CDATA[J. A.]]></given-names>
</name>
<name>
<surname><![CDATA[Stevahn]]></surname>
<given-names><![CDATA[L.]]></given-names>
</name>
<name>
<surname><![CDATA[Ghere]]></surname>
<given-names><![CDATA[G.]]></given-names>
</name>
<name>
<surname><![CDATA[Minnema]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Toward a taxonomy of essential evaluator competencies]]></article-title>
<source><![CDATA[American Journal of Evaluation]]></source>
<year>2001</year>
<volume>22</volume>
<numero>2</numero>
<issue>2</issue>
<page-range>229-47</page-range></nlm-citation>
</ref>
<ref id="B22">
<nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Kline]]></surname>
<given-names><![CDATA[R. B.]]></given-names>
</name>
</person-group>
<source><![CDATA[Principles and practice of structural equation modeling]]></source>
<year>2016</year>
<publisher-name><![CDATA[Guilford]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B23">
<nlm-citation citation-type="">
<collab>Portaria Normativa n. 840, de 24 de agosto de 2018</collab>
<source><![CDATA[Dispõe sobre os procedimentos de competência do Instituto Nacional de Estudos e Pesquisas Educacionais Anísio Teixeira - Inep referentes à avaliação de instituições de educação superior, de cursos de graduação e de desempenho acadêmico de estudantes]]></source>
<year>2018</year>
</nlm-citation>
</ref>
<ref id="B24">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Rosseel]]></surname>
<given-names><![CDATA[Y.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Iavaan: An R package for structural equation modeling]]></article-title>
<source><![CDATA[Journal of Statistical Software]]></source>
<year>2012</year>
<volume>48</volume>
<numero>2</numero>
<issue>2</issue>
</nlm-citation>
</ref>
<ref id="B25">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Stevahn]]></surname>
<given-names><![CDATA[L.]]></given-names>
</name>
<name>
<surname><![CDATA[King]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
<name>
<surname><![CDATA[Ghere]]></surname>
<given-names><![CDATA[G.]]></given-names>
</name>
<name>
<surname><![CDATA[Minnema]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Evaluator competencies in university-based evaluation training programs]]></article-title>
<source><![CDATA[The Canadian Journal of Program Evaluation]]></source>
<year>2005</year>
<month>a</month>
<volume>20</volume>
<numero>2</numero>
<issue>2</issue>
<page-range>101-23</page-range></nlm-citation>
</ref>
<ref id="B26">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Stevahn]]></surname>
<given-names><![CDATA[L.]]></given-names>
</name>
<name>
<surname><![CDATA[King]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
<name>
<surname><![CDATA[Ghere]]></surname>
<given-names><![CDATA[G.]]></given-names>
</name>
<name>
<surname><![CDATA[Minnema]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Establishing essential competencies for program evaluators]]></article-title>
<source><![CDATA[American Journal of Evaluation]]></source>
<year>2005</year>
<month>b</month>
<volume>26</volume>
<numero>1</numero>
<issue>1</issue>
<page-range>43-59</page-range></nlm-citation>
</ref>
<ref id="B27">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Trevisan]]></surname>
<given-names><![CDATA[M. S.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Enhancing practical evaluation training through long-term evaluation projects]]></article-title>
<source><![CDATA[American Journal of Evaluation]]></source>
<year>2002</year>
<volume>23</volume>
<numero>1</numero>
<issue>1</issue>
<page-range>81-92</page-range></nlm-citation>
</ref>
<ref id="B28">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Trevisan]]></surname>
<given-names><![CDATA[M. S.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Practical training in evaluation: A review of the literature]]></article-title>
<source><![CDATA[American Journal of Evaluation]]></source>
<year>2004</year>
<volume>25</volume>
<numero>2</numero>
<issue>2</issue>
<page-range>255-72</page-range></nlm-citation>
</ref>
<ref id="B29">
<nlm-citation citation-type="book">
<collab>UK Evaluation Society (UKES)</collab>
<source><![CDATA[UK Evaluation Society Framework of Evaluation Capabilities]]></source>
<year>2012</year>
<publisher-name><![CDATA[UKES]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B30">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Wehipeihana]]></surname>
<given-names><![CDATA[N.]]></given-names>
</name>
<name>
<surname><![CDATA[Bailey]]></surname>
<given-names><![CDATA[R.]]></given-names>
</name>
<name>
<surname><![CDATA[Davidson]]></surname>
<given-names><![CDATA[E. J.]]></given-names>
</name>
<name>
<surname><![CDATA[McKegg]]></surname>
<given-names><![CDATA[K.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Evaluator competencies: The Aotearoa New Zealand Experience]]></article-title>
<source><![CDATA[The Canadian Journal of Program Evaluation]]></source>
<year>2014</year>
<volume>28</volume>
<numero>3</numero>
<issue>3</issue>
<page-range>49-69</page-range></nlm-citation>
</ref>
</ref-list>
</back>
</article>
