<?xml version="1.0" encoding="ISO-8859-1"?><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
<front>
<journal-meta>
<journal-id>0103-6831</journal-id>
<journal-title><![CDATA[Estudos em Avaliação Educacional]]></journal-title>
<abbrev-journal-title><![CDATA[Est. Aval. Educ.]]></abbrev-journal-title>
<issn>0103-6831</issn>
<publisher>
<publisher-name><![CDATA[Fundação Carlos Chagas]]></publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id>S0103-68312018000300858</article-id>
<article-id pub-id-type="doi">10.18222/eae.v29i72.4897</article-id>
<title-group>
<article-title xml:lang="pt"><![CDATA[Evidências de validade de conteúdo da prova de psicologia do ENADE]]></article-title>
<article-title xml:lang="es"><![CDATA[Evidencias de validez de contenido de la prueba de psicología del ENADE]]></article-title>
<article-title xml:lang="en"><![CDATA[Evidence of content validity of the ENADE psychology assessment]]></article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name>
<surname><![CDATA[Jesus]]></surname>
<given-names><![CDATA[Girlene Ribeiro de]]></given-names>
</name>
<xref ref-type="aff" rid="Aff"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname><![CDATA[Rêgo]]></surname>
<given-names><![CDATA[Renata Manuelly de Lima]]></given-names>
</name>
<xref ref-type="aff" rid="Aff"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname><![CDATA[Souza]]></surname>
<given-names><![CDATA[Victor Vasconcelos de]]></given-names>
</name>
<xref ref-type="aff" rid="Aff"/>
</contrib>
</contrib-group>
<aff id="Af1">
<institution><![CDATA[,Universidade de Brasília Centro Brasileiro de Pesquisa em Avaliação e Seleção e de Promoção de Eventos ]]></institution>
<addr-line><![CDATA[Brasília-DF ]]></addr-line>
<country>Brazil</country>
</aff>
<aff id="Af2">
<institution><![CDATA[,Universidade de Brasília Centro Brasileiro de Pesquisa em Avaliação e Seleção e de Promoção de Eventos ]]></institution>
<addr-line><![CDATA[Brasília-DF ]]></addr-line>
<country>Brazil</country>
</aff>
<aff id="Af3">
<institution><![CDATA[,Universidade de Brasília Centro Brasileiro de Pesquisa em Avaliação e Seleção e de Promoção de Eventos ]]></institution>
<addr-line><![CDATA[Brasília-DF ]]></addr-line>
<country>Brazil</country>
</aff>
<pub-date pub-type="pub">
<day>00</day>
<month>09</month>
<year>2018</year>
</pub-date>
<pub-date pub-type="epub">
<day>00</day>
<month>09</month>
<year>2018</year>
</pub-date>
<volume>29</volume>
<numero>72</numero>
<fpage>858</fpage>
<lpage>884</lpage>
<copyright-statement/>
<copyright-year/>
<self-uri xlink:href="http://educa.fcc.org.br/scielo.php?script=sci_arttext&amp;pid=S0103-68312018000300858&amp;lng=en&amp;nrm=iso"></self-uri><self-uri xlink:href="http://educa.fcc.org.br/scielo.php?script=sci_abstract&amp;pid=S0103-68312018000300858&amp;lng=en&amp;nrm=iso"></self-uri><self-uri xlink:href="http://educa.fcc.org.br/scielo.php?script=sci_pdf&amp;pid=S0103-68312018000300858&amp;lng=en&amp;nrm=iso"></self-uri><abstract abstract-type="short" xml:lang="pt"><p><![CDATA[RESUMO O presente estudo tem como objetivo analisar evidências de validade com base no conteúdo da prova de psicologia aplicada no Exame Nacional de Desempenho dos Estudantes (Enade) de 2015. Foi utilizada a blueprint, ferramenta recomendada pela literatura internacional que embasa o planejamento dos testes. Houve divergência significativa entre as competências e habilidades apresentadas na matriz de referência e a demanda cognitiva solicitada na maior parte das questões objetivas. Há habilidades presentes na matriz que não foram contempladas na prova e outras foram contempladas com apenas um único item, o que compromete a confiabilidade da medida. As análises mostraram a necessidade do uso de técnicas que podem melhorar essa fonte primária de evidência.]]></p></abstract>
<abstract abstract-type="short" xml:lang="es"><p><![CDATA[RESUMEN El presente estudio tiene el propósito de analizar evidencias de validez en base al contenido de la prueba de psicología aplicada en el Exame Nacional de Desempenho dos Estudantes (Enade) del 2015. Se utilizó la blueprint, herramienta recomendada por la literatura internacional que sirve como base para la planificación de las pruebas. Hubo divergencia significativa entre las competencias y habilidades presentadas en la matriz de referencia y la demanda cognitiva solicitada en la mayoría de las preguntas objetivas. Hay habilidades presentes en la matriz que no se tuvieron en cuenta en la prueba y otras fueron contempladas con tan solo un ítem, lo que compromete la confiabilidad de la medida. Los análisis mostraron la necesidad del uso de técnicas que pueden mejorar esa fuente primaria de evidencia.]]></p></abstract>
<abstract abstract-type="short" xml:lang="en"><p><![CDATA[ABSTRACT This study aims to analyze evidence of validity based on the content of the psychology test applied in the Exame Nacional de Desempenho dos Estudantes (Enade) [National Exam of Student Proficiency] of 2015. We used Blueprint, a tool recommended in the international literature for test design. There were significant discrepancies between the skills and abilities presented in the test specifications, and in the cognitive demand demanded in almost all multiple-choice questions. Furthermore, there are skills and abilities presented in test specifications that were not in the test, and other skills and abilities that were represented by only one item, which compromise measurement reliability. We conclude that the evidence based on the content for this test shows the necessity to use tools to improve this primary source of evidence.]]></p></abstract>
<kwd-group>
<kwd lng="pt"><![CDATA[Validade]]></kwd>
<kwd lng="pt"><![CDATA[Exame Nacional de Desempenho dos Estudantes (Enade)]]></kwd>
<kwd lng="pt"><![CDATA[Blueprint]]></kwd>
<kwd lng="pt"><![CDATA[Demanda Cognitiva]]></kwd>
<kwd lng="es"><![CDATA[Validez]]></kwd>
<kwd lng="es"><![CDATA[Exame Nacional de Desempenho dos Estudantes (Enade)]]></kwd>
<kwd lng="es"><![CDATA[Blueprint]]></kwd>
<kwd lng="es"><![CDATA[Demanda Cognitiva]]></kwd>
<kwd lng="en"><![CDATA[Validity]]></kwd>
<kwd lng="en"><![CDATA[National Exam of Student Proficiency (Enade)]]></kwd>
<kwd lng="en"><![CDATA[Blueprint]]></kwd>
<kwd lng="en"><![CDATA[Cognitive Demand]]></kwd>
</kwd-group>
</article-meta>
</front><back>
<ref-list>
<ref id="B1">
<nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[ALDERMAN]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
</person-group>
<source><![CDATA[Test development process at ETS]]></source>
<year>2015</year>
<publisher-loc><![CDATA[Princeton ]]></publisher-loc>
<publisher-name><![CDATA[ETS Global Institute Course]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B2">
<nlm-citation citation-type="book">
<collab>AMERICAN EDUCATIONAL RESEARCH ASSOCIATION; AMERICAN PSYCHOLOGICAL ASSOCIATION; NATIONAL COUNCIL ON MEASUREMENT IN EDUCATION</collab>
<source><![CDATA[Standards for educational and psychological testing]]></source>
<year>2014</year>
<publisher-loc><![CDATA[Washington, DC ]]></publisher-loc>
<publisher-name><![CDATA[APA]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B3">
<nlm-citation citation-type="book">
<collab>AMERICAN PSYCHOLOGICAL ASSOCIATION</collab>
<source><![CDATA[Standards for educational and psychological tests and manuals]]></source>
<year>1966</year>
<publisher-loc><![CDATA[Washington, DC ]]></publisher-loc>
<publisher-name><![CDATA[APA]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B4">
<nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[ANDERSON]]></surname>
<given-names><![CDATA[L. W.]]></given-names>
</name>
</person-group>
<source><![CDATA[A taxonomy for learning, teaching, and assessing: a revision of Bloom&#8217;s Taxonomy of educational objectives]]></source>
<year>2001</year>
<edition>2</edition>
<publisher-loc><![CDATA[New York ]]></publisher-loc>
<publisher-name><![CDATA[Longman]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B5">
<nlm-citation citation-type="">
<person-group person-group-type="author">
<name>
<surname><![CDATA[BORSBOOM]]></surname>
<given-names><![CDATA[D.]]></given-names>
</name>
<name>
<surname><![CDATA[MELLENBERGH]]></surname>
<given-names><![CDATA[G. J.]]></given-names>
</name>
<name>
<surname><![CDATA[VAN HEERDEN]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
</person-group>
<source><![CDATA[Psychological Review]]></source>
<year>2004</year>
<volume>111</volume>
<numero>4</numero>
<issue>4</issue>
<page-range>1061-71</page-range><publisher-loc><![CDATA[Washington ]]></publisher-loc>
</nlm-citation>
</ref>
<ref id="B6">
<nlm-citation citation-type="book">
<collab>BRASIL. Instituto Nacional de Estudos e Pesquisas Educacionais Anísio Teixeira</collab>
<source><![CDATA[Exame nacional do desempenho dos estudantes: psicologia]]></source>
<year>2015</year>
<month>a</month>
<publisher-loc><![CDATA[Brasília, DF ]]></publisher-loc>
<publisher-name><![CDATA[Inep]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B7">
<nlm-citation citation-type="book">
<collab>BRASIL</collab>
<source><![CDATA[Portaria Inep n. 243, de 10 de junho de 2015. Estabelece as diretrizes da área de psicologia.]]></source>
<year>2015</year>
<month>b</month>
<page-range>27</page-range><publisher-loc><![CDATA[Brasília, DF ]]></publisher-loc>
<publisher-name><![CDATA[Diário Oficial da União]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B8">
<nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[CHAPELLE]]></surname>
<given-names><![CDATA[C. A.]]></given-names>
</name>
<name>
<surname><![CDATA[ENRIGHT]]></surname>
<given-names><![CDATA[M. K.]]></given-names>
</name>
<name>
<surname><![CDATA[JAMIESON]]></surname>
<given-names><![CDATA[J. M.]]></given-names>
</name>
</person-group>
<source><![CDATA[Building a validity argument for the test of English as a foreign language.]]></source>
<year>2011</year>
<publisher-loc><![CDATA[New York ]]></publisher-loc>
<publisher-name><![CDATA[Routledge]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B9">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[CIZEK]]></surname>
<given-names><![CDATA[G. J.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Validating test score meaning and defending test score use: different aims, different methods]]></article-title>
<source><![CDATA[Assessment in Education: Principles, Policy &amp; Practice]]></source>
<year>2016</year>
<volume>23</volume>
<numero>2</numero>
<issue>2</issue>
<page-range>212-25</page-range><publisher-loc><![CDATA[London ]]></publisher-loc>
</nlm-citation>
</ref>
<ref id="B10">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[CIZEK]]></surname>
<given-names><![CDATA[G. J.]]></given-names>
</name>
<name>
<surname><![CDATA[WEBB]]></surname>
<given-names><![CDATA[L. C.]]></given-names>
</name>
<name>
<surname><![CDATA[KALOHN]]></surname>
<given-names><![CDATA[J. C.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[The use of cognitive taxonomies in licensure and certification test development: reasonable or customary?]]></article-title>
<source><![CDATA[Evaluation &amp; The Health Professions, Thousand Oaks]]></source>
<year>1995</year>
<volume>18</volume>
<numero>1</numero>
<issue>1</issue>
<page-range>77-91</page-range></nlm-citation>
</ref>
<ref id="B11">
<nlm-citation citation-type="book">
<collab>COLLEGE BOARD</collab>
<source><![CDATA[Test specifications for the redesigned SAT.]]></source>
<year>2015</year>
<publisher-loc><![CDATA[New York ]]></publisher-loc>
<publisher-name><![CDATA[College Board]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B12">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[CRONBACH]]></surname>
<given-names><![CDATA[L. J.]]></given-names>
</name>
<name>
<surname><![CDATA[MEEHL]]></surname>
<given-names><![CDATA[P. E.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Construct validity in psychological tests]]></article-title>
<source><![CDATA[Psychological Bulletin]]></source>
<year>1955</year>
<volume>52</volume>
<page-range>281-302</page-range><publisher-loc><![CDATA[Washington, DC ]]></publisher-loc>
</nlm-citation>
</ref>
<ref id="B13">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[DEVILLE]]></surname>
<given-names><![CDATA[C. W.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[An empirical link of content and construct validity evidence]]></article-title>
<source><![CDATA[Applied Psychological Measurement]]></source>
<year>1996</year>
<volume>20</volume>
<numero>2</numero>
<issue>2</issue>
<page-range>127-39</page-range><publisher-loc><![CDATA[Thousand Oaks ]]></publisher-loc>
</nlm-citation>
</ref>
<ref id="B14">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[DEVILLE]]></surname>
<given-names><![CDATA[C. W.]]></given-names>
</name>
<name>
<surname><![CDATA[PROMETRIC]]></surname>
<given-names><![CDATA[S.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[An empirical link of content and construct validity evidence]]></article-title>
<source><![CDATA[Applied Psychological Measurement]]></source>
<year>1996</year>
<volume>20</volume>
<numero>2</numero>
<issue>2</issue>
<page-range>127-39</page-range><publisher-loc><![CDATA[Thousand Oaks ]]></publisher-loc>
</nlm-citation>
</ref>
<ref id="B15">
<nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[DOWNING]]></surname>
<given-names><![CDATA[S. M.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Handbook of test development]]></article-title>
<person-group person-group-type="editor">
<name>
<surname><![CDATA[DOWNING]]></surname>
<given-names><![CDATA[S. M.]]></given-names>
</name>
<name>
<surname><![CDATA[HALADYNA]]></surname>
<given-names><![CDATA[T. M.]]></given-names>
</name>
</person-group>
<source><![CDATA[Twelve steps for effective test development]]></source>
<year>2006</year>
<page-range>3-25</page-range><publisher-loc><![CDATA[New Jersey ]]></publisher-loc>
<publisher-name><![CDATA[Lawrence Erlbaum Associates]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B16">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[DOWNING]]></surname>
<given-names><![CDATA[S. M.]]></given-names>
</name>
<name>
<surname><![CDATA[HALADYNA]]></surname>
<given-names><![CDATA[T. M.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Test item development: validity evidence from quality assurance procedures]]></article-title>
<source><![CDATA[Applied Measurement in Education]]></source>
<year>2009</year>
<volume>10</volume>
<numero>1</numero>
<issue>1</issue>
<page-range>61-82</page-range><publisher-loc><![CDATA[Oxford ]]></publisher-loc>
</nlm-citation>
</ref>
<ref id="B17">
<nlm-citation citation-type="book">
<collab>EDUCATIONAL TESTING SERVICE</collab>
<source><![CDATA[ETS standards for quality and fairness]]></source>
<year>2014</year>
<publisher-loc><![CDATA[Princeton ]]></publisher-loc>
<publisher-name><![CDATA[ETS]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B18">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[FERRAZ]]></surname>
<given-names><![CDATA[A. P. C. M.]]></given-names>
</name>
<name>
<surname><![CDATA[BELHOT]]></surname>
<given-names><![CDATA[R. V.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Taxonomia de Bloom: revisão teórica e apresentação das adequações do instrumento para definição de objetivos instrucionais]]></article-title>
<source><![CDATA[Gestão &amp; Produção]]></source>
<year>2010</year>
<volume>17</volume>
<numero>2</numero>
<issue>2</issue>
<page-range>421-31</page-range><publisher-loc><![CDATA[São Carlos ]]></publisher-loc>
</nlm-citation>
</ref>
<ref id="B19">
<nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[HALADYNA]]></surname>
<given-names><![CDATA[T. M.]]></given-names>
</name>
</person-group>
<source><![CDATA[Developing and validating multiple-choice test items.]]></source>
<year>2004</year>
<edition>3</edition>
<publisher-loc><![CDATA[New Jersey ]]></publisher-loc>
<publisher-name><![CDATA[Lawrence Erlbaum Associates]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B20">
<nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[HALADYNA]]></surname>
<given-names><![CDATA[T. M.]]></given-names>
</name>
<name>
<surname><![CDATA[RODRIGUEZ]]></surname>
<given-names><![CDATA[M. C.]]></given-names>
</name>
</person-group>
<source><![CDATA[Developing and validating test items]]></source>
<year>2013</year>
<publisher-loc><![CDATA[New York ]]></publisher-loc>
<publisher-name><![CDATA[Taylor &amp; Francis Group]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B21">
<nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[HOGAN]]></surname>
<given-names><![CDATA[T. P.]]></given-names>
</name>
</person-group>
<source><![CDATA[Introdução à prática de testes psicológicos]]></source>
<year>2006</year>
<publisher-loc><![CDATA[São Paulo ]]></publisher-loc>
<publisher-name><![CDATA[LTC]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B22">
<nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[HUTZ]]></surname>
<given-names><![CDATA[C. S.]]></given-names>
</name>
</person-group>
<source><![CDATA[Avanços e polêmicas em avaliação psicológica]]></source>
<year>2009</year>
<publisher-loc><![CDATA[Itatiba ]]></publisher-loc>
<publisher-name><![CDATA[Casa do Psicólogo]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B23">
<nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[HUTZ]]></surname>
<given-names><![CDATA[C. S.]]></given-names>
</name>
<name>
<surname><![CDATA[BANDEIRA]]></surname>
<given-names><![CDATA[D. R]]></given-names>
</name>
<name>
<surname><![CDATA[TRENTINI]]></surname>
<given-names><![CDATA[C. M.]]></given-names>
</name>
</person-group>
<source><![CDATA[Psicometria]]></source>
<year>2015</year>
<publisher-loc><![CDATA[Porto Alegre ]]></publisher-loc>
<publisher-name><![CDATA[Artmed]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B24">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[JENSEN]]></surname>
<given-names><![CDATA[J. L.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Teaching to the test&#8230; or testing to teach: exams requiring higher order thinking skills encourage greater conceptual understanding.]]></article-title>
<source><![CDATA[Educational Psychology Review]]></source>
<year>2014</year>
<volume>26</volume>
<numero>2</numero>
<issue>2</issue>
<page-range>307-29</page-range><publisher-loc><![CDATA[New York ]]></publisher-loc>
</nlm-citation>
</ref>
<ref id="B25">
<nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[KANE]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Handbook of test development]]></article-title>
<person-group person-group-type="editor">
<name>
<surname><![CDATA[DOWNING]]></surname>
<given-names><![CDATA[S. M.]]></given-names>
</name>
<name>
<surname><![CDATA[HALADYNA]]></surname>
<given-names><![CDATA[T. M.]]></given-names>
</name>
</person-group>
<source><![CDATA[Content-related validity evidence in test development]]></source>
<year>2006</year>
<page-range>131-53</page-range><publisher-loc><![CDATA[New Jersey ]]></publisher-loc>
<publisher-name><![CDATA[Lawrence Erlbaum Associates]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B26">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[KANE]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Validating the interpretations and uses of test scores]]></article-title>
<source><![CDATA[Journal of Educational Measurement]]></source>
<year>2013</year>
<volume>50</volume>
<numero>1</numero>
<issue>1</issue>
<page-range>1-73</page-range><publisher-loc><![CDATA[New Jersey ]]></publisher-loc>
</nlm-citation>
</ref>
<ref id="B27">
<nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[KELLEY]]></surname>
<given-names><![CDATA[T. L.]]></given-names>
</name>
</person-group>
<source><![CDATA[Interpretations of educational measurement]]></source>
<year>1927</year>
<publisher-loc><![CDATA[Yonkers-on-Hudson ]]></publisher-loc>
<publisher-name><![CDATA[World Book]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B28">
<nlm-citation citation-type="">
<person-group person-group-type="author">
<name>
<surname><![CDATA[LAWSHE]]></surname>
<given-names><![CDATA[C. H.]]></given-names>
</name>
</person-group>
<source><![CDATA[Personnel Psychology]]></source>
<year>1975</year>
<volume>28</volume>
<numero>4</numero>
<issue>4</issue>
<page-range>563-75</page-range><publisher-loc><![CDATA[Hoboken ]]></publisher-loc>
</nlm-citation>
</ref>
<ref id="B29">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[LEUNG]]></surname>
<given-names><![CDATA[S. F.]]></given-names>
</name>
<name>
<surname><![CDATA[MOK]]></surname>
<given-names><![CDATA[E.]]></given-names>
</name>
<name>
<surname><![CDATA[WONG]]></surname>
<given-names><![CDATA[D.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[The impact of assessment methods on the learning of nursing students.]]></article-title>
<source><![CDATA[Nurse Education Today]]></source>
<year>2008</year>
<volume>28</volume>
<numero>6</numero>
<issue>6</issue>
<page-range>711-9</page-range></nlm-citation>
</ref>
<ref id="B30">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[LI]]></surname>
<given-names><![CDATA[X.]]></given-names>
</name>
<name>
<surname><![CDATA[SIRECI]]></surname>
<given-names><![CDATA[S. G.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[A new method for analyzing content validity data using multidimensional scaling]]></article-title>
<source><![CDATA[Educational and Psychological Measurement]]></source>
<year>2013</year>
<volume>73</volume>
<numero>3</numero>
<issue>3</issue>
<page-range>365-85</page-range><publisher-loc><![CDATA[Thousand Oaks ]]></publisher-loc>
</nlm-citation>
</ref>
<ref id="B31">
<nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[LINN]]></surname>
<given-names><![CDATA[R. L.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Handbook of test development]]></article-title>
<person-group person-group-type="editor">
<name>
<surname><![CDATA[DOWNING]]></surname>
<given-names><![CDATA[S. M.]]></given-names>
</name>
<name>
<surname><![CDATA[HALADYNA]]></surname>
<given-names><![CDATA[T. M.]]></given-names>
</name>
</person-group>
<source><![CDATA[The standards for educational and psychological testing: guidance in test development.]]></source>
<year>2006</year>
<page-range>27-38</page-range><publisher-loc><![CDATA[New Jersey ]]></publisher-loc>
<publisher-name><![CDATA[Lawrence Erlbaum Associates]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B32">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[LYNN]]></surname>
<given-names><![CDATA[M. R.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Determination and quantification of content validity]]></article-title>
<source><![CDATA[Nursing Research]]></source>
<year>1986</year>
<volume>35</volume>
<numero>6</numero>
<issue>6</issue>
<page-range>382-5</page-range><publisher-loc><![CDATA[London ]]></publisher-loc>
</nlm-citation>
</ref>
<ref id="B33">
<nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[MARZANO]]></surname>
<given-names><![CDATA[R. J.]]></given-names>
</name>
<name>
<surname><![CDATA[KENDALL]]></surname>
<given-names><![CDATA[J. S.]]></given-names>
</name>
</person-group>
<source><![CDATA[The new taxonomy of educational objectives]]></source>
<year>2007</year>
<edition>2</edition>
<publisher-loc><![CDATA[Thousand Oaks ]]></publisher-loc>
<publisher-name><![CDATA[Corwin]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B34">
<nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[MESSICK]]></surname>
<given-names><![CDATA[S.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Educational measurement.]]></article-title>
<person-group person-group-type="editor">
<name>
<surname><![CDATA[LINN]]></surname>
<given-names><![CDATA[R. L.]]></given-names>
</name>
</person-group>
<source><![CDATA[Validity]]></source>
<year>1989</year>
<page-range>13-103</page-range><publisher-loc><![CDATA[Washington, DC ]]></publisher-loc>
<publisher-name><![CDATA[American Council on Education; National Council on Measurement in Education]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B35">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[MISLEVY]]></surname>
<given-names><![CDATA[R. J.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Validity by design]]></article-title>
<source><![CDATA[Educational Reseacher]]></source>
<year>2007</year>
<volume>36</volume>
<numero>8</numero>
<issue>8</issue>
<page-range>463-9</page-range><publisher-loc><![CDATA[Washington ]]></publisher-loc>
</nlm-citation>
</ref>
<ref id="B36">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[MISLEVY]]></surname>
<given-names><![CDATA[R. J.]]></given-names>
</name>
<name>
<surname><![CDATA[ALMOND]]></surname>
<given-names><![CDATA[R. G.]]></given-names>
</name>
<name>
<surname><![CDATA[LUKAS]]></surname>
<given-names><![CDATA[J. F.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[A brief introduction to Evidence- -Centered Design]]></article-title>
<source><![CDATA[ETS Research Report Series]]></source>
<year>2003</year>
<volume>03-16</volume>
<numero>1</numero>
<issue>1</issue>
<page-range>i-29</page-range><publisher-loc><![CDATA[Princeton ]]></publisher-loc>
</nlm-citation>
</ref>
<ref id="B37">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[MOMSEN]]></surname>
<given-names><![CDATA[J. L.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Just the facts? Introductory undergraduate biology courses focus on low-level cognitive skills]]></article-title>
<source><![CDATA[CBE-Life Sciences Education]]></source>
<year>2010</year>
<volume>9</volume>
<numero>4</numero>
<issue>4</issue>
<page-range>435-40</page-range><publisher-loc><![CDATA[Bethesda ]]></publisher-loc>
</nlm-citation>
</ref>
<ref id="B38">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[NASCIMENTO]]></surname>
<given-names><![CDATA[T. G.]]></given-names>
</name>
<name>
<surname><![CDATA[SOUZA]]></surname>
<given-names><![CDATA[E. C. L.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Escala trifatorial da identidade social (ETIS): evidências de sua adequação psicométrica.]]></article-title>
<source><![CDATA[Psico-USF]]></source>
<year>2017</year>
<volume>22</volume>
<numero>2</numero>
<issue>2</issue>
<page-range>217-34</page-range><publisher-loc><![CDATA[Bragança Paulista ]]></publisher-loc>
</nlm-citation>
</ref>
<ref id="B39">
<nlm-citation citation-type="book">
<collab>NATIONAL ASSESSMENT OF EDUCATIONAL PROGRESS</collab>
<source><![CDATA[Reading Framework for the 2015 National Assessment of Educational Progress]]></source>
<year>2015</year>
<publisher-loc><![CDATA[Washington ]]></publisher-loc>
<publisher-name><![CDATA[U.S. Government Printing Office]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B40">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[NEWTON]]></surname>
<given-names><![CDATA[P. E.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Macro- and micro-validation: Beyond the &#8220;five sources&#8221; framework for classifying validation evidence and analysis.]]></article-title>
<source><![CDATA[Practical Assessment, Research &amp; Evaluation]]></source>
<year>2016</year>
<volume>21</volume>
<numero>12</numero>
<issue>12</issue>
<page-range>1-13</page-range><publisher-name><![CDATA[College Park]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B41">
<nlm-citation citation-type="">
<collab>PARTNERSHIP FOR ASSESSMENT OF READINESS FOR COLLEGE AND CAREERS</collab>
<source><![CDATA[PARCC Grades 6-11 High Level Blueprints]]></source>
<year>2017</year>
<publisher-loc><![CDATA[EUA ]]></publisher-loc>
</nlm-citation>
</ref>
<ref id="B42">
<nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[PASQUALI]]></surname>
<given-names><![CDATA[L.]]></given-names>
</name>
</person-group>
<source><![CDATA[Instrumentos psicológicos: manual prático de elaboração]]></source>
<year>1999</year>
<publisher-loc><![CDATA[Brasília, DF ]]></publisher-loc>
<publisher-name><![CDATA[LabPAM/IBAPP]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B43">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[PASQUALI]]></surname>
<given-names><![CDATA[L.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Psicometria]]></article-title>
<source><![CDATA[Revista da Escola de Enfermagem]]></source>
<year>2009</year>
<volume>43</volume>
<edition>especial</edition>
<page-range>992-9</page-range><publisher-loc><![CDATA[São Paulo ]]></publisher-loc>
<publisher-name><![CDATA[USP]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B44">
<nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[PASQUALI]]></surname>
<given-names><![CDATA[L.]]></given-names>
</name>
</person-group>
<source><![CDATA[Instrumentação psicológica: fundamentos e prática]]></source>
<year>2010</year>
<publisher-loc><![CDATA[Porto Alegre ]]></publisher-loc>
<publisher-name><![CDATA[Artmed]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B45">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[PASQUALI]]></surname>
<given-names><![CDATA[L.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Validade dos testes]]></article-title>
<source><![CDATA[Examen: Pesquisa em Avaliação, Certificação e Seleção]]></source>
<year>2017</year>
<volume>1</volume>
<numero>1</numero>
<issue>1</issue>
<page-range>14-48</page-range><publisher-loc><![CDATA[Brasília, DF ]]></publisher-loc>
</nlm-citation>
</ref>
<ref id="B46">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[POLIT]]></surname>
<given-names><![CDATA[D. F.]]></given-names>
</name>
<name>
<surname><![CDATA[BECK]]></surname>
<given-names><![CDATA[C. T.]]></given-names>
</name>
<name>
<surname><![CDATA[OWEN]]></surname>
<given-names><![CDATA[S. T]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Is the CVI an acceptable indicator of content validity? Appraisal and recommendations]]></article-title>
<source><![CDATA[Research in Nursing &amp; Health]]></source>
<year>2007</year>
<volume>30</volume>
<numero>4</numero>
<issue>4</issue>
<page-range>459-567</page-range><publisher-loc><![CDATA[Thousand Oaks ]]></publisher-loc>
</nlm-citation>
</ref>
<ref id="B47">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[RULON]]></surname>
<given-names><![CDATA[P. J.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[On the validity of educational tests]]></article-title>
<source><![CDATA[Harvard Educational Review]]></source>
<year>1946</year>
<volume>16</volume>
<page-range>290-6</page-range><publisher-loc><![CDATA[Washington, DC ]]></publisher-loc>
</nlm-citation>
</ref>
<ref id="B48">
<nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[RUTKOWSKI]]></surname>
<given-names><![CDATA[L.]]></given-names>
</name>
<name>
<surname><![CDATA[VON DAVIER]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
<name>
<surname><![CDATA[RUTKOWSKI]]></surname>
<given-names><![CDATA[D.]]></given-names>
</name>
</person-group>
<source><![CDATA[Handbook of international large-scale assessment: background, technical issues, and methods of data analysis]]></source>
<year>2014</year>
<publisher-loc><![CDATA[Boca Raton ]]></publisher-loc>
<publisher-name><![CDATA[CRC/Taylor &amp; Francis Group]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B49">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[SCULLY]]></surname>
<given-names><![CDATA[D.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Constructing multiple-choice items to measure higher-order thinking]]></article-title>
<source><![CDATA[Practical Assessment, Research &amp; Evaluation]]></source>
<year>2017</year>
<volume>22</volume>
<numero>4</numero>
<issue>4</issue>
<page-range>1-13</page-range><publisher-name><![CDATA[College Park]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B50">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[SIRECI]]></surname>
<given-names><![CDATA[S. G.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[The construct of content validity]]></article-title>
<source><![CDATA[Social Indicators Research]]></source>
<year>1998</year>
<volume>45</volume>
<numero>1-3</numero>
<issue>1-3</issue>
<page-range>83-117</page-range><publisher-loc><![CDATA[New York ]]></publisher-loc>
</nlm-citation>
</ref>
<ref id="B51">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[SIRECI]]></surname>
<given-names><![CDATA[S. G.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Agreeing on validity arguments]]></article-title>
<source><![CDATA[Journal of Educational Measurement]]></source>
<year>2013</year>
<volume>50</volume>
<numero>1</numero>
<issue>1</issue>
<page-range>99-104</page-range><publisher-loc><![CDATA[New Jersey ]]></publisher-loc>
</nlm-citation>
</ref>
<ref id="B52">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[SIRECI]]></surname>
<given-names><![CDATA[S. G.]]></given-names>
</name>
<name>
<surname><![CDATA[GEISINGER]]></surname>
<given-names><![CDATA[K. F.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Analyzing test content using cluster analysis and multidimensional scaling]]></article-title>
<source><![CDATA[Applied Psychological Measurement]]></source>
<year>1992</year>
<volume>16</volume>
<numero>1</numero>
<issue>1</issue>
<page-range>17-31</page-range><publisher-loc><![CDATA[Thousand Oaks ]]></publisher-loc>
</nlm-citation>
</ref>
<ref id="B53">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[ZIEKY]]></surname>
<given-names><![CDATA[M. J.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[An introduction to the use of Evidence-Centered Design in test development]]></article-title>
<source><![CDATA[Psicología Educativa]]></source>
<year>2014</year>
<volume>20</volume>
<numero>2</numero>
<issue>2</issue>
<page-range>79-87</page-range><publisher-loc><![CDATA[Madrid ]]></publisher-loc>
</nlm-citation>
</ref>
<ref id="B54">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[ZUMBO]]></surname>
<given-names><![CDATA[B. D.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[What role does, and should, the test standards play outside of the United States of America?]]></article-title>
<source><![CDATA[Educational Measurement: Issues and Practice]]></source>
<year>2014</year>
<volume>33</volume>
<numero>4</numero>
<issue>4</issue>
<page-range>31-3</page-range><publisher-loc><![CDATA[Philadelphia ]]></publisher-loc>
</nlm-citation>
</ref>
<ref id="B55">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[HUDDLESTON]]></surname>
<given-names><![CDATA[E. M.]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Test development on the basis of content validity]]></article-title>
<source><![CDATA[Educational and Psychological Measurement]]></source>
<year>1956</year>
<volume>16</volume>
<numero>3</numero>
<issue>3</issue>
<page-range>283-93</page-range><publisher-loc><![CDATA[Thousand Oaks ]]></publisher-loc>
</nlm-citation>
</ref>
</ref-list>
</back>
</article>
