<?xml version="1.0" encoding="ISO-8859-1"?><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
<front>
<journal-meta>
<journal-id>0103-6831</journal-id>
<journal-title><![CDATA[Estudos em Avaliação Educacional]]></journal-title>
<abbrev-journal-title><![CDATA[Est. Aval. Educ.]]></abbrev-journal-title>
<issn>0103-6831</issn>
<publisher>
<publisher-name><![CDATA[Fundação Carlos Chagas]]></publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id>S0103-68312011000100006</article-id>
<title-group>
<article-title xml:lang="pt"><![CDATA[Desenvolvimento e validação de um instrumento para avaliação de disciplinas na educação superior]]></article-title>
<article-title xml:lang="es"><![CDATA[Desarrollo y validación de un instrumento para la evaluación de asignaturas en la educación superior]]></article-title>
<article-title xml:lang="en"><![CDATA[Development and validation of an instrument for evaluating courses in higher education]]></article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name>
<surname><![CDATA[Bittencourt]]></surname>
<given-names><![CDATA[Hélio Radke]]></given-names>
</name>
</contrib>
<contrib contrib-type="author">
<name>
<surname><![CDATA[Creutzberg]]></surname>
<given-names><![CDATA[Marion]]></given-names>
</name>
</contrib>
<contrib contrib-type="author">
<name>
<surname><![CDATA[Rodrigues]]></surname>
<given-names><![CDATA[Alziro César de Morais]]></given-names>
</name>
</contrib>
<contrib contrib-type="author">
<name>
<surname><![CDATA[Casartelli]]></surname>
<given-names><![CDATA[Alam de Oliveira]]></given-names>
</name>
</contrib>
<contrib contrib-type="author">
<name>
<surname><![CDATA[Freitas]]></surname>
<given-names><![CDATA[Ana Lúcia Souza de]]></given-names>
</name>
</contrib>
</contrib-group>
<aff id="A06">
<institution><![CDATA[,Pontifícia Universidade Católica do Rio Grande do Sul  ]]></institution>
<addr-line><![CDATA[ ]]></addr-line>
</aff>
<pub-date pub-type="pub">
<day>00</day>
<month>04</month>
<year>2011</year>
</pub-date>
<pub-date pub-type="epub">
<day>00</day>
<month>04</month>
<year>2011</year>
</pub-date>
<volume>22</volume>
<numero>48</numero>
<fpage>91</fpage>
<lpage>113</lpage>
<copyright-statement/>
<copyright-year/>
<self-uri xlink:href="http://educa.fcc.org.br/scielo.php?script=sci_arttext&amp;pid=S0103-68312011000100006&amp;lng=en&amp;nrm=iso"></self-uri><self-uri xlink:href="http://educa.fcc.org.br/scielo.php?script=sci_abstract&amp;pid=S0103-68312011000100006&amp;lng=en&amp;nrm=iso"></self-uri><self-uri xlink:href="http://educa.fcc.org.br/scielo.php?script=sci_pdf&amp;pid=S0103-68312011000100006&amp;lng=en&amp;nrm=iso"></self-uri><abstract abstract-type="short" xml:lang="pt"><p><![CDATA[A avaliação educacional e, mais especificamente, a avaliação de disciplinas geram polêmicas no âmbito da educação superior, a começar pelos instrumentos utilizados. Este artigo tem por objetivo apresentar as etapas do processo de desenvolvimento e de validação de um instrumento de avaliação para disciplinas de graduação, utilizando técnicas oriundas da Psicometria. Elaborou-se um instrumento simples e pouco extenso que contemplasse três dimensões específicas: 1) aspectos gerais da disciplina; 2) ação de ensino do professor; e 3) auto avaliação (ação do aluno). Dentre as técnicas utilizadas no processo de validação, destacam-se a realização de reuniões com especialistas e o uso de técnicas estatísticas multivariadas de Análise Fatorial Confirmatória e Análise de Regressão. Os resultados obtidos com base em um conjunto de 151.220 instrumentos, preenchidos por 32.124 estudantes em três períodos letivos, revelaram que o instrumento proposto apresenta qualidades psicométricas desejáveis relativamente à sua validação e fidedignidade. Adicionalmente, sustenta-se que a avaliação de disciplinas não seja vista como um processo desconectado do projeto pedagógico institucional, contando com a participação de profissionais de diferentes áreas no desenvolvimento do instrumento e na condução do processo, com base em uma perspectiva de avaliação formativa, orientada à promoção da aprendizagem dos estudantes.]]></p></abstract>
<abstract abstract-type="short" xml:lang="es"><p><![CDATA[La evaluación educativa y, más específicamente, la evaluación de asignaturas generan controversias en el ámbito de la educación superior, comenzando por los instrumentos utilizados. Este artículo tiene como objetivo presentar las etapas del proceso de desarrollo y de validación de un instrumento de evaluación para asignaturas de grado, utilizando técnicas de la Psicometría. Se elaboró un instrumento sencillo y poco extenso que contemplas e tres dimensiones específicas: 1) aspectos generales de la asignatura; 2) la acción del docente y 3) la autoevaluación (acción del alumno). Entre las técnicas utilizadas en el proceso de validación se destaca la realización de reuniones con especialistas y el uso de técnicas estadísticas multivariadas de Análisis Factorial Confirmatorio y Análisis de Regresión. Los resultados obtenidos a partir de un conjunto de 151.220 instrumentos, llenados por 32.124 estudiantes en tres períodos lectivos, revelaron que el instrumento propuesto presenta cualidades psicométricas deseables en relación a su validación y confiabilidad. Además, se argumenta que la evaluación de asignaturas no sea vista como un proceso desconectado del proyecto pedagógico institucional. El mismo cuenta con la participación de profesionales de diferentes áreas en el desarrollo del instrumento y en la conducción del proceso, con base en una perspectiva de evaluación formadora, orientada a la promoción del aprendizaje de los estudiantes.]]></p></abstract>
<abstract abstract-type="short" xml:lang="en"><p><![CDATA[The issue of educational evaluation and, more specifically, the evaluation of courses generates controversy in the context of higher education, chiefly considering the instruments adopted. This article presents the stages of development and validation of an evaluation instrument for undergraduate courses, using Psychometric techniques. A simple and not extensive instrument was created to cover three specific dimensions: 1) general aspects of the course, 2) teacher's teaching action, and 3) self-evaluation (student's action). Among the techniques used in the validation process we highlight interviews with experts and the use of multivariate techniques of Confirmatory Factor Analysis and Regression Analysis. The results obtained from a set of 151,220 instruments, completed by 32,124 students in three academic periods, revealed that the instrument has desirable psychometric qualities as regards its reliability and validity. Additionally, it is argued that evaluation of courses should not be seen as a process disconnected from the institutional pedagogical project, but should also count on the participation of professionals from different areas in developing the instrument and conducting the process, based on a perspective of formative evaluation, aimed at improving student learning.]]></p></abstract>
<kwd-group>
<kwd lng="pt"><![CDATA[Ensino Superior]]></kwd>
<kwd lng="pt"><![CDATA[Avaliação da Educação]]></kwd>
<kwd lng="pt"><![CDATA[Psicometria]]></kwd>
<kwd lng="pt"><![CDATA[Avaliação da Aprendizagem]]></kwd>
<kwd lng="es"><![CDATA[Educación Superior]]></kwd>
<kwd lng="es"><![CDATA[Evaluación de la Educación]]></kwd>
<kwd lng="es"><![CDATA[Psicometría]]></kwd>
<kwd lng="es"><![CDATA[Evaluación del Aprendizaje]]></kwd>
<kwd lng="en"><![CDATA[Higher Education]]></kwd>
<kwd lng="en"><![CDATA[Educational Assessment]]></kwd>
<kwd lng="en"><![CDATA[Psychometry]]></kwd>
<kwd lng="en"><![CDATA[Learning Assessment]]></kwd>
</kwd-group>
</article-meta>
</front><body><![CDATA[ <font face="Arial, Helvetica, sans-serif"> <h2>Desenvolvimento e valida&ccedil;&atilde;o  de um instrumento para avalia&ccedil;&atilde;o de disciplinas na educa&ccedil;&atilde;o superior.</h2> <h3>Desarrollo y validaci&oacute;n de un instrumento para la evaluaci&oacute;n de asignaturas  en la educaci&oacute;n superior.</h3> <h3>Development and validation of an instrument for evaluating courses in  higher education.</h3>     <p>&nbsp;</p> <h4>H&eacute;lio Radke Bittencourt, Marion  Creutzberg, Alziro C&eacute;sar de Morais Rodrigues, Alam de Oliveira Casartelli,  Ana L&uacute;cia Souza de Freitas    <br> </h4> </font>      ]]></body><back>
<ref-list>
<ref id="B1">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[BESSA]]></surname>
<given-names><![CDATA[N. M.]]></given-names>
</name>
</person-group>
<article-title xml:lang="pt"><![CDATA[Validade: o conceito, a pesquisa, os problemas de provas geradas pelo computador.]]></article-title>
<source><![CDATA[Estudos em Avaliação Educacional]]></source>
<year>maio</year>
<month>/a</month>
<day>go</day>
<volume>18</volume>
<numero>37</numero>
<issue>37</issue>
<page-range>115-155</page-range></nlm-citation>
</ref>
<ref id="B2">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[CHEN]]></surname>
<given-names><![CDATA[F.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[An Empirical evaluation of the use of fixed cutoff points in RMSEA test statistic in structural equation models.]]></article-title>
<source><![CDATA[Sociological Methods & Research]]></source>
<year>2008</year>
<volume>36</volume>
<numero>4</numero>
<issue>4</issue>
<page-range>462-494</page-range></nlm-citation>
</ref>
<ref id="B3">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[CRONBACH]]></surname>
<given-names><![CDATA[L. J.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[Coefficient alpha and the internal structure of tests.]]></article-title>
<source><![CDATA[Psychometrika]]></source>
<year>1951</year>
<volume>3</volume>
<numero>16</numero>
<issue>16</issue>
<page-range>297-334</page-range></nlm-citation>
</ref>
<ref id="B4">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[DEPRESBITERIS]]></surname>
<given-names><![CDATA[L.]]></given-names>
</name>
</person-group>
<article-title xml:lang="pt"><![CDATA[Autoavaliação das instituições de ensino superior.]]></article-title>
<source><![CDATA[Estudos em Avaliação Educacional]]></source>
<year>jan.</year>
<month>/a</month>
<day>br</day>
<volume>16</volume>
<numero>32</numero>
<issue>32</issue>
<page-range>7-24</page-range><publisher-loc><![CDATA[São Paulo ]]></publisher-loc>
</nlm-citation>
</ref>
<ref id="B5">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[FERNANDES]]></surname>
<given-names><![CDATA[D.]]></given-names>
</name>
</person-group>
<article-title xml:lang="pt"><![CDATA[Notas sobre os paradigmas da investigação em educação.]]></article-title>
<source><![CDATA[Noesis]]></source>
<year>1991</year>
<volume>18</volume>
<page-range>64-66</page-range><publisher-loc><![CDATA[Lisboa ]]></publisher-loc>
</nlm-citation>
</ref>
<ref id="B6">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[FERNANDES]]></surname>
<given-names><![CDATA[D. A]]></given-names>
</name>
</person-group>
<article-title xml:lang="pt"><![CDATA[Avaliação das aprendizagens no sistema educativo português.]]></article-title>
<source><![CDATA[Educação e Pesquisa]]></source>
<year>set.</year>
<month>/d</month>
<day>ez</day>
<volume>33</volume>
<numero>3</numero>
<issue>3</issue>
<page-range>581-600</page-range><publisher-loc><![CDATA[São Paulo ]]></publisher-loc>
</nlm-citation>
</ref>
<ref id="B7">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[GATTI]]></surname>
<given-names><![CDATA[B. A.]]></given-names>
</name>
</person-group>
<article-title xml:lang="pt"><![CDATA[Estudos quantitativos em educação.]]></article-title>
<source><![CDATA[Educação e Pesquisa]]></source>
<year>jan.</year>
<month>/a</month>
<day>br</day>
<volume>30</volume>
<numero>1</numero>
<issue>1</issue>
<page-range>11-30</page-range><publisher-loc><![CDATA[São Paulo ]]></publisher-loc>
</nlm-citation>
</ref>
<ref id="B8">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[GREENWALD]]></surname>
<given-names><![CDATA[A. G.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[Validity concerns and usefulness of student ratings of instruction.]]></article-title>
<source><![CDATA[American Psychologist]]></source>
<year>1997</year>
<volume>52</volume>
<numero>11</numero>
<issue>11</issue>
<page-range>1182-1186</page-range></nlm-citation>
</ref>
<ref id="B9">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[JACKSON]]></surname>
<given-names><![CDATA[D. L.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[The dimensions of students' perceptions of teaching effectiveness.]]></article-title>
<source><![CDATA[Educational and Psychological Measurement]]></source>
<year>1999</year>
<volume>59</volume>
<numero>4</numero>
<issue>4</issue>
<page-range>580-596</page-range></nlm-citation>
</ref>
<ref id="B10">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[MARSH]]></surname>
<given-names><![CDATA[H. W.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[Students' evaluations of university teaching: dimensionality, reliability, validity, potential biases and utility.]]></article-title>
<source><![CDATA[Journal of Educational Psychology]]></source>
<year>1984</year>
<volume>76</volume>
<numero>5</numero>
<issue>5</issue>
<page-range>707-754</page-range></nlm-citation>
</ref>
<ref id="B11">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[McCALLUM]]></surname>
<given-names><![CDATA[R.]]></given-names>
</name>
<name>
<surname><![CDATA[BROWNE]]></surname>
<given-names><![CDATA[M. W.]]></given-names>
</name>
<name>
<surname><![CDATA[SUGAWARA]]></surname>
<given-names><![CDATA[H. M.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[Power analysis and determination of sample size for covariance structure modeling.]]></article-title>
<source><![CDATA[Psychological Methods]]></source>
<year>1996</year>
<numero>1</numero>
<issue>1</issue>
<page-range>130-149</page-range></nlm-citation>
</ref>
<ref id="B12">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[NAFTULlN]]></surname>
<given-names><![CDATA[D. H.]]></given-names>
</name>
<name>
<surname><![CDATA[WARE]]></surname>
<given-names><![CDATA[J. E.]]></given-names>
</name>
<name>
<surname><![CDATA[DONNELLY]]></surname>
<given-names><![CDATA[F. A.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[The Doctor fox lecture: a paradigm of educational seduction.]]></article-title>
<source><![CDATA[Journal of Medical Education]]></source>
<year>1973</year>
<volume>48</volume>
<page-range>630-635</page-range></nlm-citation>
</ref>
<ref id="B13">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[NUNES]]></surname>
<given-names><![CDATA[A. K.]]></given-names>
</name>
<name>
<surname><![CDATA[HELFER]]></surname>
<given-names><![CDATA[C. L. L.]]></given-names>
</name>
</person-group>
<article-title xml:lang="pt"><![CDATA[Diagnóstico do desempenho na docência da graduação da UNISC.]]></article-title>
<source><![CDATA[Avaliação]]></source>
<year>mar.</year>
<month> 2</month>
<day>00</day>
<volume>14</volume>
<numero>1</numero>
<issue>1</issue>
<page-range>169-183</page-range><publisher-loc><![CDATA[Campinas ]]></publisher-loc>
</nlm-citation>
</ref>
<ref id="B14">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[PERES-DOS-SANTOS]]></surname>
<given-names><![CDATA[L. F. B.]]></given-names>
</name>
<name>
<surname><![CDATA[LAROS]]></surname>
<given-names><![CDATA[J. A.]]></given-names>
</name>
</person-group>
<article-title xml:lang="pt"><![CDATA[Avaliação da prática pedagógica do professor de ensino superior.]]></article-title>
<source><![CDATA[Estudos em Avaliação Educacional]]></source>
<year>jan.</year>
<month>/a</month>
<day>br</day>
<volume>18</volume>
<numero>36</numero>
<issue>36</issue>
<page-range>75-95</page-range><publisher-loc><![CDATA[São Paulo ]]></publisher-loc>
</nlm-citation>
</ref>
<ref id="B15">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[PETCHERS]]></surname>
<given-names><![CDATA[M. K.]]></given-names>
</name>
<name>
<surname><![CDATA[CHOW]]></surname>
<given-names><![CDATA[J.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[Interpreting students' course evaluations: a look at the underlying conceptual dimensions.]]></article-title>
<source><![CDATA[Journal of Teaching in Social Work]]></source>
<year>1988</year>
<volume>2</volume>
<numero>2</numero>
<issue>2</issue>
<page-range>51-61</page-range></nlm-citation>
</ref>
<ref id="B16">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[SAUL]]></surname>
<given-names><![CDATA[A. M. A]]></given-names>
</name>
</person-group>
<article-title xml:lang="pt"><![CDATA[Sistemática de autoavaliação do Programa de Pós-Graduação em Educação (currículo) da PUC/SP.]]></article-title>
<source><![CDATA[Estudos em Avaliação Educacional]]></source>
<year>jul.</year>
<month>/d</month>
<day>ez</day>
<numero>26</numero>
<issue>26</issue>
<page-range>97-109</page-range></nlm-citation>
</ref>
<ref id="B17">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[SOUSA]]></surname>
<given-names><![CDATA[C. P.]]></given-names>
</name>
</person-group>
<article-title xml:lang="pt"><![CDATA[Dimensões da avaliação educacional.]]></article-title>
<source><![CDATA[Estudos em Avaliação Educacional]]></source>
<year>jul/</year>
<month>.d</month>
<day>ez</day>
<numero>22</numero>
<issue>22</issue>
<page-range>101-118</page-range></nlm-citation>
</ref>
<ref id="B18">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[TEIXEIRA]]></surname>
<given-names><![CDATA[G. W.]]></given-names>
</name>
<name>
<surname><![CDATA[ANDRADE JR.]]></surname>
<given-names><![CDATA[M. N.]]></given-names>
</name>
</person-group>
<article-title xml:lang="pt"><![CDATA[Avaliação do processo de ensino-aprendizagem e suas dimensões.]]></article-title>
<source><![CDATA[Revista de Administração]]></source>
<year>1983</year>
<volume>18</volume>
<numero>4</numero>
<issue>4</issue>
<page-range>69-75</page-range></nlm-citation>
</ref>
<ref id="B19">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[VIANNA]]></surname>
<given-names><![CDATA[H. M.]]></given-names>
</name>
</person-group>
<article-title xml:lang="pt"><![CDATA[Avaliação de cursos pelos alunos: considerações.]]></article-title>
<source><![CDATA[Estudos em Avaliação Educacional]]></source>
<year>jan.</year>
<month>/j</month>
<day>un</day>
<numero>29</numero>
<issue>29</issue>
<page-range>137-147</page-range></nlm-citation>
</ref>
<ref id="B20">
<nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[VIEIRA]]></surname>
<given-names><![CDATA[K. M.]]></given-names>
</name>
<name>
<surname><![CDATA[MILACH]]></surname>
<given-names><![CDATA[F. T.]]></given-names>
</name>
<name>
<surname><![CDATA[HUPPES]]></surname>
<given-names><![CDATA[D.]]></given-names>
</name>
</person-group>
<article-title xml:lang="pt"><![CDATA[Equações estruturais aplicadas à satisfação dos alunos: um estudo no curso de ciências contábeis da Universidade Federal de Santa Maria.]]></article-title>
<source><![CDATA[Revista Contabilidade e Finanças]]></source>
<year>2008</year>
<volume>19</volume>
<numero>48</numero>
<issue>48</issue>
<page-range>65-76</page-range></nlm-citation>
</ref>
</ref-list>
</back>
</article>
