Abstract

TRAVITZKI, Rodrigo. Evaluation of Enem (2009 and 2011) quality with psychometric techniques. Est. Aval. Educ. [online]. 2017, vol.28, n.67, pp.256-288.  Epub Jan 10, 2017. ISSN 1984-932X.  https://doi.org/10.18222/eae.v28i67.3910.

This study is a meta evaluation of the Exame Nacional do Ensino Médio [National Secondary Education Examination] (Enem) of 2009 and 2011, applying psychometric techniques to 2.025.268 tests. Some techniques were illustrated by analysis of item content, showing their usefulness to educators. We compared indicators related to the tests (α coefficient and average inter-item correlation), but mainly related to the items (item-whole correlation, biserial coefficient, discrimination and fit of two-parameter logistic model). The 2009 Mathematics test showed insufficient reliability (α <0.6). The Language and Human Sciences tests showed better quality indicators in both years. In total, we found 25% of items with anomalous empirical behavior in 2009 and 17% in 2011.

Keywords : Meta Evaluation; Psychometrics; Large-Scale Evaluation; ENEM.

        · abstract in Portuguese | Spanish     · text in Portuguese     · Portuguese ( pdf )