<?xml version="1.0" encoding="ISO-8859-1"?><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
<front>
<journal-meta>
<journal-id>1981-5271</journal-id>
<journal-title><![CDATA[Revista Brasileira de Educação Médica]]></journal-title>
<abbrev-journal-title><![CDATA[Rev. Bras. Educ. Med.]]></abbrev-journal-title>
<issn>1981-5271</issn>
<publisher>
<publisher-name><![CDATA[Associação Brasileira de Educação Médica]]></publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id>S1981-52712020000100401</article-id>
<article-id pub-id-type="doi">10.1590/1981-5271v44.1-20190130.ing</article-id>
<title-group>
<article-title xml:lang="en"><![CDATA[Improvement of Faculty&#8217;s Skills on the Creation of Items for Progress Testing Through Feedback to Item Writers: a Successful Experience]]></article-title>
<article-title xml:lang="pt"><![CDATA[Melhora na Habilidade de Elaboração de Itens para o Teste de Progresso por meio de Feedback aos Autores: uma Experiência Exitosa]]></article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name>
<surname><![CDATA[Hamamoto Filho]]></surname>
<given-names><![CDATA[Pedro Tadao]]></given-names>
</name>
<xref ref-type="aff" rid="Aff"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname><![CDATA[Bicudo]]></surname>
<given-names><![CDATA[Angélica Maria]]></given-names>
</name>
<xref ref-type="aff" rid="Aff"/>
</contrib>
</contrib-group>
<aff id="Af1">
<institution><![CDATA[,Universidade Estadual Paulista  ]]></institution>
<addr-line><![CDATA[Botucatu São Paulo]]></addr-line>
<country>Brazil</country>
</aff>
<aff id="Af2">
<institution><![CDATA[,Universidade Estadual de Campinas  ]]></institution>
<addr-line><![CDATA[Campinas São Paulo]]></addr-line>
<country>Brazil</country>
</aff>
<pub-date pub-type="pub">
<day>00</day>
<month>00</month>
<year>2020</year>
</pub-date>
<pub-date pub-type="epub">
<day>00</day>
<month>00</month>
<year>2020</year>
</pub-date>
<volume>44</volume>
<numero>1</numero>
<copyright-statement/>
<copyright-year/>
<self-uri xlink:href="http://educa.fcc.org.br/scielo.php?script=sci_arttext&amp;pid=S1981-52712020000100401&amp;lng=en&amp;nrm=iso"></self-uri><self-uri xlink:href="http://educa.fcc.org.br/scielo.php?script=sci_abstract&amp;pid=S1981-52712020000100401&amp;lng=en&amp;nrm=iso"></self-uri><self-uri xlink:href="http://educa.fcc.org.br/scielo.php?script=sci_pdf&amp;pid=S1981-52712020000100401&amp;lng=en&amp;nrm=iso"></self-uri><abstract abstract-type="short" xml:lang="en"><p><![CDATA[Abstract: The evaluation of knowledge is an important step in the teachers&#8217; work, because it is fundamental that the evaluation results be valid and reliable. Several faculty development programs have been undertaken to improve teachers&#8217; skills on item writing. Few studies, however, have explored the benefits of providing feedback to multiple-choice item writers. Progress Testing is a longitudinal assessment of students&#8217; knowledge gain. Their results are useful for generating feedback to students, teachers and medical school managers. The aim of this report is to present a successful experience of faculty development on high-quality item writing for Progress Testing through feedback about the fate of the items written by faculty members. Annually, faculties from medical schools participating in a consortium for the application of the Progress Test are asked to formulate new items to compose the test version. However, the fate of the items is not known by their authors, that is, they do not know if the items are incorporated into the test, if the items have good quality, what is the students&#8217; performance in each of the items, and what is the psychometric function of the items. In 2017, one of the schools participating in the consortium offered its item authors a feedback regarding the flaws in item writing, modification of items by the review committee and students&#8217; performance, as well as psychometric function in each item. The percentage of flawed item (items without enough quality to be selected for the test) was more than 30%. There was an inverse relation between the number of flawed item and the number of items included in the final exam, when analyzing the different content areas of the test (that is, Internal Medicine, Surgery, Pediatrics, Obstetrics and Gynecology, Public Health, and Basic Sciences). In the following year, we observed a decrease in the number of flawed item (less than 10%) and an increase in the number of eligible items to be selected for the Progress Testing. Therefore, giving feedback to item writers seems to be a good strategy for developing the faculty&#8217;s ability on writing good quality items.]]></p></abstract>
<abstract abstract-type="short" xml:lang="pt"><p><![CDATA[Resumo: A avaliação de conhecimentos é uma etapa importante do trabalho docente, pois é preciso que os resultados das avaliações sejam válidos e confiáveis. Diversos programas de desenvolvimento docente têm sido realizados para melhorar a habilidade em elaborar questões objetivas pelos professores. Poucos estudos, no entanto, exploraram os benefícios de fornecer feedback aos autores de itens de múltipla escolha. O Teste de Progresso é uma avaliação longitudinal do ganho de conhecimentos dos estudantes cujos resultados são úteis para gerar feedback aos próprios estudantes, aos professores e aos gestores das escolas médicas. O objetivo deste relato é apresentar uma experiência exitosa em gerar desenvolvimento docente na habilidade de elaborar itens de qualidade para o Teste de Progresso por meio do feedback a respeito da qualidade e do destino destes. Anualmente, os professores das escolas médicas participantes de um consórcio para aplicação do Teste de Progresso são solicitados a formular novos itens para compor a versão do teste. Porém, o destino dos itens não é conhecido por seus autores, ou seja, eles não sabem se as questões são incorporadas à prova, se elas têm boa qualidade, qual o desempenho dos estudantes em cada questão e qual o funcionamento psicométrico delas. Em 2017, uma das escolas participantes do consórcio ofereceu aos seus autores de questões uma devolutiva sobre as falhas na redação, a modificação dos itens pelo comitê revisor, o desempenho dos estudantes nas questões e o funcionamento psicométrico em cada item. A porcentagem de itens falhos, ou seja, de qualidade não satisfatória para a inclusão no teste, era superior a 30%. Houve uma relação inversa entre a quantidade de itens falhos e o número de itens incluídos na prova final, numa análise por área de conhecimento da prova (ou seja, clínica, cirurgia, pediatria, ginecologia e obstetrícia, saúde pública e ciências básicas). No ano seguinte, observamos uma diminuição no número de falhas de itens (menor que 10%) e um aumento no número de questões elegíveis a serem selecionadas para o exame de Teste de Progresso. Portanto, oferecer feedback para os redatores de questões parece ser uma boa estratégia para desenvolver a habilidade docente em elaborar itens objetivos de boa qualidade.]]></p></abstract>
<kwd-group>
<kwd lng="en"><![CDATA[Educational Measurement]]></kwd>
<kwd lng="en"><![CDATA[Formative Feedback]]></kwd>
<kwd lng="en"><![CDATA[Examination Question]]></kwd>
<kwd lng="en"><![CDATA[Academic Performance]]></kwd>
<kwd lng="en"><![CDATA[Faculty Medical]]></kwd>
<kwd lng="pt"><![CDATA[Avaliação Educacional]]></kwd>
<kwd lng="pt"><![CDATA[Feedback formativo]]></kwd>
<kwd lng="pt"><![CDATA[Questão de prova]]></kwd>
<kwd lng="pt"><![CDATA[Desempenho Acadêmico]]></kwd>
<kwd lng="pt"><![CDATA[Docentes de Medicina]]></kwd>
</kwd-group>
</article-meta>
</front><back>
<ref-list>
<ref id="B1">
<label>1</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Coombes]]></surname>
<given-names><![CDATA[L]]></given-names>
</name>
<name>
<surname><![CDATA[Ricketts]]></surname>
<given-names><![CDATA[C]]></given-names>
</name>
<name>
<surname><![CDATA[Freeman]]></surname>
<given-names><![CDATA[A]]></given-names>
</name>
<name>
<surname><![CDATA[Stratford]]></surname>
<given-names><![CDATA[J]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Beyond assessment: Feedback for individuals and institutions based on the progress test]]></article-title>
<source><![CDATA[Med Teach]]></source>
<year>2010</year>
<volume>32</volume>
<numero>6</numero>
<issue>6</issue>
<page-range>486-90</page-range></nlm-citation>
</ref>
<ref id="B2">
<label>2</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Neeley]]></surname>
<given-names><![CDATA[SM]]></given-names>
</name>
<name>
<surname><![CDATA[Ulman]]></surname>
<given-names><![CDATA[CA]]></given-names>
</name>
<name>
<surname><![CDATA[Sydelko]]></surname>
<given-names><![CDATA[BS]]></given-names>
</name>
<name>
<surname><![CDATA[Borges]]></surname>
<given-names><![CDATA[NJ]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[The value of progress testing in undergraduate medical education: a systematic review of the literature]]></article-title>
<source><![CDATA[Med Sci Educ]]></source>
<year>2016</year>
<volume>26</volume>
<numero>4</numero>
<issue>4</issue>
<page-range>617-22</page-range></nlm-citation>
</ref>
<ref id="B3">
<label>3</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Wrigley]]></surname>
<given-names><![CDATA[W]]></given-names>
</name>
<name>
<surname><![CDATA[van der Vleuten]]></surname>
<given-names><![CDATA[CP]]></given-names>
</name>
<name>
<surname><![CDATA[Freeman]]></surname>
<given-names><![CDATA[A]]></given-names>
</name>
<name>
<surname><![CDATA[Muijtjens]]></surname>
<given-names><![CDATA[A]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[A systemic framework for the progress test: strengths, constraints and issues: AMEE Guide No. 71]]></article-title>
<source><![CDATA[Med Teach]]></source>
<year>2012</year>
<volume>34</volume>
<numero>9</numero>
<issue>9</issue>
<page-range>683-97</page-range></nlm-citation>
</ref>
<ref id="B4">
<label>4</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Tio]]></surname>
<given-names><![CDATA[R]]></given-names>
</name>
<name>
<surname><![CDATA[Schutte]]></surname>
<given-names><![CDATA[B]]></given-names>
</name>
<name>
<surname><![CDATA[Meiboom]]></surname>
<given-names><![CDATA[AA]]></given-names>
</name>
<name>
<surname><![CDATA[Greidanus]]></surname>
<given-names><![CDATA[J]]></given-names>
</name>
<name>
<surname><![CDATA[Dubois]]></surname>
<given-names><![CDATA[EA]]></given-names>
</name>
<name>
<surname><![CDATA[Bremers]]></surname>
<given-names><![CDATA[AJA]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[The progress test of medicine: the Dutch experience]]></article-title>
<source><![CDATA[Perspect Med Educ]]></source>
<year>2016</year>
<volume>5</volume>
<numero>1</numero>
<issue>1</issue>
<page-range>51-5</page-range></nlm-citation>
</ref>
<ref id="B5">
<label>5</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Muijtjens]]></surname>
<given-names><![CDATA[AMM]]></given-names>
</name>
<name>
<surname><![CDATA[Timmermans]]></surname>
<given-names><![CDATA[I]]></given-names>
</name>
<name>
<surname><![CDATA[Donkers]]></surname>
<given-names><![CDATA[J]]></given-names>
</name>
<name>
<surname><![CDATA[Peperkamp]]></surname>
<given-names><![CDATA[R]]></given-names>
</name>
<name>
<surname><![CDATA[Medema]]></surname>
<given-names><![CDATA[H]]></given-names>
</name>
<name>
<surname><![CDATA[Cohen-Schotanus]]></surname>
<given-names><![CDATA[J]]></given-names>
</name>
<name>
<surname><![CDATA[Thoben]]></surname>
<given-names><![CDATA[A]]></given-names>
</name>
<name>
<surname><![CDATA[Wernick]]></surname>
<given-names><![CDATA[AC]]></given-names>
</name>
<name>
<surname><![CDATA[van der Vleuten]]></surname>
<given-names><![CDATA[CP]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Flexible electronic feedback using the virtues of progress testing]]></article-title>
<source><![CDATA[Med Teach]]></source>
<year>2010</year>
<volume>32</volume>
<numero>6</numero>
<issue>6</issue>
<page-range>491-5</page-range></nlm-citation>
</ref>
<ref id="B6">
<label>6</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Wade]]></surname>
<given-names><![CDATA[L]]></given-names>
</name>
<name>
<surname><![CDATA[Harrison]]></surname>
<given-names><![CDATA[C]]></given-names>
</name>
<name>
<surname><![CDATA[Hollands]]></surname>
<given-names><![CDATA[J]]></given-names>
</name>
<name>
<surname><![CDATA[Mattick]]></surname>
<given-names><![CDATA[K]]></given-names>
</name>
<name>
<surname><![CDATA[Ricketts]]></surname>
<given-names><![CDATA[C]]></given-names>
</name>
<name>
<surname><![CDATA[Wass]]></surname>
<given-names><![CDATA[V]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Student perceptions of the progress test in two settings and the implications for test deployment]]></article-title>
<source><![CDATA[Adv Health Sci Educ]]></source>
<year>2012</year>
</nlm-citation>
</ref>
<ref id="B7">
<nlm-citation citation-type="">
<source><![CDATA[Med Teach]]></source>
<year>1996</year>
<volume>18</volume>
<numero>2</numero>
<issue>2</issue>
<page-range>103-9</page-range></nlm-citation>
</ref>
<ref id="B8">
<label>8</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Schuwirth]]></surname>
<given-names><![CDATA[LWT]]></given-names>
</name>
<name>
<surname><![CDATA[van der Vleuten]]></surname>
<given-names><![CDATA[CPM]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[The use of progress testing]]></article-title>
<source><![CDATA[Perspect Med Educ]]></source>
<year>2012</year>
<volume>1</volume>
<numero>1</numero>
<issue>1</issue>
<page-range>24-30</page-range></nlm-citation>
</ref>
<ref id="B9">
<label>9</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Muijtjens]]></surname>
<given-names><![CDATA[AMM]]></given-names>
</name>
<name>
<surname><![CDATA[Schuwirth]]></surname>
<given-names><![CDATA[LWT]]></given-names>
</name>
<name>
<surname><![CDATA[Cohen-Schotanus]]></surname>
<given-names><![CDATA[J]]></given-names>
</name>
<name>
<surname><![CDATA[Thoben]]></surname>
<given-names><![CDATA[AJNM]]></given-names>
</name>
<name>
<surname><![CDATA[van der Vleuten]]></surname>
<given-names><![CDATA[CPM]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Benchmarking by cross&#8208;institutional comparison of student achievement in a progress test]]></article-title>
<source><![CDATA[Med Educ]]></source>
<year>2008</year>
<volume>42</volume>
<numero>1</numero>
<issue>1</issue>
<page-range>82-8</page-range></nlm-citation>
</ref>
<ref id="B10">
<label>10</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Spaan]]></surname>
<given-names><![CDATA[M]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Test and item specifications development]]></article-title>
<source><![CDATA[Lang Assess Q]]></source>
<year>2006</year>
<volume>3</volume>
<numero>1</numero>
<issue>1</issue>
<page-range>71-9</page-range></nlm-citation>
</ref>
<ref id="B11">
<label>11</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Abdulghani]]></surname>
<given-names><![CDATA[HM]]></given-names>
</name>
<name>
<surname><![CDATA[Ahmad]]></surname>
<given-names><![CDATA[F]]></given-names>
</name>
<name>
<surname><![CDATA[Irshad]]></surname>
<given-names><![CDATA[M]]></given-names>
</name>
<name>
<surname><![CDATA[Khalil]]></surname>
<given-names><![CDATA[MS]]></given-names>
</name>
<name>
<surname><![CDATA[Al-Shaikh]]></surname>
<given-names><![CDATA[GK]]></given-names>
</name>
<name>
<surname><![CDATA[Syed]]></surname>
<given-names><![CDATA[S]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Faculty development programs improve the quality of multiple choice questions items&#8217; writing]]></article-title>
<source><![CDATA[Sci Rep]]></source>
<year>2015</year>
<volume>5</volume>
<page-range>9556</page-range></nlm-citation>
</ref>
<ref id="B12">
<label>12</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Coughlin]]></surname>
<given-names><![CDATA[PA]]></given-names>
</name>
<name>
<surname><![CDATA[Featherstone]]></surname>
<given-names><![CDATA[CR]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[How to Write a High Quality Multiple Choice Question (MCQ): A Guide for Clinicians]]></article-title>
<source><![CDATA[Eur J Vasc Endovasc Surg]]></source>
<year>2017</year>
<volume>54</volume>
<numero>5</numero>
<issue>5</issue>
<page-range>654-8</page-range></nlm-citation>
</ref>
<ref id="B13">
<label>13</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Naeem]]></surname>
<given-names><![CDATA[N]]></given-names>
</name>
<name>
<surname><![CDATA[van der Vleuten]]></surname>
<given-names><![CDATA[C]]></given-names>
</name>
<name>
<surname><![CDATA[Alfaris]]></surname>
<given-names><![CDATA[EA]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Faculty development on item writing substantially improves item quality]]></article-title>
<source><![CDATA[Adv Health Sci Educ Theory Pract]]></source>
<year>2012</year>
<volume>17</volume>
<numero>3</numero>
<issue>3</issue>
<page-range>369-76</page-range></nlm-citation>
</ref>
<ref id="B14">
<label>14</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Ali]]></surname>
<given-names><![CDATA[SH]]></given-names>
</name>
<name>
<surname><![CDATA[Ruit]]></surname>
<given-names><![CDATA[KG]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[The impact of item flaws, testing at low cognitive level, and low distractor functioning on multiple-choice question quality]]></article-title>
<source><![CDATA[Perspect Med Educ]]></source>
<year>2015</year>
<volume>4</volume>
<numero>5</numero>
<issue>5</issue>
<page-range>244-51</page-range></nlm-citation>
</ref>
<ref id="B15">
<label>15</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Dellinges]]></surname>
<given-names><![CDATA[MA]]></given-names>
</name>
<name>
<surname><![CDATA[Curtis]]></surname>
<given-names><![CDATA[DA]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Will a short training session improve multiple-choice item-writing quality by dental school faculty? A pilot stud]]></article-title>
<source><![CDATA[J Dent Educ]]></source>
<year>2017</year>
<volume>81</volume>
<numero>8</numero>
<issue>8</issue>
<page-range>948-55</page-range></nlm-citation>
</ref>
<ref id="B16">
<label>16</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Elliot]]></surname>
<given-names><![CDATA[DL]]></given-names>
</name>
<name>
<surname><![CDATA[Skeff]]></surname>
<given-names><![CDATA[KM]]></given-names>
</name>
<name>
<surname><![CDATA[Stratos]]></surname>
<given-names><![CDATA[GA]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[How do you get to the improvement of teaching? A longitudinal faculty development program for medical educators]]></article-title>
<source><![CDATA[Teach Learn Med]]></source>
<year>1999</year>
<volume>11</volume>
<numero>1</numero>
<issue>1</issue>
<page-range>52-7</page-range></nlm-citation>
</ref>
<ref id="B17">
<label>17</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Knight]]></surname>
<given-names><![CDATA[AM]]></given-names>
</name>
<name>
<surname><![CDATA[Cole]]></surname>
<given-names><![CDATA[KA]]></given-names>
</name>
<name>
<surname><![CDATA[Kern]]></surname>
<given-names><![CDATA[DE]]></given-names>
</name>
<name>
<surname><![CDATA[Barker]]></surname>
<given-names><![CDATA[LR]]></given-names>
</name>
<name>
<surname><![CDATA[Kolodner]]></surname>
<given-names><![CDATA[K]]></given-names>
</name>
<name>
<surname><![CDATA[Wright]]></surname>
<given-names><![CDATA[SM]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Long-term follow-up of a longitudinal faculty development program in teaching skills]]></article-title>
<source><![CDATA[J Gen Intern Med]]></source>
<year>2005</year>
<volume>20</volume>
<numero>8</numero>
<issue>8</issue>
<page-range>721-5</page-range></nlm-citation>
</ref>
<ref id="B18">
<label>18</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Singh]]></surname>
<given-names><![CDATA[T]]></given-names>
</name>
<name>
<surname><![CDATA[de Grave]]></surname>
<given-names><![CDATA[W]]></given-names>
</name>
<name>
<surname><![CDATA[Ganjiwale]]></surname>
<given-names><![CDATA[J]]></given-names>
</name>
<name>
<surname><![CDATA[Supe]]></surname>
<given-names><![CDATA[A]]></given-names>
</name>
<name>
<surname><![CDATA[Burdick]]></surname>
<given-names><![CDATA[WP]]></given-names>
</name>
<name>
<surname><![CDATA[van der Vleuten]]></surname>
<given-names><![CDATA[C]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Impact of a fellowship program for faculty development on the self-efficacy beliefs of health professions teachers: a longitudinal study]]></article-title>
<source><![CDATA[Med Teach]]></source>
<year>2013</year>
<volume>35</volume>
<numero>5</numero>
<issue>5</issue>
<page-range>359-64</page-range></nlm-citation>
</ref>
<ref id="B19">
<label>19</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Abdulghani]]></surname>
<given-names><![CDATA[HM]]></given-names>
</name>
<name>
<surname><![CDATA[Irshad]]></surname>
<given-names><![CDATA[M]]></given-names>
</name>
<name>
<surname><![CDATA[Haque]]></surname>
<given-names><![CDATA[S]]></given-names>
</name>
<name>
<surname><![CDATA[Ahmad]]></surname>
<given-names><![CDATA[T]]></given-names>
</name>
<name>
<surname><![CDATA[Sattar]]></surname>
<given-names><![CDATA[K]]></given-names>
</name>
<name>
<surname><![CDATA[Khalil]]></surname>
<given-names><![CDATA[MS]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Effectiveness of longitudinal faculty development programs on MCQs items writing skills: A follow-up study]]></article-title>
<source><![CDATA[PLoS One]]></source>
<year>2017</year>
<volume>12</volume>
<numero>10</numero>
<issue>10</issue>
</nlm-citation>
</ref>
<ref id="B20">
<label>20</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Karthikeyan]]></surname>
<given-names><![CDATA[S]]></given-names>
</name>
<name>
<surname><![CDATA[O&#8217;Connor]]></surname>
<given-names><![CDATA[E]]></given-names>
</name>
<name>
<surname><![CDATA[Hu]]></surname>
<given-names><![CDATA[W]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Barriers and facilitators to writing quality items for medical school assessments - a scoping review]]></article-title>
<source><![CDATA[BMC Med Educ]]></source>
<year>2019</year>
<volume>19</volume>
<page-range>123</page-range></nlm-citation>
</ref>
<ref id="B21">
<label>21</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Rush]]></surname>
<given-names><![CDATA[BR]]></given-names>
</name>
<name>
<surname><![CDATA[Rankin]]></surname>
<given-names><![CDATA[DC]]></given-names>
</name>
<name>
<surname><![CDATA[White]]></surname>
<given-names><![CDATA[BJ]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[The impact of item-writing flaws and item complexity on examination item difficulty and discrimination value]]></article-title>
<source><![CDATA[BMC Med Educ]]></source>
<year>2016</year>
<volume>16</volume>
<page-range>250</page-range></nlm-citation>
</ref>
<ref id="B22">
<label>22</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Bicudo]]></surname>
<given-names><![CDATA[AM]]></given-names>
</name>
<name>
<surname><![CDATA[Hamamoto Filho]]></surname>
<given-names><![CDATA[PT]]></given-names>
</name>
<name>
<surname><![CDATA[Abbade]]></surname>
<given-names><![CDATA[JF]]></given-names>
</name>
<name>
<surname><![CDATA[Hafner]]></surname>
<given-names><![CDATA[MLMB]]></given-names>
</name>
<name>
<surname><![CDATA[Maffei]]></surname>
<given-names><![CDATA[CML]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Teste de Progresso em consórcio para todas as escolas médicas do Brasil]]></article-title>
<source><![CDATA[Rev Bras Educ Méd]]></source>
<year>2019</year>
<volume>43</volume>
<numero>4</numero>
<issue>4</issue>
<page-range>151-6</page-range></nlm-citation>
</ref>
<ref id="B23">
<label>23</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Van Der Vleuten]]></surname>
<given-names><![CDATA[CPM]]></given-names>
</name>
<name>
<surname><![CDATA[Verwijnen]]></surname>
<given-names><![CDATA[GM]]></given-names>
</name>
<name>
<surname><![CDATA[Wijnen]]></surname>
<given-names><![CDATA[WHFW]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Fifteen years of experience with progress testing in a problem based learning curriculum]]></article-title>
<source><![CDATA[Med Teach]]></source>
<year>1996</year>
<volume>18</volume>
<numero>2</numero>
<issue>2</issue>
<page-range>103-9</page-range></nlm-citation>
</ref>
<ref id="B24">
<label>24</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Blake]]></surname>
<given-names><![CDATA[JM]]></given-names>
</name>
<name>
<surname><![CDATA[Norman]]></surname>
<given-names><![CDATA[GR]]></given-names>
</name>
<name>
<surname><![CDATA[Keane]]></surname>
<given-names><![CDATA[DR]]></given-names>
</name>
<name>
<surname><![CDATA[Muelle]]></surname>
<given-names><![CDATA[CB]]></given-names>
</name>
<name>
<surname><![CDATA[Cunnington]]></surname>
<given-names><![CDATA[J]]></given-names>
</name>
<name>
<surname><![CDATA[Didyk]]></surname>
<given-names><![CDATA[N]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Introducing progress testing in McMaster university&#8217;s problem-based medical curriculum: psychometric properties and effect on learning]]></article-title>
<source><![CDATA[Acad Med]]></source>
<year>1996</year>
<volume>71</volume>
<numero>9</numero>
<issue>9</issue>
<page-range>1002-7</page-range></nlm-citation>
</ref>
<ref id="B25">
<label>25</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Epstein]]></surname>
<given-names><![CDATA[RM]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Assessment in medical education]]></article-title>
<source><![CDATA[New Engl J Med]]></source>
<year>2007</year>
<volume>356</volume>
<page-range>387-96</page-range></nlm-citation>
</ref>
<ref id="B26">
<label>26</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Haladyna]]></surname>
<given-names><![CDATA[TM]]></given-names>
</name>
<name>
<surname><![CDATA[Downing]]></surname>
<given-names><![CDATA[SM]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Validity of taxonomy of multiple-choice item writing rules]]></article-title>
<source><![CDATA[Appl Meas Educ]]></source>
<year>1989</year>
<volume>2</volume>
<page-range>51-78</page-range></nlm-citation>
</ref>
<ref id="B27">
<label>27</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Downing]]></surname>
<given-names><![CDATA[SM]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[The effects of violating standard item writing principles on tests and students: The consequences of using flawed items on achievement examinations in medical education]]></article-title>
<source><![CDATA[Adv Health Sci Educ]]></source>
<year>2005</year>
<volume>10</volume>
<page-range>133-43</page-range></nlm-citation>
</ref>
<ref id="B28">
<label>28</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Ware]]></surname>
<given-names><![CDATA[J]]></given-names>
</name>
<name>
<surname><![CDATA[Vik]]></surname>
<given-names><![CDATA[T]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Quality assurance of item writing: During the introduction of multiple choice questions in medicine for high stakes examinations]]></article-title>
<source><![CDATA[Med Teach]]></source>
<year>2009</year>
<volume>31</volume>
<page-range>238-43</page-range></nlm-citation>
</ref>
<ref id="B29">
<label>29</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Downing]]></surname>
<given-names><![CDATA[SM]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Construct-irrelevant variance and flawed test questions: Do multiple-choice item-writing principles make any difference?]]></article-title>
<source><![CDATA[Acad Med]]></source>
<year>2002</year>
<volume>77</volume>
<numero>^s10 Suppl</numero>
<issue>^s10 Suppl</issue>
<supplement>10 Suppl</supplement>
<page-range>S103-4</page-range></nlm-citation>
</ref>
<ref id="B30">
<label>30</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Kim]]></surname>
<given-names><![CDATA[J]]></given-names>
</name>
<name>
<surname><![CDATA[Chi]]></surname>
<given-names><![CDATA[Y]]></given-names>
</name>
<name>
<surname><![CDATA[Huensch]]></surname>
<given-names><![CDATA[A]]></given-names>
</name>
<name>
<surname><![CDATA[Jun]]></surname>
<given-names><![CDATA[H]]></given-names>
</name>
<name>
<surname><![CDATA[Li]]></surname>
<given-names><![CDATA[H]]></given-names>
</name>
<name>
<surname><![CDATA[Roullion]]></surname>
<given-names><![CDATA[V]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[A Case Study on an Item Writing Process: Use of Test Specifications, Nature of roup Dynamics, and Individual Item Writers&#8217; Characteristics]]></article-title>
<source><![CDATA[Lang Assess Q]]></source>
<year>2010</year>
<volume>7</volume>
<numero>2</numero>
<issue>2</issue>
<page-range>160-74</page-range></nlm-citation>
</ref>
<ref id="B31">
<label>31</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Frey]]></surname>
<given-names><![CDATA[BB]]></given-names>
</name>
<name>
<surname><![CDATA[Petersen]]></surname>
<given-names><![CDATA[S]]></given-names>
</name>
<name>
<surname><![CDATA[Edwards]]></surname>
<given-names><![CDATA[LM]]></given-names>
</name>
<name>
<surname><![CDATA[Pedrotti]]></surname>
<given-names><![CDATA[JT]]></given-names>
</name>
<name>
<surname><![CDATA[Peyton]]></surname>
<given-names><![CDATA[V]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Item-writing rules: collective wisdom]]></article-title>
<source><![CDATA[Teaching Teach Educ]]></source>
<year>2005</year>
<volume>21</volume>
<page-range>357-64</page-range></nlm-citation>
</ref>
</ref-list>
</back>
</article>
