<?xml version="1.0" encoding="ISO-8859-1"?><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
<front>
<journal-meta>
<journal-id>1981-5271</journal-id>
<journal-title><![CDATA[Revista Brasileira de Educação Médica]]></journal-title>
<abbrev-journal-title><![CDATA[Rev. Bras. Educ. Med.]]></abbrev-journal-title>
<issn>1981-5271</issn>
<publisher>
<publisher-name><![CDATA[Associação Brasileira de Educação Médica]]></publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id>S1981-52712021000500228</article-id>
<article-id pub-id-type="doi">10.1590/1981-5271v45.4-20210346.ing</article-id>
<title-group>
<article-title xml:lang="en"><![CDATA[Procedure-based assessment (PBA) in urology residency: initial experience]]></article-title>
<article-title xml:lang="pt"><![CDATA[Avaliação baseada em procedimentos (PBA) em uma residência de urologia: experiência inicial]]></article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name>
<surname><![CDATA[Medeiros]]></surname>
<given-names><![CDATA[Daniel Câmara Alves de]]></given-names>
</name>
<xref ref-type="aff" rid="Aff"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname><![CDATA[Medeiros]]></surname>
<given-names><![CDATA[Paulo José de]]></given-names>
</name>
<xref ref-type="aff" rid="Aff"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname><![CDATA[Diniz]]></surname>
<given-names><![CDATA[Rosiane Viana Zuza]]></given-names>
</name>
<xref ref-type="aff" rid="Aff"/>
</contrib>
</contrib-group>
<aff id="Af1">
<institution><![CDATA[,Universidade Federal do Rio Grande do Norte  ]]></institution>
<addr-line><![CDATA[Natal Rio Grande do Norte]]></addr-line>
<country>Brazil</country>
</aff>
<pub-date pub-type="pub">
<day>00</day>
<month>00</month>
<year>2021</year>
</pub-date>
<pub-date pub-type="epub">
<day>00</day>
<month>00</month>
<year>2021</year>
</pub-date>
<volume>45</volume>
<numero>4</numero>
<copyright-statement/>
<copyright-year/>
<self-uri xlink:href="http://educa.fcc.org.br/scielo.php?script=sci_arttext&amp;pid=S1981-52712021000500228&amp;lng=en&amp;nrm=iso"></self-uri><self-uri xlink:href="http://educa.fcc.org.br/scielo.php?script=sci_abstract&amp;pid=S1981-52712021000500228&amp;lng=en&amp;nrm=iso"></self-uri><self-uri xlink:href="http://educa.fcc.org.br/scielo.php?script=sci_pdf&amp;pid=S1981-52712021000500228&amp;lng=en&amp;nrm=iso"></self-uri><abstract abstract-type="short" xml:lang="en"><p><![CDATA[Abstract:  Introduction:  Changes in society and in medical practice have demanded improvements in the surgical teaching process in Medical Residency, leading to the emergence of new teaching-learning and assessment models based on competencies. In this process, the Procedure Based Assessment (PBA) stands out as an assessment tool in the workplace, supported by the assessment of competencies and structured feedback.  Objective: This study aims to present the development and implementation of PBA protocols in an Urology Medical Residency Program.  Method:  This is a prospective, action-research study, carried out from July/2019 to July/2020, involving 10 preceptors and six urology residents. The group consensus methodology was used to create the protocols, in addition to training participants for competency assessment. Six PBA protocols were created, corresponding to the prevalent procedures in the training of the resident/year, followed by their implementation. In addition to the descriptive data analysis, Spearman&#8217;s coefficient (rR) was used for inferential analysis of the correlation between training time and the resident&#8217;s performance assessed by the PBA.  Result:  The development of two PBA instruments for each of the three years of training allowed the assessment of all residents. Thirty-one evaluation meetings were held, with an average of five evaluations per resident. There was a positive correlation between longer training time and better resident performance in laparoscopic radical prostatectomy, percutaneous nephrolithotomy, laparoscopic nephrectomy and in the set of the six procedures (rR = 0.97, 0.55, 0.42 and 0.31, respectively). We report the first use of PBA in Urology Residency in Brazil. The methodology of group consensus associated with a training process proved to be an option for developing this type of instrument. The positive correlation between improved performance in the PBA and training time corroborates studies that resulted in the consolidation of the tool&#8217;s validity and reliability.  Conclusion: The creation of PBA protocols by group consensus is feasible and resulted in the first use of this tool in Urology Residency in Brazil. The PBA may represent a more modern surgical teaching assessment strategy, suitable for training in real scenarios.]]></p></abstract>
<abstract abstract-type="short" xml:lang="pt"><p><![CDATA[Resumo:  Introdução: Mudanças na sociedade e nas práticas da medicina têm demandado melhorias no processo de ensino cirúrgico nas residências médicas, levando ao surgimento de novos modelos de ensino-aprendizagem e de avaliação baseados em competências. Nesse processo, o Procedure Based Assessment (PBA) se destaca como uma ferramenta de avaliação em ambiente de trabalho, amparada na avaliação de competências e no feedback estruturado.  Objetivo:  Este estudo tem o objetivo de apresentar a elaboração e implantação de protocolos de PBA em um programa de residência médica de urologia.  Método: Trata-se de estudo prospectivo, do tipo pesquisa-ação, realizado de julho de 2019 a julho de 2020, envolvendo dez preceptores e seis residentes de urologia. Utilizou-se a metodologia de consenso de grupo para a elaboração dos protocolos, além de capacitação dos participantes para avaliação por competência. Elaboraram-se seis protocolos de PBA, correspondentes aos procedimentos prevalentes na formação do residente/ano. Em seguida, esses protocolos foram implantados. Além da análise descritiva dos dados, utilizou-se o coeficiente de Spearman (rR) para análise inferencial de correlação entre tempo de treinamento e o desempenho do residente avaliado pelo PBA.  Resultado: A elaboração de dois instrumentos de PBA para cada um dos três anos de formação permitiu a avaliação de todos os residentes. Foram realizados 31 encontros avaliativos, com média de cinco avaliações por residente. Houve correlação positiva entre o maior tempo de treinamento e melhor desempenho do residente na prostatectomia radical laparoscópica, na nefrolitotripsia percutânea, na nefrectomia laparoscópica e no conjunto dos seis procedimentos (rR = 0,97, 0,55, 0,42 e 0,31, respectivamente). Relatamos a primeira utilização do PBA em residência de urologia no Brasil. A metodologia de consenso de grupo associada a um processo de capacitação mostrou-se como opção para elaboração desse tipo de instrumento. A correlação positiva entre melhora do desempenho no PBA e o tempo de treinamento corrobora estudos que resultaram em consolidação da validade e confiabilidade da ferramenta.  Conclusão:  A elaboração de protocolos de PBA por consenso de grupo é factível e resultou na primeira utilização dessa ferramenta em residência de urologia no Brasil. O PBA pode representar uma estratégia de avaliação de ensino cirúrgico mais moderno e adequado ao treinamento em cenários reais.]]></p></abstract>
<kwd-group>
<kwd lng="en"><![CDATA[Internship and Residency]]></kwd>
<kwd lng="en"><![CDATA[Competency-Based Education]]></kwd>
<kwd lng="en"><![CDATA[Urologic Surgical Procedures]]></kwd>
<kwd lng="en"><![CDATA[Educational Measurement]]></kwd>
<kwd lng="en"><![CDATA[Urology]]></kwd>
<kwd lng="pt"><![CDATA[Internato e Residência]]></kwd>
<kwd lng="pt"><![CDATA[Educação Baseada em Competências]]></kwd>
<kwd lng="pt"><![CDATA[Procedimentos Cirúrgicos Urológicos]]></kwd>
<kwd lng="pt"><![CDATA[Avaliação Educacional]]></kwd>
<kwd lng="pt"><![CDATA[Urologia]]></kwd>
</kwd-group>
</article-meta>
</front><back>
<ref-list>
<ref id="B1">
<label>1</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Tennent]]></surname>
<given-names><![CDATA[D]]></given-names>
</name>
<name>
<surname><![CDATA[Pitts]]></surname>
<given-names><![CDATA[D]]></given-names>
</name>
<name>
<surname><![CDATA[Foote]]></surname>
<given-names><![CDATA[J]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Procedure-based assessment in shoulder and elbow surgery]]></article-title>
<source><![CDATA[Shoulder Elbow]]></source>
<year>2013</year>
<volume>5</volume>
<page-range>73-7</page-range></nlm-citation>
</ref>
<ref id="B2">
<label>2</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Torsney]]></surname>
<given-names><![CDATA[KM]]></given-names>
</name>
<name>
<surname><![CDATA[Cocker]]></surname>
<given-names><![CDATA[DM]]></given-names>
</name>
<name>
<surname><![CDATA[Slesser]]></surname>
<given-names><![CDATA[AAP]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[The modern surgeon and competency assessment: are the Workplace-Based Assessments Evidence-Based?]]></article-title>
<source><![CDATA[World J of Surg]]></source>
<year>2015</year>
<volume>39</volume>
<page-range>623-33</page-range></nlm-citation>
</ref>
<ref id="B3">
<label>3</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Hurreiz]]></surname>
<given-names><![CDATA[H]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[The evolution of surgical training in the UK]]></article-title>
<source><![CDATA[Adv Med Educ Pract]]></source>
<year>2019</year>
<volume>10</volume>
<page-range>163-8</page-range></nlm-citation>
</ref>
<ref id="B4">
<label>4</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Hopkins]]></surname>
<given-names><![CDATA[L]]></given-names>
</name>
<name>
<surname><![CDATA[Robinson]]></surname>
<given-names><![CDATA[DBT]]></given-names>
</name>
<name>
<surname><![CDATA[Brown]]></surname>
<given-names><![CDATA[C]]></given-names>
</name>
<name>
<surname><![CDATA[Egan]]></surname>
<given-names><![CDATA[R]]></given-names>
</name>
<name>
<surname><![CDATA[Iorwerth]]></surname>
<given-names><![CDATA[A]]></given-names>
</name>
<name>
<surname><![CDATA[Holt]]></surname>
<given-names><![CDATA[M]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Trauma and orthopedic surgery curriculum concordance: an operative learning curve trajectory perspective]]></article-title>
<source><![CDATA[J Surg Educ]]></source>
<year>2019</year>
<volume>76</volume>
<numero>6</numero>
<issue>6</issue>
<page-range>1569-78</page-range></nlm-citation>
</ref>
<ref id="B5">
<label>5</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[De Siqueira]]></surname>
<given-names><![CDATA[JR]]></given-names>
</name>
<name>
<surname><![CDATA[Gouch]]></surname>
<given-names><![CDATA[MJ]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Correlation between experience targets and competence for general surgery certification]]></article-title>
<source><![CDATA[BJS Open]]></source>
<year>2016</year>
<volume>103</volume>
<page-range>921-7</page-range></nlm-citation>
</ref>
<ref id="B6">
<label>6</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Beard]]></surname>
<given-names><![CDATA[J]]></given-names>
</name>
<name>
<surname><![CDATA[Rowley]]></surname>
<given-names><![CDATA[D]]></given-names>
</name>
<name>
<surname><![CDATA[Bussey]]></surname>
<given-names><![CDATA[M]]></given-names>
</name>
<name>
<surname><![CDATA[Pitts]]></surname>
<given-names><![CDATA[D]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Workplace-based assessment: assessing technical skill throughout the continuum of surgical training]]></article-title>
<source><![CDATA[ANZ J Surg]]></source>
<year>2009</year>
<volume>79</volume>
<page-range>148-53</page-range></nlm-citation>
</ref>
<ref id="B7">
<label>7</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Evgeniou]]></surname>
<given-names><![CDATA[E]]></given-names>
</name>
<name>
<surname><![CDATA[Peter]]></surname>
<given-names><![CDATA[L]]></given-names>
</name>
<name>
<surname><![CDATA[Tsironi]]></surname>
<given-names><![CDATA[M]]></given-names>
</name>
<name>
<surname><![CDATA[Iyer]]></surname>
<given-names><![CDATA[S]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Assessments methods in surgical training in the United Kingdom]]></article-title>
<source><![CDATA[J Educ Eval Health Prof]]></source>
<year>2013</year>
<volume>10</volume>
<numero>2</numero>
<issue>2</issue>
<page-range>1-7</page-range></nlm-citation>
</ref>
<ref id="B8">
<label>8</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Bindal]]></surname>
<given-names><![CDATA[T]]></given-names>
</name>
<name>
<surname><![CDATA[Wall]]></surname>
<given-names><![CDATA[D]]></given-names>
</name>
<name>
<surname><![CDATA[Goodyear]]></surname>
<given-names><![CDATA[HM]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Trainee doctors&#8217; views on workplace-based assessments: are they just a tick box exercise?]]></article-title>
<source><![CDATA[Med Teach]]></source>
<year>2011</year>
<volume>33</volume>
<page-range>919-27</page-range></nlm-citation>
</ref>
<ref id="B9">
<label>9</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Moorthy]]></surname>
<given-names><![CDATA[K]]></given-names>
</name>
<name>
<surname><![CDATA[Munz]]></surname>
<given-names><![CDATA[Y]]></given-names>
</name>
<name>
<surname><![CDATA[Sarker]]></surname>
<given-names><![CDATA[SK]]></given-names>
</name>
<name>
<surname><![CDATA[Darzi]]></surname>
<given-names><![CDATA[A]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Objective assessment of technical skills in surgery]]></article-title>
<source><![CDATA[BMJ]]></source>
<year>2003</year>
<volume>327</volume>
<page-range>1032-7</page-range></nlm-citation>
</ref>
<ref id="B10">
<label>10</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Swanwick]]></surname>
<given-names><![CDATA[T]]></given-names>
</name>
<name>
<surname><![CDATA[Chana]]></surname>
<given-names><![CDATA[N]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Workplace assessment for licensing in general practice]]></article-title>
<source><![CDATA[Brit J Gen Pract]]></source>
<year>2005</year>
<volume>55</volume>
<page-range>461-7</page-range></nlm-citation>
</ref>
<ref id="B11">
<label>11</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Eardley]]></surname>
<given-names><![CDATA[I]]></given-names>
</name>
<name>
<surname><![CDATA[Bussey]]></surname>
<given-names><![CDATA[M]]></given-names>
</name>
<name>
<surname><![CDATA[Woodthorpe]]></surname>
<given-names><![CDATA[A]]></given-names>
</name>
<name>
<surname><![CDATA[Munsch]]></surname>
<given-names><![CDATA[C]]></given-names>
</name>
<name>
<surname><![CDATA[Beard]]></surname>
<given-names><![CDATA[J]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Workplace-based assessment in surgical training: experiences from the Intercollegiate Surgical Curriculum Programme]]></article-title>
<source><![CDATA[ANZ J Surg]]></source>
<year>2013</year>
<volume>83</volume>
<page-range>448-53</page-range></nlm-citation>
</ref>
<ref id="B12">
<label>12</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Marriott]]></surname>
<given-names><![CDATA[J]]></given-names>
</name>
<name>
<surname><![CDATA[Purdie]]></surname>
<given-names><![CDATA[H]]></given-names>
</name>
<name>
<surname><![CDATA[Crossley]]></surname>
<given-names><![CDATA[J]]></given-names>
</name>
<name>
<surname><![CDATA[Beard]]></surname>
<given-names><![CDATA[JD]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Evaluation of procedure-based assessment for assessing trainees&#8217; skills in the operating theatre]]></article-title>
<source><![CDATA[Br J Surg]]></source>
<year>2011</year>
<volume>98</volume>
<numero>3</numero>
<issue>3</issue>
<page-range>450-7</page-range></nlm-citation>
</ref>
<ref id="B13">
<label>13</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Awad]]></surname>
<given-names><![CDATA[Z]]></given-names>
</name>
<name>
<surname><![CDATA[Hayden]]></surname>
<given-names><![CDATA[L]]></given-names>
</name>
<name>
<surname><![CDATA[Robson]]></surname>
<given-names><![CDATA[AK]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Reliability and validity of Procedure-Based Assessments in otolaryngology training]]></article-title>
<source><![CDATA[Laryngoscope]]></source>
<year>2015</year>
<volume>125</volume>
<page-range>1328-35</page-range></nlm-citation>
</ref>
<ref id="B14">
<label>14</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Abdelaal]]></surname>
<given-names><![CDATA[A]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Procedure-based assessments: the past, the present and the future]]></article-title>
<source><![CDATA[Postgrad Med J]]></source>
<year>2020</year>
<volume>96</volume>
<page-range>7-8</page-range></nlm-citation>
</ref>
<ref id="B15">
<label>15</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Shalhoub]]></surname>
<given-names><![CDATA[J]]></given-names>
</name>
<name>
<surname><![CDATA[Marshall]]></surname>
<given-names><![CDATA[DC]]></given-names>
</name>
<name>
<surname><![CDATA[Ippolito]]></surname>
<given-names><![CDATA[K]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Perspectives on procedure-based assessments: a thematic analysis of semistructured interviews with 10 UK surgical trainees]]></article-title>
<source><![CDATA[BMJ Open]]></source>
<year>2017</year>
<volume>7</volume>
<page-range>1-8</page-range></nlm-citation>
</ref>
<ref id="B16">
<label>16</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Ali]]></surname>
<given-names><![CDATA[JM]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Getting lost in translation? Workplace based assessments in surgical training]]></article-title>
<source><![CDATA[Surgeon]]></source>
<year>2013</year>
<volume>11</volume>
<numero>5</numero>
<issue>5</issue>
<page-range>286-9</page-range></nlm-citation>
</ref>
<ref id="B17">
<label>17</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[Hunter]]></surname>
<given-names><![CDATA[AR]]></given-names>
</name>
<name>
<surname><![CDATA[Maird]]></surname>
<given-names><![CDATA[EJ]]></given-names>
</name>
<name>
<surname><![CDATA[Reed]]></surname>
<given-names><![CDATA[MR]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Procedure-based assessments in trauma and orthopaedic training - the trainees&#8217; perspective]]></article-title>
<source><![CDATA[Med Teach]]></source>
<year>2015</year>
<volume>37</volume>
<page-range>444-9</page-range></nlm-citation>
</ref>
<ref id="B18">
<label>18</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[James]]></surname>
<given-names><![CDATA[K]]></given-names>
</name>
<name>
<surname><![CDATA[Cross]]></surname>
<given-names><![CDATA[K]]></given-names>
</name>
<name>
<surname><![CDATA[Lucarotti]]></surname>
<given-names><![CDATA[ME]]></given-names>
</name>
<name>
<surname><![CDATA[Fowler]]></surname>
<given-names><![CDATA[AL]]></given-names>
</name>
<name>
<surname><![CDATA[Cook]]></surname>
<given-names><![CDATA[TA]]></given-names>
</name>
</person-group>
<article-title xml:lang=""><![CDATA[Undertaking procedure-based assessment is feasible in clinical practice]]></article-title>
<source><![CDATA[Ann R Coll Surg Engl]]></source>
<year>2009</year>
<volume>91</volume>
<page-range>110-2</page-range></nlm-citation>
</ref>
</ref-list>
</back>
</article>
