SciELO - Scientific Electronic Library Online

 
vol.46 número3Identidade médica: o impacto do primeiro contato com pacientes na empatia do estudante de MedicinaAderência dos PPC de Medicina aos parâmetros da política de formação médica brasileira índice de autoresíndice de assuntospesquisa de artigos
Home Pagelista alfabética de periódicos  

Serviços Personalizados

Journal

Artigo

Compartilhar


Revista Brasileira de Educação Médica

versão impressa ISSN 0100-5502versão On-line ISSN 1981-5271

Rev. Bras. Educ. Med. vol.46 no.3 Rio de Janeiro  2022  Epub 16-Ago-2022

https://doi.org/10.1590/1981-5271v46.3-20220046 

ORIGINAL ARTICLE

Can the traditional class be replaced by the Worked Example in the teaching of Radiology?

Paola Isabel Silva Barros1 
http://orcid.org/0000-0002-8678-1543

Cássio da Cunha Ibiapina1 
http://orcid.org/0000-0003-3607-8857

Leandro Malloy Diniz1 
http://orcid.org/0000-0002-6606-1354

Bruno Morais Damião1 
http://orcid.org/0000-0002-3850-973X

1Universidade Federal de Minas Gerais, Belo Horizonte, Minas Gerais, Brazil.


Abstract:

Introduction:

During the last decade, the traditional model of medical education was widely debated, and recently, the Covid-19 pandemic added new challenges in teaching and learning in medical education. The Worked Example is an instructional tool in which an expert shows a detailed problem solution for a learner.

Objective:

This study aimed to compare, in an experimental study with medical students, lectures in online format with Worked Example for teaching chest tomography.

Method:

Experimental study through an educational intervention with medical students in the initial and final stages of clinical practice.

Result:

Analysis of variance of repeated measures (ANOVA) was used in the statistical analysis. There was a significant difference between the grades before and after training (F1; 74 = 46.008; p < 0.001) and between the course phases studied (F2; 148 = 19.452; p < 0.001). There was no statistically significant difference between the groups (F2; 74 = 1.401; p = 0.240). There was no significant difference in mental effort reported in the comparison between groups (F1; 69 = 0.092; p = 0.762), but students in the 2th year had a significantly higher effort score.

Conclusion:

Worked Example, which is a good technique for students and suitable for digital formats, was equally effective as lecture, a well-known instructional method for teaching radiology.

Keywords: Radiology; Medical Education; Tomography

Resumo:

Introdução:

Durante a última década, o modelo tradicional de ensino médico foi amplamente debatido, e, há pouco tempo, a pandemia da Covid-19 impôs novamente mudanças, iniciadas em caráter de urgência em todo o mundo, trazendo novos desafios à formação médica no que concerne ao ensino e à aprendizagem. A estratégia de ensino conhecida como Worked Example é uma ferramenta instrucional na qual um especialista mostra a solução de um determinado problema para um aprendiz de forma pormenorizada.

Objetivo:

Este estudo teve como objetivo comparar as aulas expositivas em vídeo com a técnica Worked Example para ensino de tomografia de tórax.

Método:

Trata-se de um estudo experimental realizado, por meio de uma intervenção educacional, com alunos do curso de Medicina em fases iniciais e finais da prática clínica.

Resultado:

A análise de variância de medidas repetidas (ANOVA) foi usada na análise estatística. Houve diferença significativa entre as notas antes e depois do treinamento (F1; 74 = 46,008; p < 0,001) e entre as fases do curso (F2; 148 = 19,452; p < 0,001). Não houve diferença estatisticamente significativa entre os grupos (F2; 74 = 1,401; p = 0,240). Não houve diferença significativa no esforço mental referido na comparação entre grupos (F1; 69 = 0,092; p = 0,762), porém os alunos do segundo ano apresentaram um escore de esforço significativamente maior.

Conclusão:

O Worked Example, uma técnica com boa aplicabilidade para estudantes da graduação e adequada para formatos digitais, mostrou-se igualmente eficaz a aula expositiva, técnica consagrada no ensino de radiologia.

Palavras-chave: Radiologia; Educação Médica; Tomografia

INTRODUCTION

Over the last decade, the traditional model of medical education has been widely debated, questioned and tested, and new teaching strategies centered on the student, with active learning models, which prioritize social learning have been elected, replacing instructional methods based on didactic lectures. Recently, the COVID-19 pandemic once again enforced changes to medical education, initiated as a matter of urgency all over the world and bringing challenges to teaching and learning in medical training1)-(3. This sudden rupture imposed by social distancing resulted in a transition from classrooms, laboratories, outpatient clinics and even hospitals, to virtual and online resources, in addition to the incorporation of technologies and teaching strategies and probably inaugurating a period of transition to a new format of teaching and learning 1),(3.

It would be no different for the teaching of radiology in undergraduate courses. Even before the pandemic, the teaching of medical image interpretation showed to be the focal point of questions and discrepancies between medical schools worldwide, differing from the absence of the formal teaching of radiology in curricula to the presence of mandatory internships4)-(6. Moreover, a growing need to optimize the teaching methods in medical image interpretation has been observed7)-(9.

Nevertheless, in recent decades, lectures as a pedagogical resource have been subject to several criticisms, especially because they are related to a passive transfer of information, with little cognitive gain 7)-(12. In emergency remote teaching, this discussion is incorporated into others, bringing greater relevance, for instance, to the increased time of exposure to electronic device screens in populations from all age groups and the possible harm related to sleep disorders and their correlation with learning13),(14, decrease in social interaction between peers with its recognized benefits, in addition to the physical and mental well-being of students 1),(2),(15.

Kok et al. demonstrated, after reviewing the literature on the teaching of medical image interpretation, that instructional studies in education with student-centered, active learning, were successfully implemented in image interpretation, surpassing the teacher-centered teaching model, based on lectures; however, studies have shown little evidence on specific techniques to optimize learning9.

The teaching strategy known as Worked Example is an instructional tool, in which an expert demonstrates the solution of a given problem to a learner in details16)-(19, that is, all the successively necessary movements towards the solution of a problem are provided from the systematization of a complex instruction or skill18. The solution of the problem by the specialist becomes a model for the student to learn and reproduce the acquired knowledge16)-(19. Therefore, this instructional method manipulates the cognitive loads, facilitating the construction of mental scripts and improving teaching by reducing the cognitive effort during skill acquisition, when compared to problem-solving strategies, showing to be more effective and efficient. This would occur by dedicating the available working memory capacity to build a cognitive schema that guides the resolution of future problems20. Considering the teaching of medical image interpretation in undergraduate courses, this characteristic would be extremely favorable, since it is a complex cognitive task, which requires the learner to interact with several elements, such as anatomical knowledge, the pathophysiology of diseases, in addition to the radiological knowledge itself, therefore, with a high intrinsic cognitive load18)-(20.

Based on the concept of the Worked Example, we developed a reading material with a step-by-step guide for the basic interpretation of chest CT scans with pediatric particularities and we developed an experimental study with medical students to compare this strategy and the use of lectures.

METHODS

This is an experimental study carried out through an educational intervention at the Faculty of Medicine of UFMG with undergraduate medical students, regularly enrolled in the 2nd year attending the 4th semester in one group and in the other, 6th year medical students, attending internships in medical specialties.

Procedures

The participants were allocated into two groups according to the year of the medical course they were attending and were randomly distributed into two subgroups according to the type of training they received: one for those who watched the recorded online lecture - traditional class (TC) and in the other, the students who performed the guided reading of the printed material - the Worked Example (WE) group. The experiment was divided into three phases:

  1. Phase 1: assessment of prior knowledge through the pre-test.

  2. Phase 2: training phase. A 50-minute recorded lecture or guided study of the printed material called ‘Worked Example’.

  3. Phase 3: immediate post-test, promptly after the training phase.

After the training phase, the participants were asked to rate the mental effort made to carry out the proposed tasks, according to the allocated group, choosing a number on a scale ranging from 1 to 10, where 1 was very, very low effort, and 10 was a very, very high mental effort.

Two different tests were developed for application in the different phases of the study, both with the same dynamics of performance and with contents that covered the three domains of knowledge proposed in the didactic material: basic knowledge about the formation of tomographic and anatomical images, mediastinal diseases and patterns of alterations in the lung parenchyma, in an equal number of open-ended questions by content, with different questions in the two tests, but with the same level of difficulty, whose answers should be briefly described. The identification of normal and pathological images in axial tomographic sections and related theoretical knowledge were addressed, with the projection of tomographic images on a computer screen. The answers and scores per question were validated by another radiologist, a specialist in Pediatric Radiology with experience in Thoracic Radiology.

Inclusion and exclusion criteria

Regularly enrolled students, whose participation was voluntary and extracurricular, were included in the study. Students who attended years other than the abovementioned ones or who expressed their desire not to carry out the proposed phases of the research were excluded from the analysis.

Statistical analysis

The Analysis of Variance (ANOVA) for Repeated Measures was used to assess the effect/influence of variables on student performance in the pre-test and immediate post-test. Student’s t test was used to compare paired/dependent samples. To evaluate the effect/influence of the course year and group factors on the mean effort score related to the training, analysis of variance based on a two-factor model was used. The p-value considered statistically significant was < 0.05.

Ethical aspects

The study protocol and the free and informed consent form were approved by the Research Ethics Committee of Universidade Federal de Minas Gerais under number 2,638,289. All participants signed the Free and Informed Consent Term (FICT).

RESULTS

A total of 78 students participated in the research, 46 of them in the beginning of clinical practice, regularly enrolled in the 4th semester (2nd year) - 24 in the online Traditional Class (TC) group and 22 in the Worked Example (WE) group; and 32 students attending the internship (6th year) - 15 students in the TC group and 17 in the WE group.

For students who carried out the Worked Example, the time spent studying the material was recorded. The minimum time obtained was 19 minutes and the maximum was 92 minutes. The average time spent studying the material was 48.7 minutes (95%CI: 42.1; 55.3).

Chart 1 shows the average of the students’ grades in the two phases of the study in relation to the group and stage of the course.

Source: prepared by the authors.

Chart 1 Averages of students' grades in relation to the study phase and group. 

The scores obtained in the immediate post-test, stratified by the three included topics (anatomy, diseases of the mediastinum and lung parenchyma), are shown in Chart 2. As expected, there is a significant effect between the scores and the course year (F1;74 = 46.008; p < 0.001) and the study phase (F2;148 = 12.222; p < 0.001), as well as the interaction between the study phase and year (F2;148 = 19.452; p < 0.001), with the grades of the pre-test, on average, being lower than the scores of the immediate post-test, both for the overall score, which consists of the sum of scores by topic, and for the separate evaluation of the three assessed topics.

Chart 2 Averages of students' grades in the immediate post-test based on the three topics in relation to the Group and the Course year. 

The interaction between the groups (WE x TC) was not statistically significant (F 2; 74 = 1.401; p = 0.240), not even when associated with other variables: course year (F1; 74 = 1.091; p = 0.300), study phase ( F 2;148 = 3.001; p = 0.053), and phase and year altogether (F2; 148 = 0.309; p = 0.734).

The interaction of grades with the topic variable was statistically significant, with P < 0.001.

The scores obtained in the immediate post-test, stratified by the three included topics (anatomy, diseases of the mediastinum and lung parenchyma), are shown in Chart 2. As expected, there is a significant effect between the scores and the course year (F1;74 = 46.008; p < 0.001) and the study phase (F2;148 = 12.222; p < 0.001), as well as the interaction between the study phase and year (F2;148 = 19.452; p < 0.001), with the grades of the pre-test, on average, being lower than the scores of the immediate post-test, both for the overall score, which consists of the sum of scores by topic, and for the separate evaluation of the three assessed topics.

The interaction between the groups (WE x TC) was not statistically significant (F 2; 74 = 1.401; p = 0.240), not even when associated with other variables: course year (F1; 74 = 1.091; p = 0.300), study phase ( F 2;148 = 3.001; p = 0.053), and phase and year altogether (F2; 148 = 0.309; p = 0.734).

The interaction of grades with the topic variable was statistically significant, with P < 0.001.

Assessment of mental effort for the training phase

There was no statistically significant difference in mental effort reported by students who took the traditional classes when compared to WE (F1;69 = 0.092; p = 0.762). The mental effort scale reported after the training phase showed that there is a statistically significant influence only in the course year (F1; 69 = 5.776; p = 0.019). The 2nd-year students had a significantly higher effort score when compared to the 6th-year students, regardless of the group they were allocated to (F1; 69 = 2.083; p = 0.153).

DISCUSSION

Overall, the results found in the present study did not show a significant difference between traditional online classes and Worked Example. Furthermore, as expected, there was a significant increase in the average of the scores between the pre- and immediate post-test phases, with significant differences between the phases of the course (beginning x final), showing scores after the training phase, on average, higher than the average of the scores in the pre-test phase.

However, it is important to point out some findings when the grade averages are stratified by topic. In this analysis, the averages obtained by the students at the end of the course were significantly higher than the averages of the 2nd-year students’ grades only in the lecture group. In the WE group, this pattern only occurred for the topics “Parenchyma” and “Mediastinum”.

Additionally, as expected, the 2nd-year students in both groups had significantly higher average grades for the topic “Anatomy” than the averages of the other topics, probably because they were taking the anatomy course during the semester when they performed the task, although without correlation with tomographic images as in the task performed in the study, demonstrating the students’ ability to combine simple ideas into more complex ones, developing the so-called ‘mental scripts’20.

In a complementary way, in this phase of the course, the lecture group showed the lowest averages for the topic “parenchyma”, a fact that may be related to the content being shown at the end of the video, beyond the initial 20 minutes, as some authors showed to be the best moment. for learning11,12. This was not observed among 6th-year students, probably due to the students’ greater familiarity with the topic, as they already had the associated mental scripts20.

As for the students at the end of the course, it was observed that only the grade averages for the topic “Anatomy” were higher in the WE group, with a significant difference compared to the other topics. Moreover, the comparison of the grade averages taking into account the topics and the phase of the course, showed that statistically significant differences were observed only for the 2nd-year students, in the evaluation of the topics “anatomy” and “parenchyma”, between the two groups, where the students of the WE group showed grade averages for each of the topics that were significantly higher than the students of the “Lecture” group.

These results indicate a better performance of the ‘Worked Example’ as a teaching method for the anatomy topic in our study, especially for students at the beginning of the course. This finding corroborates the findings in the literature on education, which point out that such strategy is more important in the early stages of cognitive skill acquisition, as reported by Atkinson et al. in a review of studies using Worked Example in the most varied fields of knowledge, such as basic mathematics, music, programming, and chess, among others16.

According to the cognitive load theory, the learning process occurs with the processing of new information in working memory to build schemas in long-term memory, or mental scripts 17)-(20. In turn, working memory can be affected by the nature of the task, called intrinsic load, the way the task is presented, external load, and the way learning actually occurs, called ‘pertinent load’18. Van Merriänboer et al., after a review of studies in education of health professionals, concluded that Worked Examples could reduce the intrinsic load and the external load, optimizing learning20, as our results indicate. In this context, our study is relevant for evaluating the performance of complex cognitive tasks, such as the interpretation of medical images, especially in students in the initial phase of clinical practice.

On the other hand, the so-called “expertise reversal effect” must also be considered, which results from the interaction of several basic cognitive effects and demonstrates that instructional methods that work well for beginners may not be suitable for more experienced learners18.

The average time spent by students to perform the Worked Example was similar to the duration of the theoretical class and there was no statistically significant difference for the effort reported by students to perform the tasks between the two groups. As expected, for the present study, the mental effort reported by students with less expertise was significantly greater than that reported by students at the end of the course, probably related to the lack of prior knowledge, or mental scripts, requiring greater effort to perform the proposed activities. This is an important piece of information when considering the teaching of radiology in undergraduate courses regarding the timing of the inclusion of the disciplines in the course. Other authors have shown the benefits of the early inclusion of radiology content in undergraduate curricula21),(22.

The literature review carried out using the words “medical education, radiology and Worked Example” showed no studies that directly demonstrated the use of the Worked Example technique for the teaching of radiology. One should also consider that instructional studies with radiological contents differ in terms of results when lectures are used in the methodology.

El-Ali et al. carried out a randomized, controlled study with 47 pediatric internship students comparing the use of a traditional lecture based on clinical cases with the use of the flipped classroom methodology in the teaching of pediatric radiology23. In this study, the researchers found higher test scores among students who used the flipped classroom methodology23. On the other hand, Afzal et al. compared this methodology and the traditional class with 40 3rd-year students for the teaching of chest radiography, finding no significant difference between the groups; however, the results showed the students’ good acceptability regarding the method24.

The methodology used by El-Ali and Afzal et al. to prepare students for their individual study before the class is similar to the Worked Example proposal; however, they are not comparable because it associates knowledge acquired in practice with the teacher.

Courtier et al., in a study with 100 students, evaluated the teaching of pediatric radiology in a module on gastrointestinal tract diseases for undergraduate students in their internship years25. In this study, they compared lectures and the application of an interactive digital game in a popular format among the students and found better learning levels among the students who attended the classes25.

Stein et al. compared the use of lectures with the Team-based learning (TBL) strategy for teaching the application of the American College of Radiology (ACR) criteria in choosing radiological exams in different clinical situations26. As in our study, a significant difference was found between the pre-test scores and the tests performed after the training phase; however, they did not find a statistically significant difference between the study groups, either26. In this study, the aim was to evaluate the opinion of students attending internship at the University of California about the radiology lectures held during a year, and Jen et al. applied questionnaires after the lectures held during that period, with the participation of 77 students and found positive and negative evaluations about the lectures27. The characteristics that are most related to the classes classified with higher grades and, therefore, considered better, were ‘interactive’, ‘fun/engaging’ and ‘practical/relevant content’. The characteristics related to the worst evaluations were: “lack of interactivity”, “poor structure” (probably related to the way the content was presented), “excessive information”27.

Considering these research results that involved lectures on methodology and radiology, it is likely that the acceptance by the students and the learning could be influenced both by the format of the lecture and the methods that were compared.

The present study has the small number of participants as a limitation. However, studies within this perspective have a similar or even smaller number of participants, such as the studies by Ali et al., Jen et al., and Stein et al. in the late phase23), (​​27), (26, all reported above. Likewise, as it was a study carried out with volunteers who performed an extracurricular activity, the participants’ knowledge about the research could be a source of bias; however, both groups were submitted to the same limitation.

It should also be considered that further studies are necessary to compare the effect between different teaching strategies and the ability to retain knowledge in the long term, with the incorporation of late tests into the methodology.

In short, the choice of the radiology teaching technique for medical students must be individualized in each institution, as it depends on several factors, such as time available for the disciplines, phase of the course in which the disciplines are included, availability of teachers and resources. However, when the radiology content is considered, there are advantages in the transition to distance learning, as the digital formats are adequate and easily transposable when compared to other disciplines3. Additionally, as stated by Darras et al. after a review on radiology teaching during the COVID-19 pandemic, we consider this an opportune time to critically think about radiology teaching strategies for undergraduate medical students3.

The Worked Example technique allows an individualized, student-centered teaching that can be directed by the teacher to what is the most relevant content. In addition, it can be very interesting for early stage students, potentially used in digital formats and used as preparation for practical classes, whether in radiology or in the clinical practice during internships in other medical specialties. All these favorable characteristics of the method are widely applicable and reproducible and, in our study, they showed to be equally effective in a consolidated teaching format in image interpretation, such as video lectures.

REFERENCES

1. Papapanou M, Routsi E, Tsamakis K, Fotis L, Marinos G, Lidoriki I, et al. Medical education challenges and innovations during Covid-19 pandemic. Postgrad Med J. 2021. postgradmedj-2021-140032. [ Links ]

2. O’Byrne L, Gavin B, Adamis D, Lim YX, McNicholas F. Levels of stress in medical students due to Covid-19. Journal of Medical Ethics. 2021;47(6):383-8. [ Links ]

3. Darras KE, Spouge RJ, de Bruin ABH, Sedlic A, Hague C, Forster BB. Undergraduate radiology education during the Covid-19 pandemic: a review of teaching and learning strategies [Formula: see text]. Can Assoc Radiol J. 2021;72(2):194-200. [ Links ]

4. ESR statement on new approaches to undergraduate teaching in Radiology. Insights Imaging. 2019;10(1):109. [ Links ]

5. Straus CM, Webb EM, Kondo KL, Phillips AW, Naeger DM, Carrico CW, et al. Medical student radiology education: summary and recommendations from a national survey of medical school and radiology department leadership. J Am Coll Radiol. 2014;11(6):606-10. [ Links ]

6. Chojniak R, Carneiro DP, Moterani GS, Duarte ID, Bitencourt AG, Muglia VF, et al. Mapping the different methods adopted for diagnostic imaging instruction at medical schools in Brazil. Radiol Bras. 2017;50(1):32-7. [ Links ]

7. Schiller PT, Phillips AW, Straus CM. Radiology education in medical school and residency: the views and needs of program directors. Acad Radiol. 2018;25(10):1333-43. [ Links ]

8. Slanetz PJ, Mullins ME. Radiology education in the era of population-based medicine in the United States. Acad Radiol . 2016;23(7):894-7. [ Links ]

9. Kok EM, van Geel K, van MerriÎnboer JJG, Robben SGF. What we do and do not know about teaching medical image interpretation. Front Psychol. 2017;8:309-. [ Links ]

10. Mustafa T, Farooq Z, Asad Z, Amjad R, Badar I, Chaudhry AM, et al. Lectures in medical education: what students think? J Ayub Med Coll Abbottabad. 2014;26(1):21-5. [ Links ]

11. Wilson K, H. Korn J. Attention during lectures: beyond ten minutes. Teaching of Psychology. 2007;34. [ Links ]

12. Zinski A, Blackwell KTCPW, Belue FM, Brooks WS. Is lecture dead? A preliminary study of medical students’ evaluation of teaching methods in the preclinical curriculum. Int J Med Educ. 2017;8:326-33. [ Links ]

13. Janssen X, Martin A, Hughes AR, Hill CM, Kotronoulas G, Hesketh KR. Associations of screen time, sedentary time and physical activity with sleep in under 5s: a systematic review and meta-analysis. Sleep Med Rev. 2020;49:101226. [ Links ]

14. Hale L, Guan S. Screen time and sleep among school-aged children and adolescents: a systematic literature review. Sleep Med Rev . 2015;21:50-8. [ Links ]

15. Keren D, Lockyer J, Ellaway RH. Social studying and learning among medical students: a scoping review. Perspect Med Educ. 2017;6(5):311-8. [ Links ]

16. Atkinson RK, Derry SJ, Renkl A, Wortham D. Learning from examples: instructional principles from the Worked Examples research. Rev Educ Res. 2000;70(2):181-214. [ Links ]

17. Sweller J. The worked example effect and human cognition. Learning and Instruction. 2006;16(2):165-9. [ Links ]

18. Spanjers IAE, van Gog T, van Merriînboer JJG. Segmentation of Worked Examples: effects on cognitive load and learning. Appl Cogn Psychol. 2012;26(3):352-8. [ Links ]

19. Stark R, Kopp V, Fischer MR. Case-based learning with worked examples in complex domains: two experimental studies in undergraduate medical education. Learning and Instruction . 2011;21(1):22-33. [ Links ]

20. Merriënboer JJ van, Sweller J. Cognitive load theory in health professional education: design principles and strategies. Med Educ. 2010;44(1):85-93. [ Links ]

21. Branstetter BF, Faix LE, Humphrey AL, Schumann JB. Preclinical medical student training in radiology: the effect of early exposure. AJR Am J Roentgenol. 2007;188(1):W9-14. [ Links ]

22. Kraft M, Sayfie A, Klein K, Gruppen L, Quint L. Introducing first-year medical students to radiology: implementation and impact. Acad Radiol . 2018;25(6):780-8. [ Links ]

23. El-Ali A, Kamal F, Cabral CL, Squires JH. Comparison of traditional and web-based medical student teaching by radiology residents. J Am Coll Radiol . 2019;16(4):492-5. [ Links ]

24. Afzal S, Masroor I. Flipped classroom model for teaching undergraduate students in radiology. J Coll Physicians Surg Pak. 2019;29(11):1083-6. [ Links ]

25. Courtier J, Webb EM, Phelps AS, Naeger DM. Assessing the learning potential of an interactive digital game versus an interactive-style didactic lecture: the continued importance of didactic teaching in medical student education. Pediatr Radiol. 2016;46(13):1787-96. [ Links ]

26. Stein MW, Frank SJ, Roberts JH, Finkelstein M, Heo M. Integrating the ACR Appropriateness Criteria Into the Radiology Clerkship: comparison of didactic format and group-based learning. J Am Coll Radiol . 2016;13(5):566-70. [ Links ]

27. Jen A, Webb EM, Ahearn B, Naeger DM. Lecture evaluations by medical students: concepts that correlate with scores. J Am Coll Radiol . 2016;13(1):72-6. [ Links ]

7Evaluated by double blind review process.

SOURCES OF FUNDING The authors declare no sources of funding.

Received: March 25, 2022; Accepted: June 08, 2022

Chief Editor: Rosiane Viana Zuza Diniz. Associate editor: Margareth Rodrigues Salerno.

AUTHORS’ CONTRIBUTION

Cássio da Cunha Ibiapina: Conceptualization, coordination, methodology, analysis and manuscript writing. No conflicts of interest. Leandro Malloy Diniz: conceptualization, advisory, supervision and analysis. Paola Isabel Silva Barros: study conceptualization and performance, analysis and manuscript writing. Bruno Morais Damião: study performance and methodology.

CONFLICTS OF INTEREST

The authors declare no conflicts of interest.

Creative Commons License Este é um artigo publicado em acesso aberto sob uma licença Creative Commons