English (pdf)
Article in xml format
Automatic translation
Send this article by e-mail
Permalink
1 INTRODUCTION
The compulsory requirement for Special Educational Services (SES) in Brazil has resulted in an increased number of special education target students enrolled in Brazilian schools (BRASIL, 2008). A survey by thb e Ministry of Education (BRASIL, 2016a), aimed at monitoring the inclusion process, showed an increase in the enrollment of this type of student from 504,039 in 2003 to 930,683 in 2015, representing an increase of 85%. The enrollment rates of special education target students in mainstream education classes also showed a significant increase, from 145,141 students in 2003 to 760,983 in 2015, an increase of 425% (BRASIL, 2016a).
However, there are still a significant number of students who enter the first phase of elementary school with neurodevelopmental disorders, such as autism spectrum disorder (ASD) and intellectual disability (ID), without having a diagnosis that guarantees their legal rights to SES (ROBERTSON et al., 2012).
Intellectual disability is manifested by different levels of intellectual impairment with limitations in social and adaptive functioning. In its intellectual aspects, it is characterized by deficits in reasoning, problem solving, planning, abstract thinking, judgment and academic learning. In social functioning, limitations can be observed in skills for the recognition of the feelings and experiences of others, empathy, interpersonal communication and social judgment, among others (APA, 2014; TEIXEIRA et al., 2017a). Impairments in adaptive functioning manifest themselves as deficits in the skills and abilities to perform daily living activities, both from a practical and social point of view. In respect of the practical aspects, individuals can present mild to severe limitations in learning, self-management in various contexts such as personal care, self-control and task organization, among others. In 2011, Maulik and colleagues published a systematic review study of ID prevalence rates based on 52 studies. The prevalence rates of ID according to age were 4.9:1000 (for the adult population); 18.30:1000 (for children and adolescents) and 5.04:1000 (for the combined adult, child and adolescent population), with the highest rates being in poor and developing countries (MAULIK et al., 2011). The Diagnostic and Statistical Manual of Mental Disorders/DSM - 5 (APA, 2014) stated that the prevalence rates of ID were about 1% of the general population, with variations due to age, specifying a rate of about 6:1000 for severe ID (APA, 2014). In Brazil, a study by Malta and colleagues (2016)assessed the epidemiological distribution of various types of disabilities, ID being one of these (reporting an ID prevalence rate of 0.8% in the surveyed areas, with no differences by age, ethnicity and region). Although the study by Malta and colleagues (2016) represented an important advance to support decisions taken in respect of public policy formation to care for this population, the data collection technique was based on interviews with caregivers, without the use of standardized instruments, which resulted in methodological limitations. In contrast, a study conducted in southern Brazil with 4231 participants used intelligence tests and evaluated developmental milestones, reporting ID prevalence rates of 4.5% in the studied population (KARAM et al., 2015). However, it should be noted that the study by Karam and colleagues, while having excellent genetic and developmental assessments with repeated measures, did not evaluate the other two domains (social and practical) that are recommended for the diagnosis of ID according to DSM-5 (APA, 2014), which may explain the higher prevalence values in this study.
ASD, on the other hand, is a highly variable disorder throughout the different stages of development, characterized by signs and symptoms manifested in deficits in interaction and social communication, as well as the presence of restricted and repetitive patterns of behaviors, interests and activities. In general, the impairment can be observed as difficulties in social-emotional exchanges, verbal and non-verbal communication, the establishment of social relations, stereotypies and ritualized behaviors, inflexibility, and sensorial alterations, among others (APA, 2014; PAULA et al., 2017). One of the most recent estimates of prevalence rates of the disorder by Christensen et al. (2016) estimated a rate of 1:69 in children in a population study conducted in 11 cities in the United States. In 2018, a new study by the same author found that ID rates in 8-year-old children with ASD in 9 of these cities ranged from 20% (in Utah) to 48% (Arkansas) (BAIO et al., 2018). A Brazilian epidemiological study of 2015 estimated that the rate of ASD is around 1% (PARASMO et al., 2015).
As ASD and ID often appear early in a child’s development, have a chronic course, and multiple etiologic factors associated with high variability, Brazilian public policies recommend that the diagnosis be made in the first years of life (BRASIL, 2016b). As a result of these policies, the diagnosis of ASD at early ages of development has been more frequent, however, there are still some regional imbalances between different areas of the country (BRASIL, 2007, BRASIL, 2014, PORTOLESE et al., 2017). These imbalances are associated with different factors, such as a lack of training of health professionals and a shortage of specialized services (COUTO et al., 2008; SANTOS & FERNANDEZ, 2014; BORDINI et al., 2015; SANTOS & CELERI, 2018); delays in parents detecting the first signs of autism that in turn delays the search for professional help and receiving the diagnosis (ZANON et al., 2014; OLASHORE et al., 2017); and the long waiting times for diagnostic evaluations in specialized child mental health services (ARAUJO & TANAKA, 2012), among others. The diagnosis of ID in early life has not received the same attention as ASD in terms of studies that assess the factors associated with the delay in its identification (RUSSELL et al., 2019).
In Brazil, as in other developing countries (OLASHORE et al., 2017), there are few public policies that establish mandatory screening to detect indicators of neurodevelopmental changes in children, either through mental health services or the public education system (BORDINI et al., 2015; COUTO & DELGADO, 2015; PAULA et al., 2016; BOSA & TEIXEIRA, 2017; TEIXEIRA et al., 2017; PAULA et al., 2018; FARIA et al., 2018). This lack of monitoring of mental health problems in childhood, combined with the clinical complexity of these disorders, causes a high number of children with ASD or ID to start elementary school without having received the due diagnosis (ROBERTSON et al., 2012; ZANON et al., 2014;LAKHAN & MAWSON, 2016; DENCKLA et al., 2017; FRANZ et al., 2017; TEIXEIRA et al., 2017).
When a student with ASD or ID is enrolled in the first phase of elementary school without yet being diagnosed, teachers can be one of the main actors to identify these students. Moreover, according to the monitoring and care flowchart for people with ASD in the Brazilian public health system (SUS), early identification and monitoring of ASD should be carried out by both the health and education teams (in this case, by the classroom teacher) (BRASIL, 2014). However, raising suspicions of disorders such as these demands specific training, both in relation to expected developmental milestones and signs and symptoms, as well as in the use of appropriate instruments that allow the professional to perform a careful evaluation of the student suspected to have ASD or ID. A study by Murphy et al. (2015) found that the use of standardized instruments for mental health evaluation by teachers can be useful in identifying students who might benefit from preventive and/or remedial interventions. When the teacher identifies a child who may have one of the conditions, those responsible for the child can be conducted to diagnostic evaluations. Giving teachers both the correct training and evaluation tools, could contribute to a more efficient use of public resources and enable interventions and care for children with ASD or ID.
Currently equipping professionals to use evaluation tools has significantly benefited from computer systems for collecting and analyzing data with applications in sectors such as economics, education and health (TURBAN et al., 2010; SILBERSCHAATZ et al., 2006). Elementary education is an appropriate setting for the implementation of this type of technology, since it can assist in the collection, storage, monitoring and analysis of data of students enrolled in the public education system. Among these computer systems, database management systems (DBMS) have had the most significant growth, both in respect of their storage and data mining capabilities (SILVA, PERES & BOSCARIOLI, 2016). These systems function as a resource for the creation of repositories of data or actions and, as a result, can be sources for data analysis focused on generating managerial reports for tracking or monitoring tasks and actions in diverse areas of knowledge.
There were three main reasons for this study: a) the need to equip teachers, both in respect of training and the use of assessment tools for students with suspected ASD and ID who enter the first stage of elementary school in Brazil; b) the need to optimize the assessment processes conducted by teachers; c) the application of computer systems in order to assist the registration and storage of data to monitor tasks and actions and to systematize decision-making regarding referrals of students to other public services (MAYER-SCHÖNBERGER & CUKIER, 2013).
Based on these goals, the overall objective of this study was to develop a decision-making model, with a flowchart detailing the required tasks and actions, through the use by elementary education teachers in the public education system of instruments for the evaluation of indicators of ASD and ID. The specific objectives of the study were: a) to construct two evaluation checklists for students with suspected ID and ASD, based on DSM-5 clinical criteria for the use of teachers in elementary school; b) to assess the construct validity of these instruments based on the analysis of experts; c ) delimit the tasks and actions that each actor of the process should have, including producing guidelines on the specialized evaluations that should take place following the evaluations made by the teachers; d) develop a computer system to implement flowcharts with actions, activities and decisions to identify elementary school students suspected of having ID, ASD or both conditions.
2 METHOD
The study was conducted in two phases.
Phase 1
Two instruments in a checklist format were produced containing statements (called items) about the characteristics of the disorders to assist the teacher in the evaluation of students suspected of having ASD or ID. Response options were on a Likert scale of the frequency with which the items can be observed in the student by the teacher (‘never or rarely’, ‘sometimes’, ‘often’ or ‘very often’).
The construct validity of the instruments was then assessed by 6 experts selected based on their backgrounds, experience and knowledge of the subject. All had a PhD in the area of human development, as well as clinical and teaching experience in the same area. The criteria used for the analysis were objectivity, clarity and precision as described by Pasquali (2010). The definitions adopted for the criteria were: objectivity, the item is adequately described for its correct application or scoring; clarity, the item is clear and comprehensible for its application and scoring by teachers; precision, the item is specific and precise in what it describes or evaluates in relation to the activity/behavior/area in question and not to others.
Each instrument was evaluated by 3 of the experts and scored on a scale of 0 to 2 (response 0 indicated total disagreement as to clarity, accuracy or objectivity; response 1 indicated partial agreement; response 2 indicated total agreement). The experts’ average scores for each criterion were calculated for all items of the instrument (PASQUALI, 2010). The experts were asked to propose changes to the items to match their wording to the evaluated criteria.
The results were analysed by their average score in respect of meeting the criterion, and there was also a qualitative analysis of the suggestions made by the experts. These analyses, described in the results section, enabled the writing of the final versions of the two checklists.
Phase 2
Two flowcharts were created, one for ASD and the other for ID. Both were composed of a set of logically organized sequential activities, in line with the objectives of the study. In each activity the tasks of the teacher and of the SES team of the educational system were defined. The main purpose of the flowcharts was to represent schematically an operational sequence of actions that can be developed within their own educational system, the main actors being the classroom teachers, the SES team and network managers. In these flowcharts, the processes start with the checklists developed in phase 1. To complement this initial assessment by the teacher’s specific evaluation instruments for ASD and ID to be applied by the teachers or the SES team of a given educational system, including psychologists, were selected. The results will be described in the results and discussion section.
After the completion of the flowcharts, the actions of the flowcharts were computerized in order to optimize their use and provide real-time monitoring in the public education system. The procedure for both flowcharts consisted of a process for identifying cases of the disorders based on Business Process Model and Notation (BPMN) and automated using the open-source platform Business Process Management System (BPMS), BonitaSoft (DAMIJ & DAMIJ, 2013). The software can be applied in any educational system, regardless of the number of students enrolled. The BPMS BonitaSoft platform consists of Bonita BPM Studio (a module for business process modeling), UI Designer (a module for creating web pages defined in HTML for human interaction, which uses web development languages such as Javascript, AngularJs, BootStrap and others), and an e-mail module. In addition, the BonitaSoft platform allows connections to other platforms including databases such as MySql, SQL Server, Oracle and PostgreSQL. Thus, through the BonitaSoft platform it was possible to develop a BPMS web portal to identify possible cases of the disorders, via a Web server that can be accessed through the Internet by all those involved in the educational system.
BPMS works through of a sequence of activities from the beginning to the end and can be deployed in a network such as the computers of schools that are part of a particular municipality. The logic of the process is visually demonstrated by a flowchart created by the connected sequences that comprise all the activities that must be developed and their respective agents. The purpose of transferring these flowcharts to this BPMS model was to offer the educational system the ability to manage the evaluations, record data and monitor the process, - from the initial identification of the student by the teacher until the confirmation of the suspected condition. It could also be used in the final stage of the process when the student is referred to the mental health services of the locality with the report being made to the educational system through the system. All flow-chart decisions were based on evidence-based instruments that meet the DSM-5 clinical criteria for both disorders (Table 1).
Another procedure that should be adopted in this phase to ensure the successful implementation of the flowchart in an educational system is that teachers, and members of the SES team should be trained in the expected cognitive, behavioral and functional milestones in child development, as well as in the signs of the neurodevelopmental disorders involved in the project (ASD and ID). They should also receive training in the process model, in relation to all phases of the respective flowcharts of procedures and evaluation instruments to define suspected ASD and ID. Depending the role of each one of the professionals in the process, they should also receive training and specific orientation in the use of the instruments and their role in the computer system. Training in the use of the flowcharts in the BPMS system should be offered in a computer environment to ensure that the teachers and other professionals who are the main actors in the use of these tools have the required skills and competencies to use them effectively. To achieve this, an instruction manual for the system has been developed, and can be accessed (on request to the authors) at the following link: http://lfs.mackenzie.br/bonita/. The system can only be put into use in an educational system after the specific training described here has been completed. Following the results of a pilot study by Suriano (2018), it is recommended that the assessments detailed in the flowcharts are only carried out 4 months after the start of the school year, so that the teachers are able to build up knowledge about their students’ problems.
The last activity in the flowcharts should be performed by local mental health professionals and targets the evaluation to confirm or not confirm the diagnosis of ASD or ID, with appropriate recommendations or interventions according to each outcome. Connections were designed in the flowchart to indicate the desired collaboration that should exist between health and education systems in treating children with neurodevelopmental disorders.
3 RESULTS AND DISCUSSION
Phase 1
The results of the analysis of construct validity are shown in Table 1. The lowest averages were obtained in the instrument to evaluate the presence of ID in the criteria of clarity and precision. The agreement indexes among the experts in respect of these criteria was also the lowest. The suggested amendments of the experts were included in the items with the aim of producing an instrument whose items had adequate precision, clarity and objectivity according to the type of construct validity adopted. Appendix A and B show the final versions of the two instruments.
Table 1 Agreement indexes of the construct validity analysis of the instruments (criteria of accuracy, precision and clarity).
| Suspected Disorder | Suspected Autism Spectrum Disorder screening checklist | Suspected Intellectual Disability screening checklist |
|---|---|---|
| Criteria | Average of agreement indexes between experts | Average of agreement indexes between experts |
| Objectivity | 1.95 | 1.90 |
| Clarity | 1.80 | 1.70 |
| Accuracy | 1.82 | 1.70 |
Appendix A. Suspected Autism Spectrum Disorder screening checklist.
Appendix B. Suspected Intellectual Disability screening checklist.
Phase 2
Flowcharts of the actions, activities and decision-making were designed for elementary students with a suspected neurodevelopmental disorder related to ID, or ASD or with both disorders. They are shown in Figures 1 and 2.
Figure 1 Flowchart of activities and decision-making to identify students with suspected Autism Spectrum Disorder.
Figure 2 Flowchart of activities and decision-making to identify students with suspected Intellectual Disability.
Figures 1 and 2 show that the process begins with the identification by the teacher of students with signs and/or suspected symptoms ASD or ID. After the identification of the student, the teacher completes the checklists on the characteristics of the disorders (Figures 1 and 2) and the BPM-T (see BPM-T in Chart 1) for an emotional and behavioral assessment. If the student presents both complaints, the teacher can complete the two checklists.
The first decision is then made based on the results in the checklists for each type of complaint (see Figures 1 and 2). The student remains in the evaluation process if at least one of the responses to the items on the checklist is “sometimes”, “often”, or “very often.
The tools provided in the flowcharts (Figures 1 and 2) for use by the teacher or the SES staff team (which must include a psychologist, since some of these instruments are restricted for use by these professionals) are shown in Chart 1. They were selected after an analysis of the instruments available for use in Brazil compatible with the characteristics of each disorder and with the purpose of the process model.
Table 1 Specific assessment instruments for Autism Spectrum Disorder and Intellectual Disability.
| Suspected Condition | Instrument | Goals | Applied By |
|---|---|---|---|
| Autism Spectrum Disorder and Intellectual Disability | Wechsler Abbreviated Scale of Intelligence (WASI) (YATES et al., 2006). | Evaluates intellectual functioning of individuals from 6 to 89 years The WASI consists of four subtests: Vocabulary and Similarities form the Verbal Intelligence Quotient (VIQ) while Block Design and Matrix Reasoning form the Performance Intelligence Quotient (PIQ). In addition, all four subtests are combined to form the Full-Scale IQ-4 Subtests. | Must be applied by a Psychologist. |
| Brief Problem Monitor (BPM) (Brief Problem Monitor - Teacher Form For Ages 6-18/BPM-T and (Brief Problem Monitor - Parent Form For Ages 6-18/BPM-P] (ACHENBACH & RESCORLA, 2001). |
Assesses emotional and behavioral problems, both internalizing and externalizing types and attention problems in children and adolescents between 6 and 18 years. BPM-P and BPM-T are short-form versions of Child Behavior Checklist For Ages 6-18/CBCL and Teacher’s Report Form For Ages 6-18/TRF, respectively. | BPM-T must be completed by the student’s class teacher. BPM-P should be completed by the parents or caregivers of the child and may be applied by any SES team professional with specific training in the use of the instrument. |
|
| Autistic Spectrum Disorder | Autism Behavior Checklist (MARTELETO & PEDROMÔNICO, 2005). | The Autism Behavior Checklist (ABC) consists of a list of atypical behaviors characteristic of the Autism and is designed for the screening of children suspected of having this disorder. The ABC is composed of 57 atypical behaviors related to five areas: 1) sensory stimuli sensorial; 2) relating; 3) body and object use; 4) language; and 5) social self-care. | It should be applied by any SES team professional with specific training in ASD and in this instrument. Respondents to the instrument are the parents or caregivers of the child. |
| In case of nonverbal children with 2½ - 7 years old: Non-Verbal Intelligence Test SON-R 2½ - 7a (LAROS et al., 2013). | Evaluates the intellectual functioning of children between the ages of 2 ½ and 7. The test does not require instructions or verbal responses that are often compromised in children with ASD. It has four subtests: mosaics, categories, puzzles, analogies, situations and patterns. Offers scores indicative of reasoning and execution skills. | Must be applied by a Psychologist. |
Therefore, in accordance with the flowcharts, elementary school students up to the 5th grade who meet the requirements described above are referred to the SES team, who will carry out the relevant specialized assessment. As described in Chart 1 and in the flowcharts in Figures 1 and 2, these actions are: a) Students with suspected ASD will be evaluated by a psychologist using WASI or SON-R 2 ½-7a, ASQ, BPM-P and application of the ASD Checklist with the caregiver (the details in relation to the respondents to these instruments are described in Chart 1); b) Students with suspected ID will be evaluated by a psychologist using WASI, BPM-P and application of the ID Checklist with the caregiver (the details in relation to the respondents to these instruments are described in Chart 1).
The main advantage of using this model is that data resulting from the evaluations are stored using BPMS in a data repository, allowing the generation of reports containing all the descriptive results of the evaluation. The report will allow the visualization of the results of all evaluations, namely, the ASD or ID indicators checklist, the neuropsychological assessment (WASI or SON-R 2 ½-7a), the emotional and behavioral assessments (BPM-T and BPM-P) and the evaluation of ASD signs using the ASQ. The results from instruments that are restricted because they contain intellectual property will be presented in the reports only in relation to the total score or the score of the scales, depending on the instrument (WASI or SON-R 2 ½-7a, BPM-T and BPM-P and ASQ).
The computer system proposed in the study based on BPMS will allow the modeling of all activities and tasks and, at the same time, the storage of data about the student. This strategy will make it possible to visualize in real time the actions of all the professionals that work with the student and, over the years, will generate a database of special education target students. These databases will enable more complex analyses through the application of embedded artificial intelligence algorithms for data mining tasks (CHIAVEGATTO FILHO, 2015; SILVA, PERES & BOSCARIOLI, 2016), a promising solution in various areas of knowledge and public sectors (MAYER-SCHÖNBERGER & CUCKIER, 2013).
In addition, the use of this type of model adopting all the steps of the flowcharts may significantly decrease the backlog of students waiting for assessments to clarify their difficulties, some of them with a great impact on adaptive functioning and opportunities for learning academic skills (CARDOSO et al., 2012; ROSSATO & LEONARDO, 2012; ENRICONE & SALLES, 2012; CARNEIRO & COUTINHO, 2015; PALERMO et al., 2015). Unlike Brazil, other countries, such as The United States, include in their government policies the use of assessment technologies and preventive intervention measures for various correlates of behavioral problems and cognitive functioning deficits in children with signs of neurodevelopmental disorders (ROTHOLZ et al., 2013).
The study presents a process model for teachers and educational managers that uses a computer system to assist them in the collection, storage, and analysis of data, as well as enabling them to make decisions in real time to identify students with suspected neurodevelopmental disorders consistent with ID and ASD. This model presents a real possibility for an intersectoral approach, with education and health services working together to identify students with suspected ID and ASD. The data required for the development of models and decision-making processes for the identification of complaints will be derivedfrom cognitive and emotional-behavioral evaluations. Using these assessments, teachers, SES teams and educational managers can develop the skills to produce an effective assessment for identifying students with suspected ID or ASD. They can also become proficient in the use of standardized assessment tools and computerized technologies to assist them in decision making in elementary education, both for the identification of students suspected to have these conditions and for their referral to other public services such as health.
4 CONCLUSION
In Brazil, the public health system (SUS), through the Primary Health Care Units is the gateway for the evaluation and diagnosis of individuals with suspected developmental disorders. In general, these referrals, often generated in the educational system, lack pertinent information because the observations about student performance are not systematized. Structured reports with objective observations will facilitate reference and counter-reference procedures between education and health. This study shows a structured model that meets these procedures.
Once the suspicion of ASD or ID in an elementary school student has been raised, following the process model presented in this study optimizes the further definition of the problem of the student in the minimum time so that they can receive the appropriate intervention. The system presented here and the actions detailed in the flowchart for each disorder function as a tool that makes it possible for teachers to develop the skills and competencies required to recognize signs of ASD and ID. In addition, it provides the teacher with an appropriate set of tools to identify and make an initial evaluation of the student. Thus, the identification of signs indicative of these neurodevelopmental disorders, enables the student to receive furthermore specialized evaluations and services that correspond to their needs.
The implementation of this model in the educational system can validate the feasibility of its for other neurodevelopmental disorders. In fact, this model has already been developed by the authors of this study for use in Attention Deficit Hyperactivity Disorder (ADHD) and Specific Learning Disorder (SLD). A general model covering the four disorders (ASD, ID, ADHD and SLD) is already being tested in a municipal educational system in the State of São Paulo in a research project financed by the São Paulo Research Foundation (FAPESP). In this project the flowcharts are being tested with students without complaints to compare the results with students who present suspected ASD and ID, as well as to identify false negative cases in order to verify the specificity of the checklists that were developed.
Another important outcome is the validation of the potential for collaborative working between different sectors (education and health). Finally, the system can test the sensitivity of the checklists by comparing their results with the outcome of the health service diagnostic evaluation and verify the sensitivity indicators of the checklists.
