REFLEXIONES EPISTEMOLÓGICAS
Sensitivity and specificity of “Ages and Stages Questionnaires: Social-emotional” (ASQ: SE-2) in a Colombian population
Sensibilidad y especificidad de los Cuestionarios de Edades y Etapas: Social-emocional (ASQ:SE-2) en una población colombiana
Sensitivity and specificity of “Ages and Stages Questionnaires: Social-emotional” (ASQ: SE-2) in a Colombian population
Tésis Psicológica, vol. 17, no. 2, pp. 1-21, 2022
Fundación Universitaria Los Libertadores
Received: 07 February 2021
Revised document received: 03 March 2021
Accepted: 02 September 2022
ABSTRACT: The timely detection of risks in emotional development requires valid and reliable instruments that sufficiently evaluate the construct. In Colombia, the Personal-social Subscale of the Abbreviated Development Scale (EAD-3 by its acronym in Spanish) is used; however, there are instruments that more fully evaluate the dimensions of socialemotional development for which there is no conclusive evidence on their sensitivity and specificity in the Colombian population. This instrumental study had the objective of identifying the sensitivity and specificity of the questionnaires for 6, 12, 18, 24, 30 and 36 months of the ASQ: SE-2. The sample was composed of 512 boys and girls between 3 and 36 months of age, from the city of Colombia of the Colombian Institute of Family Welfare and the Secretariat for Women, Gender Equality and Social Development. The comparative analysis between the ASQ:SE-2 and the Personal-social subscale of the EAD-3, showed relationship between the two instruments to identify risk in socialemotional development in the 6 (X2 (1, 85)= 7.869, p=.005), 18 (X2 (1, 97)= 15.966, p=.000), and 36 month (X2 (1, 50) =11.387, p=.001) questionnaires. The ASQ: SE-2 reports optimal levels of specificity and adequate sensitivity in the 12 and 18-month questionnaires. The results of the research provide positive evidence on the use of the ASQ: SE-2 as a recommended instrument for the screening of social-emotional development in the Colombian population.
Keywords: Social-emotional development, psychometrics, ASQ: SE-2, EAD-3.
RESUMEN: La detección oportuna de riesgos en el desarrollo socioemocional requiere de instrumentos válidos y confiables que evalúen suficientemente el constructo. En Colombia se emplea la Subescala Personal-social de la Escala Abreviada del Desarrollo, sin embargo, existen instrumentos que evalúan de manera más completa las dimensiones del desarrollo socioemocional de los que no se tiene evidencia contundente sobre su sensibilidad y especificidad en la población colombiana. Esta investigación instrumental tuvo como objetivo identificar la sensibilidad y especificidad de los cuestionarios de 6,12, 18, 24, 30, 36 meses del Ages & Stages Questionnaires: Social-Emotional, Second Edition (ASQ:SE-2). La muestra estuvo conformada por 512 niños de 3 a 36 meses de una ciudad Colombiana que hacen parte de los programas sociales del Instituto Colombiano de Bienestar Familiar y la Secretaría de la Mujer, Equidad de género y Desarrollo Social. El análisis comparativo entre el ASQ: SE-2 y la Subescala Personal-social de la Escala Abreviada del Desarrollo, Tercera versión (EAD-3), evidenció relación entre los dos instrumentos para identificar el riesgo de desarrollo socioemocional en los cuestionarios de 6 meses (X2 (1, 85) = 7.869, p=.005), 18- meses (X2 (1, 97)= 15.966, p=.000) y 36-meses (X2 (1, 50) =11.387, p=.001). El ASQ: SE-2 reporta niveles óptimos de especificidad y adecuada sensibilidad en los cuestionarios de 12 y 18 meses. Los resultados de la investigación aportan evidencia positiva sobre el uso del ASQ: SE-2 como instrumento recomendable para la evaluación inicial del desarrollo socioemocional en población colombiana.
Palabras clave: Desarrollo socioemocional, psicometría, ASQ: SE-2, EAD-3, Sensibilidad, Especificidad.
Introduction
Social-emotional development is understood as the capacity to achieve optimum levels of social and emotional competencies, which allow for establishing positive relationships and fulfilling personal goals (Squires et al., 2015). This process involves the development of competencies throughout the cycle of life, such as self-recognition and self-regulation autonomy, cooperation, and social communication, among others (Chalata-Chambi, 2021; Gómez, 2019). The first years of life are crucial because, since birth, children rapidly develop their abilities to experience and express different emotions and to face and handle a variety of feelings (Nieves & Rodríguez, 2016; Salzwedel et al., 2019). Such abilities are produced together with those related to motor control, cognition, and language. In fact, learning how to handle their emotions is, for some children, more difficult than learning to count or read, and, in some cases, this could be an early sign of future psychological problems, such as the difficulty in functionally adapting to a school context and to form successful relationships throughout their lives (Suárez & Castro, 2022).
Likewise, empirical evidence has allowed establishing social-emotional competencies developed during childhood as important predictors of children's mental health, school readiness, well-being, academic success, and easiness of participating in different processes and contexts (e.g., School and family) (Denham, 2019; Gadaire et al., 2021; Im, Jiar, & Talib, 2019). Correspondingly, these competencies have been considered essential for problem-solving, collaboration, and bouncing back from difficulties (Moreno et al., 2018).
However, various factors can hinder social-emotional development. Examples are the lack of early stimulation and the existence of biological risk factors such as diseases during pregnancy and premature birth. Similarly, social risk factors such as economic deprivation, low levels of education or violent contexts, and maternal stress, among others, are also likely to hamper this aspect of development (Aaron & MizeI, 2022; Ibañez & Mudarra, 2014). In Colombia, a study carried out in Bogota to determine the prevalence of developmental delay in preschool-age children showed that 9.8% of the 2,043 children evaluated exhibited some deficit regarding personal-social interactions (González-Reyes et al., 2007). In 2013, according to a survey conducted in around 10,000 Colombian households (out of which 6,000 were urban and 4,000 were rural), 20% of the boys and girls under 5 were at risk of social-emotional delay (Bernal et al., 2015). These figures suggest the need for early detection of developmental delays in order to facilitate timely interventions through social competence measures that are brief, easy to apply, and useful for assessing the construct in preschool children. However, without valid psychometric screening tools, children in need of early intervention may not be identified, referred to, and treated (Dougherty et al., 2015).
The scientific literature reports significant improvements in child development when social-emotional progress issues are timely detected and intervened in. Similarly, when primary caregivers know the correct ways to enhance child progress, developmental lags are leveled out (Galvis-Serna et al., 2021; Im, Jiar, & Talib, 2019). Nevertheless, there is evidence of a gap in the evaluation of social-emotional development in clinical contexts, wherein this parameter is frequently assessed through verification lists that provide either incomplete evaluations or are plainly not valid methods since they tend to detect a lower number of cases than there actually are (Godoy & Carter, 2013).
Therefore, it has been proposed to resort to detection instruments that include the necessary psychometric characteristics to measure the construct in question specifically and are in accordance with the age, cultural values, and circumstances of the context in which the measurement is intended to be carried out (Heo & Squires, 2012). In this sense, validated tools allow for better detection and an increased probability that the children found to be at risk receive treatment for their mental health (Barger et al., 2018); hence, the importance of psychometric research in child-development-care contexts.
The present work suggests the early evaluation of social-emotional development problems, which is addressed by the Ages & Stages Questionnaires: Social-Emotional, Second Edition (ASQ:SE-2), through the assessment of the main factors determining social-emotional development milestones. This instrument has reported an internal consistency of 91%, measured using Cronbach’s alpha coefficient, and a validity of 71% to 90%, obtained through concurrent measurements with an 84% general agreement (Squires et al., 2015). This instrument has been validated in countries such as Norway (Stensen et al., 2018), reporting high specificity and sensitivity in the 30-to-60-month questionnaires. For their part, the 18-to-24-month questionnaires demonstrated more limited efficacy in detecting children at risk. In the Netherlands, good specificity and sensitivity were only observed in the ≥18 months-of-age versions (Krijnen et al., 2021). In Latin America, in countries such as Uruguay (Alvarez-Nuñez et al., 2020) and Perú (Gudiel-Hermoza et al., 2021); in Uruguay, it showed adequate sensitivity, specificity, and criterion validity to detect children whose social and emotional development requires further evaluation or continuous monitoring. Finally, in Perú, the ASQ:SE-2, applied to parents of children from 15 to 48 months of age, proved to be a reliable and valid tool for the surveillance and screening of social-emotional development (Gudiel-Hermoza et al., 2021). However, no data has been found on the sensitivity and specificity of the instrument in a Colombian population. For this reason, the objective of this research is to identify the sensitivity and specificity of ASQ:SE-2 in children from 3 to 36 months, thus contributing to the early detection of social-emotional problems in children and promoting their well-being and healthy development.
Methodology
Research design
The current one is a quantitative investigation aimed at a psychometric instrument design; this includes the design, adaptation, and studies of psychometric properties –namely sensitivity and specificity– of ASQ: SE-2 (Montero & León, 2007).
Participants
The participants were selected by probability sampling, with a 5% margin of error. The sample was composed of 512 children from the city of Tunja, Colombia: 253 boys and 259 girls aged between 3 and 36 months, coming from the Child Development Centres of Instituto Colombiano de Bienestar Familiar (ICBF), the Secretariat of Women, Gender equality and Social Development, and private educational institutions. The socioeconomic strata of the participants were the following: 150 boys and girls (29.3%) from 1; 156 (30.5%) from 2; 57 (11.1%) from 3, and 2 (0.3%) from 4. With regards to family type, 242 children (47.3%) reported belonging to a nuclear family (mother, father, and child/children); 141 (27.5%) to an extended family (mother, grandparents, and child/children); 21 (4.1%) to a mixed family (parents, grandparents or uncles/aunts, and children); and 69 (13.5%) to a single-parent family (single mother or father and his/her child/children). The inclusion criteria selected children who resided in Tunja and corresponded to the specified age range at the moment of conducting the research. Children diagnosed with some disability (Down syndrome, global developmental delay, mental delay, speech impediment, cerebral palsy) were excluded from the sample.
Instruments
Ages and Stages Questionnaires Social Emotional (ASQ: SE-2
Originally designed by Jane Squires, Elizabeth Twombly, and Diane Bricker (2015), ASQ:SE-2 evaluates self-regulation, obedience, communication, adaptative behavior, autonomy, affection, and interaction with people. The present work resorted to the adapted Spanish version developed by its original authors, which comprises nine questionnaires to be used according to the age of the children (2, 6, 12, 18, 24, 30, 36, 48, and 60 months). The questionnaires to be validated in the present investigation (6, 12, 18, 24, 30, and 36 months), respectively, have 26, 30, 34, 34, 36, and 38 items to be answered. Within the total number of items, there are four qualitative ones, while the rest are of the Likert type, with four possible responses (Always, Sometimes, Never, and Mark if this concerns you.) ASQ:SE-2 classifies its results into three levels: Within Expectation, Observe (i.e., one standard deviation above the mean), and Consult (i.e., two standard deviations above the mean). ASQ:SE-2 has an internal consistency measured using Cronbach’s alpha coefficient (91%), which indicates solid relations between the total scores of the questionnaire and the individual items. The validity was obtained through concurrent measurements and varied from 71% to 90%, with an 84% general agreement (Squires et al., 2015).
Abbreviated Development Scale (Escala Abreviada del Desarrollo - EAD-3
EAD-3 started as a collaborative project between the Colombian Ministry of Health and the United Nations Fund (UNICEF). To come up with this last version, a consensual dialogue took place among experts from Pontificia Universidad Javeriana (2016). The instrument in its current form contains 144 items distributed uniformly in four areas of development: Gross motor skills, Fine motor skills, Hearing and Language, and Personal-social. The Personal-social area includes processes related to the initiation and response to social interaction, dependence and independence, expression of feelings and emotions, and learning behavioral patterns related to child self-care.
EAD-3 covers 12 age ranges which guide the evaluator according to the child's age utilizing a nominal scale with values 0 or 1 (if they present the condition or not). After evaluating a pilot test of this version, the position of some items was adjusted, as well as the formulation of statements, the conditions of observation, and the score criteria. The purpose is to identify, from an early age, the delay risk in the development of Spanish-speaking boys and girls up to 7 years of age. The results of the children in each one of the areas of the scale can be classified as development expected for their age (green region), risk of developmental problems (yellow region), and suspicion of developmental problems (red region). EAD-3 reports two types of scores: direct and typical scores (expressed on a T scale, M=50 and DS=10).
Procedure
The current work, which included a quantitative study and an instrument design process, was developed in three phases: a) Endorsement and informed consent, b) Application and scoring of the instrument, and c) Data analysis. In the first phase, the research was endorsed by the ethics committee of the Universidad Pedagógica y Tecnológica de Colombia. The parents of the selected children were contacted via phone. Later on, they attended a meeting wherein the objective of the investigation and the voluntary character of the participation in it were explained, after which they filled out the informed consent, where the ethical considerations were detailed (Law 1090 of 2006, resolution 8430 of 1993 from the Colombian Ministry of Health). In the third phase, the statistical analysis permitted calculating the sensitivity and specificity of the instrument.
Data analysis
The data were analyzed in SPSS Statistics version 28. First, the descriptive statistics of the social-emotional development of the sample were evaluated by gender. The results obtained from the children evaluated through ASQ:SE-2 were classified based on the criteria established by Squires et al. (2015): Within Expectation, Observe (+1 SD), and Consult (+2 SD). In the second stage, contingency tables containing four types of data (i.e., true positive, false positive, false negative, and true negative data) were developed for each ASQ:SE-2 age interval using cutoff scores (1.0 standard deviation above the mean) to conduct comparisons with EAD-3. Using the data contained in the contingency table, the sensitivity, specificity, false positive rate, false negative rate, positive and negative predictive values, and agreement, percentages were calculated for each ASQ:SE-2 age interval. Sensitivity is the proportion of children correctly identified by the questionnaires as needing further assessment. Specificity is the proportion of children correctly identified by the questionnaires as undergoing typical development processes. The positive predictive value is the proportion of children identified by the questionnaires as needing further assessment who will have intervention needs. The negative predictive value is the proportion of children identified as developing typically, and the agreement percentage is the ratio of concordance between the screening tool and the standardized assessment.
Ethical considerations
The present study conveyed a minimum level of risk because the applied research techniques and methods implied no intervention or intentional modification of the biological, physiological, psychological, or social characteristics of the individuals who participated in the study. The informed consent was correctly filled out, thus guaranteeing the voluntary participation and total confidentiality of the data obtained and analyzed during the investigation, in strict compliance with the constitutional regulations for the protection of personal data. No conflict of interest was involved in the present research. There was no funding from any entity, and its sole purpose corresponds to the dissemination of information for academic purposes, which may serve as input for future investigation.
Results
Risk prevalence in social-emotional development
The prevalence of boys and girls at social-emotional development risk was analyzed (Table 1). The statistical analysis revealed that the average ranges of the total scores did not vary significantly between boys and girls (U Mann Whitney (1, 512) = 3.074, p = 0.08). No significant variation was found either by levels of social-emotional development (Within expectation, Observe and Consult) (X2(1, 512)= 4.621, p=.09). However, in the six and twelve-month ranges, there were higher percentages of girls requiring observation. In the case of boys, the same situation was observed in the 12 month range. The total percentage of development risk, which included those boys and girls placed at the Observe and Consult categories, was 11.3%. The six-month questionnaire presented the most cases at risk (22%), whereas the least count was found in the 36-month range (6%).

The contingency analysis between ASQ:SE-2 and the personal-social subscale of EAD-3 revealed a relationship between the two instruments, both of which were capable of identifying social-emotional development risk through the 6 (X2(1. 85)= 7.869, p=.005), 18 (X2(1. 97)= 15.966, p=.000), and 36-month (X2(1. 50) =11.387, p=.001) questionnaires. The results of the 12, 24, and 30-month questionnaires of ASQ:SE-2 were not statistically significant to confirm their relationship with the scores obtained by EAD-3. These results may be because the EAD-3 and ASQ:SE-2 items differ in the 12, 24, and 30-month protocols. In those age ranges, ASQ:SE-2 includes items addressing dimensions such as Obedience and Adaptative functioning, which are not contemplated in EAD-3.
The information obtained from the agreement percentage analysis of the 6 ASQ:SE-2 questionnaires (see Table 2) indicated the instrument's capability to detect children at social-emotional development risk and those undergoing expected development; this can be observed through the agreement percentage values, which are between 66.7% and 92%. The highest sensitivity value (100%) corresponded to the 18-month questionnaire, followed by the six and thirty-six-month questionnaires, which exhibited values of 50% and 40%, respectively. The sensitivity levels for the 12, 24, and 30-month questionnaires were found to be low, which reveals a weaker capacity of the instrument to detect social-emotional development risk at said age ranges.
Concerning the specificity values, a high capacity of the instrument to identify expected social-emotional development levels is evidenced in all the evaluated questionnaires, which exhibited scores for this parameter ranging between 80% and 97.8%. The 36-month questionnaire showed the highest specificity (97.8%), whereas the 30-month questionnaire had the lowest specificity (80%). According to the sensitivity and specificity data, the questionnaire with the greater ability to identify both risk and expected development was the 18-month questionnaire, with 90.7%. The questionnaire with the lowest potency was the 30-month one, with 75.8%. Regarding the remaining questionnaires, and despite the high level of specificity they registered, it is necessary to take into consideration the importance of supporting the results obtained in the questionnaires with other screening tools to avoid cases of undetected social-emotional development risk, especially in the 12, 24 and 30-month questionnaires.

Discussion
Empirical evidence reveals that the problems related to neurodevelopment, and more specifically to social-emotional problems, are often not identified in time due to biased evaluation processes. This may be the case when the evaluations only consider the clinical judgment of the professional, the instruments employed have not been duly validated in specific contexts, or the applied verification lists are not sensitive enough for development risk detection. This difficulty highlights the need to carry out studies that allow the identification of the validity and reliability of the tests that are intended to detect social-emotional development problems (Kyerematen et al., 2014).
The findings revealed that 88.7% of the participants were at the expected social-emotional development level for their age; 11.3% of the children were at risk, most of the cases being 6 to 12-month-old boys and girls. This can be related to the fact that, during this phase, important self-regulation bases are set where the assistance of caregivers is required. They have a crucial role in the affective expectations of the babies. If babies do not receive such attention, there is a higher chance of a deficit in their social-emotional development (Duschinsky, 2018). At the same time, identifying risk in this phase is vital because brain development and learning are directly dependent on social-emotional experiences (Immordino-Yang et al., 2019). These results are similar to those of other studies conducted in Colombia, which applied both ASQ:SE and EAD-3. These tools respectively identified that 9.8% and 20% of the children under 60 months of age were experiencing social-emotional development risk (Bernal et al., 2015; González-Reyes et al., 2007).
Concerning the validity analysis, a relation was found between the two instruments in terms of their capability to measure social-emotional development in the 6, 18, and 36-month questionnaires. For their part, the results of the 12, 24, and 30-month questionnaires of ASQ:SE-2 are not statistically significant to confirm their relationship with the scores obtained by the Personal-social sub-scale of EAD-3. The existing convergence between the questionnaires could be explained by the similarity of both instruments in the questionnaires of the age ranges in question, which coincides with components such as autonomy, affection, and social communication. In the rest of the questionnaires, the contrast may result from the fact that the Personal-social sub-scale, as opposed to the ASQ: SE-2, does not give relevance to adaptive functioning and obedience/conformity as components of social-emotional development but rather privileges autonomy and social communication.
The levels of specificity of the test were higher than the sensitivity levels; this coincides with what was reported in other studies (Squires et al., 2001; Krijnen et al., 2021) in the sense that, through the instrument, it is easier to tell expected from risky social-emotional development. This could be influenced by the perception of the parents who, despite being the main source of information about the development of their children, could be overlooking risk factors that they do not report at the moment of the test. For this reason, it is recommended that the measures of detection completed by the parents are complemented by using additional methods to compile corroborating information, such as clinical observations and professional evaluation criteria (Squires et al., 2001). In addition, it is important to carry out a continuous screening, including the concerns of the parents and the application of detection tests, as is the case of the checking of biological and environmental risk factors (American Academy of Pediatrics, 2016).
It is suggested that the psychometric research continues by increasing the sample size, which would give more support to the obtained information, especially in the questionnaires of the earlier ages. Likewise, it is valid to suggest the use of the psychometric analysis of ASQ:SE-2 together with other developmental tests and to expand the evidence supporting the validity of the instrument concerning other variables not contemplated in this study. These variables include the quality of the infant-parent attachment, the mother's emotional stability, and violence within the couple, among others which, according to certain studies, could be related to child social-emotional development (Ahlfs-Dunn & Huth-Bocks, 2014; Cheung et al., 2018; Raskin, 2016; Zarra-Nezhad, 2014).
Conclusions
ASQ:SE-2 reports optimal levels of specificity and adequate sensitivity in the 12 and 18-month questionnaires. This instrument facilitates telling those children who present the expected social-emotional development from those who do not. Positive evidence was obtained on the psychometric power of ASQ: SE-2. The instrument identified that 11.3% of boys and girls do not have an expected level of development.
ASQ:SE-2 includes items that assess dimensions such as Obedience and Adaptive Functioning in the 12-, 24-, and 30-month protocols, which are not contemplated in EAD-3. To this end, it is recommended for screening measures completed by parents be complemented by using additional methods to collect corroborative information, such as clinical observations and other professional evaluation criteria.
These results are important in the child development measurement field, especially social-emotional development, as having instruments that adequately identify lags in development is essential to provide timely and comprehensive care.
Disclosure statement
No potential conflict of interest was reported by the authors. The results shown are derived from research project, SGI code 2775 of Universidad Pedagógica y Tecnológica de Colombia – UPTC.
Referencias
Aaron, N., & Mize, K. D. (2022). Ontogeny of the social brain in utero and in infancy: risk factors and resilience in socioemotional development. Current Opinion in Behavioral Sciences, 43, 200-206.https://doi.org/10.1016/j.cobeha.2021.10.003
Ahlfs-Dunn, S., & Huth-Bocks, A. (2014). Intimate partner violence and infant socioemotional development: the moderating effects of maternal trauma symptoms. Infant Mental Health Journal, 35(4), 322–335.https://doi.org/10.1002/imhj.21453
American Academy of Pediatrics. (2016). Identifying Infants and Young Children with Developmental Disorders in the Medical Home: An Algorithm for Developmental Surveillance and Screening. PEDIATRICS, 118 (1), 405-420.https://doi.org/10.1542/peds.2006-1231
Alvarez-Nuñez, L., González, M., Rudnitzky, F., & Vásquez-Echeverría, A. (2020). Psychometric properties of the Spanish version of the Ages & Stages Questionnaires: Social–Emotional in a nationally representative sample. Early Human Development, 105157.https://doi.org/10.1016/j.earlhumdev.2020.105157
Barger, B., Rice, C. & Roach, A. (2018). Better together: Developmental screening and monitoring best identify children who need early intervention. DisabilHealt Journal, 11(3), 420-426.https://doi.org/10.1016/j.dhjo.2018.01.002
Bernal, R., Martínez, M. A., & Quintero, C. (2015) Situación de niñas y niños colombianos menores de cinco años, entre 2010 y 2013. Bogota, Colombia: Universidad de los Andes, School of Economics, Ediciones Uniandes.https://encuestalongitudinal.uniandes.edu.co/es/publicaciones/libros/9-situacion-de-ninas-y-ninos-colombianos-menores-de-cinco-anos-2010-2013
Chalata-Chambi, B. (2021). Desarrollo socioemocional y conciencia fonológica en niños de cuatro a cinco años de la institución educativa inicial 229 Orurillo-Puno, 2020. [Tesis Fin de Grado]. Universidad Católica Los Ángeles Chimbote.http://repositorio.uladech.edu.pe/handle/123456789/20319
Cheung, R. Y., Boise, C., Cummings, E. M., Davies, P. T. (2018). Mothers and Fathers Roles in Child Adjustment: Parenting Practices and Mothers Emotion Socialization as Predictors. Journal of Child & Family Studies, 27(12), 4033–4043.https://doi.org/10.1007/s10826-018-1214-1
Congreso de la República de Colombia (2006). Ley 1090 del 06 de septiembre de 2006 por el cual se reglamenta el ejercicio profesional psicológico, se dicta el código deontológico. Bogota, D.C. Congreso de la República de Colombia
Denham, S. A. (2019). Emotional competence during childhood and adolescence. In Handbook of emotional development (pp. 493-541). Springer, Cham.
Duschinsky, R. (2018). Disorganization, fear and attachment: Working towards clarification. Infant Mental Health Journal, 39(1), 17-29.https://dx.doi.org/10.1002/imhj.21689
Gadaire, A. P., Armstrong, L. M., Cook, J. R., Kilmer, R. P., Larson, J. C., Simmons, C. J., Messinger, L.G. Thiery, T.L. & Babb, M. J. (2021). A data-guided approach to supporting students’ social-emotional development in pre-k. American Journal of Orthopsychiatry, 91(2), 193- 207.https://doi-org.bdbib.javerianacali.edu.co/10.1037/ort0000522
Galvis-Serna, E., Maldonado-Carreño, C., & Molano, A. (2021). Trayectorias del desarrollo infantil en instituciones de protección en Colombia. Psicoperspectivas, 20(1), 1-13.https://dx.doi.org/10.5027/psicoperspectivas-vol20-issue1-fulltext-2012
Godoy, L., & Carter, A. (2013). Identifying and Addressing Mental Health Risks and Problems in Primary Care Pediatric Settings: A Model to Promote Developmental and Cultural Competence. American Journal of Orthopsychiatry, 83(1), 73-88.https://doi.org/10.1111/ajop.12005
Gómez, E. (2019). Lenguaje, parentalidad y desarrollo socioemocional en la primera infancia: relaciones conceptuales y asociaciones concurrentes y longitudinales en una muestra chilena (Doctoral dissertation, Pontificia Universidad Católica de Chile). Retrieved fromhttps://repositorio.uc.cl/xmlui/bitstream/handle/11534/23546/TESIS%20DOCTORADO%20Esteban%20Gomez%2012.03.19.pdf?sequence=1&isAllowed=y
González-Reyes, R., Talero-Gutiérrez, C. & Vélez, A. (2007). Prevalence of delayed neurodevelopment in children from Bogota, Colombia, South América. Neuroepedimiology, 29(1:2), 74-77.https://doi.org/10.1159/000109499
Gudiel-Hermoza, A., Gudiel-Hermoza, J., Mancilla-Gudiel, Y., & Guillen-Pinto, D. (2021). Validación y puntos de corte de la versión en español del Cuestionario de Edades y Etapas: Social-emocional, 2da edición (ASQ: SE-2), en un entorno ambulatorio urbano de Lima-Perú. Revista de Neuro-Psiquiatría, 84(2), 75-82.http://dx.doi.org/10.20453/rnp.v84i2.3994
Heo, K. H., & Squires, J. (2012). Cultural adaptation of a parent completed social emotional screening instrument for young children: Ages and stages questionnaire-social emotional. Early Human Development, 88(3), 151-158.https://doi.org/10.1016/j.earlhumdev.2011.07.019
Ibañez, P., & Mudarra, M. (2014). Atención temprana: diagnóstico e intervención psicológica. Spain: Universidad Nacional de Educación a Distancia.
Im, G. W., Jiar, Y. K., & Talib, R. B. (2019). Development of Preschool Social Emotional Inventory for Preschoolers: A Preliminary Study. International Journal of Evaluation and Research in Education, 8(1), 158-164.
Immordino-Yang, M. H., Darling-Hammond, L., & Krone, C. R. (2019). Nurturing nature: How brain development is inherently social and emotional, and what this means for education. Educational Psychologist, 54(3), 185-204.
Kyerematen, V., Hamb, A. & Oberhelman R. (2014) Exploratory application of the Ages and Stages (ASQ) child development screening test in a low-income Peruvian shantytown population. BMJ Journals, 4(1), 503-509.https://doi.org/10.1136/bmjopen-2013-004132
Krijnen, L. J., Verhoeven, M., & van Baar, A. L. (2021). Assessing social-emotional development in infants and toddlers using parent-reports: comparing the ASQ-SE-NL to the social-emotional scale of the Bayley-III-NL. Early Human Development, 161, 105439.https://doi.org/10.1016/j.earlhumdev.2021.105439
Moreno, A., Nagasawa, M., & Schwartz, T. (2018). Social and emotional learning and early childhood education: Redundant terms? Contemporary Issues in Early Childhood,1(3), 1–15.https://doi.org/10.1177/1463949118768040
Ministerio de Salud (1993). Resolution 8430 of 1993. Available at:https://www.minsalud.gov.co/sites/rid/Lists/BibliotecaDigital/RIDE/DE/DIJ/RESOLUCION-8430-DE-1993.PDF
Montero, I., & León, O. G. (2007). A guide for naming research studies in Psychology. International Journal of clinical and Health psychology, 7(3), 847-862. https://www.redalyc.org/pdf/337/33770318.pdf Nieves – Rosa, A., & Rodríguez – Arocho, W. (2016). Un modelo de educación en clave Vygotskiana: estudio piloto del desarrollo socioemocional de pre-escolares con el currículo “Key to Learning. Revista Puertorriqueña de Psicología, 27(2), 334-352.https://www.redalyc.org/articulo.oa?id=233247620010
Pontificia Universidad Javeriana (2016). Escala Abreviada de Desarrollo – 3. Retrieved fromhttps://www.minsalud.gov.co/sites/rid/Lists/BibliotecaDigital/RIDE/VS/PP/ENT/Escala-abreviada-de-desarrollo-3.pdf
Raskin, M. (2016). Depression Trajectories of Antenatally Depressed and Nondepressed Young Mothers: Implications for Child Socioemotional Development. Women’s Health Issues, 26(3), 344–350.https://doi.org/10.1016/j.whi.2016.02.002
Salzwedel, A. P., Stephens, R. L., Goldman, B. D., Lin, W., Gilmore, J. H., & Gao, W. (2019). Development of amygdala functional connectivity during infancy and its relationship with 4-year behavioral outcomes. Biological psychiatry. Cognitive neuroscience and neuroimaging, 4(1), 62–71.https://doi.org/10.1016/j.bpsc.2018.08.010
Squires, J., Bricker, D & Twombly, E. (2015). ASQ: SE- 2 User’s Guide. Brookes Publishing.
Squires, J., Bricker, D., Heo, K., & Twombly, E. (2001). Identification of social-emotional problems in young children using a parent-completed screening measure. Early Childhood Research Quarterly, 16(4), 405-419.https://doi.org/10.1016/S0885-2006(01)00115-6
Stensen, K., Stenseng, F., Lydersen, S., de Wolff, M. S., Wallander, J., & Drugli, M. B. (2018). Screening for mental health problems in a Norwegian preschool population. A validation of the ages and stages questionnaire: Social‐emotional (ASQ: SE). Child and Adolescent Mental Health, 23(4), 368-375.https://doi.org/10.1111/camh.12257
Suárez, X., & Castro, N. (2022). Competencias socioemocionales y resiliencia de estudiantes de escuelas vulnerables y su relación con el rendimiento académico. Revista De Psicología, 40(2), 879-904.https://doi.org/10.18800/psico.202202.009
Zarra-Nezhad, M. (2014). Social withdrawal in children moderates the association between parenting styles and the children’s own socioemotional development. Journal Of Child Psychology And Psychiatry, And Allied Disciplines, 55(11), 1260–1269.https://doi.org/10.1111/jcpp.12