Servicios
Descargas
Buscar
Idiomas
P. Completa
Assessing Workplace Bullying: Psychometric Analysis of the Negative Acts Questionnaire-Revised (NAQ-R) among Brazilian Teachers
Esthela Sá Cunha; Francisco Pablo Huascar Aragão Pinheiro; Alex Sandro de Moura Grangeiro;
Esthela Sá Cunha; Francisco Pablo Huascar Aragão Pinheiro; Alex Sandro de Moura Grangeiro; Jorge Tarcisio da Rocha Falcão; Walberto Silva dos Santos; Francisco Herbert Lima Vasconcelos; Amanda Queiroz Silva; Lorena Albuquerque Mendes
Assessing Workplace Bullying: Psychometric Analysis of the Negative Acts Questionnaire-Revised (NAQ-R) among Brazilian Teachers
Evaluación del acoso laboral: análisis psicométrico del Cuestionario de Actos Negativos Revisado (CAQ-R) entre docentes brasileños
Avaliação do assédio no local de trabalho: análise psicométrica do Negative Acts Questionnaire-Revised (NAQ-R) entre professores brasileiros
Avances en Psicología Latinoamericana, vol. 42, núm. 2, a14321, 2024
Universidad del Rosario
resúmenes
secciones
referencias
imágenes

Abstract: Most research on school violence in Brazil has over-looked teacher victimization, focusing instead on students. This study focused on evaluating the psychometric properties of the Negative Acts Questionnaire-Revised (NAQ-R) in a sample of 10.148 teachers from Brazilian public schools. The NAQ-R, developed to measure exposure to workplace bullying, originally included 23 items but was later revised to 22. It assesses three factors of bullying: personal, work- related, and physically intimidating forms. The study employed a self-administered questionnaire issued via the Internet. Exploratory and confirmatory factor analyses were performed, alongside assessment of convergent validity with the Self-Reporting Questionnaire-20 (SRQ-20), an instrument for screening common mental disorders. This study discovered a two-factor structure (personal bullying: α = .93, ω = .79; work-related bullying: α = .92, ω = .74). The NAQ-R showed adequate internal consistency and validity (RMSEArobust = .089, 90 % CI: .086 - .089, SRMR = .041, CFIrobust = .916, TLIrobust = .905), correlating positively with the SRQ-20. The findings align with international studies, suggesting the measure’s stability.

Keywords: Harassment, workplace violence, teachers, schools, validation studies.

Resumen: La mayor parte de la investigación sobre la violencia escolar en Brasil ha pasado por alto la victimización de los docentes, centrándose en los estudiantes. Este estudio se centró en evaluar las propiedades psicométricas del Cuestionario de Actos Negativos Revisado (CAN-R), en una muestra de 10.148 profesores de escuelas públicas brasileñas. El CAN-R, desarrollado para medir la exposición al acoso laboral, incluía originalmente 23 ítems, pero posteriormente se revisó a 22. Evalúa tres factores del acoso: personal, laboral y formas con intimidación física. El estudio empleó un cuestionario autoadministrado difundido a través de Internet. Se realizaron análisis factoriales exploratorios y confirmatorios, junto con la evaluación de la validez convergente con el SelfReporting Questionnaire-20 (SRQ-20), un instrumento para el cribado de los trastornos mentales comunes. Este estudio descubrió una estructura de dos factores (acoso personal: α = .93, ω = .79; acoso laboral: α = .92, ω = .74). El CAN-R presentó una consistencia interna y validez adecuadas (RMSEArobusto = .089, IC del 90 %: .086 - .089, SRMR = .041, CFIrobusto = .916, TLIrobusto = .905), correlacionándose positivamente con el SRQ-20. Los hallazgos se alinean con estudios internacionales, lo que sugiere la estabilidad de la medida.

Palabras clave: Acoso, violencia laboral, docentes, escuelas, estudios de validación.

Resumo: A maior parte da pesquisa sobre violência escolar no Brasil tem ignorado a vitimização de professores, concentrando-se nos alunos. Este estudo se concentrou na avaliação das propriedades psicométricas do Negative Acts Questionnaire-Revised (NAQ-R) em uma amostra de 10.148 professores de escolas públicas brasileiras. O NAQ-R, desenvolvido para medir a exposição ao assédio no local de trabalho, incluía originalmente 23 itens, mas foi posteriormente revisado para 22. Ele avalia três fatores de assédio: pessoal, profissional e formas de intimidação física. O estudo utilizou um questionário autoadministrado divulgado pela internet. Foram realizadas análises fatoriais exploratórias e confirmatórias, juntamente com a avaliação da validade convergente com o Self-Reporting Questionnaire-20 (SRQ-20), um instrumento para a triagem de transtornos mentais comuns. Este estudo encontrou uma estrutura de dois fatores (assédio pessoal: α = 0.93, ω = 0.79; assédio profissional: α = 0.92, ω = 0.74). O NAQ-R apresentou consistência interna e validade adequadas (RMSEArobusto = 0.089; 90 % IC: 0.086-0.089; SRMR = 0.041; CFIrobusto = 0.916; TLIrobusto = 0.905), correlacionando-se positivamente com o SRQ-20. Os resultados estão de acordo com estudos internacionais, sugerindo a estabilidade da medida.

Palavras-chave: Assédio, violência no local de trabalho, professores, escolas, estudos de validação.

Carátula del artículo

Artículos

Assessing Workplace Bullying: Psychometric Analysis of the Negative Acts Questionnaire-Revised (NAQ-R) among Brazilian Teachers

Evaluación del acoso laboral: análisis psicométrico del Cuestionario de Actos Negativos Revisado (CAQ-R) entre docentes brasileños

Avaliação do assédio no local de trabalho: análise psicométrica do Negative Acts Questionnaire-Revised (NAQ-R) entre professores brasileiros

Esthela Sá Cunha
Centro Universitário INTA - UNINTA , Brazil
Francisco Pablo Huascar Aragão Pinheiro
Universidade Federal do Ceará, Brazil
Alex Sandro de Moura Grangeiro
Universidade Federal do Ceará, Brazil
Jorge Tarcisio da Rocha Falcão
Universidade Federal do Ceará, Brazil
Walberto Silva dos Santos
Universidade Federal do Ceará, Brazil
Francisco Herbert Lima Vasconcelos
Universidade Federal do Ceará, Brazil
Amanda Queiroz Silva
Universidade Federal do Ceará, Brazil
Lorena Albuquerque Mendes
Universidade Federal do Ceará, Brazil
Avances en Psicología Latinoamericana, vol. 42, núm. 2, a14321, 2024
Universidad del Rosario

Recepção: 30 Abril 2024

Aprovação: 12 Dezembro 2024

DOI: https://doi.org/10.12804/revistas.urosario.edu.co/apl/a.14321

Financiamento
Fonte: Fundação Cearense de Apoio ao Desenvolvimento Científico e Tecnológico (Funcap)
Número do contrato: 403787/2023-8
Descrição completa: The authors disclosed receipt of the following financial support for the research of this article: This work was supported by the Fundação Cearense de Apoio ao Desenvolvimento Científico e Tecnológico (Funcap) [grant number - BP4-0172-00166.01.00/20 and BP5-0197-00046.01.00/22] and Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq) [grant number - 403787/2023-8].

In 2021, Brazil recorded over 52.000 cases of workplace bullying (Modesto, 2022). Most research and interventions in school violence particularly obscure this form of violence among teachers by focusing on students as victims of aggression (Scheeler et al., 2022). Repeated offenses, exclusion, and humiliations characterize workplace bullying, detrimentally affecting an employee’s performance and fostering a hostile work environment. The victim experiences belittlement and becomes a target of negative social acts (Einarsen et al., 2003). Hostile behaviors can also define it, occurring at least weekly or daily for at least six months. This definition excludes temporary mistreatments, and the manner of aggression is not considered (Leymann, 1996).

In educational settings, instances of this form of violence may originate from multiple individuals involved in the teaching environment, such as directors, students, parents, administrative personnel, and peer educators (Wet & Jacob, 2021). Among teachers, stress (Malik & Björkqvist, 2019), burnout (Inandi & Büyüközkan, 2022; Mościcka-Teske et al., 2014), and psychological distress (Bernotaite & Malinauskiene, 2017) have been associated with workplace bullying.

The Negative Acts Questionnaire (NAQ; Einarsen et al., 1994; Einarsen et al., 2009) was developed to gauge feelings of exposure to moral harassment and victimization at work. Initially, the NAQ comprised twenty-three items (Einarsen & Raknes, 1997). However, cultural limitations and issues with its factorial structure required a revision, resulting in a 22-item questionnaire.

The NAQ-R encompasses three factors: personal bullying, work-related bullying, and physically intimidating forms of bullying. Personal bullying includes negative acts such as humiliation, exclusion, slander, and intimidation that target the person or their private life (Einarsen et al., 2009). Work-related bullying pertains to dysfunctional or adverse work organization, often manifesting as the imposition of excessive workloads, alteration of the nature of tasks, or enforcement of stringent deadlines (Einarsen et al., 2009). Physically intimidating forms of bullying, the third factor, involve more severe actions like physical aggression, shoving, abuse, and threats (Einarsen et al., 2003).

Global studies have confirmed the psychometric properties of the NAQ among various worker categories. Research has identified structures of three (Erwandi et al., 2021; Dujo López et al., 2020; González-Trijueque & Gómez, 2013; Gupta et al., 2017; Nam et al., 2010; Takaki et al., 2010; Tsuno et al., 2010) and two factors (Charilaos et al., 2015; Giorgi et al., 2011; Makarem et al., 2018; Rai & Agarwal, 2017), and even four (Simons et al., 2011) and five factors (Abe & Henly, 2010; Verdasca, 2008).

These investigations used exploratory factor analysis (Erwandi et al., 2021; Gupta et al., 2017; León-Pérez et al., 2019; Makarem et al., 2018; Nam et al., 2010; Takaki et al., 2010; Tsuno et al., 2010) and principal components analysis (Charilaos et al., 2015; González-Trijueque & Gómez, 2013; Rai & Agarwal, 2017; Verdasca, 2008), or both (Abe & Henly, 2010; Simons et al., 2011). The factor retention method most employed was the classic Kaiser-Guttman and Cattell criteria (Eigenvalues > 1), despite their imprecision and tendency to overestimate factor numbers (Damásio, 2012).

These studies used both oblique and orthogonal rotations to enhance result interpretation. The correlation between factors ranged from 0.16 to 0.86 (Dujo López et al., 2020; Giorgi et al., 2011; Gupta et al., 2017; Simons et al., 2011), with a total explained variances ranging from 35.58 % to 69.72 % (Abe & Henly, 2010; Giorgi et al., 2011; González-Trijueque & Gómez, 2013; Gupta et al., 2017; León-Pérez et al., 2019; Makarem et al., 2018; Rai & Agarwal, 2017; Simons et al., 2011; Tsuno et al., 2010; Verdasca, 2008). Reliability, primarily assessed using Cronbach’s alpha, varied between 0.56 and 0.98 (Abe & Henly, 2010; Charilaos et al., 2015; Dujo López et al., 2020; Erwandi et al., 2021; Giorgi et al., 2011; González-Trijueque & Gómez, 2013; Gupta et al., 2017; León-Pérez et al., 2019; Nam et al., 2010; Rai & Agarwal, 2017; Simons et al., 2011; Takaki et al., 2010; Verdasca, 2008).

The NAQ’s convergent validity was evaluated by examining its relationship with constructs like psychosocial suffering, life satisfaction (Erwandi et al., 2021; Makarem et al., 2018), self-esteem, anxiety (Charilaos et al., 2015), stress (Charilaos et al., 2015), depression (Charilaos et al., 2015; Makarem et al., 2018), work engagement (Gupta et al., 2017), burnout (Dujo López et al., 2020; González-Trijueque & Gómez, 2013; Gupta et al., 2017), job satisfaction (Simons et al., 2011), among others. The instrument’s concurrent validity was also evaluated (Simons et al., 2011; Tsuno et al., 2010).

In Brazil, these validations of the NAQ have been conducted with workers from various categories (Amazarray, 2010; Christ, 2011; Maciel & Gonçalves, 2008; Silva et al., 2017). Maciel and Gonçalves (2008) assessed its internal consistency among bank officers and professionals from various sectors, achieving a Cronbach’s alpha of 0.90. Amazarray (2010), in a study with bank officers, named a unifactorial structure, with a 45 % variance explained and a reliability of 0.94. Christ (2011) explored its application with university students, youth and adult education students, and workers from various categories, revealing four factors accounting for 58.75 % of the total variance, with reliability ranging from 0.65 to 0.87. Silva et al. (2017) found a two-factor structure for men and a single-factor structure for women among statutory servers, with variances explained of 61.3 % and 67.9 %, respectively. However, none of the Brazilian studies used confirmatory factor analysis to investigate the measure’s dimensionality, and there have been no validations with teachers.

Given the disparities in the number of NAQ factors found among Brazilian workers, the lack of studies explicitly targeting teachers, and the need for further evidence to confirm the instrument’s validity in Brazil, this study aims to examine the psychometric properties of the NAQ-R among Brazilian K12 teachers. We hypothesize that (H1) the instrument will exhibit a three- factor structure consistent with the original research (Einarsen et al., 2009) and (H2) will demonstrate convergent validity with indicators of common mental disorders, paralleling findings in the studies of Malik and Björkqvist (2019) , Inandi and Büyüközkan (2022) , Mościcka- Teske et al. (2014), and Bernotaite and Mali-nauskiene (2017) .

Method
Sample

The convenience sample included 10.148 teachers. The inclusion criteria for the sample stipulated that participants must be teachers working in public schools, ranging from Early Childhood Education to High School.

Most participants were female (81 %), aged 18 to 74 (M = 41.8; SD = 9.3). The teachers self-identified as Brown (51.2 %), White (35.5 %), Black (11.3 %), Asian (1.4 %), and Indigenous (0.7 %). The average per capita family income was R$ 2,282.8 (SD = 2,571.4). Geographically, 59.8 % worked in the Northeast, 25.2 % in the Southeast, 6.9 % in the Central-West, 5.9 % in the North, and 2.2 % in the South of Brazil.

In terms of educational background, most teachers reported having a specialization (63.9 %), a completed higher education degree (21.5 %), and a master’s degree (8.9 %). On average, they had 13.2 years of teaching experience (SD = 8.4) in public schools. Regarding the educational levels they taught, 15.7 % worked in Early Childhood Education, 39.7 % in Elementary School, 12.3 % in High School, 2.3 % in Special Education, 1.9 % in Youth and Adult Education, and 28.1 % engaged in teaching at multiple educational levels. The sample was randomly split into equal-sized groups: sample 1 for Exploratory Factor Analysis (EFA) and sample 2 for Confirmatory Factor Analysis (CFA). We detailed both samples in Table 1.

Table 1
Sociodemographic characteristics of participants

Note .a The “Magistério” is a technical secondary education program designed to train teachers in Brazil. This course prepares individuals to teach in early childhood education, elementary school, and high school.

To evaluate the cross-validation and factorial stability of the measurement, we randomly divided the sample into two groups of equal size. This method adheres to the recommendations of Laros (2005) and Schumacker and Lomax (2004) , aiming to figure out how replicable the factorial solution obtained in one dataset is within a second sample. This approach is particularly suitable when the sample size is sufficiently large to allow for the random division of respondents into two groups that are equivalent in sociodemographic characteristics. In the first of these samples, the factorial structure is derived using an exploratory factor analysis technique. In contrast, in the second sample, the cross-validation of the previously shown factorial solution is conducted using a different method, specifically confirmatory factor analysis.

Measures
Workplace Bullying

The NAQ-R measures exposure to workplace bullying over the preceding six months using a five-level response scale ranging from never to daily (Einarsen et al., 2009). The original version of NAQ-R comprises twenty-two items categorized into three factors: personal bullying (e.g., “Allegations were made against you”), work-related bullying (e.g., “You were humiliated or ridiculed because of your work”), and physically intimidating forms of bullying (e.g., “You were threatened with violence or physical abuse or were the target of actual violence”). Scores for each factor are derived by calculating the averages of their respective items.

The items on the scale do not explicitly mention “moral harassment;” instead, the assessment is based on the respondent’s self-perception of exposure to behaviors characteristic of workplace bullying (Christ, 2011). In its original study, the NAQ-R proved adequate internal consistency (α = .90).

For the Brazilian Portuguese adaptation of the NAQ-R, the translation process involved three independent translators focusing on linguistic and semantic aspects, followed by a back-translation into English. This back-translated version was compared with the original by the translators and the Norwegian authors, with discrepancies being discussed, corrected, and improved. The adapted version then underwent evaluation by five experts for relevance and cultural-semantic understanding. There was unanimous agreement on linguistic and semantic equivalence. The Brazilian Portuguese version of the NAQ-R kept the twenty-two original items and the self-perception item from the English version (Christ, 2011).

Common Mental Disorders

The Self-Reporting Questionnaire-20 (SRQ-20) is a screening tool for non-psychotic mental disorders (common mental disorders, CMDs), such as insomnia, difficulty concentrating, fatigue, headaches, and lack of appetite (e.g., “Do you easily get tired?”). This instrument includes twenty statements with binary response options of “yes” or “no.” Negative responses are scored as zero, while positive responses are scored as 1. The accumulated scores are then totaled, with a cut-off point proved at 7/8 to distinguish between the absence and presence of CMDs, respectively (Gonçalves et al., 2008). In its Brazilian validation study, the SRQ-20 proved adequate internal consistency (α = .86), a finding also seen in the current investigation (α = .96).

Procedure

The study employed an online self-administered questionnaire issued via the Internet. Informed onsent was obtained individually from all participants involved in the study.

Data Analysis

Data analysis was conducted using R (version 4.3.2) and RStudio (version 2023.12.0), incorporating various packages and metapackages, including tidyverse (version 2.0.0), tidymodels (version 1.1.1), MVN (version 5.9), psych (version 2.3.3), EFA.dimensions (version 0.1.8.1), EFAtools (version 0.4.4), lavaan (version 0.6- 17), semPlot (version 1.1.6), semptools (version 0.2.10), and semTools (version 0.5-6). Data from Sample 1 were analyzed using EFA. The process began by verifying the multivariate normality of the data through Mardia’s test. The Kaiser-Meyer- Olkin (KMO) adequacy index and Bartlett’s test of sphericity were also calculated to assess the factorability of the data matrix. Expectations were set for KMO values higher than .80 and a significant result in Bartlett’s test of sphericity (Damásio, 2012). We used parallel analysis and the Minimum Average Partial (MAP) to decide the number of factors to keep. We utilized oblimin rotation, considering the potential correlation between factors. Items with a factor loading greater than |.40| were kept.

Data from Sample 2 underwent CFA. As in Study 1, the assessment of multivariate normality of the data was conducted using Mardia’s test. Fit indices analyzed included the comparative fit index (CFI), Tucker-Lewis’s index (TLI), root mean square error of approximation (RMSEA), and standardized root mean square residual (SRMR). Expected values for CFI and TLI were greater than .90, and for RMSEA and SRMR, less than .08 (Brown, 2015). The internal consistency of the measure was evaluated using Cronbach’s alpha and McDonald’s omega. Lastly, convergent validity was assessed through Spearman’s rank correlation between the NAQ-R and the SRQ-20 factors.

Results
Exploratory Factor Analysis

Multivariate skewness and kurtosis, according to Mardia, were both significant, writing down the data’s non-normal distribution (𝛽1,p = 172685.2, p < .001; 𝛽2,p = 1109.6, p < .001). The Kaiser- Meyer-Olkin (KMO) measure was .97, and Bartlett’s test of sphericity was significant (χ2(231) = 89753.5, p < .001), affirming the data matrix’s factorability. The data’s non-normality and the variables’ ordinal nature needed using a polychoric matrix and the Weighted Least Squares Mean and Variance adjusted (WLSMV) method for extraction.

Parallel analysis and the Minimum Average Partial (MAP) suggested keeping up to five and two factors, respectively. However, models with three, four, and five dimensions lacked theoretical coherence. The two-factor structure merged fifteen items under “personal bullying” and six under “work-related bullying.” Item 1, “Someone withheld information that could affect your work performance”, did not achieve a factor loading above |.40| and was thus excluded from CFA. The two factors accounted for 61 % of the variance. The results of the exploratory factor analysis are presented in Table 2.

Table 2
Results from an exploratory factor analysis of the Negative Acts Questionnaire-Revised (NAQ -R)

Note. N = 5074. The extraction method was WLSMV with an oblique (oblimin) rotation. Factor loadings above .40 are in bold. The items’ content aligns with the Brazilian Portuguese version of the NAQ-R and may not directly correspond to the content of the original English version.

Confirmatory Factor Analysis

Mardia’s test for multivariate normality revealed a non-normal distribution of data (𝛽1,p = 161962.8, p < .001; 𝛽2,p = 1028.6, p < .001). The WLSMV method was employed again as the estimation method. The CFA of the NAQ-R showed inadequate robust fit indices (Brosseau-Liard & Savalei, 2014). Consequently, modification indices were reviewed, leading to the decision to correlate residuals of items with similar content (5 and 7; 3 and 4; 8 and 9). These correlations were added progressively to the model until the fit indices reached acceptable levels, except RMSEA (Byrne, 1994). We present the conventional, scaled, and robust fit indices in Table 3.

Table 3
Fit indices for the confirmatory factor analysis of the Negative Acts Questionnaire - Revised (NAQ-R)

Note. CFI = comparative fit index, TLI = Tucker-Lewis’s index, RMSEA = root mean square error of approximation, SRMR = standardized root mean square residual.

In the final model, all items proved factor loadings above .50 (Stevens, 2009). The standardized factor loadings are depicted in Figure 1.


Figure 1
Results from a confirmatory factor analysis of the Negative Acts Questionnaire-Revised (NAQ -R)

Internal Consistency and Convergent Validity

The reliability of the NAQ-R factors was found to be satisfactory (personal bullying: α = .93, ω = .79; work-related bullying: α = .92, ω = .74). Additionally, positive correlations between the NAQ-R factors and the SRQ-20 were seen, showing convergent validity (personal bullying: rs(10,146) = .27, p < .001; work-related bullying rs(10,146) = .33, p < .001).

Discussion

The objective of this study was to investigate the psychometric properties of the NAQ within the context of Brazilian K-12 educators, incorporating exploratory and confirmatory factor analyses alongside convergent validity. The findings showed a two-factor structure for the NAQ-R, including personal bullying and work-related bullying. The instrument proved proper fit indices, internal consistency, and convergent validity evidence with a mental health measure.

Exploratory factor analysis revealed that two underlying factors of the NAQ-R accounted for 61 % of the variance in item responses, aligning with the results of similar international studies (Abe & Henly, 2010; Verdasca, 2008). Conversely, other investigations have reported lower explained variances for the instrument’s factors in comparison to the findings of the current study (Giorgi et al., 2011; González-Trijueque & Gómez, 2013; León- Pérez et al., 2019; Makarem et al., 2018; Simons et al., 2011; Tsuno et al., 2010).

Contrasting with the original study (Einarsen et al., 2009), this investigation found that items associated with the “Physically intimidating bullying” factor were grouped under the “Personal bullying” factor. This finding does not support the H1 outlined in the study.

The amalgamation between those factors is rationalized since statements about physical intimidation are variations of personal bullying, albeit standing for more severe violence forms. This finding echoes other NAQ-R adaptations (Giorgi et al., 2011; Makarem et al., 2018; Rai & Agarwal, 2017), including studies with teachers (Charilaos et al., 2015), where similar integration of these factors was seen.

Item 1, “Someone withholding information which affects your performance at work,” did not reach a factor loading above |0.40| and was excluded from the confirmatory analysis, a result that aligns with another study where this item also received no endorsement (Abe & Henly, 2010). Given a teacher’s autonomy in classroom management and work performance, withholding information may take time to affect their work. Conversely, teachers generate student-related information, typically shared with colleagues.

In contrast to the original study (Einarsen et al., 2009), “Having key areas of responsibility removed or replaced with more trivial or unpleasant tasks” aligned with the work-related bullying factor instead of personal bullying. This item’s focus on work tasks justifies its categorization in this dimension, as corroborated by other studies (Charilaos et al., 2015; Dujo López et al., 2020; Erwandi et al., 2021; Giorgi et al., 2011; González-Trijueque & Gómez, 2013; Makarem et al., 2018; Nam et al., 2010; Takaki et al., 2010).

Also deviating from the original version of the NAQ-R (Einarsen et al., 2009), the statement “Having your opinions and viewpoints ignored” was included in the personal bullying factor. This item’s retention in this dimension is plausible as it involves devaluing personal stances, extending beyond professional opinions. Equivalent results were noted in other studies (Dujo López et al., 2020; González-Trijueque & Gómez, 2013; Makarem et al., 2018; Takaki et al., 2010).

The NAQ-R’s CFA yielded acceptable fit indices, showing that the theoretical measurement model aligns well with the empirical data (Hair et al., 2009). This outcome is consistent with earlier studies, where the two-factor structure showed suitable fit indices (Giorgi et al., 2011; Makarem et al., 2018; Rai & Agarwal, 2017). The original study posited that both unidimensional and two-factor structures showed good fit indices, though the data favored a three-factor structure (Einarsen et al., 2009). Cultural differences may account for the variations between this study, the original research, and other global instrument validations.

Finally, the NAQ-R in this study proved internal consistency measures of reliability above the desirable threshold for both factors, aligning with past research that found adequate reliability for the two-factor structure (Rai & Agarwal, 2017). The correlation between the NAQ-R factors in this study shows that the instrument’s dimensions are interrelated, supporting the use of oblique rotation methods for more nuanced interpretation. Consistent with the original NAQ-R validation study, the high correlation between the factors shows that personal and work-related bullying often co-occur in the work environment (Einarsen et al., 2009).

The NAQ-R factors positively correlated with CMDs, supporting the measure’s convergent validity. This result supports H2 of the study. Similar validity evidence has been found in other studies that correlated the NAQ-R with instruments assessing mental health (e.g., Erwandi et al., 2021; Makarem et al., 2018; Charilaos et al., 2015). Workplace bullying, encompassing victimization primarily causing psychological harm (Einarsen et al., 2009), suggests that negative behaviors like threats, humiliation, intimidations, and physical aggressions can inflict significant mental health damage. A study involving teachers (Pinheiro et al., 2023) highlighted the association between physical aggression, verbal harassment, and psychological harm. Moreover, these results align with other research exploring the impact of school violence on teacher health (Wilson et al., 2011).

Strengths and Limitations

This study faced limitations. The use of convenience sampling restricts the generalizability of the results. Nonetheless, the factorial structure aligns with earlier studies (Charilaos et al., 2015; Giorgi et al., 2011; Makarem et al., 2018; Rai & Agarwal, 2017) conducted in different contexts, suggesting the measure’s robustness.

Another limitation concerns the inherent nature of self-report scales, which do not provide causal explanations for the observed phenomena. High scores on the NAQ-R show the presence of workplace bullying but offer limited insight into the underlying reasons for this phenomenon. While helpful for screening workplace bullying, deeper understanding needs added research approaches, such as qualitative methods. The NAQ-R is a measure that can generate hypotheses and aid in intervention planning. Despite these limitations, the study employed rigorous methods appropriate to the data and conducted comprehensive analyses to show evidence of the instrument’s validity, with the substantial sample size being noteworthy.

Recommendations for Future Research and Intervention

Future research extending the psychometric analysis of the NAQ-R and exploring its properties among other Brazilian worker samples could contribute to a better understanding of workplace bullying in Brazil. It is valuable to set up evidence of convergent and predictive validity through the NAQ-R’s relationship with external measures and its use in predicting work-related psychological phenomena (e.g., mental health, burnout, engagement, job satisfaction, turnover, productivity, absenteeism).

The NAQ-R can support effective interventions, informed by the detection of workplace bullying, which could include the formulation of organizational policies against harassment, information dissemination through manuals and training, adoption of ethical leadership styles, and management reorganization. These initiatives require senior management’s support and active involvement (Glina & Soboll, 2012).

Material suplementar
Apêndices
Anexo 1

Versão em português do Negative Acts Questionnaire - Revised (NAQ-R)

Assédio moral pessoal

2 Foi humilhado(a) ou ridicularizado(a) em relação ao seu trabalho

5 Espalharam boatos ou rumores sobre você

6 Foi ignorado(a), excluído(a) ou “colocado(a) na geladeira”

7 Foram feitos comentários ofensivos sobre a sua pessoa, suas atitudes ou sobre sua vida privada

8 Gritaram com o(a) Sr(a) ou o(a) Sr(a) foi alvo de agressividade gratuita

9 Foi alvo de comportamentos intimidativos, tais como “apontar o dedo”, invasão do seu espaço pessoal, empurrões

10 Recebeu sinais ou dicas de que você deve pedir demissão ou largar o emprego (transferir-se para outra unidade)

11 Foi constantemente lembrado dos seus erros ou omissões

12 Foi ignorado ou foi recebido com uma reação hostil quando tentou uma aproximação

13 Recebeu críticas persistentes ao seu trabalho e esforço

14 Suas opiniões e pontos de vista foram ignorados

15 Pessoas com as quais você não tem intimidade lhe aplicaram “pegadinhas”

17 Foram feitas alegações contra o(a) Sr(a)

20 Foi submetido a sarcasmos ou alvo de brincadeiras excessivas

22 Foi ameaçado(a) de violência ou abuso físico ou foi alvo de violência real

Assédio moral profissional

3 Foi obrigado(a) a realizar um trabalho abaixo do seu nível de competência

4 Áreas ou tarefas de sua responsabilidade foram retiradas ou substituídas por tarefas mais desagradáveis ou mais simples

16 Foi solicitado(a) a realizar tarefas despropositadas ou com um prazo impossível de ser cumprido

18 Sofreu supervisão excessiva de seu trabalho

19 Foi pressionado a não reclamar um direito que o(a) Sr(a) tem

21 Foi exposto a uma carga de trabalho excessiva

References
Abe, K., & Henly, S. J. (2010). Bullying (ijime) among japanese hospital nurses: Modeling responses to the revised Negative Acts Questionnaire. Nursing Research, 59(2), 110-118. https://doi.org/10.1097/NNR.0b013e3181d1a709
Amazarray, M. R. (2010). Violência psicológica e assédio moral no trabalho enquanto expressões de estratégias de gestão [Psychological violence and moral harassment at work as expressions of management strategies] [Doctoral dissertation, Universidade Federal do Rio Grande do Sul]. Lume, Repositório Institucional. https://lume.ufrgs.br/handle/10183/26083
Bernotaite, L., & Malinauskiene, V. (2017). Work-place bullying and mental health among teachers in relation to psychosocial job characteristics and burnout. International Journal of Occupational Medicine and Environmental Health, 30(4), 629. https://doi.org/10.13075/ijomeh.1896.00943
Brosseau-Liard, P. E., & Savalei, V. (2014). Adjusting incremental fit indices for nonnormality. Multi-variate Behavioral Research, 49(5), 460-470. https://doi.org/10.1080/00273171.2014.933697
Brown, T. A. (2015). Confirmatory factor analysis for applied research. Guilford Publications.
Byrne, B. M. (1994). Structural equation modeling with EQS and EQS/Windows. Sage Publications.
Charilaos, K., Michael, G., Chryssa, B.-T., Panagiota, D., George, C. P., & Christina, D. (2015). Validation of the Negative Acts Questionnaire (NAQ) in a sample of Greek teachers. Psychology, 6, 63-74. http://doi.org/10.4236/psych.2015.61007
Christ, H. D. (2011). Estudo de adaptação e fidedignidade do questionário de atos negativos: revisado (QAN-R) para o português do [Adaptation and reliability study of the negative acts questionnaire - revised (NAQ-R) into Brazilian Portuguese Brasil] [Master’s thesis, Pontifícia Universidade Católica do Rio Grande do Sul]. TEDE, PUCRS. https://tede2.pucrs.br/tede2/handle/tede/772
Damásio, B. F. (2012). Uso da análise fatorial exploratória em psicologia [Uses of exploratory factorial analysis in psychology]. Avaliação Psicológica, 11(2), 213-228. http://pepsic.bv-salud.org/scielo.php?script=sci_arttext&pi-d=S1677-04712012000200007&lng=pt&nr-m=iso&tlng=pt
Dujo López, V., González Trijueque, D., Graña Gómez, J. L., & Andreu Rodríguez, J. M. (2020). A psychometric study of a Spanish version of the Negative Acts Questionnaire-Revised: Confirmatory factor analysis. Frontiers in Psychology, 11(1856), Article 1856. https://doi.org/10.3389/fpsyg.2020.01856
Einarsen, S., Raknes, B. I., & Matthiesen, S. B. (1994). Bullying and harassment at work and their relationships to work environment quality: An exploratory study. European Work and Organizational Psychologist, 4(4), 381-401. https://doi.org/10.1080/13594329408410497
Einarsen, S., & Raknes, B.I. (1997). Harassment in the workplace and the victimization of men. Violence and Victims, 12(3), article 247263. https://doi.org/10.1891/0886-6708.12.3.247
Einarsen, S., Hoel, H., Zapf, D., & Cooper, C. (2003). Bullying and emotional abuse in the workplace: International perspectives in research and practice. Taylor & Francis. https://doi.org/10.1201/9780203164662
Einarsen, S., Hoel, H., & Notelaers, G. (2009). Measuring exposure to bullying and harassment at work: Validity, factor structure and psychometric properties of the Negative Acts Questionnaire- Revised. Work & Stress, 23(1), 24-44. https://doi.org/10.1080/02678370902815673
Erwandi, D., Kadir, A., & Lestari, F. (2021). Identification of workplace bullying: Reliability and validity of Indonesian version of the Negative Acts Questionnaire-Revised (NAQ-R). International Journal of Environmental Research and Public Health, 18(8), Article 3985. https://doi.org/10.3390/ijerph18083985
Giorgi, G., Arenas, A., & Leon-Perez, J. M. (2011). An operative measure of workplace bullying: The negative acts questionnaire across Italian companies. Industrial Health, 49(6), 686-695. https://doi.org/10.2486/indhealth.MS1287
Glina, D. M. R., & Soboll, L. A. (2012). Bullying at work interventions: A literature review. Revista Brasileira de Saúde Ocupacional, 37(126), 269-283. https://doi.org/10.1590/S0303-76572012000200008
Gonçalves, D. M., Stein, A. T., & Kapczinski, F. (2008). Avaliação de desempenho do Self-Reporting Questionnaire como instrumento de rastreamento psiquiátrico: Um estudo comparativo com o Structured Clinical Interview for DSM-IV-TR [Performance of the Self-Reporting Questionnaire as a psychiatric screening questionnaire: A comparativestudy with Structured Clinical Interview for DSM-IV-TR]. Cadernos de Saúde Pública, 24(2), 380-390. https://doi.org/10.1590/S0102-311X2008000200017
González-Trijueque, D., & Gómez, J. L. G. (2013). Adaptación psicométrica de una versión española del cuestionario de conductas negativas revisado (NAQ-R) [Psychometric adaptation of a Spanish version of the negative acts questionnaire revised (NAQ-R)]. Psicopatología Clínica Legal y Forense, 13(1), 7-28. https://masterforense.com/pdf/2013/2013art1.pdf
Gupta, R., Bakhshi, A., & Einarsen, S. (2017). Investigating workplace bullying in India: Psychometric properties, validity, and cutoff scores of Negative Acts Questionnaire-Revised. SAGE Open, 7(2), 1-12. https://doi.org/10.1177/2158244017715674
Hair, J. F., Black, W. C., Babin, B. J., Anderson, R. E., & Tatham, R. L. (2009). Multivariate data analysis. A global perspective. Pearson.
Inandi, Y., & Büyüközkan, A. S. (2022). The relationship between mobbing, alienation, and burnout among teachers in Mersin, Turkey. South African Journal of Education, 42(1), Article 1990. https://doi.org/10.15700/saje.v42n1a1990
Laros, J. A. (2005). O uso de análise fatorial: Algumas diretrizes para pesquisadores [The use of factor analysis: Some guidelines for researchers]. In L. Pasquali (Eds.), Análise fatorial para pesquisadores [Factor analysis for researchers] (pp. 163-184). LabPAM.
León-Pérez, J. M., Sánchez Iglesias, I., Rodríguez Muñoz, A., & Notelaers, G. (2019). Cutoff scores for workplace bullying: The Spanish short-negative acts questionnaire (S-NAQ). Psicothema, 31(4), 482-490. https://doi.org/10.7334/psicothema2019.137
Leymann, H. (1996). The content and development of mobbing at work. European Journal of Work and Organizational Psychology, 5(2), 165-184. https://doi.org/10.1080/13594329608414853
Maciel, R. H., & Gonçalves, R. C. (2008). Pesquisando o assédio moral: A questão do método do Negative Acts Questionnaire (NAQ) para o Brasil [Researching bullying: The issue of the Negative Acts Questionnaire (NAQ) method for Brazil]. In L. A. P. Soboll (Org.). Violência psicológica e assédio moral no trabalho [Psychological violence and moral harassment in work]. Casa do Psicólogo.
Makarem, N. N., Tavitian-Elmadjian, L. R., Brome, D., Hamadeh, G. N., & Einarsen, S. (2018). Assessment of workplace bullying: Reliability and validity of an Arabic version of the Ne gative Acts Questionnaire-Revised (NAQ-R). BMJ Open, 8(12), Article e024009. https://doi.org/10.1136/bmjopen-2018-024009
Malik, N. A., & Björkqvist, K. (2019). Workplace bullying and occupational stress among university teachers: Mediating and moderating factors. Europe’s Journal of Psychology, 15(2), 240-259. https://doi.org/10.5964/ejop.v15i2.1611
Modesto, C. (2022, May 3). Em 2021, Justiça do Trabalho registrou mais de 52 mil casos de assédio moral no Brasil [In 2021, Labor Justice registered more than 52 thousand cases of moral harassment in Brazil]. Justiça do Trabalho - Tribunal Regional do Trabalho da 13ª Região. https://www.trt13.jus.br/informe-se/noticias/em-2021-justica-do-trabalho-registrou-mais-de-52-mil-casos-de-assedio-moral-no-brasil
Mościcka-Teske, A., Drabek, M., & Pyżalski, J. (2014). Experienced bullying and hostile behavior in the workplace and symptoms of burnout in teachers. Medycyna Pracy, 65(4), 535-542. https://doi.org/10.13075/mp.5893.00017
Nam, W., Kim, J. W., Kim, Y. K., Koo, J. W., & Park, C. Y. (2010). The reliability and validity of the negative acts questionnaire-revised (NAQ-R) for nurses for the assessment of workplace bullying. Korean Journal of Occupational and Environmental Medicine, 22(2), 129-139. https://doi.org/10.35371/kjoem.2010.22.2.129
Pinheiro, F. P. H. A., Aquino, C. A. B. de, Vieira, E. M., Marques, N. S., Vieira, C. A. L., Cunha, E. S., Aguiar, H. M. T., Feijão, A. R. C., & Rodrigues,H. M. P. (2023). Effects of school violence and work context on teachers’ health. Psico, 54(1), Article e37756. https://doi.org/10.15448/1980-8623.2023.1.37756
Rai, A., & Agarwal, U. A (2017), Exploring nature of workplace bullying and psychometric properties of negative acts questionnaire-revised (NAQ-R) in Indian organizations. Journal of Indian Business Research, 9(3), 229-247. https://doi.org/10.1108/JIBR-12-2016-0145
Scheeler, M. C., Markelz, A., Taylor, J. C., Deshpande, D. S., & Wolfe, P. (2022). Teacher workplace bullying: How pervasive is the problem? Teacher Education and Special Education, 45(2), 123-140. https://doi.org/10.1177/08884064211015698
Schumacker, R. E., & Lomax, R. G. (2004). A beginner’s guide to structural equation modeling. Psychology Press.
Silva, I. V., Aquino, E. M. L., & Pinto, I. C. M. (2017). Características psicométricas do Negative Acts Questionnaire para detecção do assédio moral no trabalho: Estudo avaliativo do instrumento com uma amostra de servidores estaduais da saúde [Psychometric properties of the Negative Acts Questionnaire for the detection of workplace bullying: An evaluation of the instrument with a sample of state health care Workers]. Revista Brasileira de Saúde Ocupacional, 42, 1-9. https://doi.org/10.1590/2317-6369000128715
Simons, S. R., Stark, R. B., & DeMarco, R. F. (2011). A new, four-item instrument to measure workplace bullying. Research in Nursing & Health, 34(2), 132-140. https://doi.org/10.1002/nur.20422
Stevens, J. P. (2009). Applied multivariate statistics for the social sciences. Routledge. https://doi.org/10.4324/9780203843130
Takaki, J., Tsutsumi, A., Fujii, Y., Taniguchi, T., Hirokawa, K., Hibino, Y., Lemmer, J. R., Nashiwa, H., Wang, D., & Ogino, K. (2010). Assessment of workplace bullying and harassment: Reliability and validity of a Japanese version of the negative acts questionnaire. Journal of Occupational Health, 52(1), 74-81. https://doi.org/10.1539/joh.O9011
Tsuno, K., Kawakami, N., Inoue, A., & Abe, K. (2010). Measuring workplace bullying: Reliability and validity of the Japanese version of the negative acts questionnaire. Journal of Occupational Health, 52(4), 216-226. https://doi.org/10.1539/joh.L10036
Verdasca, A. T. (2008, November 29-30). Portuguese validation of the negative acts questionnaire revised (NAQ-R) [Conference presentation]. Socius Working Papers. https://www.repository.utl.pt/bitstream/10400.5/1913/1/WP.6.2008.pdf
Wet, C., & Jacobs, L. (2021). Workplace bullying, emotional abuse, and harassment in schools. In P. D’Cruz, E. Noronha, L. Keashly & S. Tye-Williams (Eds.), Special topics and particular occupations, professions, and sectors. Handbooks of workplace bullying, emotional abuse, and harassment (pp. 187-219). Springer. https://doi.org/10.1007/978-981-10-5308-5_11
Wilson, C. M., Douglas, K. S., & Lyon, D. R. (2011). Violence against teachers: Prevalence and consequences. Journal of Interpersonal Violence, 26(12), 2353-2371. https://doi.org/10.1177/0886260510383027
Notas
Notas
To reference this article: Sá Cunha, E., Huascar, A. P. F., de Moura, A., da Rocha, J., Silva, d. W., Lima, F., Queiroz, A., & Albuquerque, L. (2024). Assessing workplace bullying: Psychometric analysis of the Negative Acts Questionnaire-Revised (NAQ-R) among brazilian teachers. Avances en Psicología Latinoamericana, 42(2), 1-16. https://doi.org/10.12804/revistas.urosario.edu.co/apl/a.14321
Funding The authors disclosed receipt of the following financial support for the research of this article: This work was supported by the Fundação Cearense de Apoio ao Desenvolvimento Científico e Tecnológico (Funcap) [grant number - BP4-0172-00166.01.00/20 and BP5-0197-00046.01.00/22] and Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq) [grant number - 403787/2023-8].
Ethical Approval The research project received approval from the Research Ethics Committee of the Universidade Estadual Vale do Acaraú under the number 39276720.5.0000.5053. This approval aligned with the guidelines outlined in 466/12 and 510/16 of the Brazilian National Health Council.
Declaração de interesses
Declaration of Conflicting Interests The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article
Autor notes

Correspondence concerning this article should be addressed to Esthela Sá Cunha, Curso de Psicologia, Faculdade 5 de Julho, Av. Estrada do Jordão, s/nº - KM 02, Ac - Jordão, Sobral - CE. E-mail: esthelasa7@gmail.com. Phone: +55(88) 98196-4199

Table 1
Sociodemographic characteristics of participants

Note .a The “Magistério” is a technical secondary education program designed to train teachers in Brazil. This course prepares individuals to teach in early childhood education, elementary school, and high school.
Table 2
Results from an exploratory factor analysis of the Negative Acts Questionnaire-Revised (NAQ -R)

Note. N = 5074. The extraction method was WLSMV with an oblique (oblimin) rotation. Factor loadings above .40 are in bold. The items’ content aligns with the Brazilian Portuguese version of the NAQ-R and may not directly correspond to the content of the original English version.
Table 3
Fit indices for the confirmatory factor analysis of the Negative Acts Questionnaire - Revised (NAQ-R)

Note. CFI = comparative fit index, TLI = Tucker-Lewis’s index, RMSEA = root mean square error of approximation, SRMR = standardized root mean square residual.

Figure 1
Results from a confirmatory factor analysis of the Negative Acts Questionnaire-Revised (NAQ -R)
Buscar:
Contexto
Descargar
Todas
Imágenes
Visualizador XML-JATS. Desarrollado por Redalyc