Articles

Factorial Structure of the Frugality Scale: Exploratory Evidence

Estrutura Fatorial da Escala de Frugalidade: Evidências Exploratórias

La Estructura Factorial de la Escala de Frugalidad: Evidencia Exploratorios

Pedro P. Pires
Universidade Federal do Rio de Janeiro, Brazil
Ana Carolina Monnerat Fioravanti Bastos
Universidade Federal Fluminense, Brazil
Érica de Lana Meirelles
Universidade Federal Fluminense, Brazil
Júlia Mulinari Peixoto
Universidade Federal do Rio de Janeiro, Brazil
Natacha de Barros Candido
Universidade do Estado do Rio de Janeiro, Brazil
Leonardo de Barros Mose
Universidade São Francisco, Brazil

Factorial Structure of the Frugality Scale: Exploratory Evidence

Psico-USF, vol. 24, no. 1, pp. 1-9, 2019

Universidade de São Francisco, Programa de Pós-Graduação Stricto Sensu em Psicologia

Received: 01 September 2017

Revised document received: 15 June 2018

Accepted: 30 July 2018

Abstract: This article aims to promote an investigation of the psychometric properties of Frugality Scale adapted to Brazilian Portuguese. Frugality is characterized by using and consuming goods in a resourceful way, fully exploring its durability as well. To this end, 626 people responded to an online form that contained the frugality scale. Procedures such as non-graphical solutions to the scree plot, exploratory graphical analysis and a Schmid-Leiman factor solution point to evidence that the scale’s structure is not one-dimensional but two-dimensional. Finally, modeling strategies also indicate that a bifactor solution can be applied.

Keywords: frugality, resources, consumption, consumer behavior, validity.

Resumo: Este artigo tem por objetivo promover uma investigação das propriedades psicométricas da Escala de Frugalidade (Lastovicka et al., 1999) adaptada para o português brasileiro. Frugalidade é caracterizada pelo controle em consumir e pelo uso pleno de recursos. Com esse objetivo, 626 pessoas responderam a um formulário on-line que continha a Escala de Frugalidade. Foram utilizados quatro procedimentos com o objetivo de investigar a estrutura da escala de frugalidade por um framework exploratório. Procedimentos como as soluções não gráficas para o scree plot, análise gráfica exploratória e a solução fatorial Schmid-Leiman apontam para a possibilidade da escala não ser unidimensional, mas bidimensional. As estratégias de modelagem da estrutura da escala apontam que um modelo bifator pode ser aplicado.

Palavras-chave: frugalidade, recursos, consumo, comportamento do consumidor, validade.

Resúmen: Este artículo tiene como objetivo promover una investigación de las propiedades psicométricas de la Escala de Frugalidad (Lastovicka et al.,1999) adaptada al portugués de Brasil. La frugalidad se caracteriza por el control en consumir y la plena utilización de los recursos. Con este objetivo, 626 personas respondieron a un formulario online que contenía la Escala de Frugalidad. Se utilizaron cuatro procedimientos con el objetivo de investigar la estructura de la Escala de Frugalidad por un framework exploratorio. Los procedimientos como las soluciones no gráficas para el scree plot, el análisis gráfico exploratorio y la solución factorial Schmid-Leiman apuntan hacia la posibilidad de que la escala no sea unidimensional, sino bidimensional. Las estrategias de modelado de la estructura de la escala señalan que un modelo bifactor puede ser aplicado.

Palabras-clave: frugalidad, recursos, consumo, comportamiento del consumidor, validez.

Since the very beginning of Brazil as an independent country in 1822, consumers thrived dealing mostly with basic needs until the later 1980’s 1990’s. Initially, the economy was structured on the exportation of raw material, which was a poor source of employment. Brazil would increase its development on services and industrial production only during the 1930’s and markedly during the 1950’s when policies were approved in order to attract multinational companies in the post-war scenario. The country ascended as an emergent economy until the year of 2001. Through all this time, and even now, frugality has been playing a major role as a value in the Brazilian society, although it does not necessarily implies going through economic hardships - frugality is a matter of choice.

Frugality alone reflects the degree to which someone is (1) restrained in acquiring and (2). Considering that, being frugal is different from “living tight” and is observed as an option throughout different economic levels. Still, there is evidence on the relationship between hardships and values on frugality. According to, economic crisis can be an important.

Pepper, Jackson & Uzzell (2009) revealed also that frugal consumer behavior is strongly related to personal materialism - the importance of ownership and acquisition of material goods as life goals. The authors comment also that although personal materialism is known to be related negatively with universalism and postmaterialism (conscious purchasing), both were not found to be related with frugal purchasing. Frugal purchasing was not related to socio-political materialism (economic growth and national defense are priorities) as well, but was negatively associated with power. In the current state of things, Pepper et al (2009) indicate that besides its importance, frugality still is not associated with ecological or social justice considerations, and so remains as a value yet to be fully developed as a moral challenge to consumerism.

For Bhatti (2012) and, frugality can be an important engine for innovation in a society, as it involves using products in a resourceful way. It is not by chance that since long, the literature of ecological values usually have dialogs with frugality. As resources tend to become increasingly scarce in the world, ingenuity related to reusing and recycling products to get the maximum of usability becomes a real interest. As frugality values need more investigation with the objective of promoting them across society, the development of measures able to detect cues are needed.

While proposing a measure for frugality, Lastovicka et al. (1999) defined it as a unidimensional consumer lifestyle trait consisting of the degree towards which consumers are both restrained in acquiring and using wisely economic goods and services, in order to achieve long-term goals. Measuring frugality can be of importance in several instances such as understanding self-control in consumer behavior (e.g. Haws, Naylor, Coulter & Bearden, 2012), the composition of worldviews (e.g. Nepomuceno & Laroche, 2014) and even in clinical problems such as compulsive shopping (e.g.). Despite the frugality scale by Lastovicka et al (1999) being largely used in the research field (e.g. Rick, Cryder & Lowenstein, 2008), we did not find until this moment a meta-analysis on its adaptation to other languages.

In Brazil, we were not able to detect the use of the measure in our bibliographic review. Using the keyword “frugalidade” in Scielo returned only three studies - Veras (2004), Ribeiro and Schramm (2004) and Carvalho and Oreiro (2007). In Google Academics, no papers were found related to psychology and the construct of frugality. The scarcity of contributions in this field can be considered problematic as data might not be available on the afore mentioned aspects pertinent to frugality and in need of further development.

According to the need of development on the study of frugality in Brazil, our initiative is to provide Brazilian Portuguese version. The main objective of this paper is to assess the scale’s structure in order to provide information on construct validity. This paper considered an investigation of dimensionality and also on the instrument’s latent structure through.

Methods

Participants

Our research design can be considered cross-sectional. The sampling technique of the current research can be characterized as convenience sampling, with subjects being recruited by students from Centro Universitário Celso Lisboa’s psychology laboratory, at Rio de Janeiro city, Brazil, and from the Universidade Federal do Rio de Janeiro (UFRJ), located in the same city. Data was collected through internet, whereas survey instruments were available starting in March 1st of 2014 and finished in July 1st of 2014. Descriptive statistics on sample characteristics are available in the results section.

Procedure

As affirmed before, this research used an online form containing: (1) a consent form explaining the objectives of our research and implications, (2) a sociodemographic form and (3) the frugality scale, through the web applet of Google Docs which enables to create online surveys. The link was posted to the web address of a blog maintained for this research’s purposes only. Prior to answering the survey, participants red and signed a consent form. The survey took about 15-20 minutes to be filled as verified in our pilot study.

Instruments

Participants answered both sociodemographic questions and the Frugality Scale. For the sociodemographic scale, participants had to report their sex, age, highest education level achieved, and income. A Brazilian Portuguese version of the Frugality Scale was elaborated by our research team according to the International Test Comission’s (2010) recommendations. The original version was extracted from the paper by Lastovicka et al. (1999). Versions on both idioms are available at Table 1. Data on the adaptation and translation process will be available on future publications.

Table 1
Item translations from English to Brazilian Portuguese
Item translations from English to Brazilian Portuguese

Participants were instructed to read each item and answer based on how much they agree/disagree that the item reflects their usual behavior at the present. Each item should be judged separately. Responses were in the form of a rating scale from one to six, where the minimal category represented “completely disagree”, while the opposite represented “completely agree”. The rating scale was kept in the same way as the original scale, as an even number of options. This strategy can be considered a strength of the instrument as it prevents against the tendency of central responses.

Statistical analysis

All of the statistical analysis was computed through R v3.3.2 (R Core Team, 2016). Data Analysis had three main objectives: (1) evidence on dimensionality and (2) modeling structure. First, dimensionality was assessed through the package nFactors (Raiche & Magis, 2015), which computes regular eigenvalues, parallel analysis, optimal coordinates and acceleration factor. Dimensionality was determined through parallel analysis considering the amount of factors to be retained by the method. Further investigation on dimensionality and structure in an exploratory framework was conducted using the packages Exploratory Graphical Analysis (EGA, Golino, 2017) and psych (Revelle, 2017). EGA represents a perspective where items are nodes in a network while they can be grouped according to their connections, those groups could be also representative of possible latent variables. Psyche package allows for the use of the omega command, which tests for the general factor saturation of a test for a given structure. The data set then is tested through factor analysis, factors are rotated obliquely and a Schmid Leiman transformation is performed, so that omega can be estimated.

Modeling the frugality scale’s structure was conducted using the package lavaan (Rosseel, 2012). Structures were tested using Mean and Variance-adjusted Weighted Least Square (WLSMV). Selected fit indexes were robust X2, CFI (fit is indicated by values close to 1.00), TLI (same as prior index), RMSEA (error of approximation is acceptable for values below .08) and SRMR (same as prior error of approximation index). This paper followed guidelines for interpreting fit indexes suggested by Brown (2015).

Results

Final sample did not need removal of any subjects due to missing data. A total of 626 participants answered our online form. From the total, 402 (64,2%) are female, 223 (35,6%) male, with an age of M=34,96 (DP =13,18). Considering location, 85,7% of the participants were from Rio de Janeiro city. Results for dimensionality assessment were obtained from the package nFactors by plotting the non-graphical solutions to scree test. Kaiser criteria, parallel analysis and optimal coordinates resulted in a two factors solution, whereas acceleration factor resulted in a single factor solution. Solution is available at figure 1.

Dimensionality assessment’s plot including Kaiser criteria (eigenvalues), parallel analysis, optimal coordinates and acceleration factor
Figure 1
Dimensionality assessment’s plot including Kaiser criteria (eigenvalues), parallel analysis, optimal coordinates and acceleration factor

Considering the results problematic considering the original paper’s structural factor, dimensionality was also assessed considering an Exploratory Graphical Analysis (EGA), which also resulted in a two-factors solution, where items 1 to 4 were correlated in a first dimension, while items 5 to 8 loaded in the second dimension. Considering listed items, the first dimension seems to be related to values on the management of resources, while the second dimension has items related to the management of financial resources. The robust solution for the resulted structure achieved a fit of X2(19)=61,15, CFI=0,99, RMSEA=0,036, GFI=1,00, NFI=0,97. As the chi-square test resulted significant, statistical fit still indicates there’s room for improvement in the model. Solution for the EGA is available in figure 2.

Exploratory graphical analysis’ solution for the Frugality Scale
Figure 2
Exploratory graphical analysis’ solution for the Frugality Scale

Considering aspects that could be related to a bifactor solution, command omega was executed considering a two-factors solution. That resulted in an alpha coefficient of 0,73 and an omega total of 0,79. Factor loadings in the Schmid Leiman solution were all significant and above 0,20 for the general factor, while just item 2 resulted in a factor loading below 0,30 on that factor. Factor 1, which included items from 5 to 6 had factor loadings above 0,50, while factor 2 has only item 4 with a weak factor loading of 0,23, with the others achieving loadings above 0,30. Structure and factor loadings are available at figure 3.

From the results obtained through the omega command it is possible to include in the the possibility of a bifactor structure. Among possible solutions we tested for a two-factors oblique solution, a second-order solution with two factors and a bifactor structure. An orthogonal solution was also tested just for comparison. Obtained fit results are available in Table 2

Table 2
Fit indexes by type of structure
Fit indexes by type of structure

Among the obtained solutions, all of the proposed models achieve better fit when compared to the baseline model. The orthogonal structure performed the worse when compared to other modeled structures. A second order factor structure failed converging a solution, while the oblique and bifactor solution performed close comparing other fit indexes than chi-square, where the bifactor model achieved the best performance.

Structure resulted from the omega command for a two-factor solution
Figure 3
Structure resulted from the omega command for a two-factor solution

Considering the bifactor solution, there remains a significant chi-square fit and through the items, item 4 did not achieve a significant factor loading on its factor, which was expected as it obtained a low factor loading on the Schmid Leiman solution, while still loading significant at the general factor. After keeping only the factor loading from item 4 into the general factor, a high dependence between item 7 and 8 was detected in the modification indices output. After applying the two mentioned modifications, the model achieved a fit of X2(12)=12.09, p=0.439, CFI=1.00, TLI=1.00, RMSEA=0.003 and SRMR=0.016. Factor loadings for each item and factor is available at table 3.

Table 3
Factor loadings for items and its corresponding dimensions, standard error (S.E.), Z and p-value
Factor loadings for items and its corresponding dimensions, standard error (S.E.), Z and p-value

Discussion

The frugality scale has been used extensively as a unidimensional measure since its proposal by Lastovicka et al (1999). Our results represent the value in a Brazilian sample and items were expected to vary considering that across different countries relationship between people and their possessions might vary due to the economic or political moment (Hampson & McGoldrick, 2013).

Different from the original structure, in Brazil the frugality scale seems to be organized through two primary order factors, which can be named as “resource management” and “financial management”, while all of the items also loaded in a general factor. The general factor might represent frugality itself. It is reasonable to think that behaviors related to being conservative with money or possessions might not necessarily be related only to wisely managing resources to its fullest as Lastovicka et al (1999) defines the construct. Some of the listed behaviors and attitudes could also be motivated by buying intentions activated by a desired good or even by economic crisis forcing people to act frugal. That configuration is better represented by a bifactor solution, where a general independent factor accounts for part of the variance of items, while other items can vary also due to other independent primary factors.

Considering the implications for the usage of the scale in Brazil, it is still safe to score the scale with a single score summing the set of items. Still, it is important to take under consideration that one might be actually looking at variance being explained not only by frugality, but by other activated values. It is important to mention as well that the frugality scale is a very brief measure and there’s a risk of underrepresentation issues. Less items also mean less portions of the latent trait being represented. To investigate more thoroughly frugality as a latent trait, we recommend the development of a longer form, with a more varied set of behaviors and attitudes.

Another point is that the scale was applied during the risk of economic recession being communicated through media on the mid 2014. One hypothesis to test in the future could be if the current warning of an incoming economic crisis induced sample respondents to a higher activation of financial-related attitudes and behaviors in a way other than caused by frugality. That way our current sample could be used as a prior for future investigations using the frugality scale.

A major weakness of our research is that we did not use other frugality measures, which could bring more information on the functioning of the other underlying dimensions of the scale that we were able to detect in the current study. Still, in our bibliographic research it was noticeable that frugality measures are scarce or miss a more thoroughly investigation of psychometric qualities. A second weakness is our research design that followed a cross-sectional design, where understanding frugality’s stability through time could also elucidate another psychometric information related to test-retest stability or even comparing the factor structure across time.

References

Bhatti, Y. A. (2012). What is frugal, what is innovation? Towards a theory of frugal innovation. SSRN. doi: 10.2139/ssrn.2005910

Brown, T. A.. (2015). Confirmatory Factor Analysis for Applied Research. New York, NY: Guilford Press.

Caldeira, J. (2017). História da Riqueza no Brasil: Cinco Séculos de Pessoas, Costumes e Governos. São Paulo, SP: Estação Brasil.

Carvalho, L. D. d., & Oreiro, J. L. (2007). A dinâmica da taxa de lucro, da taxa de juros e do grau de utilização da capacidade produtiva em um modelo pós-keynesiano. Estudos Econômicos (São Paulo), 37(4), 903-936. doi: 10.1590/S0101-41612007000400008

Farooq, R. (2017). A conceptual model of frugal innovation: is environmental munificence a missing link?. International Journal of Innovation Science, 9(4), 320-334. doi: 10.1108/IJIS-08-2017-0076

IBGE. (2010). Censo 2010. Retrieved from http://censo2010.ibge.gov.br/

Goldsmith, R. E., Flynn, L. R., & Clark, R. A. (2014). The etiology of the frugal consumer. Journal of Retailing and Consumer Services, 21(2), 175-184. doi: 10.1016/j.jretconser.2013.11.005

Goldsmith, R. E., Flynn, L. R., & Goldsmith, E. B. (2015). Consumer characteristics associated with compulsive buying. Journal of Multidisciplinary Research, 7(3), 21. Retrieved from: https://search.proquest.com/openview/42a311206b6573267c54ced9a689421a/1?pq-origsite=gscholar&cbl=287912

Golino, H., & Epskamp, S. (2017). Exploratory graph analysis: a new approach for estimating the number of dimensions in psychological research. PLoS ONE 12(6): e0174035. doi: 10.1371/journal.pone.0174035

Hampson, D. P., & McGoldrick, P. J. (2013). A typology of adaptive shopping patterns in recession. Journal of Business Research, 66(7), 831-838. doi: 10.1016/j.jbusres.2011.06.008

Harris, C. R., Jenkins, M., & Glaser, D. (2006). Gender differences in risk assessment: why do women take fewer risks than men? Judgment and Decision Making, 1(1), 48. Retrieved from: https://search.proquest.com/openview/49cd8d879e42d32c98cbb0ae124ff738/1?pq-origsite=gscholar&cbl=6196407

Haws, K., Reczek, R. W., Coulter, R. A., & Bearden, W. O. (2012). Keeping it all without being buried alive: Understanding product retention tendency. Journal of Consumer Psychology, 22, 224-236. doi: 10.1016/j.jcps.2011.05.003

Kasser, T. (2005). Frugality, generosity, and materialism in children and adolescents What Do Children Need to Flourish? (pp. 357-373): Springer. doi: 10.1007/0-387-23823-9_22

Ladeira, W. J., Santini, F. D. O., & Sampaio, C. H. (2018). Food Package Familiarity and Perceived Amount of Verbal Information: The Moderating Effect of Frugal Behavior. Journal of International Food & Agribusiness Marketing, 1-20. doi: 10.1080/08974438.2018.1426072

Lastovicka, J. L., Bettencourt, L. A., Hughner, R. S., & Kuntze, R. J. (1999). Lifestyle of the tight and frugal: Theory and measurement. Journal of consumer research, 26(1), 85-98. doi: 10.1086/209552

LI, L., & HUANG, X. (2014). Frugality: A Perspective of Psychology. Advances in Psychological Science, 22(1), 181-189. Retrieved from: http://journal.psych.ac.cn/xlkxjz/EN/abstract/abstract3022.shtml

Mitchell, J. E., Burgard, M., Faber, R., Crosby, R. D., & de Zwaan, M. (2006). Cognitive behavioral therapy for compulsive buying disorder. Behaviour research and therapy, 44(12), 1859-1865. doi: 10.1016/j.brat.2005.12.009

Nepomuceno, M. V., & Laroche, M. (2015). The impact of materialism and anti-consumption lifestyles on personal debt and account balances. Journal of Business Research, 68(3), 654-664. doi: 10.1016/j.jbusres.2014.08.006

Pepper, M., Jackson, T., & Uzzell, D. (2009). An examination of the values that motivate socially conscious and frugal consumer behaviours. International Journal of Consumer Studies, 33(2), 126-136. doi: 10.1111/j.1470-6431.2009.00753.x

R Core Team. (2016). R: A Language and Environment for Statistical Computing (Version 3.3.1). Vienna, Austria: R Foundation for Statistical Computing.

Raiche, G., & Magis, D. (2010). nFactors: an R package for parallel analysis and non graphical solutions to the Cattell scree test. R package version, 2(3). Retrieved from: https://cran.r-project.org/web/packages/nFactors/nFactors.pdf

Revelle, W. (2017). Procedures for Psychological, Psychometric, and Personality Research (Version 1.6.9): CRAN. Retrieved from: https://personality-project.org/r/psych-manual.pdf

Ribeiro, C. D. M., & Schramm, F. R. (2004). A necessária frugalidade dos idosos[The necessary frugality of the elderly]. Cad. Saúde Pública, 20(5), 1141-1159. Retrieved from: https://www.scielosp.org/article/csp/2004.v20n5/1141-1148/

Rick, S. I., Cryder, C. E., & Loewenstein, G. (2008). Tightwads and spendthrifts. Journal of consumer research, 34(6), 767-782. doi: 10.1086/523285

Rosseel, Y. (2012). Lavaan: An R package for structural equation modeling and more. Version 0.5-12 (BETA). Journal of statistical software, 48(2), 1-36. Retrieved from: http:// http://users.ugent.be/~yrosseel/lavaan/lavaanIntroduction.pdf

Sapienza, P., Zingales, L., & Maestripieri, D. (2009). Gender differences in financial risk aversion and career choices are affected by testosterone. Proceedings of the National Academy of Sciences, 106(36), 15268-15273. doi: 10.1073/pnas.0907352106

Sapienza, P., Zingales, L., & Maestripieri, D. (2009). Gender differences in financial risk aversion and career choices are affected by testosterone. Proceedings of the National Academy of Sciences, 106(36), 15268-15273. doi: 10.1073/pnas.0907352106

Veras, R. (2004). A frugalidade necessária: modelos mais contemporâneos. Cadernos de Saúde Pública, 20(5), 1152-1154. Retreived from: https://www.scielosp.org/scielo.php?pid=S0102-311X2004000500005&script=sci_arttext

Wergin, R. E. (2009). The frugal and the environmentally concerned: who are they, what do they do, and how do you influence them?, Oklahoma State University.

Pepper, M., Jackson, T., & Uzzell, D. (2009). An examination of the values that motivate socially conscious and frugal consumer behaviours. International Journal of Consumer Studies, 33(2), 126-136. Retrieved from: https://search.proquest.com/openview/5e9911b6d9e4346c60ed6c4ba372e30e/1?pq-origsite=gscholar&cbl=18750&diss=y

Author notes

Sobre os autores: Pedro P. Pires, PhD in Psychology at the Graduate Program in Psychology at the Universidade Federal do Rio de Janeiro, with Doctoral Stay at the University of Maryland - School of Public Health. Professor at Universidade Federal do Rio de Janeiro, researches topics in the elaboration and adaption of instruments applied to the context of organizational and consumer psychology. ORCID: 0000-0001-8831-9056 E-mail: ppires85@gmail.com
Ana Carolina Monnerat Fioravanti Bastos, Psychologist from Universidade Federal Fluminense (2002). Holds masters (2006) and PhD (2011) degrees in Psychology from the Clinical and Neurosciences Department of Psychology at PUC-Rio. Professor at the Institute of Psychology UFF. Collaborator Professor at the Graduate Program in Social Psychology at UERJ. Interests include psychometrics and psychological assessment, with emphasis on the validation of assessment instruments in Psychology. ORCID: 0000-0003-2340-4043 E-mail: ana@fioravantiana.org
Érica de Lana Meirelles, Psychologist (UERJ), holds a PhD degree in Neuropsychology (SCMRJ), masters in Clinical and Neurosciences Psychology (PUC-Rio), and PhD in Sciences (ICBBF/UFRJ and EPFL, Switzerland). Visiting professor of the Lato Sensu Graduate Courses in CTT at the WP Institute and the InTCC, in Neuropsychology at Censupeg and UNESA, and in Neurosciences at IPUB/UFRJ. Professor of the Department of Psychology at Universidade Federal Fluminense Volta Redonda (PUVR). ORCID: 0000-0003-1431-6228 E-mail: delanna.uff@gmail.com
Júlia Mulinari Peixoto, Master’s student at the Graduate Program in Psychology at Universidade Federal do Rio de Janeiro - UFRJ. Holds a degree in Psychology from Universidade Federal Fluminense - UFF (2017). Currently conducts research in Organizational and Work Psychology. From a clinical perspective, works in Cognitive-Behavioral Therapy. Interests include Social Work and Organizational Psychology and Gender Issues. ORCID: 0000-0002-6189-5501 E-mail: juliamulinari@id.uff.br
Natacha de Barros Candido, Master’s student at the Graduate Program in Social Psychology at Universidade Estadual do Rio de Janeiro - UERJ. Holds a degree in Psychology from Universidade Federal Fluminense - UFF (2017). Currently conducts research in Organizational and Work Psychology, with emphasis on issues related to suicide in the Work context. ORCID: 0000-0002-6189-5501 E-mail: natachabarros@id.uff.br
Leonardo de Barros Mose, Master’s student at the Graduate Program in Psychology at Universidade São Francisco - USF. Conducts research in Organizational and Work Psychology, with emphasis on Quality of Life at Work. Interests include research lines on Quality of Life at Work and, also in Construction, Validation and Standardization of Measurement Instruments. Has experience in Psychological Assessment and Cognitive-Behavioral Therapy. ORCID: 0000-0002-5328-7442 E-mail: leonardo.mose@hotmail.com

Contato com os autores: Institute of Psychology, Graduate Program in Psychology Av. Pasteur, 250, Urca Rio de Janeiro-RJ, Brasil CEP: 22290-240

HTML generated from XML JATS4R by