Construct Validity and Reliability of the Scale of Attitudes towards External Assessments Applied on a Large Scale
DOI:
https://doi.org/10.1590/Abstract
The Scale of Attitudes towards External Assessments applied on a Large-Scale was developed to capture what basic education teachers think, feel, and how they behave in response to this type of assessment. Considering the potential of the instrument to support management decisions in the field of educational assessment policies, this article aimed to evaluate construct validity, via factor analysis, as well as scale reliability, via composite reliability of the scale, based on its application to a sample of teachers affiliated with the Education Department of Espírito Santo/Brazil. This is a quantitative, nonexperimental, instrumental study that involved 405 teachers from the public school network, whose results indicate adequate psychometric indices and a satisfactory factor structure consistent with the proposed three-dimensional attitude construct. The statistical coefficients found at the level of the analyses performed legitimize its use for the development of public policies and effective practices in the educational field.
Downloads
References
Ajzen, I., & Fishbein, M. (1980). Understanding attitudes and predicting social behavior. Prentice-Hall.
Allport, G. W. (1935). Attitudes. In C. Murchison (Ed.), A handbook of social psychology (pp. 798-844). Clark University Press.
Ankiewicz, P. (2019). Alignment of the traditional approach to perceptions and attitudes with Mitcham’s philosophical framework of technology. International Journal of Technology and Design Education, 29, 329-340. https://doi.org/10.1007/s10798-018-9443-6
» https://doi.org/10.1007/s10798-018-9443-6
Baidoo-Anu, D., & Ennu Baidoo, I. (2022). Performance-based accountability: Exploring Ghanaian teachers perception of the influence of large-scale testing on teaching and learning. Education Inquiry. Advance online publication. https://doi.org/10.1080/20004508.2022.2110673
» https://doi.org/10.1080/20004508.2022.2110673
Carretero-Dios, H., & Pérez, C. (2007). Standards for the development and review of instrumental studies: Considerations about test selection in psychological research. International Journal of Clinical and Health Psychology, 7(3), 863-882. https://www.redalyc.org/pdf/337/33770319.pdf
» https://www.redalyc.org/pdf/337/33770319.pdf
Costa, A. G., Vidal, E. M., & Vieira, S. L. (2019). Avaliação em larga escala no Brasil: Entre a coordenação federativa e o ethos do Estado-avaliador [Large-scale evaluation in Brazil: Between federative coordination and the ethos of the evaluative State]. Revista Educação em Questão, 57(51), 1-29. https://doi.org/10.21680/1981-1802.2019v57n51ID15806
» https://doi.org/10.21680/1981-1802.2019v57n51ID15806
Eagly, A. H., & Chaiken, S. (1993). The psychology of attitudes. Harcourt, Brace, & Jovanovich.
Epskamp, S., & Fried, E. I. (2018). A tutorial on regularized partial correlation networks. Psychological Methods, 23(4), 617-634. https://doi.org/10.1037/met0000167
» https://doi.org/10.1037/met0000167
Falabella, A. (2021). The seduction of hyper-surveillance: Standards, testing, and accountability. Educational Administration Quarterly, 57(1), 113-142. https://doi.org/10.1177/0013161X20912299
» https://doi.org/10.1177/0013161X20912299
Hair, J. F. Jr., Hult, G. T. M., Ringle, C. M., Sarstedt, M., Danks, N. P., & Ray, S. (2021). An introduction to structural equation modeling. In J. F. Hair Jr., G. T. M. Hult, C. M. Ringle, M. Sarstedt, N. P. Danks, & S. Ray, Partial least squares structural equation modeling (PLS-SEM) using R: A workbook (pp. 1-29). Springer.
Lei Complementar No. 504. (2009, 23 de novembro). Institui a Bonificação por Desempenho, no âmbito da Secretaria de Estado da Educação-SEDU, e dá outras providências. Diário Oficial dos Poderes do Estado (p. 1). https://www3.al.es.gov.br/Arquivo/Documents/legislacao/html/LEC5042009.html?identificador=320036003500310032003A004C00
Mazana, M. Y., Montero, C. S., & Casmir, R. O. (2019). Investigating Students’ Attitude towards Learning Mathematics. International Electronic Journal of Mathematics Education, 14(1), 207-231. https://doi.org/10.29333/iejme/3997
» https://doi.org/10.29333/iejme/3997
Parcerisa, L., Verger, A., Pagès, M., & Browes, N. (2022). Teacher autonomy in the age of performance-based accountability: A review based on teaching profession regulatory models (2017-2020). Education Policy Analysis Archives, 30(100), 1-29. https://doi.org/10.14507/epaa.30.6204
» https://doi.org/10.14507/epaa.30.6204
Reckase, M. D. (1985). The difficulty of test items that measure more than one ability. Applied Psychological Measurement, 9(4), 401-412. https://doi.org/10.1177/014662168500900
» https://doi.org/10.1177/014662168500900
Rosenberg, M. J., & Hovland, C. I. (1960). Cognitive, affective and behavioral components of attitudes. In M. J. Rosenberg, C. I. Hovland, W. J. McGuire, R. P. Abelson, & J. W. Brehm (Eds.), Attitude organization and change: An analysis of consistency among attitude components (pp. 1-14). Yale University Press.
Secretaria de Estado da Educação do Espírito Santo. (2009, 17 de novembro). Portaria SEDU nº 143-R. Estabelece Diretrizes para a Organização Curricular nas Escolas Estaduais para o Ano Letivo 2010 [SEDU Ordinance No. 143-R. Establishes Guidelines for Curricular Organization in State Schools for the 2010 Academic Year]. https://www.legisweb.com.br/legislacao/?id=126933
» https://www.legisweb.com.br/legislacao/?id=126933
Soares, D. J. M., Soares, T. E. A., & Santos, W. (2022a). Evidências de validade de conteúdo da escala de atitudes frente às avaliações externas aplicadas em larga escala-EAAE [Evidence of content validity of the scale of attitudes towards external assessments applied on a large scale (EAAE)]. Revista Ibero-Americana de Estudos em Educação, 17(3), 1806-1818. https://doi.org/10.21723/riaee.v17i3.16191
» https://doi.org/10.21723/riaee.v17i3.16191
Soares, D. J. M., Soares, T. E. A., & Santos, W. (2022b). Análise do indicador de desenvolvimento das escolas estaduais do Espírito Santo [Analysis of the development indicator in Espírito Santo state schools]. Educação & Sociedade, 43(1), e256722. https://doi.org/10.1590/ES.256722
» https://doi.org/10.1590/ES.256722
Svenningsson, J., Höst, G., Hultén, M., & Hallström, J. (2022). Students’ attitudes toward technology: Exploring the relationship among affective, cognitive and behavioral components of the attitude construct. International Journal of Technology and Design Education , 32, 1531-1551. https://doi.org/10.1007/s10798-021-09657-7
» https://doi.org/10.1007/s10798-021-09657-7
Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariate statistics (5th ed.). Allyn & Bacon.
Thomas, W. I., & Znaniecki, F. (1919). The Polish peasant in Europe and America: Monograph of an immigrant group (Vol. 3). University of Chicago Press.
Timmerman, M. E., & Lorenzo-Seva, U. (2011). Dimensionality assessment of ordered polytomous items with parallel analysis. Psychological Methods , 16(2), 209-220. https://doi.org/10.1037/a0023353
» https://doi.org/10.1037/a0023353
Wu, A. D., & Zumbo, B. D. (2017). Using Pratt’s importance measures in confirmatory factor analyses. Journal of Modern Applied Statistical Methods, 16(2), 81-98. https://doi.org/10.22237/jmasm/1509494700
» https://doi.org/10.22237/jmasm/1509494700
Yahya, A. H., & Sukmayadi, V. (2020). A review of cognitive dissonance theory and its relevance to current social issues. MIMBAR: Jurnal Sosial Dan Pembangunan, 36(2), 480-488. https://doi.org/10.29313/mimbar.v36i2.6652
Published
Issue
Section
License
Copyright (c) 2025 Paidéia (Ribeirão Preto)
This work is licensed under a Creative Commons Attribution 4.0 International License.
Regarding the availability of contents, Paideia adopts the Creative Commons License, CC-BY. With this licence anyone is allowed to copy and redistribute the material in any medium or format, as well as to remix, transform, and create from the material for any purpose, even commercial, giving the proper copyright credits to the journal, providing a link to the licence and indicating if changes have been made.
Partial reproduction of other publications
Quotations of more than 500 words, reproductions of one or more figures, tables or other illustrations must have written permission from the copyright holder of the original work for the reproduction specified in the Paidéia journal. Permission should be addressed to the author of the submitted manuscript. Secondarily obtained rights will not be transferred under any circumstance.
