Brazilian Scale for Evaluation of MentalHealth Care Needs: Additional Evidence
DOI:
https://doi.org/10.11606/s1518-8787.2023057005347Keywords:
Mental Health, Primary Health Care, Population Health ManagementAbstract
OBJECTIVE: To investigate validity evidence of the Brazilian Scale for Evaluation of Mental Health Care Needs (CuidaSM).
METHODS: This is a psychometric study, which seeks additional evidence of internal structure. Data collection was carried out in 11 Primary Health Care (PHC) services , which implement the Health Care Planning (HCP) methodology, distributed across the five Brazilian regions. The preliminary version of CuidaSM, containing a block self-referred by the user and another block
evaluated by PHC professionals, was applied to users aged 18 or over who attended the PHC services for consultation with a higher education professional. The techniques of confirmatory factor analysis and network analysis were used to investigate validity evidence. For the primary data of the confirmatory factor analysis, the factorial loads and the item’s predictive power (R2)
were used. Six model adjustment indices were adopted and reliability was measured by three indicators using Bayesian estimation.
RESULTS: A total of 879 users participated in the study. By confirmatory factor analysis, factorial loads ranged from 0.43 to 0.99 and R2 from 0.19 to 0.98. Both the primary indicators and the model adequacy indices were established at satisfactory and consistent levels. The network analysis showed that the items were appropriately associated with their peers, respecting the established dimensions, which again indicates the sustainability and stability of the proposed model.
CONCLUSIONS: The study findings confirm a consistent and reliable model of the instrument, through a combination of techniques. Considering the importance of using solid instruments in clinical practice, CuidaSM is a promising tool for population-based management and network care organization, aligned with HCP proposals.
References
Conselho Nacional de Secretários de Saúde. Planificação da Atenção à Saúde: um instrumento de gestão e organização da Atenção Primária à Saúde e da Atenção Ambulatorial Especializada nas Redes de Atenção à Saúde. Brasília, DF: Conselho Nacional de Secretários de Saúde; 2018 [citado 10 jan 2023]. Disponível em: https://www.conass.org.br/biblioteca/caderno-conass-documenta-n-31/
Mendes EV. As redes de atenção à saúde. Brasília, DF: Organização Pan-Americana da Saúde; 2011 [citado 10 jan 2023]. Disponível em: https://www.paho.org/bra/dmdocuments/Redes_Atencao_Saude_Eugenio_2ed.PDF
Alonso J, Liu Z, Evans-Lacko S, Sadikova E, Sampson N, Chatterji S, et al. Treatment gap for anxiety disorders is global: results of the World Mental Health surveys in 21 countries. Depress Anxiety. 2018 Ma;35(3):195-208. https://doi.org/10.1002/da.22711.
Thornicroft G, Chatterji S, Evans-Lacko S, Gruber M, Sampson N, Aguilar-Gaxiola S, et al. Undertreatment of people with major depressive disorder in 21 countries. Br J Psychiatry. 2017 Feb;210(2):119-24. https://doi.org/10.1192/bjp.bp.116.188078
Barros S, Nóbrega MD, Santos JC, Fonseca LM, Floriano LS. Mental health in primary health care: health-disease according to health professionals. Rev Bras Enferm. 2019 Oct;72(6):1609-17. https://doi.org/10.1590/0034-7167-2018-0743
Ayano G. Significance of mental health legislation for successful primary care for mental health and community mental health servisse: a review. Afr J Prim Health Care Fam Med. 2018 Mar;10(1):e1-4. https://doi.org/10.4102/phcfm.v10i1.1429
Gama CA, Lourenço RF, Coelho VA, Campos CG, Guimarães DA. Os profissionais da Atenção Primária à Saúde diante das demandas de Saúde Mental: perspectivas e desafios. Interface (Botucatu). 2021;25. https://doi.org/10.1590/interface.200438
Ministério da Saúde (BR). Linhas de cuidado. Brasilia, DF: Secretaria de Atenção Primária à Saúde; 2023 [citado 10 jan 2023]. Disponível em: https://linhasdecuidado.saude.gov.br/portal/todas-linhas
Mendonça JM, Sousa AA, Eshriqui I, Rebustini F, Bonfim D, Zorzi DS, et al. Brazilian Scale for Evaluation of Mental Health Care Needs: development and evidence of validity. Research Square; 2023 [citado 11 jan 2023]. Disponível em: https://doi.org/10.21203/rs.3.rs-2450855/v1
American Educational Research Association, American Psychological Association, National Council on Measurement in Education. Joint Committee on Standards for Educational and Psychological Testing (U.S.). The standards for educational and psychological testing. Washington, DC: American Psychological Association; 2014.
Hu Z, Lin L, Wang Y, Li J. The integration of classical testing theory and item response theory. Psychology (Irvine). 2021;12(9):1397-409. https://doi.org/10.4236/psych.2021.129088
Schlechter P, Wilkinson PO, Knausenberger J, Wanninger K, Kamp S, Morina N, et al. Depressive and anxiety symptoms in refugees: insights from classical test theory, item response theory and network analysis. Clin Psychol Psychother. 2021 Jan;28(1):169-81. https://doi.org/10.1002/cpp.2499
Raykov T, Marcoulides GA. On the relationship between classical test theory and item response theory. Educ Psychol Meas. 2015 Apr;76(2):325-38. https://doi.org/10.1177/0013164415576958
Crobach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16(3):297-334. https://doi.org/10.1007/BF02310555
Woodhouse B, Jackson PH. Lower bounds for the reliability of the total score on a test composed of non-homogeneous items: II: a search procedure to locate the greatest lower bound. Psychometrika. 1977;42(4):579-91. https://doi.org/10.1007/BF02295980
McDonald RP. Test theory: a unified treatment. New York: Psychology Press; 2013.
Pfadt JM, Bergh DV, Sijtsma K, Wagenmakers EJ. A tutorial on Bayesian single-test reliability analysis with JASP. Behav Res Methods. 2022;55(3):1069-78. https://doi.org/10.3758/s13428-021-01778-0
Mullarkey MC, Marchetti I, Beevers CG. Using network analysis to identify central symptoms of adolescent depression. J Clin Child Adolesc Psychol. 2019;48(4):656-68. https://doi.org/10.1080/15374416.2018.1437735
Epskamp S, Borsboom D, Fried EI. Estimating psychological networks and their accuracy: a tutorial paper. Behav Res. 2017;50(1):195-212. https://doi.org/10.3758/s13428-017-0862-1
Contreras A, Nieto I, Valiente C, Espinosa R, Vazquez C. The study of psychopathology from the network analysis perspective: a systematic review. Psychother Psychosom. 2019;88(2):71-83. https://doi.org/10.1159/000497425
Liang Y, Li F, Zhou Y, Liu Z. Evolution of the network pattern of posttraumatic stress symptoms among children and adolescents exposed to a disaster. J Anxiety Disord. 2021 Jan;77:102330. https://doi.org/10.1016/j.janxdis.2020.102330
Yuan GF, Shi W, Elhai JD, Montag C, Chang K, Jackson T, et al. Gaming to cope: applying network analysis to understand the relationship between post-traumatic stress symptoms and internet gaming disorder symptoms among disaster-exposed Chinese young adults. Addict Behav. 2022;124:107096. https://doi.org/10.1016/j.addbeh.2021.107096
Fonseca-Pedrero E, Ortuño J, Debbané M, Chan RC, Cicero D, Zhang LC, et al. The network structure of schizotypal personality traits. Schizophr Bull. 2018 Oct;44(2 suppl_2):S468-79. https://doi.org/10.1093/schbul/sby044
Haws JK, Brockdorf AN, Gratz KL, Messman TL, Tull MT, DiLillo D. Examining the associations between PTSD symptoms and aspects of emotion dysregulation through network analysis. J Anxiety Disord. 2022 Mar;86:102536. https://doi.org/10.1016/j.janxdis.2022.102536
Borsboom D. Possible futures for network psychometrics. Psychometrika. 2022 Mar;87(1):253-65. https://doi.org/10.1007/s11336-022-09851-z
Marsman M, Rhemtulla M. Guest editors’ Introduction to the special issue “network psychometrics in action”: methodological innovations inspired by empirical problems. Psychometrika. 2022 Mar;87(1):1-11. https://doi.org/10.1007/s11336-022-09861-x
Marsman M, Borsboom D, Kruis J, Epskamp S, Bork R, Waldorp LJ, et al. An introduction to network psychometrics: relating ising network models to item response theory models. Multivariate Behav Res. 2017 Nov 7;53(1):15-35. https://doi.org/10.1080/00273171.2017.1379379
Costantini G, Richetin J, Preti E, Casini E, Epskamp S, Perugine M. Stability and variability of personality networks: a tutorial on recent developments in network psychometrics. Pers Individ Dif. 2019 Jan;136:68-78.
Daharnis D, Ardi Z, Alizamar A, Ifdil I, Rangka IB, Suranata K. Adaptation and validation of mathematics anxiety: rasch and network psychometrics analysis. J Phys Conf Ser. 2018 Nov;1114:012113. https://doi.org/10.1088/1742-6596/1114/1/012113
Holst B, Lisboa CSM, Machado WL. Children and adolescents psychotherapy: Evidences of validity of the Brazilian Portuguese Youth Outcome Questionnaire 2.01. Psicol Clin. 2021;33(2):211-36. https://doi.org/10.33208/PC1980-5438v0033n02A01
Wechsler SM, Benson N, Machado WL, Bachert CMD, Gums EF. Adult temperament styles: a network analysis of their relationships with the Big Five Personality Model. Eur J Psychol Educ. 2018;11(1):61-75. [cited 2023 Jan 10] Available from: https://psycnet.apa.org/record/2019-04358-005
Newman ME. Networks: an introduction. Oxford: Oxford University Press; 2010.
Zhao T, Liu H, Roeder K, Lafferty J, Wasserman L. The huge package for high-dimensional undirected graph estimation in R. J Mach Learn Res. 2012 Apr;13:1059-62.
Meinshausen N, Bühlmann P. High-dimensional graphs and variable selection with the Lasso. Ann Stat. 2006;34(3):1436-62. https://doi.org/10.1214/009053606000000281
Friedman J, Hastie T, Tibshirani R. Sparse inverse covariance estimation with the graphical lasso. Biostatistics. 2008 Jul;9(3):432-41. https://doi.org/10.1093/biostatistics/kxm045
Fruchterman TM, Reingold EM. Graph drawing by force-directed placement. Softw Pract Exper. 1991;21(11):1129-64. https://doi.org/10.1002/spe.4380211102
Valente TW. Network interventions. Science. 2012 Jul;337(6090):49-53. https://doi.org/10.1126/science.1217330
Berger M, Fernando S, Churchill A, Cornish P, Henderson J, Shah J, et al. Scoping review of stepped care interventions for mental health and substance use service delivery to youth and young adults. Early Interv Psychiatry. 2022 Apr;16(4):327-41. https://doi.org/10.1111/eip.13180
Delgadillo J, Ali S, Fleck K, Agnew C, Southgate A, Parkhouse L, et al. Stratified care vs stepped care for depression: a cluster randomized clinical trial. JAMA Psychiatry. 2022 Feb;79(2):101-8. https://doi.org/10.1001/jamapsychiatry.2021.3539
Downloads
Published
Issue
Section
License
Copyright (c) 2023 Joana Moscoso Teixeira de Mendonça, Flavio Rebustini, Ana Alice Freire de Sousa, Ilana Eshriqui, Daiana Bonfim, Leticia Yamawaka de Almeida
This work is licensed under a Creative Commons Attribution 4.0 International License.
