Construct Validation of the Rainbow Model of Integrated Care Measurement Tool in Dutch Primary Care for Older Adults

Dorien L. Oostra; Minke S. Nieuwboer; Jeroen H. M. Janssen; Marcel G. M. Olde Rikkert; Pim P. Valentijn; Marieke Perry

doi:10.5334/ijic.6739

Construct Validation of the Rainbow Model of Integrated Care Measurement Tool in Dutch Primary Care for Older Adults

International Journal of Integrated Care

Volume 23 (2023): Issue 1

By: Dorien L. Oostra , Minke S. Nieuwboer , Jeroen H. M. Janssen , Marcel G. M. Olde Rikkert , Pim P. Valentijn and Marieke Perry

Open Access

|Feb 2023

Abstract

Introduction: Care integration in primary elderly care is suboptimal. Validated instruments are needed to enable the implementation of integrated primary care. We aimed to assess construct validity of the Rainbow Model of Integrated Care measurement tool (RMIC-MT) for healthcare professionals working in an integrated primary elderly care setting in the Netherlands.

Methods: In a cross-sectional study, the RMIC-MT, a 36-item questionnaire covering all domains of the Rainbow Model of Integrated Care (RMIC), was sent out to local networks of primary elderly care professionals. Confirmatory factor analysis with maximum likelihood estimation was used for the validation of the factor structure of the RMIC-MT. Model fit was assessed by the chi-square test and fit indices.

Results: The RMIC-MT was completed by 323 professionals, primarily general practitioners, community nurses, practice nurses, and case managers. Confirmatory factor analysis and corresponding fit indices showed moderate to good fit, thereby confirming a nine factor model with a total of 36 items.

Conclusions: The RMIC-MT is promising for the primary elderly care setting in the Netherlands. It can be used for evaluating integrated care initiatives in a primary care setting, thereby contributing to implementation of integrated primary elderly care.

References

Europe WHO. Lessons from transforming health services delivery: Compendium of initiatives in the WHO European Region. Copenhagen: World Health Organisation; 2016.
Search in Google Scholar Back to article
Enthoven AC. Integrated delivery systems: the cure for fragmentation. American Journal of Managed Care. 2009; 15(10 Suppl): S284–90.
Search in Google Scholar Back to article
Stange KC. The problem of fragmentation and the need for integrative solutions. Ann Fam Med. 2009; 7(2): 100–3. DOI: 10.1370/afm.971
Open DOI Search in Google Scholar Back to article
Valentijn PP, Vrijhoef HJ, Ruwaard D, Boesveld I, Arends RY, Bruijnzeels MA. Towards an international taxonomy of integrated primary care: a Delphi consensus approach. BMC Fam Pract. 2015; 16(1): 64. DOI: 10.1186/s12875-015-0278-x
Open DOI Search in Google Scholar Back to article
Berwick DM, Nolan TW, Whittington J. The triple aim: care, health, and cost. Health affairs. 2008; 27(3): 759–69. DOI: 10.1377/hlthaff.27.3.759
Open DOI Search in Google Scholar Back to article
Uittenbroek RJ, Kremer HP, Spoorenberg SL, Reijneveld SA, Wynia K. Integrated care for older adults improves perceived quality of care: results of a randomized controlled trial of embrace. Journal of general internal medicine. 2017; 32(5): 516–23. DOI: 10.1007/s11606-016-3742-y
Open DOI Search in Google Scholar Back to article
Briggs AM, Valentijn PP, Thiyagarajan JA, Araujo de Carvalho I. Elements of integrated care approaches for older people: a review of reviews. BMJ Open. 2018; 8(4): e021194. DOI: 10.1136/bmjopen-2017-021194
Open DOI Search in Google Scholar Back to article
D’Amour D, Goulet L, Labadie JF, Martin-Rodriguez LS, Pineault R. A model and typology of collaboration between professionals in healthcare organizations. Bmc Health Services Research. 2008; 8(1): 188. DOI: 10.1186/1472-6963-8-188
Open DOI Search in Google Scholar Back to article
Valentijn PP, Vrijhoef HJ, Ruwaard D, de Bont A, Arends RY, Bruijnzeels MA. Exploring the success of an integrated primary care partnership: a longitudinal study of collaboration processes. BMC health services research. 2015; 15(1): 32. DOI: 10.1186/s12913-014-0634-x
Open DOI Search in Google Scholar Back to article
De Bruin SR, Billings J, Stoop A, Lette M, Ambugo EA, Gadsby E, et al. Different contexts, similar challenges. SUSTAIN’s experiences with improving integrated care in Europe. International Journal of Integrated Care. 2020; 20(2): 17. DOI: 10.5334/ijic.5492
Open DOI Search in Google Scholar Back to article
Bautista MAC, Nurjono M, Lim YW, Dessers E, Vrijhoef HJ. Instruments measuring integrated care: a systematic review of measurement properties. The Milbank Quarterly. 2016; 94(4): 862–917. DOI: 10.1111/1468-0009.12233
Open DOI Search in Google Scholar Back to article
Grooten L, Borgermans L, Vrijhoef HJ. An Instrument to Measure Maturity of Integrated Care: A First Validation Study. International Journal of Integrated Care. 2018; 18(1): 10. DOI: 10.5334/ijic.3063
Open DOI Search in Google Scholar Back to article
Grooten L, Vrijhoef HJM, Calciolari S, Ortiz LGG, Janečková M, Minkman MM, et al. Assessing the maturity of the healthcare system for integrated care: testing measurement properties of the SCIROCCO tool. BMC medical research methodology. 2019; 19(1): 63. DOI: 10.1186/s12874-019-0704-1
Open DOI Search in Google Scholar Back to article
Kelly L, Harlock J, Peters M, Fitzpatrick R, Crocker H. Measures for the integration of health and social care services for long-term health conditions: a systematic review of reviews. BMC Health Services Research. 2020; 20(1): 1–11. DOI: 10.1186/s12913-020-05206-5
Open DOI Search in Google Scholar Back to article
Minkman M. The Development Model for Integrated Care: a validated tool for evaluation and development. Journal of Integrated Care. 2016; 24(1): 38–52. DOI: 10.1108/JICA-01-2016-0005
Open DOI Search in Google Scholar Back to article
Valentijn PP, Pereira F, Sterner CW, Vrijhoef HJ, Ruwaard D, Hegbrant J, et al. Validation of the Rainbow Model of Integrated Care Measurement Tools (RMIC-MTs) in renal care for patient and care providers. PloS one. 2019; 14(9): e0222593. DOI: 10.1371/journal.pone.0222593
Open DOI Search in Google Scholar Back to article
Huang Y, Zhu P, Chen L, Wang X, Valentijn P. Validation of the care providers version of the Rainbow Model of Integrated Care-measurement tool in Chinese primary care systems. BMC Health Services Research. 2020; 20(1): 1–10. DOI: 10.1186/s12913-020-05562-2
Open DOI Search in Google Scholar Back to article
Nieuwboer MS, Richters A, van der Marck MA. Triple aim improvement for individuals, services and society in dementia care: The DementiaNet collaborative care approach. Zeitschrift für Gerontologie und Geriatrie. 2017; 50(Suppl 2): 78–83. DOI: 10.1007/s00391-017-1196-4
Open DOI Search in Google Scholar Back to article
Richters A, Nieuwboer MS, Perry M, Olde Rikkert MGM, Melis RJF, van der Marck MA. Evaluation of DementiaNet, a network-based primary care innovation for community-dwelling patients with dementia: protocol for a longitudinal mixed methods multiple case study. BMJ Open. 2017; 7(8): e016433. DOI: 10.1136/bmjopen-2017-016433
Open DOI Search in Google Scholar Back to article
Costello AB, Osborne J. Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical assessment, research, and evaluation. 2005; 10(1): 7.
Search in Google Scholar Back to article
Essenburgh Research & Consultancy. Rainbow Model of Integrated Care Measurement Tools (RMICMT’s) for Patient and Care providers 2019. Available from: https://www.essenburgh.com/the-rainbow-model-measurements-tools-for-integrated-care.
Search in Google Scholar Back to article
Hu Lt, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural equation modeling: a multidisciplinary journal. 1999; 6(1): 1–55. DOI: 10.1080/10705519909540118
Open DOI Search in Google Scholar Back to article
Xia Y, Yang Y. RMSEA, CFI, and TLI in structural equation modeling with ordered categorical data: The story they tell depends on the estimation methods. Behavior research methods. 2019; 51(1): 409–28. DOI: 10.3758/s13428-018-1055-2
Open DOI Search in Google Scholar Back to article
DiStefano C. The impact of categorization with confirmatory factor analysis. Structural equation modeling. 2002; 9(3): 327–46. DOI: 10.1207/S15328007SEM0903_2
Open DOI Search in Google Scholar Back to article
Van de Schoot R, Lugtig P, Hox J. A checklist for testing measurement invariance. European journal of developmental psychology. 2012; 9(4): 486–92. DOI: 10.1080/17405629.2012.686740
Open DOI Search in Google Scholar Back to article
Team RC. R: A language and environment for statistical computing; 2013.
Search in Google Scholar Back to article
Rosseel Y. Lavaan: An R package for structural equation modeling and more. Version 0.5–12 (BETA). Journal of statistical software. 2012; 48(2): 1–36. DOI: 10.18637/jss.v048.i02
Open DOI Search in Google Scholar Back to article
Wang X, Birch S, Chen L, Huang Y, Valentijn P. A Validation Study of the Rainbow Model of Integrated Care-Measurement Tool for Patients in China. International Journal of Integrated Care. 2021; 21(2): 5. DOI: 10.5334/ijic.5603
Open DOI Search in Google Scholar Back to article
Shi D, Lee T, Maydeu-Olivares A. Understanding the model size effect on SEM fit indices. Educational and psychological measurement. 2019; 79(2): 310–34. DOI: 10.1177/0013164418783530
Open DOI Search in Google Scholar Back to article
Glover PD, Gray H, Shanmugam S, McFadyen AK. Evaluating collaborative practice within community-based integrated health and social care teams: a systematic review of outcome measurement instruments. Journal of Interprofessional Care. 2021; 36(3): 1–15. DOI: 10.1080/13561820.2021.1902292
Open DOI Search in Google Scholar Back to article
Valentijn PP, Boesveld IC, Van der Klauw DM, Ruwaard D, Struijs JN, Molema JJ, et al. Towards a taxonomy for integrated care: a mixed-methods study. International journal of integrated care. 2015; 15: e003. DOI: 10.5334/ijic.1513
Open DOI Search in Google Scholar Back to article
Oostra DL, Harmsen A, Nieuwboer MS, Rikkert MGO, Perry M. Care Integration in Primary Dementia Care Networks: A Longitudinal Mixed-Methods Study. International Journal of Integrated Care. 2021; 21(4): 29. DOI: 10.5334/ijic.5675
Open DOI Search in Google Scholar Back to article
Tabachnick BG, Fidell LS, Ullman JB. Using multivariate statistics: Pearson Boston, MA; 2007.
Search in Google Scholar Back to article
Fares J, Chung KSK, Passey M, Longman J, Valentijn PP. Exploring the psychometric properties of the Rainbow Model of Integrated Care measurement tool for care providers in Australia. BMJ open. 2019; 9(12): e027920. DOI: 10.1136/bmjopen-2018-027920
Open DOI Search in Google Scholar Back to article
Uittenbroek RJ, Reijneveld SA, Stewart RE, Spoorenberg SL, Kremer HP, Wynia K. Development and psychometric evaluation of a measure to evaluate the quality of integrated care: the P atient A ssessment of I ntegrated E lderly C are. Health expectations. 2016; 19(4): 962–72. DOI: 10.1111/hex.12391
Open DOI Search in Google Scholar Back to article
Walker KO, Stewart AL, Grumbach K. Development of a survey instrument to measure patient experience of integrated care. BMC health services research. 2016; 16(1): 1–11. DOI: 10.1186/s12913-016-1437-z
Open DOI Search in Google Scholar Back to article

Articles in this issue

DOI: https://doi.org/10.5334/ijic.6739 | Journal eISSN: 1568-4156

Journal RSS Feed

Language: English

Submitted on: Apr 26, 2022

Accepted on: Jan 30, 2023

Published on: Feb 15, 2023

Published by: Ubiquity Press

In partnership with: Paradigm Publishing Services

Publication frequency: 4 issues per year

Keywords:

interprofessional collaboration

© 2023 Dorien L. Oostra, Minke S. Nieuwboer, Jeroen H. M. Janssen, Marcel G. M. Olde Rikkert, Pim P. Valentijn, Marieke Perry, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.

Volume 23 (2023): Issue 1