An Instrument to Measure Maturity of Integrated Care: A First Validation Study
References
- WHO Regional Office for Europe.
Lessons from transforming health services delivery: Compendium of initiatives in the WHO European Region . Copenhagen: World Health Organisation; 2016. [accessed 2016 Jul 14]; Available from:http://www.euro.who.int/__data/assets/pdf_file/0014/303026/Compendium-of-initiatives-in-the-WHO-European-Region-rev1.pdf?ua=1 . - World Health Organization.
Framework on integrated, people-centred health services . Geneva, 2016. [accessed 2016 Jul 14]; Available from:http://www.who.int/servicedeliverysafety/areas/people-centred-care/framework/en/ . - Timmins, N and Ham, C.
The quest for integrated health and social care: A case study in Canterbury, New Zealand . The King’s Fund; 2013. [accessed 2016 Jul 22]; Available from:https://www.cdhb.health.nz/What-We-Do/Projects-Initiatives/kings-fund/Documents/Quest-for-integrated-health-for-print.pdf . - Nolte, E, Frolich, A, Hildebrandt, H, Pimperl, A, Schulpen, GJ and Vrijhoef, HJM. Implementing integrated care: A synthesis of experiences and three European countries. International Journal of Care Coordination, 2016; 19: 5–19. DOI: 10.1177/2053434516655626
- Rosen, R, Mountford, J, Lewis, G, Lewis, R, Shand, J and Shaw, S.
Integration in action: Four international case studies . Nuffield Trust; 2012. [accessed 2016 Jul 22]; Available from:https://www.nuffieldtrust.org.uk/files/2017-01/integration-in-action-research-report-web-final.pdf . - Nolte, E, Knai, C and McKee, M. Managing chronic conditions. Experience in eight countries. Observatories Studies Series, N°15, 2008. [accessed 2016 Jul 22]; Available from:
http://www.euro.who.int/__data/assets/pdf_file/0008/98414/E92058.pdf . - Kodner, DL and Spreeuwenberg, C. Integrated care: Meaning, logic, applications, and implications-a discussion paper. International Journal of Integrated Care, 2002; 2(4). DOI: 10.5334/ijic.67
- Valentijn, PP, Vrijhoef, HJM, Ruwaard, D, Boesveld, I, Arends, RY and Bruijnzeels, MA. Towards an international taxonomy of integrated primary care: A Delphi consensus approach. BMC family practice, 2015; 16: 64. DOI: 10.1186/s12875-015-0278-x
- Nolte, E and Pitchforth, E. What is the evidence on the economic impacts of integrated care? WHO Regional Office for Europe and European Observatory on Health Systems and Policies, 2014; 1–55. [accessed 2016 Jul 22]. Available from:
http://www.euro.who.int/__data/assets/pdf_file/0019/251434/What-is-the-evidence-on-the-economic-impacts-of-integrated-care.pdf . - Kodner, D. All Together Now: A Conceptual Exploration of Integrated Care. Healthcare Quarterly, 2009; 13: 6–15. DOI: 10.12927/hcq.2009.21091
- Stein, KV and Rieder, A. Integrated care at the crossroads-defining the way forward. International Journal of Integrated Care, 2009; 9(2). DOI: 10.5334/ijic.315
- Minkman, MM.
Developing integrated care Towards a Development Model for Integrated Care . Erasmus Universiteit Rotterdam; 2012. Available from:http://www.vilans.nl/docs/vilans/over_vilans/pdf/Proefschrift_Mirella_Minkman_Developing_Integrated_Care.pdf . - Solinís, RN and Stein, KV. Measuring Integrated Care – The Quest for Disentangling a Gordian Knot. International Journal of Integrated Care, 2016; 16(3): 1–3. DOI: 10.5334/ijic.2525
- Browne, G, Kingston, D, Grdisa, V and Markle-Reid, M. Conceptualization and measurement of integrated human service networks for evaluation. International Journal of Integrated Care, 2007; 7(4). DOI: 10.5334/ijic.214
- Gibson, OR and Segal, L. Limited evidence to assess the impact of primary health care system or service level attributes on health outcomes of Indigenous people with type 2 diabetes: A systematic review. BMC health services research, 2015; 15(1): 154. DOI: 10.1186/s12913-015-0803-6
- Dickinson, H.
Evaluating outcomes in health and social care, Better Partnership Working . Bristol UK: The Policy Press; 2008. - Coulter, A.
“Evaluating the outcomes of health care.” In: The Sociology of the Health Service. London: Routledge; 1991. - Tsasis, P, Evans, JJM and Owen, S. Reframing the challenges to integrated care: A complex-adaptive systems perspective. International Journal of Integrated care, 2012; 12:
e190 . Available from:http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3601537&tool=pmcentrez&rendertype=abstract . DOI: 10.5334/ijic.843 - Donabedian, A. The quality of care. How can it be assessed? JAMA: The journal of the American Medical Association, 1988; 260(12): 1743–1748. DOI: 10.1001/jama.1988.03410120089033
- Donabedian, A. Evaluating the quality of medical care. The Milbank quarterly, 2005; 44(No. 3, Pt.
2 ): 166–203. - Zinn, JS and Mor, V. Organizational structure and the delivery of primary care to older Americans. Health Services Research, 1998; 33(2 Pt
Ii ): 354–80. Available from:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1070356/ . - Hartgerink, JM, Cramm, JM, van Wijngaarden, JDH, Bakker, TJEM, Mackenbach, JP and Nieboer, AP. A framework for understanding outcomes of integrated care programs for the hospitalised elderly. International Journal of Integrated care, 2013; 13(November):
e047 . DOI: 10.5334/ijic.1063 - Bautista, M, Nurjono, M, Lim, Y, Dessers, E and Vrijhoef, H. Instruments measuring integrated care: A systematic review of measurement properties. The Milbank Quarterly, 2016; 94: 4. DOI: 10.1111/1468-0009.12233
- Pavlickova, A. A Maturity Model for Adoption of Integrated Care within Regional Healthcare Systems (B3 Action Group) – European Commission, 2016. [accessed 2016 August 22]. Available from:
https://ec.europa.eu/eip/ageing/repository/maturity-model-adoption-integrated-care-within-regional-healthcare-systems-b3-action_en . - Henderson, D, Pavlickova, A and Lewis, L. Scalability and transferability of good practices in Europe: What does it take? 2016; 16(6): A191. DOI: 10.5334/ijic.2739
- Mokkink, LB, Terwee, CB, Knol, DL, Stratford, PW, Alonso, J, Patrick, DL, Bouter, LM and Vet de, HC. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: A clarification of its content. BMC medical research methodology, 2010; 10: 22. DOI: 10.1186/1471-2288-10-22
- Vet de, HCW, Terwee, CB, Mokkink, LB and Knol, DJ.
Measurement in Medicine: A Practical Guide . London: Cambridge University Press; 2011. - Mokkink, LB, Terwee, CB, Patrick, DL, Alonso, J, Stratford, PW, Knol, DL, Bouter, LM and De Vet, HCW. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: An international Delphi study. Quality of Life Research, 2010; 19(4): 539–549. DOI: 10.1007/s11136-010-9606-8
- Rubio, DM, Berg-Weger, M, Tebb, SS, Lee, ES and Rauch, S. Objectifying content validity: Conducting a content validity study in social work research. Social Work Research, 2003; 27(2): 94–104. DOI: 10.1093/swr/27.2.94
- SCIROCCO – Scaling Integrated Care in Context. [webpage on the internet] [Accessed 2016 Jul 21]. Available from:
http://www.scirocco-project.eu/ . - Milat, AJ, Bauman, A and Redman, S. Narrative review of models and success factors for scaling up public health interventions. Implementation Science, 2015; 10(113): 11. DOI: 10.1186/s13012-015-0301-6
- Cramer, H, Dewulf, G and Voordijk, H. The barriers to govern long-term care innovations: The paradoxical role of subsidies in a transition program. Health Policy, 2014; 116(1): 71–83. DOI: 10.1016/j.healthpol.2014.02.008
- Humphrey, WS.
Characterizing the Software Process A Maturity Framework. The Software Process Feasibility Project. The Software Process/External Operations Program . Pittsburgh Pennsylvania; 1987. Available from:https://www.sei.cmu.edu/reports/87tr011.pdf . - Tarhan, A, Turetken, O and van den Biggelaar, FJHM. Assessing Healthcare Process Maturity: Challenges of Using a Business Process Maturity Model. Proceedings of the 9th International Conference on Pervasive Computing Technologies for Healthcare, 2015; 344–347.
- Paulk, MC, Curtis, B, Chrissis, MB and Weber, CV. Capability maturity model, version 1.1. IEEE Software, 1993; 10(4): 18–27. DOI: 10.1109/52.219617
- Wendler, R. The maturity of maturity model research: A systematic mapping study. Information and Software Technology, 2012; 54(12): 1317–1339. DOI: 10.1016/j.infsof.2012.07.007
- Blondiau, A, Mettler, T and Winter, R. Designing and implementing maturity models in hospitals: An experience report from 5 years of research. Health Informatics Journal, 2015; 2(5): 1–10. DOI: 10.1177/1460458215590249
- Hoyt, JP and Gaston, JE. HIMSS Analytics Continuity of Care Maturity Model: Going beyond EMRAM. HIMSS 15 Annual Conference. 2015; 54(12): 1317–1339.
- Currie, WL. TEMPEST: An integrative model for health technology assessment. Health Policy and Technology. 2012; 1(1): 35–49. DOI: 10.1016/j.hlpt.2012.01.004
- Welsh Government. A Framework for Delivering Integrated Health and Social Care for Older People with Complex Needs, 2014. Available from:
http://gov.wales/docs/dhss/publications/140319integrationen.pdf . - Gupta, A, Thorpe, C, Bhattacharyya, O and Zwarenstein, M. Promoting development and uptake of health innovations: The Nose to Tail Tool. [version 1; referees: 3 approved, 1 approved with reservations]. F1000Research, 2016; 5: 361. Available from:
https://f1000research.com/articles/5-361/v1 - Mays, N, Smith, J and Trust, N. Integrated health and social care: Can England’s NHS learn from Canterbury New Zealand? BMJ: British Medical Journal (Clinical research ed), 2013; 347:
f6513 : 959–8138. DOI: 10.1136/bmj.f6513 - McKenzie, JF, Wood, ML, Kotecki, JE, Clark, JK and Brey, RA. Establishing content validity: Using qualitative and quantitative steps. American Journal of Health Behavior, 1999; 23(4): 311–318. DOI: 10.5993/AJHB.23.4.9
- Korzilius, H. De kern van survey-onderzoek [The core of survey research]. Assen, Van Gorcum, 2000. Available from:
https://books.google.nl/books?isbn=9023235401 [in Dutch]. - Sartori, R and Pasini, M. Quality and quantity in test validity: How can we be sure that psychological tests measure what they have to? Quality and Quantity, 2007; 41(3): 359–374. DOI: 10.1007/s11135-006-9006-x
- Derish, PA and Annesley, TM. How to write a rave review. Clinical Chemistry, 2011; 57(3): 388–391. DOI: 10.1373/clinchem.2010.160622
- Uijen, AA, Heinst, CW, Schellevis, FG, van den Bosch, WJHM, van de Laar, FA, Terwee, CB and Schers, HJ. Measurement Properties of Questionnaires Measuring Continuity of Care: A Systematic Review. PLoS ONE, 2012; 7(7): 42256. DOI: 10.1371/journal.pone.0042256
- Terwee, CB, Jansma, EP, Riphagen, II and de Vet, HCW. Development of a methodological PubMed search filter for finding studies on measurement properties of measurement instruments. Quality of life research: An international journal of quality of life aspects of treatment, care and rehabilitation, 2009; 18(8): 1115–23. DOI: 10.1007/s11136-009-9528-5
- VU University Medical Center. Knowledgecenter Measurement Instruments of the VU University Medical Center. [accessed 2016 August 2]. Available from:
http://www.kmin-vumc.nl/index.php?change=1&lang=en . - Terwee, CB, Mokkink, LB, Knol, DL, Ostelo, RWJG, Bouter, LM and de Vet, HCW. Rating the methodological quality in systematic reviews of studies on measurement properties: A scoring system for the COSMIN checklist. Quality of Life Research, 21(4), 2012: 651–657. DOI: 10.1007/s11136-011-9960-1
- Mokkink, LB, Terwee, CB, Patrick, DL, Alonso, J, Stratford, PW, Knol, DL, Bouter, LM and de Vet, HC.
The COSMIN checklist manual . Amsterdam: EMGO Institute for Health and Care Research; 2012. Available from:http://www.cosmin.nl/images/upload/files/COSMIN%20checklist%20manual%20v9.pdf . - Terwee, CB, Bot, SDM, de Boer, MR, van der Windt, DAWM, Knol, DL, Dekker, J, Bouter, L and de Vet, HCW. Quality criteria were proposed for measurement properties of health status questionnaires. Journal of Clinical Epidemiology, 2007; 60(1): 34–42. DOI: 10.1016/j.jclinepi.2006.03.012
- Keeney, S, Hasson, F and McKenna, H. Consulting the oracle: Ten lessons form using the Delphi technique in nursing research. Journal of Advanced Nursing, 2006; 53(2): 205–212. DOI: 10.1111/j.1365-2648.2006.03716.x
- Fitch, K, Bernstein, SJJ, Aguilar, MDD, Burnand, B, LaCalle, JRR, Lazaro, P, Van Het Loo, M, McDonnell, J, Vader, JPP and Kahan, JPP. The RAND/UCLA Appropriateness Method User’s Manual. Transformation; 2001. Available from:
http://www.rand.org . - Ahgren, B and Axelsson, R. Evaluating integrated health care: A model for measurement. International Journal of Integrated Care, 2005; 5(August). DOI: 10.5334/ijic.134
- von der Gracht, HA. Consensus measurement in Delphi studies. Review and implications for future quality assurance. Technological Forecasting and Social Change, 2012; 79(8): 1525–1536. DOI: 10.1016/j.techfore.2012.04.013
- Williams, PL and Webb, C. The Delphi technique: A methodological discussion. Journal of Advanced Nursing, 1994; 19(1): 180–186. DOI: 10.1111/j.1365-2648.1994.tb01066.x
- Kilroy, D and Driscoll, P. Determination of required anatomical knowledge for clinical practice in emergency medicine: National curriculum planning using a modified Delphi technique. Emergency Medicine Journal, 2006; 23(9): 693–696. DOI: 10.1136/emj.2006.037309
- Syed, A, Hjarnoe, L and Aro, A. Policies: Experience From The SARSControl Project, 2008; 8(2): 1–7. Available from:
http://print.ispub.com/api/0/ispub-article/6223 . - Waters, AM, Smith, CT, Young, B and Jones, TM. The CONSENSUS study: Protocol for a mixed methods study to establish which outcomes should be included in a core outcome set for oropharyngeal cancer. Trials, 2014; 15: 168. DOI: 10.1186/1745-6215-15-168
- Gerritsen, A, Jacobs, M, Henselmans, I, Van Hattum, J, Efficace, F, Creemers, GJ, De Hingh, IH, Koopman, M, Molenaar, IQ, Wilmink, HW, Busch, OR, Besselink, MG and Van Laarhoven, HW. Developing a core set of patient-reported outcomes in pancreatic cancer: A Delphi survey. European Journal of Cancer, 2016; 57: 68–77. DOI: 10.1016/j.ejca.2016.01.001
- Ahgren, B, Axelsson, SB and Axelsson, R. Evaluating intersectoral collaboration: A model for assessment by service users. International Journal of Integrated Care, 2009; 9(1). DOI: 10.5334/ijic.304
- Browne, G, Roberts, J, Gafni, A, Byrne, C, Kertyzia, J and Loney, P. Conceptualizing and validating the human services integration measure. International Journal of Integrated Care, 2004; 4. DOI: 10.5334/ijic.98
- Lukas, CV, Meterko, M, Lowcock, S, Donaldson-Parlier, R, Blakely, M, Davies, M and Petzel, RA. Monitoring the progress of system integration. Quality management in health care, 2002; 10(2): 1–11. Available from:
http://www.ncbi.nlm.nih.gov/pubmed/11799825 . DOI: 10.1097/00019514-200210020-00004 - McGovern, MP, Urada, D, Lambert-Harris, C, Sullivan, ST and Mazade, NA. Development and initial feasibility of an organizational measure of behavioral health integration in medical care settings. Journal of Substance Abuse Treatment, 2012; 43(4): 402–409. DOI: 10.1016/j.jsat.2012.08.013
- Singer, SJ, Friedberg, MW, Kiang, MV, Dunn, T and Kuhn, DM. Development and Preliminary Validation of the Patient Perceptions of Integrated Care Survey. Medical Care Research and Review, 2013; 70(2): 143–164. DOI: 10.1177/1077558712465654
- Uyei, J, Coetzee, D, MacInko, J, Weinberg, SL and Guttmacher, S. Measuring the degree of integrated tuberculosis and HIV service delivery in Cape Town, South Africa. Health Policy and Planning, 2014; 29(1): 42–55. DOI: 10.1093/heapol/czs131
- Bainbridge, D, Brazil, K, Krueger, P, Ploeg, J and Taniguchi, A. A proposed systems approach to the evaluation of integrated palliative care. BMC palliative care, 2010; 9: 8. DOI: 10.1186/1472-684X-9-8
- Bainbridge, D, Brazil, K, Krueger, P, Ploeg, J, Taniguchi, A and Darnay, J. Measuring horizontal integration among health care providers in the community: An examination of a collaborative process within a palliative care network. Journal of interprofessional care, 2015; 29(3): 245–252. DOI: 10.3109/13561820.2014.984019
- Calciolari, S and Ilinca, S. Unraveling care integration: Assessing its dimensions and antecedents in the Italian Health System. Health Policy, 2016; 120(1): 129–138. DOI: 10.1016/j.healthpol.2015.12.002
- Longpré, C and Dubois, CA. Implementation of integrated services networks in Quebec and nursing practice transformation: Convergence or divergence? BMC health services research, 2015; 15(1): 84. DOI: 10.1186/s12913-015-0720-8
- Minkman, MM. The development model for integrated care: A validated tool for evaluation and development. Journal of Integrated Care, 2016; 24(1). DOI: 10.1108/JICA-01-2016-0005
- Strandberg-Larsen, M and Krasnik, A. Measurement of integrated healthcare delivery: A systematic review of methods and future research directions. International Journal of Integrated Care, 2009; 9(4 February): 1–10. DOI: 10.5334/ijic.305
- Hasson, F, Keeney, S and McKenna, H. Research guidelines for the Delphi survey technique. Journal of Advanced Nursing, 2000; 32(4): 1008–1015. DOI: 10.1046/j.1365-2648.2000.t01-1-01567.x
- Powell, C. The Delphi Technique: Myths and realities. Methodological Issues in Nursing Research, 2003; 41(4): 376–382. DOI: 10.1046/j.1365-2648.2003.02537.x
DOI: https://doi.org/10.5334/ijic.3063 | Journal eISSN: 1568-4156
Language: English
Submitted on: Feb 23, 2017
Accepted on: Nov 28, 2017
Published on: Jan 25, 2018
Published by: Ubiquity Press
In partnership with: Paradigm Publishing Services
Publication frequency: 4 issues per year
Keywords:
© 2018 Liset Grooten, Liesbeth Borgermans, Hubertus J.M. Vrijhoef, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.