Skip to main content
Have a personal or library account? Click to login
Evaluating Large-Scale Integrated Care Projects: The Development of a Protocol for a Mixed Methods Realist Evaluation Study in Belgium Cover

Evaluating Large-Scale Integrated Care Projects: The Development of a Protocol for a Mixed Methods Realist Evaluation Study in Belgium

Open Access
|Sep 2020

References

  1. Bernstein A, Hing E, Moss A, Allen K, Siller A, Tiggle R. Health care in America: Trends in utilization. Hyattsville, Maryland: National Center for Health Statistics; 2003. DOI: 10.1037/e309002005-001
  2. World Health Organization. Global Status Report On Noncommunicable Diseases 2014. 2014; Available from: https://apps.who.int/iris/bitstream/handle/10665/148114/9789241564854_eng.pdf;jsessionid=14E4E7161A799E5FC14AAE5FF9D826E5?sequence=1.
  3. Lenzi J, Avaldi VM, Rucci P, Pieri G, Fantini MP. Burden of multimorbidity in relation to age, gender and immigrant status: a cross-sectional study based on administrative data. 2016; 110. DOI: 10.1136/bmjopen-2016-012812
  4. World Health Organization. Global Strategy on People-centred and Integrated Health Services. Serv Deliv Saf [Internet], 2015; 150. Available from: http://www.who.int/servicedeliverysafety/areas/people-centred-care/global-strategy/en/.
  5. World Economic Forum, BCG. Value in Healthcare Laying the Foundation for Health System Transformation: Insight Report, 2017(April); 140. Available from: www.weforum.org.
  6. Paulus D, Van Den Heede K, Mertens R. Organisation of Care for Chronic Patients in Belgium: Development of A Position Paper [Internet]. Available from: https://kce.fgov.be/sites/default/files/atoms/files/KCE_190C_organisation_care_chronic_patients_0.pdf.
  7. Adriaenssens J, Benahmed N, Eyssen M, Paulus D, Mertens R. Towards an integrated evidence-based practice plan in Belgium – Part 1: literature, Belgian situation and end-user needs [Internet]. [cited 2020 Aug 1]. Available from: www.kce.fgov.be.
  8. Baxter S, Johnson M, Chambers D, Sutton A, Goyder E, Booth A. The effects of integrated care: A systematic review of UK and international evidence. BMC Health Serv Res, 2018; 18(1). DOI: 10.1186/s12913-018-3161-3
  9. Busetto L, Luijkx KG, Elissen AMJ, Vrijhoef HJM. Context, mechanisms and outcomes of integrated care for diabetes mellitus type 2: A systematic review. BMC Health Serv Res, 2016; 16(1). DOI: 10.1186/s12913-015-1231-3
  10. Busetto L, Luijkx KG, Elissen AMJ, Vrijhoef, HJM. Intervention types and outcomes of integrated care for diabetes mellitus type 2: A systematic review. J Eval Clin Pract, 2016; 22(3): 299310. DOI: 10.1111/jep.12478
  11. Martínez-González NA, Berchtold P, Ullman K, Busato A, Egger M. Integrated care programmes for adults with chronic conditions: a meta-review. Int J Qual Heal Care [Internet], 2014 Oct; 26(5): 56170. Available from: https://academic.oup.com/intqhc/article-lookup/doi/10.1093/intqhc/mzu071. DOI: 10.1093/intqhc/mzu071
  12. Liljas AEM, Brattström F, Burström B, Schön P, Agerholm J. Impact of Integrated Care on Patient-Related Outcomes Among Older People – A Systematic Review. Int J Integr Care, 2019; 19(3): 116. DOI: 10.5334/ijic.4632
  13. Willis CD, Riley BL, Stockton L, Abramowicz A, Zummach D, Wong G, et al. Scaling up complex interventions: insights from a realist synthesis. Heal Res Policy Syst [Internet], 2016 Dec 19; 14(1): 88. Available from: http://health-policy-systems.biomedcentral.com/articles/10.1186/s12961-016-0158-4. DOI: 10.1186/s12961-016-0158-4
  14. Greenhalgh T, Papoutsi C. Spreading and scaling up innovation and improvement. BMJ [Internet], 2019 May 10; 365: l2068. Available from: http://www.bmj.com/lookup/doi/10.1136/bmj.l2068. DOI: 10.1136/bmj.l2068
  15. World Health Organization. Scaling up action against noncommunicable diseases: How much will it cost? Geneva: World Health Organization; 2011.
  16. Plsek PE, Greenhalgh T. The challenge of complexity in health care. Br Med J, 2001; 323(7313): 6258. DOI: 10.1136/bmj.323.7313.625
  17. Lipsitz LA. Understanding Health Care as a Complex System. JAMA [Internet], 2012 Jul 18; 308(3): 243. Available from: http://jama.jamanetwork.com/article.aspx?doi=10.1001/jama.2012.7551. DOI: 10.1001/jama.2012.7551
  18. Edwards N, Rowan M, Marck P, Grinspun D. Understanding Whole Systems Change in Health Care: The Case of Nurse Practitioners in Canada. Policy, Polit Nurs Pract [Internet], 2011 Feb 8; 12(1): 417. Available from: http://journals.sagepub.com/doi/10.1177/1527154411403816. DOI: 10.1177/1527154411403816
  19. Dattée B, Barlow J. Complexity and whole-system change programmes. J Health Serv Res Policy, 2010; 15 Suppl 2(April): 1925. DOI: 10.1258/jhsrp.2009.009097
  20. Latham N. A practical guide to evaluating systems change in a human services system context. 2014; 87. Available from: http://www.learningforaction.com/wp/wp-content/uploads/2014/10/Systems-Change-Evaluation-Toolkit_FINAL_10-12-14.pdf.
  21. FOD VOLKSGEZONDHEID V VAN DE, VOEDSELKETEN EN LEEFMILIEU ICV. Gemeenschappelijk Plan Geïntegreerde Zorg. Gemeenschappelijke visie over zorgcoördinatie en casemanagement. [Common Plan Integrated Care. Common vision on care coordination and case management.] [Internet]. Available from: https://www.zorg-en-gezondheid.be/sites/default/files/atoms/files/CZgeïntegreerde%20zorg_Fiche A_Case management.pdf.
  22. Wilkinson GW, Sager A, Selig S, Antonelli R, Morton S, Hirsch G, et al. No Equity, No Triple Aim: Strategic Proposals to Advance Health Equity in a Volatile Policy Environment. Am J Public Health; 2017. DOI: 10.2105/AJPH.2017.304000
  23. Mery G, Majumder S, Brown A, Dobrow MJ. What do we mean when we talk about the Triple Aim? A systematic review of evolving definitions and adaptations of the framework at the health system level. Health Policy; 121: 62936. DOI: 10.1016/j.healthpol.2017.03.014
  24. Bodenheimer T, Sinsky C. From Triple to Quadruple Aim: Care of the Patient. Ann Fam Med, 2014; 12(6): 5736. DOI: 10.1370/afm.1713
  25. Baltaxe E, Cano I, Herranz C, Barberan-Garcia A, Hernandez C, Alonso A, et al. Evaluation of integrated care services in Catalonia: Population-based and service-based real-life deployment protocols. BMC Health Serv Res, 2019; 19(1): 111. DOI: 10.1186/s12913-019-4174-2
  26. Peters DH, Adam T, Alonge O, Agyepong IA, Tran N. Implementation research: What it is and how to do it. BMJ; 2013. DOI: 10.1136/bmj.f6753
  27. Greenhalgh T, Papoutsi C. Studying complexity in health services research: desperately seeking an overdue paradigm shift. BMC Med [Internet], 2018 Dec 20 [cited 2018 Jun 21]; 16(1): 95. Available from: https://bmcmedicine.biomedcentral.com/articles/10.1186/s12916-018-1089-4. DOI: 10.1186/s12916-018-1089-4
  28. Pawson R, Greenhalgh T, Harvey G, Walshe K. Realist review – a new method of systematic review designed for complex policy interventions. J Health Serv Res Policy [Internet], 2005 Jul 4; 10 (1_suppl): 2134. Available from: http://journals.sagepub.com/doi/10.1258/1355819054308530. DOI: 10.1258/1355819054308530
  29. Nurjono M, Shrestha P, Lee A, Lim XY, Shiraz F, Tan S, et al. Realist evaluation of a complex integrated care programme: Protocol for a mixed methods study. BMJ Open, 2018; 8(3). DOI: 10.1136/bmjopen-2017-017111
  30. Stokes T, Atmore C, Penno E, Richard L, Wyeth E, Richards R, et al. Protocol for a mixed methods realist evaluation of regional District Health Board groupings in New Zealand. BMJ Open, 2019; 9(3): 18. DOI: 10.1136/bmjopen-2019-030076
  31. World Health Organization, WHO, World Health Organization, WHO, World Health Organization, WHO, et al. WHO global strategy on people-centred and integrated health services [Internet]. WHO/HIS/SDS/2015.6. 2015. Available from: http://www.who.int/servicedeliverysafety/areas/people-centred-care/global-strategy/en/.
  32. De Winter M. Towards Integrated Care for Chronic Patients in Belgium: The Pilot Project, an Instrument Supporting the Emergence of Collaborative Networks. Societies, 2019; 9(2): 28. DOI: 10.3390/soc9020028
  33. CIM, Conférence interministérielle de la Santé. Des soins intégrés pour une meilleure santé [Integrated care for better health]. 2015; 168. Available from: https://www.integreo.be/fr%0Ahttp://www.schattauer.de/index.php?id=1214&doi=10.15265/IY-2016-020.
  34. Integreo. Pilot Projects for Integrated Care for Chronic Illnesses. [Internet]. 2018. Available from: https://www.integreo.be/fr/pres-de-chez-vous.
  35. Federal Public Service health food chain safety and environment. Gids Pilootprojecten geintegreerde zorg voor chronisch zieken [Guide. Pilot projects integrated care for the chronically ill]. 2016; Available from: https://www.health.belgium.be/sites/default/files/uploads/fields/fpshealth_theme_file/gids_pilootprojecten_geintegreerde_zorg_voor_chronisch_zieken.pdf.
  36. Greenhalgh T, Jackson C, Shaw S, Janamian T. Achieving Research Impact Through Co-creation in Community-Based Health Services: Literature Review and Case Study. Milbank Q, 2016; 94(2): 392429. DOI: 10.1111/1468-0009.12197
  37. Jackson CL, Greenhalgh T. Co-creation: a new approach to optimising research impact? Med J Aust, 2015 Oct 5; 203(1326–5377 (Electronic)): 2834. DOI: 10.5694/mja15.00219
  38. Wong G, Westhorp G, Greenhalgh J, Manzano A, Jagosh J, Greenhalgh T. Quality and reporting standards, resources, training materials and information for realist evaluation: the RAMESES II project. Heal Serv Deliv Res, 2017. DOI: 10.3310/hsdr05280
  39. Wong G, Westhorp G, Manzano A, Greenhalgh J, Jagosh J, Greenhalgh T. RAMESES II reporting standards for realist evaluations. BMC Med, 2016. DOI: 10.1186/s12916-016-0643-1
  40. Wong G, Greenhalgh T, Westhorp G, Buckingham J, Pawson R. RAMESES publication standards: Realist syntheses. J Adv Nurs, 2013. DOI: 10.1111/jan.12095
  41. May C, Finch T, Mair F, Ballini L, Dowrick C, Eccles M, et al. Understanding the implementation of complex interventions in health care: The normalization process model. BMC Health Serv Res, 2007; 7. DOI: 10.1186/1472-6963-7-148
  42. May CR, Finch T, Ballini L, MacFarlane A, Mair F, Murray E, et al. Evaluating complex interventions and health technologies using normalization process theory: Development of a simplified approach and web-enabled toolkit. BMC Health Serv Res, 2011. DOI: 10.1186/1472-6963-11-245
  43. May CR, Mair F, Finch T, MacFarlane A, Dowrick C, Treweek S, et al. Development of a theory of implementation and integration: Normalization Process Theory. Implement Sci [Internet], 2009; 4(1): 29. Available from: http://implementationscience.biomedcentral.com/articles/10.1186/1748-5908-4-29. DOI: 10.1186/1748-5908-4-29
  44. Wolpin S. An exploratory study of an intranet dashboard in a multi-state healthcare system. Stud Health Technol Inform [Internet], 2006. Available from: https://pubmed.ncbi.nlm.nih.gov/17102221/.
  45. Finch TL, Rapley T, Girling M, Mair FS, Murray E, Treweek S, et al. Improving the normalization of complex interventions: Measure development based on normalization process theory (NoMAD): Study protocol. Implement Sci, 2013. DOI: 10.1186/1748-5908-8-43
  46. May CRT, Mair F, Treweek Murray E, Ballini L, Macfarlane A, et al. Normalization Process Theory On-line Users’ Manual, Toolkit and NoMAD instrument [Internet]. 2015. Available from: http://www.normalizationprocess.org/.
  47. Davies R, Dart J. The ‘Most Significant Change’ (MSC) Technique. Change, 2005; (April): 1104. DOI: 10.1104/pp.110.159269
  48. Davies R, Dart J. The ‘Most Significant Change’ (MSC) Guide. Change, 2005. DOI: 10.1104/pp.110.159269
  49. Vermeulen B, Van Eenoo L, Vanneste D, Declercq A. Naar een getrapt gebruik van BelRAI met de BelRAI screener [Naar een getrapt gebruik van BelRAI met de BelRAI screener]. 2015; 112. Available from: https://www.kuleuven.be/lucas/nl/Publicaties/publi_upload/2015-rapport-belraiscreener-def.pdf.
  50. Vanneste D, Declercq A. The Development of BelRAI, a Web Application for Sharing Assessment Data on Frail Older People in Home Care, Nursing Homes, and Hospitals. In: Nursing Education, Administration, and Informatics, 2018. DOI: 10.4018/978-1-5225-5490-5.ch025
  51. Desomer A, Mistiaen P, Eyssen M. Belrai suite of instruments: an exploratory study on applicability for individual care planning and budget allocation in rehabilitation care 2016. Fed Kennisscentrum voor Gezonheidszorg [Internet], 2016; 199. Available from: https://kce.fgov.be/sites/default/files/atoms/files/KCE_262_Class-Rehab_Report.pdf.
  52. Herdman M, Gudex C, Lloyd A, Janssen M, Kind P, Parkin D, et al. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res, 2011. DOI: 10.1007/s11136-011-9903-x
  53. Glasgow RE, Wagner EH, Schaefer J, Mahoney LD, Reid RJ, Greene SM. Development and validation of the Patient Assessment of Chronic Illness Care (PACIC). Med Care, 2005; 43(5): 43644. DOI: 10.1097/01.mlr.0000160375.47920.8c
  54. Sermeus W, Aiken LH, Van den Heede K, Rafferty AM, Griffiths P, Moreno-Casbas MT, et al. Nurse forecasting in Europe (RN4CAST): Rationale, design and methodology. BMC Nurs, 2011. DOI: 10.1186/1472-6955-10-6
  55. Brenninkmeijer V. How to conduct research on burnout: advantages and disadvantages of a unidimensional approach in burnout research. Occup Environ Med, 2003. DOI: 10.1136/oem.60.suppl_1.i16
  56. Gittell JH, Fairfield KM, Bierbaum B, Head W, Jackson R, Kelly M, et al. Impact of Relational Coordination on Quality of Care, Postoperative Pain and Functioning, and Length of Stay. Med Care [Internet], 2000; 38(8): 80719. Available from: http://content.wkhealth.com/linkback/openurl?sid=WKPTLP:landingpage&an=00005650-200008000-00005. DOI: 10.1097/00005650-200008000-00005
  57. Stiefel M, Nolan K. A Guide to Measuring the Triple Aim: Population Health, Experience of Care, and Per Capita Cost [Internet]. IHI Innovation Series white paper. Cambridge, Massachusetts: Institute for Healthcare Improvement; 2012. (Available on www.IHI.org). Available from: http://scholar.google.com/scholar?hl=en&btnG=Search&q=intitle:A+Guide+to+Measuring+the+Triple+Aim+:+Population+Health,+Experience+of+Care+adn+Per+Capita+Cost#0.
  58. Hendrikx RJP, Drewes HW, Spreeuwenberg M, Ruwaard D, Struijs JN, Baan CA. Which Triple Aim related measures are being used to evaluate population management initiatives? An international comparative analysis. Health Policy, 2016. DOI: 10.1016/j.healthpol.2016.03.008
  59. Raleigh V, Bardsley M, Smith P, Wistow G, Wittenberg R, Erens B, et al. Integrated care and support Pioneers: Indicators for measuring the quality of integrated care, 2014 [cited 2018 Aug 22]; Available from: www.piru.ac.uk.
  60. Wollersheim H, Hermens R, Hulscher M, Braspenning J, Ouwens M, Schouten J, et al. Clinical indicators: development and applications. Neth J Med [Internet], 2007 Jan; 65(1): 1522. Available from: http://www.ncbi.nlm.nih.gov/pubmed/17293635.
  61. NICE GUIDANCE. Do Not! Do! :52. Available from: https://www.nice.org.uk/media/default/sharedlearning/716_716donotdobookletfinal.pdf.
  62. Allin S, Masseria C, Sorenson C, Papanicolas I, Mossialos E. Measuring inequalities in access to health care. A review of the indices. London Sch Econ Polit Sci, 2007. DOI: 10.1519/JSC.0b013e3181aeb0ea
  63. Craig P, Cooper C, Gunnell D, Haw S, Lawson K, Macintyre S, et al. Using natural experiments to evaluate population health interventions: New medical research council guidance. J Epidemiol Community Health, 2012; 66(12): 11826. DOI: 10.1136/jech-2011-200375
  64. Stuart EA, Huskamp HA, Duckworth K, Simmons J, Song Z, Chernew ME, et al. Using propensity scores in difference-in-differences models to estimate the effects of a policy change. Heal Serv Outcomes Res Methodol, 2014; 14(4): 16682. DOI: 10.1007/s10742-014-0123-z
  65. Zeldow B, Hatfield LA. Confounding and Regression Adjustment in Difference-in-Differences. 2019. Available from: http://arxiv.org/abs/1911.12185
  66. Lindner S, McConnell KJ. Difference-in-differences and matching on outcomes: a tale of two unobservables. Heal Serv Outcomes Res Methodol, 2019 Sep 14; 19(2–3): 12744. DOI: 10.1007/s10742-018-0189-0
  67. Keogh RH, Daniel RM, VanderWeele TJ, Vansteelandt S. Analysis of Longitudinal Studies with Repeated Outcome Measures: Adjusting for Time-Dependent Confounding Using Conventional Methods. Am J Epidemiol, 2018; 187(5): 108592. DOI: 10.1093/aje/kwx311
  68. Wing C, Simon K, Bello-Gomez RA. Designing Difference in Difference Studies: Best Practices for Public Health Policy Research. Annu Rev Public Health, 2018; 39(1): 45369. DOI: 10.1146/annurev-publhealth-040617-013507
  69. Curry L, Nunez-Smith M. Mixed Methods in Health Sciences Research: A Practical Primer. SAGE Publications, Inc.; 2017. DOI: 10.4135/9781483390659
  70. Fridrich A, Jenny GJ, Bauer GF. The Context, Process, and Outcome Evaluation Model for Organisational Health Interventions. BiomedResInt, 2015; 2015(2314–6141 (Electronic)): 414832. DOI: 10.1155/2015/414832
  71. Kumpunen S, Edwards N, Georghiou T, Hughes G. Why do evaluations of integrated care not produce the results we expect? [Internet]. The Nuffield Trust, 2019 Nov. Available from: http://journals.sagepub.com/doi/10.1177/2053434520909089. DOI: 10.1177/2053434520909089
  72. Wong G, Greenhalgh T, Westhorp G, Buckingham J, Pawson, R. RAMESES publication standards: Realist syntheses. J Adv Nurs, 2013. DOI: 10.1111/jan.12095
  73. Rycroft-Malone J, McCormack B, Hutchinson AM, DeCorby K, Bucknall TK, Kent B, et al. Realist synthesis: illustrating the method for implementation research. Implement Sci, 2012. DOI: 10.1186/1748-5908-7-33
  74. Bazeley P. Sequential Integration: Analysis Guiding Design and Further Analysis. In: Integrating Analyses in Mixed Methods Research. SAGE Publications Ltd 1 Oliver’s Yard London EC1Y 1SP, 2018; 7190. DOI: 10.4135/9781526417190.n4
  75. Greenhalgh T, Russell J. Why do evaluations of eHealth programs fail? An alternative set of guiding principles. PLoS Med, 2010; 7(11). DOI: 10.1371/journal.pmed.1000360
  76. Pawson R, Tilley N. Realistic Evaluation. In: Encyclopedia of Evaluation Encyclopedia of evaluation, 2012. DOI: 10.4135/9781412950596.n474
  77. Lacouture A, Breton E, Guichard A, Ridde V. The concept of mechanism from a realist approach: A scoping review to facilitate its operationalization in public health program evaluation. Implementation Science, 2015. DOI: 10.1186/s13012-015-0345-7
  78. Prior M, McManus M, White P, Davidson L. Measuring the “Triple Aim” in transition care: A systematic review. Pediatrics, 2014 Dec; 134(6): e164861. DOI: 10.1542/peds.2014-1704
  79. Zonneveld N, Driessen N, Stüssgen RAJ, Minkman, MMN. Values of Integrated Care: A Systematic Review. Int J Integr Care, 2018; 18(4). DOI: 10.5334/ijic.4172
  80. Spoorenberg SLW, Wynia K, Uittenbroek RJ, Kremer HPH, Reijneveld SA. Effects of a population-based, person-centred and integrated care service on health, wellbeing and self-management of community-living older adults: A randomised controlled trial on Embrace. PLoS One, 2018; 13(1): 116. DOI: 10.1371/journal.pone.0190751
  81. Uittenbroek RJ, Kremer HPH, Spoorenberg SLW, Reijneveld SA, Wynia K. Integrated Care for Older Adults Improves Perceived Quality of Care: Results of a Randomized Controlled Trial of Embrace. J Gen Intern Med, 2017; 32(5). DOI: 10.1007/s11606-016-3742-y
  82. Eyre L, George B, Marshall M. Protocol for a process-oriented qualitative evaluation of the Waltham Forest and East London Collaborative (WELC) integrated care pioneer programme using the researcherin-residence model. BMJ Open, 2015; 5(11): 110. DOI: 10.1136/bmjopen-2015-009567
  83. Kröger E, Tourigny A, Morin D, Côté L, Kergoat MJ, Lebel P, et al. Selecting process quality indicators for the integrated care of vulnerable older adults affected by cognitive impairment or dementia. BMC Health Serv Res, 2007; 7: 19. DOI: 10.1186/1472-6963-7-195
  84. Tsiachristas A, Stein KV, Evers S, Rutten-van Mölken M. Performing economic evaluation of integrated care: Highway to hell or stairway to heaven? Int J Integr Care, 2016; 16(4). DOI: 10.5334/ijic.2472
  85. Desmedt M, Vertriest S, Hellings J, Bergs J, Dessers E, Vankrunkelsven P, et al. Economic Impact of Integrated Care Models for Patients with Chronic Diseases: A Systematic Review. Value Heal [Internet], 2016; 19(6): 892902. Available from: DOI: 10.1016/j.jval.2016.05.001
  86. Middleton L, Rea H, Pledger M, Cumming J. A realist evaluation of local networks designed to achieve more integrated care. Int J Integr Care, 2019; 19(2): 112. DOI: 10.5334/ijic.4183
  87. Nurjono M, Shrestha P, Lee A, Lim XY, Shiraz F, Tan S, et al. Realist evaluation of a complex integrated care programme: Protocol for a mixed methods study. BMJ Open, 2018; 8(3). DOI: 10.1136/bmjopen-2017-017111
  88. Dalkin SM, Jones D, Lhussier M, Cunningham B. Understanding integrated care pathways in palliative care using realist evaluation: A mixed methods study protocol. BMJ Open, 2012; 2(4): 16. DOI: 10.1136/bmjopen-2012-001533
  89. Kirst M, Im J, Burns T, Baker GR, Goldhar J, O’Campo P, et al. What works in implementation of integrated care programs for older adults with complex needs? A realist review. Int J Qual Heal Care [Internet], 2017 Oct 1; 29(5): 61224. Available from: https://academic.oup.com/intqhc/article/29/5/612/4079832. DOI: 10.1093/intqhc/mzx095
  90. Best A, Greenhalgh T, Lewis S, Saul JE, Carroll S, Bitz J. Large-System Transformation in Health Care: A Realist Review. Milbank Q [Internet], 2012 Sep; 90(3): 42156. Available from: http://doi.wiley.com/10.1111/j.1468-0009.2012.00670.x. DOI: 10.1111/j.1468-0009.2012.00670.x
  91. Busse R, Stahl J. Integrated care experiences and outcomes in Germany, the Netherlands, and England. Health Aff, 2014; 33(9): 154958. DOI: 10.1377/hlthaff.2014.0419
  92. Conklin A, Nolte E, Vrijhoef H. Approaches to chronic disease management evaluation in use in Europe: A review of current methods and performance measures. Int J Technol Assess Health Care, 2013; 29(1): 6170. DOI: 10.1017/S0266462312000700
  93. Pimperl A, Schulte T, Mühlbacher A, Rosenmöller M, Busse R, Groene O, et al. Evaluating the Impact of an Accountable Care Organization on Population Health: The Quasi-Experimental Design of the German Gesundes Kinzigtal. Popul Health Manag [Internet], 2017 Aug 26; 20(3): 23948. Available from: http://online.liebertpub.com/doi/10.1089/pop.2016.0036. DOI: 10.1089/pop.2016.0036
  94. Greaves F, Pappas Y, Bardsley M, Harris M, Curry N, Holder H, et al. Evaluation of complex integrated care programmes: the approach in North West London. Int J Integr Care [Internet], 2013; 13(March): e006. Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3653284&tool=pmcentrez&rendertype=abstract. DOI: 10.5334/ijic.974
  95. Curry N, Harris M, Gunn L, Pappas Y, Blunt I, Soljak M, et al. Integrated care pilot in north west London: a mixed methods evaluation. Int J Integr Care [Internet], 2013 Jul 25; 13(3). Available from: http://www.ijic.org/article/10.5334/ijic.1149/. DOI: 10.5334/ijic.1149
  96. Wolpert M, Rutter H. Using flawed, uncertain, proximate and sparse (FUPS) data in the context of complexity: learning from the case of child mental health, 2018; 111. DOI: 10.1186/s12916-018-1079-6
  97. Freemantle N, Marston L, Walters K, Wood J, Reynolds MR, Petersen I. Making inferences on treatment effects from real world data: Propensity scores, confounding by indication, and other perils for the unwary in observational research. BMJ, 2013. DOI: 10.1136/bmj.f6409
  98. Wong AYS, Root A, Douglas IJ, Chui CSL, Chan EW, Ghebremichael-Weldeselassie Y, et al. Cardiovascular outcomes associated with use of clarithromycin: Population based study. BMJ, 2016. DOI: 10.1136/bmj.h6926
DOI: https://doi.org/10.5334/ijic.5435 | Journal eISSN: 1568-4156
Language: English
Submitted on: Oct 10, 2019
Accepted on: Jul 29, 2020
Published on: Sep 24, 2020
Published by: Ubiquity Press
In partnership with: Paradigm Publishing Services
Publication frequency: 4 issues per year

© 2020 Geert Goderis, Elien Colman, Lucia Alvarez Irusta, Ann Van Hecke, Benoit Petré, Dirk Devroey, Elias Van Deun, Kristof Faes, Nathan Charlier, Nick Verhaeghe, Roy Remmen, Sibyl Anthierens, Walter Sermeus, Jean Macq, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.