
Indicators and Measurement Tools for Health Systems Integration: A Knowledge Synthesis
References
- Hébert, R and Veil, A. Monitoring the degree of implementation of an integrated delivery system. International Journal of Integrated Care, 2004; 4(20): 1–7.
- Lyngso, AM, Godtfredsen, NS, Host, D and Frolich, A. Instruments to assess integrated care: A systematic review. International Journal of Integrated Care, 2014; 14: 1–15. DOI: 10.5334/ijic.1184
- Strandberg-Larsen, M and Krasnik, A. Measurement of integrated healthcare delivery: A systematic review of methods and future research directions. International Journal of Integrated Care, 2009; 9(4): 1568–4156. DOI: 10.5334/ijic.305
- Kodner, D and Spreeuwenberg, C. Integrated care: Meaning, logic, applications, and implications—a discussion paper. International Journal of Integrated Care, 2002; 2: e12. DOI: 10.5334/ijic.67
- Busse, R and Stahl, J. Integrated care experiences and outcomes in Germany, the Netherlands, and England. Health Affairs (Milwood), 2014; 33(9): 1549–1558. DOI: 10.1377/hlthaff.2014.0419
- Goodwin, N, Smith, J, Davies, A, Perry, C, Rosen, R, Dixon, A, Dixon, J and Ham, C.
Integrated care for patients and populations: Improving outcomes by working together . London: The King’s Fund, Nuffieldtrust; 2012. [cited 2016 January 13]. Available from:https://www.kingsfund.org.uk/publications/integrated-care-patients-and-populations-improving-outcomes-working-together . - Nolte, E and Pitchforth, E.
What is the evidence on the economic impacts of integrated care? Copenhagen: Regional Office for Europe of the World Health Organization; 2014. [cited 2017 January 13]. Available from:http://www.hiirc.org.nz/page/47762/what-is-the-evidence-on-the-economic-impacts/;jsessionid=E9BEE4FC8599C17A93F6022973194116?p=262&tag=coordinatedservices&tab=827&contentType=1033§ion=13414 . - Martinez-Gonzalez, NA, Berchtold, P, Ullman, K, Busato, A and Egger, M. Integrated care programmes for adults with chronic conditions: a meta-review. International Journal for Quality in Health Care, 2014; 26(5): 561–570. DOI: 10.1093/intqhc/mzu071
- Ovreveit, J.
Does clinical coordination improve quality and save money? London: Health Foundation; 2011. - Bautista, MC, Nurjono, M, Wei Lim, Y, Dessers, E and Vrijhoef, HJM. Instruments measuring integrated care: A systematic review of measurement properties. Milbank Quarterly, 2016; 94(4): 862–917. DOI: 10.1111/1468-0009.12233
- Goodwin, N. Understanding integrated care: a complex process, a fundamental principle. International Journal of Integrated Care, 2013; 13: 1–2. DOI: 10.5334/ijic.1144
- Valentijn, PP, Schepman, SM, Opheij, W and Bruijnzeels, MA. Understanding integrated care: a comprehensive conceptual framework based on the integrative functions of primary care. International Journal of Integrated Care, 2013; 13: 1–12. DOI: 10.5334/ijic.886
- Nuno Solinis, R and Stein, KV. Measuring integrated care – The quest for disentangling a Gordian knot. International Journal of Integrated Care, 2016; 16(3): 1–3. DOI: 10.5334/ijic.2525
- VanDeusen Lukas, C, Meterko, M, Lowcock, S, Donaldson-Parlier, R, Blakely, M, Davies, M and Petzel, R. Monitoring the progress of system Integration. Quality Management in Health Care, 2002; 10(2): 1–11. DOI: 10.1097/00019514-200210020-00004
- Armitage, GD, Suter, ES, Oelke, ND and Adair, CE. Health systems integration: State of the evidence. International Journal of Integrated Care, 2009; 9(17): 1–11. DOI: 10.5334/ijic.316
- de Jong, I and Jackson, C. An evaluation approach for a new paradigm – health care integration. Journal of Evaluation in Clinical Practice, 2001; 7(1): 71–79. DOI: 10.1046/j.1365-2753.2001.00285.x
- Suter, E, Oelke, ND, Adair, CE and Armitage, GD. Ten key principles for successful health systems integration. Healthcare Quarterly, 2009; 13: 16–23. DOI: 10.12927/hcq.2009.21092
- National Quality Forum. Endorsed measures for care coordination: Phase 3, April 29, 2014. Draft report for comment. Available at:
http://www.apic.org/Resource_/TinyMceFileManager/Advocacy-PDFs/care_coordination_draft_report.pdf . - Raleigh, V, Bardsley, M, Smith, P, Wistow, G, Wittenberg, R, Erens, B and Mays, N.
Integrated care and support pioneers: Indicators for measuring the quality of integrated care . Final report. London: Policy Innovation Research Unit; 2014. - Schultz, EM, Pineda, N, Lonhart, J, Davies, SM and McDonald, K. A systematic review of the care coordination measurement landscape. Health Services Research, 2013; 13: 1–12. DOI: 10.1186/1472-6963-13-119
- Singer, SJ, Burgers, J, Friedberg, M, Rosenthal, MB, Leape, L and Schneider, E. Defining and measuring integrated patient care: Promoting the next frontier in health care delivery. Medical Care Research and Review, 2011; 68(1): 112–127. DOI: 10.1177/1077558710371485
- Valentijn, PP, Boesveld, IC, van der Klauw, DM, Ruwaard, D, Struijs, JN, Molema, JJW, Bruijnzeels, MA and Vrijhoef, HJM. Towards a taxonomy for integrated care: A mixed-methods study. Journal of Integrated Care, 2015; 15: 1–18. DOI: 10.5334/ijic.1513
- Suter, E and Armitage, G. Use of a knowledge synthesis by decision makers and planners to facilitate system level integration in a large Canadian provincial health authority. International Journal of Integrated Care, 2011; 11: 1–9. DOI: 10.5334/ijic.576
- Levac, D, Colquhoun, H and O’Brien, KK. Scoping reviews: Advancing the methodology. Implementation Science, 2010; 5(1): 69–78. DOI: 10.1186/1748-5908-5-69
- Canadian Institutes of Health Research. Guide to knowledge translation planning at CIHR: Integrated and End-of-Grant Approaches. 2012. Available from:
http://www.cihr-irsc.gc.ca/e/documents/kt_lm_ktplan-en.pdf [8 March 2015]. - Hsu, C and Sandford, BA. The Delphi technique: Making sense of consensus. Practical Assessment, Research and Evaluation, 2007; 12(10): 1–8.
- Hastings, SE, Armitage, GD, Mallinson, S, Jackson, K and Suter, E. Exploring the relationship between governance mechanisms in healthcare and health workforce outcomes: a systematic review. BMC Health Services Research, 2014; 14(1): 1. DOI: 10.1186/1472-6963-14-479
- Bonomi, AE, Wagner, EH, Glasgow, RE and VonKorff, M. Assessment of chronic illness care (ACIC): A practical instrument to measure quality improvement. Health Services Research, 2002; 37(3): 791–820. DOI: 10.1111/1475-6773.00049
- Durbin, J, Goering, P, Streiner, DL and Pink, G. Continuity of care: Validation of a new self-report measure for individuals using mental health services. The Journal of Behavioral Health Services and Research, 2004; 31(3): 279–96. DOI: 10.1097/00075484-200407000-00005
- Farmanova, E, Grenier, J and Chomienne, MH. Pilot testing of a questionnaire for the evaluation of mental health services in family health team clinics in Ontario. Health Care Quarterly, 2013; 16(4): 61–67. DOI: 10.12927/hcq.2014.23657
- King, S, Rosenbaum, P and King, G. Parents’ perceptions of caregiving: Development and validation of a measure of processes. Developmental Medicine and Child Neurology, 1996; 38: 757–772. DOI: 10.1111/j.1469-8749.1996.tb15110.x
- Le Bas, J, King, R and Block, M. The impact of mental health service integration on systemic function: A staff perspective. Australian and New Zealand Journal of Psychiatry, 1998; 32: 666–672. DOI: 10.3109/00048679809113121
- Lemmon, R and Shuff, IM. Effects of mental health centre staff turnover on HIV/AIDS service delivery integration. AIDS Care: Psychological and Socio-medical Aspects of AIDS/HIV, 2001; 13(5): 651–661. DOI: 10.1080/09540120120063278
- Martz, K and Gerding, A. Perceptions of coordination of care between hospice and skilled nursing facility care providers. Journal of Hospice and Palliative Nursing, 2011; 13(4): 210–221. DOI: 10.1097/NJH.0b013e3182135ddd
- McGuiness, C and Sibthorpe, B. Development and initial validation of a measure of coordination of health care. International Journal for Quality in Health Care, 2003; 15(4): 309–318. DOI: 10.1093/intqhc/mzg043
- Safran, DG, Karp, M, Coltin, K, Chang, H, Li, A, Ogren, J and Rogers, WH. Measuring patients’ experiences with individual primary care physicians: Results of a statewide demonstration project. Journal of General Internal Medicine, 2006; 21: 13–21. DOI: 10.1111/j.1525-1497.2005.00311.x
- Sawicki, GS, Lukens-Bull, K, Yin, X, Demats, N, Huang, IC, Livingood, W, Reiss, J and Wood, D. Measuring the transition readiness of youth with special healthcare needs: Validation of the TRAQ – Transition Readiness Assessment Questionnaire. Journal of Pediatric Psychology, 2009: 1–12. DOI: 10.1093/jpepsy/jsp128
- Schaefer, JA, Cronkite, R and Ingudomnukul, E. Assessing continuity of care practices in substance use disorder treatment programs. Journal of Studies on Alcohol, 2004; 65(4): 513–520. DOI: 10.15288/jsa.2004.65.513
- Tobon, JI, Reid, GJ and Goffin, RD. Continuity of care in children’s mental health: Development of a measure. Administration and Policy in Mental Health, 2014; 41(5): 668–686. DOI: 10.1007/s10488-013-0518-0
- Center for Health Care Transition Improvement/Got Transition™. Health care transition resources: Current assessment of health care transition activities. 2014a. Available from:
http://www.gottransition.org/resources/index.cfm [23 January 2017]. - Center for Health Care Transition Improvement/Got Transition™. Health care transition resources: Health care transition process measurement tool. 2014b. Available from:
http://www.gottransition.org/resources/index.cfm [23 January 2017]. - Grimmer, K and Moss, J. The development, validity and application of a new instrument to assess the quality of discharge planning activities from the community perspective. International Journal for Quality in Health Care, 2001; 13(2): 109–116. DOI: 10.1093/intqhc/13.2.109
- Coleman, EA, Smith, JD, Frank, JC, Eilertsen, TB, Thiare, JN and Kramer, AM. Development and testing of a measure designed to assess the quality of care transitions. International Journal of Integrated Care, 2002; 2(2): 1–9. DOI: 10.5334/ijic.60
- Graetz, I, Reed, M, Shortell, SM, Rundall, TG, Bellows, J and Hsu, J. The next step towards making use meaningful: Electronic information exchange and care coordination across clinicians and delivery sites. Medical Care, 2014; 52(12): 1037–1041. DOI: 10.1097/MLR.0000000000000245
- Coleman, EA, Mahoney, E and Parry, C. Assessing the quality of preparation for posthospital care from the patient’s perspective: The care transitions measure. Medical Care, 2005; 43(3): 246–255. DOI: 10.1097/00005650-200503000-00007
- Parry, C, Mahoney, E, Chalmers, SA and Coleman, EA. Assessing the quality of transitional care: Further applications of the care transitions measure. Medical Care, 2008; 46(3): 317–322. DOI: 10.1097/MLR.0b013e3181589bdc
- Conrad, DA, Cave, SH, Lucas, M, Harville, J, Shortell, SM, Bazzoli, GJ, et al. Community care networks: Linking vision to outcomes for community health improvement. Medical Care Research and Review, 2003; 60(4): 95S–129S.
- Fletcher, BW, Lehman, WEK, Wexler, HK, Melnick, G, Taxman, FS and Young, DW. Measuring collaboration and integration activities in criminal justice and substance abuse treatment agencies. Drug and Alcohol Dependence, 2009; 103(1): S54–S64.
- Singer, SJ, Friedberg, MW, Kiang, MV, Dunn, T and Kugn, DM. Development and preliminary validation of the patient perceptions of integrated care survey. Medical Care Research and Review, 2012; 70(2): 143–164. DOI: 10.1177/1077558712465654
- VicHealth. The partnerships analysis tool: For partners in health promotion. 2003. Available from:
https://www.vichealth.vic.gov.au/ . - Morrissey, JP, Calloway, M, Bartko, WT, Ridgely, MS, Goldman, HS and Paulson, RI. Providing treatment to persons with mental illness. The Milbank Quarterly, 1994; 72(1): 49–80. DOI: 10.2307/3350338
- Pagliccia, N, Spiegel, J, Alegret, M, Bonet, M, Martinez, B and Yassi, A. Network analysis as a tool to assess the intersectoral management of health determinants at the local level: A report from an exploratory study of two Cuban municipalities. Social Science and Medicine, 2010; 71(2): 394–399. DOI: 10.1016/j.socscimed.2010.03.041
- Amoroso, C, Proudfoot, J, Bubner, T, Jayasinghe, UW, Holton, C, Winstanley, J, Beiby, J and Harris, MF. The PracCap Research. Validation of an instrument to measure inter-organisational linkages in general practice. International Journal of Integrated Care, 2007; 7(3): 1–11. DOI: 10.5334/ijic.216
- Meredith, LS, Eisenman, DP, Green, BL, Basurto-Davila, R, Cassells, A and Tobin, J. System factors affect the recognition and management of posttraumatic stress disorder by primary care clinicians. Medical Care, 2009; 47(6): 686–694. DOI: 10.1097/MLR.0b013e318190db5d
- Morrissey, J, Calloway, M, Johnsen, M and Ullman, M. Service system performance and integration: A baseline profile of the ACCESS demonstration sites access to community care and effective services and supports. Psychiatric Services, 1997; 48(3): 374–380. DOI: 10.1176/ps.48.3.374
- Tucker, S, Baldwin, R, Hughes, J, Benbow, S, Barker, A, Burns, A and Challis, D. Old age mental health services in England: Implementing the national service framework for older people. International Journal of Geriatric Psychiatry, 2007; 22(3): 211–217. DOI: 10.1002/gps.1662
- Browne, G, Roberts, J, Gafni, A, Byrne, C, Kertyzia, J and Loney, P. Conceptualizing and validating the human services integration measure. International Journal of Integrated Care, 2004; 4(19): 1–9. DOI: 10.5334/ijic.98
- Reilly, S, Challis, D, Burns, A and Hughes, J. Does integration really make a difference? A comparison of old age psychiatry services in England and Northern Ireland. International Journal of Geriatric Psychiatry, 2003; 18(10): 887–893. DOI: 10.1002/gps.942
- Passalent, L, Kennedy, C, Warmington, K, Soever, L, Lundon, K, Shupak, R, Lineker, S and Schneider, R. System integration and clinical utilization of the advanced clinician practitioner in arthritis care (ACPAC) program–trained extended role practitioners in Ontario: A two-year, system-level evaluation. Healthcare Policy, 2013; 8(4): 56–70. DOI: 10.12927/hcpol.2013.23396
- Arora, NK, Reeve, BB, Hays, RD, Clauser, SB and Oakley-Girvan, I. Assessment of quality of cancer-related follow-up care from the cancer survivor’s perspective. Journal of Clinical Oncology, 2011; 29(10): 1280–1289. DOI: 10.1200/JCO.2010.32.1554
- Bennett, C, Graham, ID, Kristjansson, E, Kearing, SA, Clay, KF and O’Connor, AM. Validation of a preparation for decision making scale. Patient Education and Counseling, 2010; 78(1): 130–133. DOI: 10.1016/j.pec.2009.05.012
- Damman, OC, Hendriks, M and Sixma, HJ. Towards more patient centred healthcare: A new consumer quality index instrument to assess patients’ experiences with breast care. European Journal of Cancer, 2009; 45(9): 1569–1577. DOI: 10.1016/j.ejca.2008.12.011
- Deber, RB, Kratschmer, N and Irvine, J. What role do patients wish to play in treatment decision making? Archives of Internal Medicine, 1996; 156(13): 1414–1420. DOI: 10.1001/archinte.1996.00440120070006
- De Kok, M, Scholte, RW, Sixma, HJ, van der Weijden, T, Spijkers, KF, van de Velde, CJH, Roukema, JA, van der Ent, FW, Bell, AVRJ and von Meyenfeldt, MF. The patient’s perspective of the quality of breast cancer care. The development of an instrument to measure quality of care through focus groups and concept mapping with breast cancer patients. European Journal of Cancer, 2007; 43: 1257–1264. DOI: 10.1016/j.ejca.2007.03.012
- Edwards, A, Elwyn, G, Hood, K, Robling, M, Atwell, C, Holmes-Rovner, M, Kinnersley, P, Houston, H and Russell, I. The development of COMRADE-a patient-based outcome measure to evaluate the effectiveness of risk communication and treatment decision making in consultations. Patient Education and Counseling, 2003; 50(3): 311–322. DOI: 10.1016/S0738-3991(03)00055-7
- Farin, E, Gramm, L and Kosiol, D. Development of a questionnaire to assess communication preferences of patients with chronic illness. Patient Education and Counseling, 2011; 82: 81–88. DOI: 10.1016/j.pec.2010.02.011
- Gagnon, M, Hebert, R, Dube, M and Dubois, MF. Development and validation of an instrument measuring individual empowerment in relation to personal health care: The health care empowerment questionnaire (HCEQ). American Journal of Health Promotion, 2006; 20(6): 429–435. DOI: 10.4278/0890-1171-20.6.429
- Galassi, JP, Schanberg, R and Ware, WB. The patient reactions assessment: A brief measure of the quality of the patient-provider medical relationship. Psychological Assessment, 1992; 4(3): 346–351. DOI: 10.1037/1040-3590.4.3.346
- Hays, RD, Shaul, JA, Williams, VS, Lubalin, JS, Harris-Kojetin, LD, Sweeny, SF and Cleary, PD. Psychometric properties of the CAHPS™ 1.0 survey measures. Medical Care, 1999; 37(3): MS22–MS31. DOI: 10.1097/00005650-199903001-00003
- Holmes-Rovner, M, Kroll, J, Schmitt, N, Rovner, DR, Breer, ML, Rothert, ML, Padonu, G and Talarczyk, G. Patient satisfaction with health care decisions: The satisfaction with decision scale. Medical Decision Making, 1996; 16(1): 58–64. DOI: 10.1177/0272989X9601600114
- Jenkinson, C, Coulter, A and Bruster, S. The picker patient experience: Development and validation using data from in-patient surveys in five countries. International Journal for Quality in Health Care, 2002; 14(5): 353–358. DOI: 10.1093/intqhc/14.5.353
- Kim, SC, Boren, D and Solem, SL. The Kim alliance scale: Development and preliminary testing. Clinical Nursing Research, 2001; 10(3): 314–331. DOI: 10.1177/c10n3r7
- Légaré, F, Kearing, S, Clay, K, Gagnon, S, D’Amours, D, Rousseau, M and O’Connor, A. Are you SURE? Assessing patient decisional conflict with a 4-item screening test. Canadian Family Physician, 2010; 56(8): e308–14.
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC2920798/pdf/056e308.pdf . - Lerman, CE, Brody, DS, Caputo, GC, Smith, DG, Lazaro, CG and Wolfson, HG. Patients’ perceived involvement in care scale: Relationship to attitudes about illness and medical care. Journal of General Internal Medicine, 1990; 5(1): 29–33. DOI: 10.1007/BF02602306
- Little, P, Everitt, H, Williamson, I, Warner, G, Moore, M, Gould, C, Ferrie, K and Payne, S. Observational study of effect of patient centredness and positive approach on outcomes of general practice consultation. British Medical Journal, 2001; 323(7318): 908–911. DOI: 10.1136/bmj.323.7318.908
- Marco, CA, Buderer, N and Thum, D. End-of-life care: Perspectives of family members of deceased patients. American Journal of Hospice and Palliative Medicine, 2005; 22(1): 26–31. DOI: 10.1177/104990910502200108
- Martin, LR, DiMatteo, MR and Lepper, HS. Facilitation of patient involvement in care: Development and validation of a scale. Behavioral Medicine, 2001; 37(3): 111–120. DOI: 10.1080/08964280109595777
- Meakin, R and Weinman, J. The Medical Interview Satisfaction Scale (MISS-21) adapted for British general use. Family Practice, 2002; 19(3): 257–263. DOI: 10.1093/fampra/19.3.257
- Mercer, SW, Maxwell, M, Heaney, D and Watt, GCM. The consultation and relational empathy (CARE) measure: development and preliminary validation and reliability of an empathy-based consultation process measure. Family Practice, 2004; 21(6): 699–705. DOI: 10.1093/fampra/cmh621
- O’Connor, AM. Validation of a decisional conflict scale. Medical Decision Making, 1995; 15(1): 25–30. DOI: 10.1177/0272989X9501500105
- Safran, DG, Kosinsk, M, Tarlov, AR, Rogers, WH, Taira, DA, Lieberman, NBA and Ware, JE. The primary care assessment survey: Tests of data quality and measurement performance. Medical Care, 1998; 36(5): 728–739. DOI: 10.1097/00005650-199805000-00012
- Simon, D, Schorr, G, Wirtz, M, Vodermaier, A, Caspari, C, Neuner, B, Spies, C, et al. Development and first validation of the shared decision-making questionnaire (SCM-Q). Patient Education and Counseling, 2006; 63(3): 319–327. DOI: 10.1016/j.pec.2006.04.012
- Sixma, HJ, Kerssens, JJ, Campen, CV and Peters, L. Quality of care from the patients’ perspective: From theoretical concept to a new measuring instrument. Health Expectations, 1998; 1: 82–95. DOI: 10.1046/j.1369-6513.1998.00004.x
- Stewart, AL, Napoles-Springer, AM, Gregorich, SE and Santoyo-Olsson, J. Interpersonal processes of care survey: Patient-reported measures for diverse groups. Health Research and Educational Trust, 2007; 42(3): 1235–1256. DOI: 10.1111/j.1475-6773.2006.00637.x
- Ainsworth, F, Cowan, E and Trieschman, AE. Family centered group care practice: Model building. Child and Youth Care Forum, 1998; 27(1): 59–69. DOI: 10.1007/BF02589528
- Campbell, C, Lockyer, J, Laidlaw, T and MacLeod, H. Assessment of a matched-pair instrument to examine doctor-patient communication skills in practising doctors. Medical Education, 2007; 14: 123–129. DOI: 10.1111/j.1365-2929.2006.02657.x
- Elwyn, G, Edwards, A, Wensing, M, Hood, K, Atwell, C and Grol, R. Shared decision making: developing the OPTION scale for measuring patient involvement. Quality and Safety in Health Care, 2003; 12(2): 93–99. DOI: 10.1136/qhc.12.2.93
- Elwyn, G, Tsulukidze, M, Edwards, A, Legare, F and Newcombe, R. Using a “talk” model of shared decision making to propose an observation-based measure: Observer OPTION5’. Patient Education and Counseling, 2013; 93(2): 265–271. DOI: 10.1016/j.pec.2013.08.005
- Heggland, LH, Mikkelsen, A, Ogaard, T and Hausken, K. Measuring patient participation in surgical treatment decision-making from healthcare professionals’ perspective. Journal of Clinical Nursing, 2012; 23(3–4): 482–491. DOI: 10.1111/jocn.12184
- Agnew-Davies, R, Stiles, WB, Hardy, GE, Barkham, M and Shapiro, DA. Alliance structure assessed by the Agnew Relationship Measure (ARM). British Journal of Clinical Psychology, 1998; 37(2): 155–172. DOI: 10.1111/j.2044-8260.1998.tb01291.x
- Cegala, DJ, Thoesen Coleman, M and Turner, JW. The development and partial assessment of the medical communication competence scale. Health Communication, 1998; 10(3): 261–288. DOI: 10.1207/s15327027hc1003_5
- Shields, CG, Franks, P, Fiscella, K, Meldrum, S and Epstein, RM. Rochester Participatory Decision-Making Scale (RPAD): Reliability and validity. Annals of Family Medicine, 2005; 3(5): 436–442. DOI: 10.1370/afm.305
- Kim, SC, Kim, S and Boren, D. The quality of therapeutic alliance between patient and provider predicts general satisfaction. Military Medicine, 2008; 173(1): 85–90. DOI: 10.7205/MILMED.173.1.85
- Flocke, SA. Measuring attributes of primary care: Development of a new instrument. Journal of Family Practice, 1997; 45(1): 64–74.
- Friedberg, MW, Safran, DG, Coltin, KL, Dresser, M and Schneider, EC. Readiness for the patient-centered medical home: Structural capabilities of Massachusetts Primary Care Practices. Journal of General Internal Medicine, 2008; 24(2): 162–9. DOI: 10.1007/s11606-008-0856-x
- Rittenhouse, DR, Casalino, LP, Gillies, RR, Shortell, SM and Lau, B. Measuring the medical home infrastructure in large medical groups. Health Affairs, 2008; 27(5): 1246–1258. DOI: 10.1377/hlthaff.27.5.1246
- Rodrigues, LBB, Leite, AC, Yamamura, M, Deon, KC and Arcencio, RA. Coordenação das redes de atenção à saúde pela atenção primária: validação semântica de um instrumento adaptado. [Coordination of primary healthcare networks: Semantic validation of an adapted instrument]. Cadernos de Saúde Pública, 2014; 30(7): 1384–1390. DOI: 10.1590/0102-311X00137613
- Birnberg, JM, Drum, ML, Huang, ES, Casalino, LP, Lewis, SE, Vable, AM, Tang, H, Quinn, M, Burnet, DL, Summerfelt, T and Chin, MH. Development of a Safety Net Medical Home Scale for Clinics. Journal of General Internal Medicine, 2011; 26(12): 1418–1425. DOI: 10.1007/s11606-011-1767-9
- Center for Medical Home Improvement. The medical home index: Adult 2008. Available from:
http://depts.washington.edu/lend/links/CMHI-MHI-Adult-Primary-Care_Full-Version.pdf [24 January 2017]. - Cooley, WC, McAllister, JW, Sherrieb, K and Clark, RE. The medical home index: Development and validation of a new practice-level measure of implementation of the medical home model. Ambulatory Pediatrics, 2003; 3(4): 173–180. DOI: 10.1367/1539-4409(2003)003<;0173:TMHIDA>2.0.CO;2
- Nikbakht-Van, M, Pruyn, JFA and Van der Rijt, CCD. Function of local networks in palliative care: A Dutch view. Journal of Palliative Medicine, 2005; 8(4): 808–816. DOI: 10.1089/jpm.2005.8.808
- Cassady, CE, Starfield, B, Hurtado, MP, Berk, RA, Nanda, JP and Friedenberg, LA. Measuring consumer experiences with primary care. Pediatrics, 2000; 105(4): 998–1003.
- Center for Medical Home Improvement. The medical home index: Revised short form: Pediatric 2006. [cited 24 January 2017]. Available from:
https://medicalhomeinfo.aap.org/tools-resources/Documents/CMHI-MHI-Pediatric_Short-Version.pdf . - McDonald, KM, Schultz, E, Albin, L, Pineda, N, Lonhart, J, Sundaram, V, Smith-Spangler, C, Brustrom, J, Malcolm, E, Rohn, L and Davies, S.
Care coordination measures atlas update June 2014, US Department of Health & Human Services . Washington DC: Agency for Healthcare Research and Quality; 2014. - Rodrigues, LBB, Benedita dos Santo, C, Leiko Takamatsu Goyata, S, Paschoal Popolin, M, Yamamura, M, Christiane Deon, K, Miguel Veles Lapao, L, et al. Assessment of the coordination of integrated health service delivery networks by the primary health care: COPAS questionnaire validation in the Brazilian context. BMC Family Practice, 2015; 16(87): 1–9. DOI: 10.1186/s12875-015-0299-5
- Amundson, SJ. The impact of relational norms on the effectiveness of health and human service teams. The Health Care Manager, 2005; 24(3): 216–224. DOI: 10.1097/00126450-200507000-00005
- Bateman, B, Wilson, FC and Bingham, D. Team effectiveness – development of an audit questionnaire. Journal of Management Development, 2002; 21(3): 215–226. DOI: 10.1108/02621710210420282
- Cramm, JM and Nieboer, AP. Professionals’ views on interprofessional stroke team functioning. International Journal of Integrated Care, 2011; 11(3): 1–8. DOI: 10.5334/ijic.657
- Schroder, C, Medves, J, Paterson, M, Byrnes, V, Chapman, C, O’Riordan, A, Pichora, D and Kelly, C. Journal of Interprofessional Care, 2011; 25(3): 189–195. DOI: 10.3109/13561820.2010.532620
- Shortell, SM, Rousseau, DM, Gillies, RR, Devers, KJ and Simons, TL. Organizational assessment in intensive care units (ICUs): Construct development, reliability, and validity of the ICU nurse-physician questionnaire. Medical Care, 1991; 29(8): 709–726. DOI: 10.1097/00005650-199108000-00004
- Smits, SJ, Falconer, JA, Herrin, J, Bowen, SE and Strasser, DC. Patient-focused rehabilitation team cohesiveness in veterans administration hospitals. Archives of Physical Medicine and Rehabilitation, 2003; 84(9): 1332–1338. DOI: 10.1016/S0003-9993(03)00197-7
- Temkin-Greener, H, Gross, D, Kunitz, SJ and Mukamel, D. Measuring interdisciplinary team performance in a long-term care setting. Medical Care, 2004; 42(5): 472–481. DOI: 10.1097/01.mlr.0000124306.28397.e2
- Undre, S, Healey, AN, Darzi, A and Vincent, CA. Observational assessment of surgical teamwork: A feasibility study. World Journal of Surgery, 2006; 30(10): 1774–1783. DOI: 10.1007/s00268-005-0488-9
- Vinokur-Kaplan, D. Treatment teams that work (and those that don’t): An application of hackman’s group effectiveness model to interdisciplinary teams in psychiatric hospitals. Journal of Applied Behavioral Science, 1995; 31(3): 303–327. DOI: 10.1177/0021886395313005
- Lurey, JS and Raisinghani, MS. An empirical study of best practices in virtual teams. Information & Management, 2001; 38(8): 523–544. DOI: 10.1016/S0378-7206(01)00074-X
- Staples, DS and Webster, J. Exploring traditional and virtual team members “Best Practices”: A social cognitive theory perspective. Small Group Research, 2007; 38(1): 60–97. DOI: 10.1177/1046496406296961
- Hepburn, K, Tsukuda, RA and Fasser, C.
Team skills scale , 1996. In: Geriatric interdisciplinary team training. Seigler, EL, Hyer, K, Fulmer, T and Mezey, M (eds). New York: Springer Publishing Company; 1998: 264–265. - Ainsworth, J and Buchan, I. COCPIT: An instrument for integrated care pathway variance analysis. Quality of Life through Quality of Information, 2012; 180: 995–999.
- Vanhaecht, K, De Witte, K, Depreitere, R, Van Zelm, R, De Bleser, L, Proost, K and Sermeus, W. Development and validation of a care process self-evaluation tool. Health Services Management Research, 2007; 20(3): 189–202. DOI: 10.1258/095148407781395964
- Van Houdt, S, Heyrman, J, Vanhaecht, K, Sermeus, W and De Lepeleire, J. Care pathways to improve care co-ordination and quality between primary and hospital care for patients with radical prostatectomy: a quality improvement project. Quality in Primary Care, 2013; 21(3): 149–55.
- Wagner, C, Thompson, CA, Arah, OA, Groene, O, Klazinga, N, Dersarkissian, M and Sunol, R. A checklist for patient safety rounds at the care pathway level. International Journal for Quality in Health Care, 2014; 26(1): 36–46. DOI: 10.1093/intqhc/mzu019
- Whittle, CL, McDonald, PS, Dunn, L and de Luc, K. Developing the integrated care pathway appraisal instrument (ICPAT): a pilot study. Journal of Integrated Care Pathways, 2004; 8(2): 77–81. DOI: 10.1177/147322970400800207
- Drewes, HW, de Jong-van Til, JT, Struijs, JN, Baan, CA, Tekle, FB, Meijboom, BR and Westert, GP. Measuring chronic care management experience of patients with diabetes: PACIC and PACIC+ validation. International Journal of Integrated Care, 2012; 12(1): 1–11. DOI: 10.5334/ijic.862
- Glasgow, RE, Wagner, EH, Schaefer, J, Mahoney, LD, Reid, RJ and Greene, SM. Development and validation of the patient assessment of chronic illness care (PACIC). Medical Care, 2005; 43(5): 436–444. DOI: 10.1097/01.mlr.0000160375.47920.8c
- Wagner, EH, Austin, BT and Von Korff, M. Organizing care for patients with chronic illness. The Milbank Quarterly, 1996; 511–544. DOI: 10.2307/3350391
- Whittle, C and Hewison, A. Integrated care pathways: pathways to change in health care? Journal of Health Organization and Management, 2007; 21(3): 297–306. DOI: 10.1108/14777260710751753
- Guthrie, B, Saultz, JW, Freeman, GF and Haggerty, JL. Continuity of care matters. British Medical Journal, 2008: 337: a867. DOI: 10.1136/bmj.a867
- Suter, E and Mallinson, S.
Accountability for coordinated/integrated health services delivery . Regional Office for Europe: World Health Organization; 2015, working paper.http://www.euro.who.int/__data/assets/pdf_file/0003/286149/Accountability_for_coordinated_integrated_health_services_delivery.pdf?ua=1 . - Stewart, LJ and Greisler, D. Measuring primary care practice performance within an integrated delivery system: A case study. Journal of Healthcare Management, 2002; 47(4): 250–261.
- Williams, JW and Manning, JS. Collaborative mental health and primary care for bipolar disorder. Journal of Psychiatric Practice, 2008; 14(2): 55–64. DOI: 10.1097/01.pra.0000320127.84175.20
- Andrade, GRBD, Vaitsman, J and Farias, LO. Metodologia de elaboração do Índice de Responsividade do Serviço (IRS). [Methodology for developing a health service responsiveness index (SRI).] Cadernos de Saúde Pública, 2010; 26(3): 523–534. [in Portuguese]. DOI: 10.1590/S0102-311X2010000300010
- Chou, AF, Nagykaldi, Z, Aspy, CB and Mold, JW. Promoting patient-centered preventive care using a wellness portal: Preliminary findings. Journal of Primary Care and Community Health, 2010; 1(2): 88–92. DOI: 10.1177/2150131910365358
- Wilkinson, DL and McCarthy, M. Use of comparative data for integrated cancer services. BMC Health Services Research, 2007; 7(204): 204–211. DOI: 10.1186/1472-6963-7-204
- Cameron, KS and Quinn, RE.
Diagnosing and changing organizational culture: Based on the competing values framework . San Francisco: John Wiley & Sons; 2005. - Molden, MM, Brown, CL and Griffith, BF. At the heart of integration: Aligning physicians and administrators to create new value. Frontiers of Health Services Management, 2013; 29(4): 3.
- Chesluk, BJ, Bernabeo, E, Hess, B, Lynn, LA, Reddy, S and Holmboe, ES. A new instrument to give hospitalists feedback to improve interprofessional teamwork and advance patient care. Health Affairs, 2012; 31(11): 2485–2492. DOI: 10.1377/hlthaff.2011.0611
- Dynan, L, Bazzoli, GJ and Burns, LR. Assessing the extent of integration achieved through physician-hospital arrangements. Journal of Healthcare Management, 1998; 43(3): 242–243.
- Milette, L, Hebert, R and Veil, A. Integrated service delivery networks for seniors: Early perceptions of family physicians. Canadian Family Physician, 2005; 51(8): 1104–1105. Available from:
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC1479506/pdf/jCFP_v051_pg1105.pdf . - Southern, DM, Appleby, NJ and Young, D. Integration from the Australian GP’s perspective. Australian Family Physician, 2001; 30(2): 182–188.
- Bradford, J, Honnold, J, Rives, ME and Hafford, K. The effectiveness of resource allocation methods used by RWCA title II consortia in Virginia. AIDS and Public Policy Journal, 2000; 15(1): 29–42.
- Abendstern, M, Reilly, S, Hughes, J, Venables, D and Challis, D. Levels of integration and specialisation within professional community teams for people with dementia. International Journal of Geriatric Psychiatry, 2006; 21(1): 77–85. DOI: 10.1002/gps.1427
- Bainbridge, D, Brazil, K, Krueger, P, Ploeg, J, Taniguchi, A and Damay, J. Measuring horizontal integration among health care providers in the community: an examination of a collaborative process within a palliative care network. Journal of Interprofessional Care, 2015; 29(3): 245–252. DOI: 10.3109/13561820.2014.984019
- Devers, KJ, Shortell, SM, Gillies, RR, Anderson, DA, Mitchell, JB and Erickson, KLM. Implementing organized delivery systems: An integration scorecard. Health Care Management Review, 1994; 19(3): 7–20. DOI: 10.1097/00004010-199422000-00003
- Friedman, EL, Chawla, N, Morris, PT, Castro, KM, Carrigan, AC, Prabhu Das, I and Clauser, SB. Assessing the development of multidisciplinary care: Experience of the national cancer institute community cancer centers program. Journal of Oncology Practice, 2015; 11(1): e36–e43. DOI: 10.1200/JOP.2014.001535
- Gillies, RR, Shortell, SA, Anderson, DA, Mitchell, JB and Morgan, KL. Conceptualizing and measuring integration: Findings from the health systems integration study. Hospital and Health Services Administration, 1993; 38(4): 467–489.
- Nelson, EC, Batalden, PB, Huber, TP, Mohr, JJ, Godfrey, MM, Headrick, LA and Wasson, JH. Microsystems in health care: Part 1. Learning from high performing front-line clinical units. Journal of Quality Improvement, 2002; 28(9): 472–493. DOI: 10.1016/S1070-3241(02)28051-7
- Ouwens, MMMTJ, Marres, HAM, Hermens, RRP, Hulscher, MME, van den Hoogen, FJA, Grol, RP and Wollersheim, HCH. Quality of integrated care for patients with head and neck cancer: Development and measurement of clinical indicators. Measuring Quality of Integrated Care, 2007; 29(4): 378–386. DOI: 10.1002/hed.20532
- The MacColl Center for Health Care Innovation at Group Health Research Institute and Qualis Health.
The Patient-Centered Medical Home Assessment Version 4.0 . Seattle: Safety Net Medical Home Initiative; 2014 Sept. [cited 2017 Feb 10]. Available from:http://www.safetynetmedicalhome.org/sites/default/files/PCMH-A.pdf . - SAMHSA-HRSA Center for Integrated Health Solutions. Organizational Assessment Toolkit for Primary and Behavioural Health Care Integration 2014. [cited 2017 January 24]. Available from:
http://www.integration.samhsa.gov/operations-administration/OATI_Overview_FINAL.pdf . - Martin, LA, Nelson, EC, Lloyd, RC and Nolan, TW.
Whole System Measures. IHI Innovation Series white paper . Cambridge, Massachusetts: Institute for Healthcare Improvement; 2007. [cited 2017 24 January]. Available from:http://www.ihi.org/resources/pages/ihiwhitepapers/wholesystemmeasureswhitepaper.aspx . - Paulhus, DL and Vazire, S. The self-report method. In handbook of research methods in personality psychology, 2007; 1: 224–239.
- Luxford, K and Sutton, S. How does patient experience fit into the overall healthcare picture? Patient Experience Journal, 2014; 1(1): 20–27.
- Clinton-McHarg, T, Yoong, SL, Tzelepis, F, Regan, T, Fielding, A, Skelton, E, Kingsland, M, Ying Ooi, J and Wofenden, L. Psychometric properties of implementation measures for public health and community settings and mapping of constructs against the Consolidated Framework for Implementation Research: a systematic review. Implementation Science, 2016; 11: 148–170. DOI: 10.1186/s13012-016-0512-5
- Squires, JE, Estabrooks, CA, O’Rourke, HM, Bustavsson, P, Newburn-Cook, C and Wallin, L. A systematic review of the psychometric properties of self-report research utilization measures used in healthcare. Implementation Science, 2011; 6: 83–101. DOI: 10.1186/1748-5908-6-83
- Bennett, C, Khangura, S, Brehaut, J, Graham, ID, Moher, D, Potter, BK and Grimshaw, JM. Reporting guidelines for survey research: An analysis of published guidance and reporting practices. PLoS Medicine, 2011; 8(8): 1–11. DOI: 10.1371/journal.pmed.1001069
DOI: https://doi.org/10.5334/ijic.3931 | Journal eISSN: 1568-4156
Language: English
Submitted on: Apr 11, 2017
Accepted on: Oct 24, 2017
Published on: Nov 13, 2017
Published by: Ubiquity Press
In partnership with: Paradigm Publishing Services
Publication frequency: 4 issues per year
© 2017 Esther Suter, Nelly D. Oelke, Maria Alice Dias da Silva Lima, Michelle Stiphout, Robert Janke, Regina Rigatto Witt, Cheryl Van Vliet-Brown, Kaela Schill, Mahnoush Rostami, Shelanne Hepp, Arden Birney, Fatima Al-Roubaiai, Giselda Quintana Marques, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.