Profiling quality of care: Is there a role for peer reviewReport as inadecuate

Profiling quality of care: Is there a role for peer review - Download this document for free, or read online. Document in PDF available to download.

BMC Health Services Research

, 4:9

First Online: 19 May 2004Received: 05 February 2004Accepted: 19 May 2004DOI: 10.1186-1472-6963-4-9

Cite this article as: Hofer, T.P., Asch, S.M., Hayward, R.A. et al. BMC Health Serv Res 2004 4: 9. doi:10.1186-1472-6963-4-9


BackgroundWe sought to develop a more reliable structured implicit chart review instrument for use in assessing the quality of care for chronic disease and to examine if ratings are more reliable for conditions in which the evidence base for practice is more developed.

MethodsWe conducted a reliability study in a cohort with patient records including both outpatient and inpatient care as the objects of measurement. We developed a structured implicit review instrument to assess the quality of care over one year of treatment. 12 reviewers conducted a total of 496 reviews of 70 patient records selected from 26 VA clinical sites in two regions of the country. Each patient had between one and four conditions specified as having a highly developed evidence base diabetes and hypertension or a less developed evidence base chronic obstructive pulmonary disease or a collection of acute conditions. Multilevel analysis that accounts for the nested and cross-classified structure of the data was used to estimate the signal and noise components of the measurement of quality and the reliability of implicit review.

ResultsFor COPD and a collection of acute conditions the reliability of a single physician review was quite low intra-class correlation = 0.16–0.26 but comparable to most previously published estimates for the use of this method in inpatient settings. However, for diabetes and hypertension the reliability is significantly higher at 0.46. The higher reliability is a result of the reviewers collectively being able to distinguish more differences in the quality of care between patients p < 0.007 and not due to less random noise or individual reviewer bias in the measurement. For these conditions the level of true quality i.e. the rating of quality of care that would result from the full population of physician reviewers reviewing a record varied from poor to good across patients.

ConclusionsFor conditions with a well-developed quality of care evidence base, such as hypertension and diabetes, a single structured implicit review to assess the quality of care over a period of time is moderately reliable. This method could be a reasonable complement or alternative to explicit indicator approaches for assessing and comparing quality of care. Structured implicit review, like explicit quality measures, must be used more cautiously for illnesses for which the evidence base is less well developed, such as COPD and acute, short-course illnesses.

Electronic supplementary materialThe online version of this article doi:10.1186-1472-6963-4-9 contains supplementary material, which is available to authorized users.

Download fulltext PDF

Author: Timothy P Hofer - Steven M Asch - Rodney A Hayward - Lisa V Rubenstein - Mary M Hogan - John Adams - Eve A Kerr


Related documents