This Article  • Full text  • PDF  • Send to a friend  • Save in My Folder  • Save to citation manager  • Permissions  Citing Articles  • Citation map  • Citing articles on HighWire  • Citing articles on ISI (8)  • Contact me when this article is cited  Related Content  • Related letters  • Similar articles in this journal  Topic Collections  • Cardiovascular System  • Quality of Care, Other  • Cardiovascular Disease/ Myocardial Infarction  • Alert me on articles by topic  Social Bookmarking   What's this?

Stephen D. Persell, MD, MPH; Jennifer M. Wright, MD; Jason A. Thompson, BA; Karen S. Kmetik, PhD; David W. Baker, MD, MPH

Arch Intern Med. 2006;166:2272-2277.

Background  Nationally endorsed, clinical performance measures are available that allow for quality reporting using electronic health records (EHRs). To our knowledge, how well they reflect actual quality of care has not been studied. We sought to evaluate the validity of performance measures for coronary artery disease (CAD) using an ambulatory EHR.

Methods  We performed a retrospective electronic medical chart review comparing automated measurement with a 2-step process of automated measurement supplemented by review of free-text notes for apparent quality failures for all patients with CAD from a large internal medicine practice using a commercial EHR. The 7 performance measures included the following: antiplatelet drug, lipid-lowering drug, -blocker following myocardial infarction, blood pressure measurement, lipid measurement, low-density lipoprotein cholesterol control, and angiotensin-converting enzyme inhibitor or angiotensin receptor blocker for patients with diabetes mellitus or left ventricular systolic dysfunction.

Results  Performance varied from 81.6% for lipid measurement to 97.6% for blood pressure measurement based on automated measurement. A review of free-text notes for cases failing an automated measure revealed that misclassification was common and that 15% to 81% of apparent quality failures either satisfied the performance measure or met valid exclusion criteria. After including free-text data, the adherence rate ranged from 87.5% for lipid measurement and low-density lipoprotein cholesterol control to 99.2% for blood pressure measurement.

Conclusions  Profiling the quality of outpatient CAD care using data from an EHR has significant limitations. Changes in how data are routinely recorded in an EHR are needed to improve the accuracy of this type of quality measurement. Validity testing in different settings is required.

Author Affiliations: Division of General Internal Medicine, Feinberg School of Medicine, Northwestern University (Drs Persell, Wright, and Baker and Mr Thompson), and American Medical Association (Dr Kmetik), Chicago, Ill.

CiteULike    Connotea    Del.icio.us    Digg    Reddit    Technorati     What's this?

RELATED LETTERS

Beware the Burden of Measurement
Christine A. Sinsky
Arch Intern Med. 2007;167(9):971-972.
EXTRACT | FULL TEXT  

Beware the Burden of Measurement—Reply
Stephen D. Persell, Jason A. Thompson, Karen S. Kmetik, and David W. Baker
Arch Intern Med. 2007;167(9):972.
EXTRACT | FULL TEXT  

THIS ARTICLE HAS BEEN CITED BY OTHER ARTICLES

Differences in Specialist Consultations for Cardiovascular Disease by Race, Ethnicity, Gender, Insurance Status, and Site of Primary Care
Cook et al.
Circulation 2009;119:2463-2470.
ABSTRACT | FULL TEXT  

Implementation and evaluation of electronic clinical decision support for compliance with pneumonia and heart failure quality indicators
Niemi et al.
Am J Health Syst Pharm 2009;66:389-397.
ABSTRACT | FULL TEXT  

Pay-for-Performance System for English Physicians
Rosof et al.
NEJM 2008;359:2176-2177.
FULL TEXT  

Quality Performance Measurement Using the Text of Electronic Medical Records
Pakhomov et al.
Med Decis Making 2008;28:462-470.
ABSTRACT  

Automatic Classification of Foot Examination Findings Using Clinical Notes and Machine Learning
Pakhomov et al.
J. Am. Med. Inform. Assoc. 2008;15:198-202.
ABSTRACT | FULL TEXT  

Use of an Electronic Patient Record System to Evaluate Restorative Treatment Following Root Canal Therapy
Shelley et al.
J Dent Educ 2007;71:1333-1339.
ABSTRACT | FULL TEXT  

Beware the Burden of Measurement--Reply
Persell et al.
Arch Intern Med 2007;167:972-972.
FULL TEXT  

Beware the Burden of Measurement
Sinsky
Arch Intern Med 2007;167:971-972.
FULL TEXT  

Automated Review of Electronic Health Records to Assess Quality of Care for Outpatients with Heart Failure
Baker et al.
ANN INTERN MED 2007;146:270-277.
ABSTRACT | FULL TEXT