You are seeing this message because your Web browser does not support basic Web standards. Find out more about why this message is appearing and what you can do to make your experience on this site better.


ABOUT ARCHIVES
Advanced Search

Welcome   | My Account | E-mail Alerts | RSS | Access Rights | Sign In


  Vol. 169 No. 3, February 9, 2009 TABLE OF CONTENTS
  Online Only
 •  Online First Table of
Contents
  Original Investigation
 •Online Features
 This Article
 •Abstract
 •PDF
 • Reply to article
 •Send to a friend
 • Save in My Folder
 •Save to citation manager
 •Permissions
 Citing Articles
 •Citation map
 •Citing articles on HighWire
 •Citing articles on Web of Science (44)
 •Contact me when this article is cited
 Related Content
 •Related letter
 •Similar articles in this journal
 Topic Collections
 •Quality of Care
 •Patient Safety/ Medical Error
 •Drug Therapy
 •Adverse Effects
 •Drug Therapy, Other
 •Alert me on articles by topic
 Social Bookmarking
  Add to CiteULike Add to Connotea Add to Delicious Add to Digg Add to Facebook Add to Reddit Add to Technorati Add to Twitter What's this?

Overrides of Medication Alerts in Ambulatory Care

Thomas Isaac, MD, MBA, MPH; Joel S. Weissman, PhD; Roger B. Davis, ScD; Michael Massagli, PhD; Adrienne Cyrulik, MPH; Daniel Z. Sands, MD, MPH; Saul N. Weingart, MD, PhD

Arch Intern Med. 2009;169(3):305-311.

ABSTRACT



Background  Electronic prescribing systems with decision support may improve patient safety in ambulatory care by offering drug allergy and drug interaction alerts. However, preliminary studies show that clinicians override most of these alerts.

Methods  We performed a retrospective analysis of 233 537 medication safety alerts generated by 2872 clinicians in Massachusetts, New Jersey, and Pennsylvania who used a common electronic prescribing system from January 1, 2006, through September 30, 2006. We used multivariate techniques to examine factors associated with alert acceptance.

Results  A total of 6.6% of electronic prescription attempts generated alerts. Clinicians accepted 9.2% of drug interaction alerts and 23.0% of allergy alerts. High-severity interactions accounted for most alerts (61.6%); clinicians accepted high-severity alerts slightly more often than moderate- or low-severity interaction alerts (10.4%, 7.3%, and 7.1%, respectively; P < .001). Clinicians accepted 2.2% to 43.1% of high-severity interaction alerts, depending on the classes of interacting medications. In multivariable analyses, we found no difference in alert acceptance among clinicians of different specialties (P = .16). Clinicians were less likely to accept a drug interaction alert if the patient had previously received the alerted medication (odds ratio, 0.03; 95% confidence interval, 0.03-0.03).

Conclusion  Clinicians override most medication alerts, suggesting that current medication safety alerts may be inadequate to protect patient safety.



INTRODUCTION


 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Author information
 •References

Adverse drug events (ADEs), defined as injuries due to medications, are common in primary care.1-4 In a study5 of 4 Boston adult outpatient practices, one-quarter of patients who received a prescription experienced an ADE during the 3 months of follow-up, and more than one-third of these injuries were preventable. Organizations such as the Institute of Medicine and the National Patient Safety Foundation indicated that electronic prescribing is an important tool for improving medication safety, and outpatient clinicians are increasingly adopting its use.6-8 Although rudimentary electronic prescribing can prevent errors through more legible and structured orders, experts believe that integrated clinical decision support, which can alert clinicians about inappropriate medications or harmful medication combinations, is needed to reduce the number of ADEs in ambulatory care.9-13

To date, studies10-12 that have examined outpatient electronic prescribing and clinical decision support alerts have been limited to a few clinicians at teaching hospitals. In 1 study12 of 5 academic primary care practices, clinicians accepted less than 10% of medication alerts, and physician reviewers concluded that more than one-third of all alerts lacked an adequate scientific basis or were not clinically useful. If the threshold for sending alerts to clinicians is set too low, prescribers may develop "alert fatigue," which can lead them to override important warnings.14

As clinicians increasingly adopt electronic prescribing, the development and dissemination of decision support systems will depend in part on whether clinicians find medication safety alerts valuable. To our knowledge, no studies have examined the behavior of clinicians regarding medication alerts in a large number of community practices or across clinicians of different specialties. This information may provide perspective on the perceived usefulness of electronic alerts in outpatient care and insights into how to design better alert systems, which, in turn, may reduce the number and severity of ADEs. Therefore, we studied the electronic prescribing behavior of clinicians in 3 states to address the following questions: How often do clinicians encounter medication safety alerts? How often do clinicians accept alerts, aborting a potentially dangerous prescription? Do accepted medication alerts vary depending on alert type (allergy vs drug interaction), alert severity, or the classes of interacting medications? Do certain characteristics of patients and clinicians affect the decision to accept an alert? Finally, what can we learn from clinician behavior regarding medication safety alerts that could be used to improve alert quality?


METHODS


 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Author information
 •References

STUDY SAMPLE

We studied electronic prescriptions and associated medication safety alerts generated by all clinicians who used a specific electronic prescribing system in Massachusetts, New Jersey, and Pennsylvania from January 1, 2006, through September 30, 2006. We included clinicians who wrote at least 50 prescriptions during the study period. These 2872 clinicians were distributed across 862 practices; 69% of eligible clinicians were from Massachusetts, 20% from New Jersey, and 11% from Pennsylvania. The study was approved in advance by the Dana-Farber Cancer Institute institutional review board.

ELECTRONIC PRESCRIBING SYSTEM

All study participants used PocketScript, an electronic prescribing system (Zix Corporation, Dallas, Texas), which enables clinicians to transmit prescriptions electronically to a pharmacy via a desktop computer or handheld device. The system creates a profile of a patient's active medications based on previous electronic prescriptions written by any member within the practice. The system also references dispensed drug history from the patient's pharmacy benefit management records, which has the added benefit of including information from handwritten prescriptions and prescriptions from other clinicians within the state. A patient's medication allergies must be entered into the system by the clinician or a member of the clinician's office staff. When an electronic prescription is written, the system alerts the clinician if the patient is allergic to the medication or if there is a drug-drug interaction (DDI) with one of the patient's active medications. The system uses a set of alerts maintained by Cerner Multum (Denver, Colorado), a health information technology company. Pharmacists at Cerner Multum use a consensus process to grade the severity of each potential DDI on a 3-tier scale (1 indicating high; 2, moderate; and 3, low) based on information from pharmaceutical companies and evidence in the scientific literature. When a DDI alert is generated, a warning banner with the severity category is displayed to the clinician. The prescriber may view a detailed description of the interaction, although this information does not appear on the initial screen. A prescriber may respond to an allergy or a DDI alert by (1) overriding the alert and continuing to prescribe the medication, (2) canceling the prescription altogether, or (3) rewriting (ie, changing) the prescription for a different medication.

PRESCRIPTION, CLINICIAN, AND PATIENT CHARACTERISTICS

We abstracted the following information from the electronic prescription database: prescription date and time, prescribed generic drug name and class, alert type (allergy or interaction), interacting generic drug name and class, alert severity level, action taken in response to an alert (override, cancel, or change), binary variable indicating whether the same generic drug had been prescribed to the patient previously, and device used to enter the prescription (handheld vs desktop computer). We abstracted deidentified clinician and practice identification numbers, clinician type (physician vs nonphysician), clinician specialty, number of electronic prescriptions written by each clinician during the study period, and length of time the clinician had been using an electronic prescribing system to write prescriptions. We also abstracted patient age, sex, and number of active medications at the beginning of the study period.

PRESCRIPTION ATTEMPTS AND MEDICATION ALERTS

If a patient takes multiple medications, several interaction warnings can arise from a single prescription attempt. Duplicate alerts can also appear for the same prescription if a clinician views an alert, cancels the prescription, and then reattempts to order the same medication.12 To eliminate duplicate alerts and to focus on the clinician's final decision of whether or not to prescribe after generating an alert, we selected the last observation of alerted prescription data sorted by physician, patient, prescribed generic drug name, date, and time.12 This eliminated 235 525 duplicate alerts, leaving 3 570 378 prescription attempts and 233 537 alerts in our final data set.

STATISTICAL ANALYSES

We performed analyses using the prescription writing attempt and the alert as units of analysis. We calculated alert rates for each clinician type and specialty by dividing the number of alerted prescription attempts by total prescription attempts. We examined a clinician's response to an alerted order as a dichotomous variable, accept vs override. Accepted orders included canceled prescription orders or a change of the alerted medication to an alternate drug. We calculated accept rates for each alert type, DDI severity, clinician type, and clinician specialty by dividing the number of accepted alerts by the total number of alerted prescriptions. We used the Fisher exact test to examine differences in alert rates and accept rates in each category. We also examined accept rates for interacting medication classes, limiting our analysis to combinations of drug classes that generated at least 50 alerts to achieve more stable estimates. Some drugs did not have a drug class specified, and in these instances we used the prescribed generic name in lieu of the drug class.

To examine characteristics of accepted alerts, we excluded allergy alerts (<2% of all alerts) because of variability with which practices entered patient allergy information into the electronic prescribing system. For adjusted analysis of DDI alerts, we excluded patients seen by a pediatrician or those younger than 18 since the safety concerns of medications for children differ from those for adults. We fit logistic regression models with generalized estimating equations using the response to the alerted prescription (accept vs override) as the binary outcome. We accounted for clustering nested within the practice at the clinician level and used an exchangeable correlation structure.

The multivariate model included patient age, sex, and number of active medications as independent predictors. We examined for differences in accept rates among patient age groups using a Wald test, and we examined for a linear trend across number of patient medication categories. We also examined the relationship between the decision to accept a DDI alert and clinician type, specialty, and experience with electronic prescribing. We examined number of prescriptions written during the study period and duration of time using electronic prescribing as indicators of electronic prescribing experience. Using Wald tests, we examined for differences in accept rates across clinician types, specialties, and categories of time since becoming an active prescriber and examined for a linear trend across categories of number of prescriptions written. Finally, we examined the relationship between the decision to accept an alert and prescription characteristics, including the type of device used to enter the prescription, severity level of the interaction, and whether the same generic drug had been prescribed to the patient previously. Since classes of prescribed medications are highly related to provider specialty and may therefore act as confounders, we included approximately 200 variables to adjust for the fixed effects of the most common class-class interactions. These variables accounted for more than 70% of all alerted orders. All analyses were conducted using a commercially available software program (SAS, version 9.1; SAS Institute, Cary, North Carolina).


RESULTS


 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Author information
 •References

CLINICIAN CHARACTERISTICS

Physicians accounted for 82.0% of the 2872 prescribing clinicians and made 86.7% of all electronic prescription attempts. Most clinicians were in primary care fields, with 21.9% in family medicine, 19.5% in internal medicine, 17.4% in pediatrics, and 3.3% in obstetrics-gynecology. Clinicians wrote 78.9% of electronic prescriptions using a desktop computer and 21.1% using a handheld device. Each clinician wrote a median of 754 electronic prescriptions (interquartile range, ±1423), with a range of 50 to 10 687 prescriptions. Clinicians had a median of 352 (interquartile range, ±426) days of experience with electronic prescribing, with a range of 0 to 1987 days.

ALERT CHARACTERISTICS AND ACCEPT RATES

During the study period, 6.6% of all attempted electronic prescriptions generated alerts. The DDI alerts and allergy alerts accounted for 98.3% and 1.7% of alerts, respectively (Table 1). Clinicians accepted DDI alerts less often than allergy alerts (9.2% vs 23.0%; Table 1; P < .001), although accept rates for both alert types were low. Most DDI alerts were high-severity (62.6%) or moderate-severity (29.6%) interactions. Clinicians were slightly more likely to heed major interactions than moderate interactions or minor interactions (10.4%, 7.3%, and 7.1%, respectively; P < .001).


View this table:
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Table 1. Alert Type and Accept Rates


ACCEPT RATES OF INTERACTING MEDICATION CLASSES

Among high-severity interactions, accept rates for classes of interacting drug combinations ranged from 2.2% to 43.1%. Table 2 lists the high-severity interactions that clinicians accepted most and least frequently. Among high-severity alerts, clinicians frequently overrode alerts for medications used in combination to treat certain diseases, such as corticosteroids and antirheumatic agents for rheumatoid arthritis. Clinicians commonly accepted alerts that involved combinations of antibiotics and antiarrhythmic medications or antibiotics and warfarin sodium.


View this table:
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Table 2. High-Severity Interactions With Highest and Lowest Accept Rates


FACTORS ASSOCIATED WITH ALERT DECISIONS

Table 3 gives the DDI alert rates and accept rates of different clinician types and specialties. In unadjusted analyses, physicians generated DDI alerts less often than nonphysicians (6.2% vs 8.2% of prescription attempts; P < .001), and physicians accepted a lower percentage of alerted prescriptions (9.0% vs 10.5%; P < .001). The alert rates varied by clinician specialty, from 1.2% for pediatricians to 27.5% for psychiatrists (P < .001). Accept rates varied by specialty as well, from 5.3% for psychiatrists to 17.7% for surgical specialists (P < .001).


View this table:
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Table 3. Electronic Prescription Attempts, Drug Interaction Alert Rates, and Drug Interaction Accept Rates by Clinician Type and Specialty


Table 4 gives the results of the multivariable model, which examined the factors associated with the clinician's decision to accept 20 180 of 219 517 DDI alerts. We found no difference in DDI acceptance for patients of different ages or sexes (P = .09 and .69, respectively). We did not find a linear trend between alert acceptance and number of active medications (P = .15), although clinicians were approximately half as likely to accept alerts of patients who took 2 or more medications compared with patients who took a single medication. Clinicians had higher odds of accepting high-severity alerts compared with low severity alerts (odds ratio, 1.43; 95% confidence interval, 1.10-1.87). Clinicians had much lower odds of accepting DDI alerts if the patient had previously received the alerted medication (odds ratio, 0.03; 95% confidence interval, 0.03-0.03). In contrast to the unadjusted analyses, we did not find any differences in acceptance of alerts between clinician types (physician vs nonphysician; P = .10) or among clinician specialties (P = .16). Clinicians who wrote more electronic prescriptions were less likely to accept DDI alerts than clinicians who wrote fewer prescriptions (P for trend <.001). However, clinicians who used the electronic prescribing system for a longer period were more likely to accept DDI alerts (P for trend <.001).


View this table:
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Table 4. Adjusted Odds Ratios of Accepting Interaction Alerts for Adult Patientsa



COMMENT


 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Author information
 •References

In this study of more than 3 million electronic prescriptions, we found that clinicians overrode most high-severity DDI alerts and allergy alerts. Clinicians distinguished among different alerts, accepting some DDI combinations more frequently than others, such as interactions between antiarrhythmic agents and antibiotics. Among high-severity DDI alerts, a 20-fold difference was found between alerts with the highest accept rate and lowest accept rate. In multivariable analyses, we found no difference in response to alerts among clinicians of different specialties.

This study offers several advantages over previous analyses of medication safety alerts in ambulatory care. We examined the behavior of a large group of community-based practitioners in response to medication alerts, and the sample size allowed us to examine responses to alerts for classes of interacting drug combinations and patient and clinician characteristics associated with alert acceptance. We found that clinicians discriminated among alerts based on their severity, the classes of interacting medications, and the patient's previous experience with the medication. Given the high override rate of all alerts, it appears that the utility of electronic medication alerts in outpatient practice is grossly inadequate. For active clinicians, most alerts may be more of a nuisance than an asset.

Our results are consistent with those of previous small studies12, 15 of practice sites affiliated with academic medical centers, which have shown that DDI and allergy alerts are commonly overridden. Several observers argue that to reduce the burden of outpatient ADEs, high-quality decision support must be an essential element of electronic prescribing systems.1, 9, 11, 16-17 However, few studies have examined ways to improve alert systems. In a survey of Veterans Health Affairs physicians, clinicians recommended that DDI alerts provide suggestions for alternative medications and that previously overridden medication alerts should not reappear for the same patient.18 Clinicians who use commercial electronic prescribing systems have suggested that extant decision support systems are inadequate.17

In a 2005 national survey, only 14% of outpatient physicians reported using electronic prescribing.8, 12 However, several government and private initiatives are under way to promote adoption. The E-prescribing and Medicare Modernization Act of 2003 created standards for electronic prescribing system data and subsidizes third parties to offset implementation costs.19 The National ePrescribing Patient Initiative, a coalition of private technology companies and insurers, offers free software to participating practices.12

Despite these efforts, the only clear evidence that computerized prescribing reduces ADEs is limited to the inpatient setting; only a few studies20-24 have examined its effectiveness in ambulatory care. Gandhi and colleagues11 found that basic electronic prescribing systems with structured orders and pick lists, but no advanced decision support, reduced the number of prescription writing errors but did not reduce the number of ADEs in 4 adult outpatient practices. Unless designers integrate high-quality decision support into electronic prescribing systems, substantial improvements in outpatient medication safety may not occur.

Our findings provide some insights into ways that designers may improve medication safety alerts. Although most DDI alerts were classified as high severity, clinicians accepted these alerts only slightly more frequently than lower severity alerts. Designers should consider reducing the proportion of alerts classified as high severity by reexamining and potentially reclassifying the alerts that are frequently overridden. By prioritizing a subset of high-severity alerts and only allowing these alerts to interrupt workflow, Shah and colleagues10 improved acceptance of these alerts to 67%. Designers should also provide an option for clinicians to suppress alerts for medications that patients had previously received, since most of these alerts are overridden. Finally, designers should consider customizing alerts depending on the clinician's specialty. For example, since psychiatrists encounter alerts in one-quarter of prescription attempts, they may be at higher risk for overriding important warnings. The usefulness of alerts may vary by clinician specialty, and reducing the number of frivolous alerts for each specialty may help improve alert adherence and enhance care.

Examination of the relationship between clinician experience and alert acceptance yielded mixed results. High-volume prescribers accepted medication alerts less often than lower-volume prescribers, raising concern that high-volume prescribers may become habituated to alerts and neglect potentially useful warnings. In contrast, clinicians who used electronic prescribing systems longer accepted more alerts than novice users. These findings are amenable to several possible interpretations. Experienced electronic prescribing clinicians may know more about alternative medications that can be prescribed after an alert is generated. Alternatively, experienced clinicians may learn to trust certain alerts over time. Further study is necessary to examine these possible relationships.

Our study has several limitations. First, we examined prescriptions written using 1 electronic prescribing system. However, the alerts we examined are typical of those encountered by clinicians, and the drug interaction database from Cerner Multum is used by many commercial electronic prescription systems. Second, our inference about an alert's utility was based on the clinician's decision to accept or override an alert. However, overridden alerts may be useful to clinicians if alerts prompt clinicians to change their behavior (eg, by observing a patient more closely or by ordering additional studies). Third, we assumed that a clinician's decision to override an alert was based on sound clinical judgment, although we were unable to validate this by reviewing the medical record. Previous studies25 have shown some examples of unjustified or dangerous prescribing behavior by clinicians. Finally, we could not examine several patient and clinician characteristics, such as patient comorbidities and clinician familiarity, with the use of electronic medical records.

In conclusion, clinicians' responses to medication safety alerts have much to teach us. Clinicians override most alerts, suggesting that existing alerts may provide little value to practitioners. Unless designers take steps to improve prescription alert systems, the potential benefits of electronic prescribing may not be realized.


AUTHOR INFORMATION


 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Author information
 •References

Correspondence: Thomas Isaac, MD, MBA, MPH, Division of General Medicine and Primary Care, Beth Israel Deaconess Medical Center, 330 Brookline Ave, Boston, MA 02215 (tisaac{at}bidmc.harvard.edu).

Accepted for Publication: September 3, 2008.

Author Contributions: Study concept and design: Isaac, Weissman, Sands, and Weingart. Acquisition of data: Weissman, Cyrulik, and Weingart. Analysis and interpretation of data: Isaac, Weissman, Davis, Massagli, and Weingart. Drafting of the manuscript: Isaac and Weissman. Critical revision of the manuscript for important intellectual content: Isaac, Weissman, Davis, Massagli, Cyrulik, Sands, and Weingart. Statistical analysis: Isaac, Davis, and Massagli. Obtained funding: Weissman, Cyrulik, Sands, and Weingart. Administrative, technical, and material support: Weingart. Study supervision: Isaac, Weissman, and Weingart.

Financial Disclosure: None reported.

Funding/Support: This study was supported by a grant from the Physicians' Foundation for Health Systems Excellence.

Author Affiliations: Division of General Medicine and Primary Care, Beth Israel Deaconess Medical Center (Drs Isaac, Davis, Sands, and Weingart), Institute for Health Policy, Massachusetts General Hospital (Dr Weissman), Blue Cross Blue Shield of Massachusetts (Ms Cyrulik), Center for Patient Safety, Dana-Farber Cancer Institute (Drs Isaac and Weingart), and Department of Medicine, Harvard Medical School (Drs Isaac, Weissman, Davis, Sands, and Weingart), Boston; PatientsLikeMe Inc, Cambridge, Massachusetts (Dr Massagli); and Cisco Systems, San Jose, California (Dr Sands).


REFERENCES


 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Author information
 •References

1. Aspden P, Wolcott JA, Bootman JL, Cronenwett LR. Preventing Medication Errors: Quality. Chasm Series. National Academies Press Washington, DC: 2007.
2. Zhan C, Arispe I, Kelley E; et al. Ambulatory care visits for treating adverse drug effects in the United States, 1995-2001. Jt Comm J Qual Patient Saf. 2005;31(7):372-378. PUBMED
3. Weingart SN, Gandhi TK, Seger AC; et al. Patient-reported medication symptoms in primary care. Arch Intern Med. 2005;165(2):234-240. FREE FULL TEXT
4. Corrigan JM, ed, Donaldson MS, ed, Kohn LT, ed. Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, DC: National Academy Press; 2001.
5. Gandhi TK, Weingart SN, Borus J; et al. Adverse drug events in ambulatory care. N Engl J Med. 2003;348(16):1556-1564. FULL TEXT | WEB OF SCIENCE | PUBMED
6. Bender RH, Garfinkel SA. Differences in the structure of CAHPS measures among the Medicare fee-for-service, Medicare managed care, and privately insured populations. Health Serv Res. 2001;36(3):489-508. WEB OF SCIENCE | PUBMED
7. King WJ, Paice N, Rangrej J, Forestell GJ, Swartz R. The effect of computerized physician order entry on medication errors and adverse drug events in pediatric inpatients. Pediatrics. 2003;112(3, pt 1):506-509. FREE FULL TEXT
8. Taking the Pulse 5.0: Physicians and Emerging Information Technologies. Manhattan Research Web site. http://www.manhattanresearch.com. Accessed May 28, 2006.
9. Gurwitz JH, Field TS, Harrold LR; et al. Incidence and preventability of adverse drug events among older persons in the ambulatory setting. JAMA. 2003;289(9):1107-1116. FREE FULL TEXT
10. Shah NR, Seger AC, Seger DL; et al. Improving acceptance of computerized prescribing alerts in ambulatory care. J Am Med Inform Assoc. 2006;13(1):5-11. FREE FULL TEXT
11. Gandhi TK, Weingart SN, Seger AC; et al. Outpatient prescribing errors and the impact of computerized prescribing. J Gen Intern Med. 2005;20(9):837-841. FULL TEXT | WEB OF SCIENCE | PUBMED
12. Weingart SN, Toth M, Sands DZ, Aronson MD, Davis RB, Phillips RS. Physicians' decisions to override computerized drug alerts in primary care. Arch Intern Med. 2003;163(21):2625-2631. FREE FULL TEXT
13. Kaushal R, Shojania KG, Bates DW. Effects of computerized physician order entry and clinical decision support systems on medication safety: a systematic review. Arch Intern Med. 2003;163(12):1409-1416. FREE FULL TEXT
14. Glassman PA, Good CB, Kelley ME; et al. Physician perceptions of a national formulary. Am J Manag Care. 2001;7(3):241-251. WEB OF SCIENCE | PUBMED
15. Payne TH, Nichol WP, Hoey P, Savarino J. Characteristics and override rates of order checks in a practitioner order entry system. Proc AMIA Symp. 2002:602-606.
16. Teich JM, Merchia PR, Schmiz JL, Kuperman GJ, Spurr CD, Bates DW. Effects of computerized physician order entry on prescribing practices. Arch Intern Med. 2000;160(18):2741-2747. FREE FULL TEXT
17. Grossman JM, Gerland A, Reed MC, Fahlman C. Physicians' experiences using commercial e-prescribing systems. Health Aff (Millwood). 2007;26(3):w393-w404. FREE FULL TEXT
18. Ko Y, Abarca J, Malone DC; et al. Practitioners' views on computerized drug-drug interaction alerts in the VA system. J Am Med Inform Assoc. 2007;14(1):56-64. FREE FULL TEXT
19. Bell DS, Friedman MA. E-prescribing and the Medicare Modernization Act of 2003. Health Aff (Millwood). 2005;24(5):1159-1169. FREE FULL TEXT
20. Koppel R, Metlay JP, Cohen A; et al. Role of computerized physician order entry systems in facilitating medication errors. JAMA. 2005;293(10):1197-1203. FREE FULL TEXT
21. Raschke RA, Gollihare B, Wunderlich TA; et al. A computer alert system to prevent injury from adverse drug events: development and evaluation in a community teaching hospital. JAMA. 1998;280(15):1317-1320. FREE FULL TEXT
22. Bates DW, Leape LL, Cullen DJ; et al. Effect of computerized physician order entry and a team intervention on prevention of serious medication errors. JAMA. 1998;280(15):1311-1316. FREE FULL TEXT
23. Bobb A, Gleason K, Husch M, Feinglass J, Yarnold PR, Noskin GA. The epidemiology of prescribing errors: the potential impact of computerized prescriber order entry. Arch Intern Med. 2004;164(7):785-792. FREE FULL TEXT
24. Varkey P, Aponte P, Swanton C, Fischer D, Johnson SF, Brennan MD. The effect of computerized physician-order entry on outpatient prescription errors. Manag Care Interface. 2007;20(3):53-57. PUBMED
25. Taylor LK, Kawasumi Y, Bartlett G, Tamblyn R. Inappropriate prescribing practices: the challenge and opportunity for patient safety. Healthc Q. 2005;8(spec):81-85. PUBMED


Add to CiteULike CiteULike   Add to Connotea Connotea   Add to Delicious Delicious   Add to Digg Digg   Add to Facebook Facebook   Add to Reddit Reddit   Add to Technorati Technorati   Add to Twitter Twitter     What's this?

RELATED LETTER

Overrides of Medication Alerts in Ambulatory Care
Stephen N. Rosenberg, Maureen Sullivan, Iver A. Juster, and Jeffrey Jacques
Arch Intern Med. 2009;169(14):1337.
EXTRACT | FULL TEXT  


THIS ARTICLE HAS BEEN CITED BY OTHER ARTICLES

The effectiveness of a new generation of computerized drug alerts in reducing the risk of injury from drug side effects: a cluster randomized trial
Tamblyn et al.
J Am Med Inform Assoc 2012;0:amiajnl-2011-000609v1-amiajnl-2011-000609.
ABSTRACT | FULL TEXT  

Comparison of a basic and an advanced pharmacotherapy-related clinical decision support system in a hospital care setting in the Netherlands
Eppenga et al.
J Am Med Inform Assoc 2012;19:66-71.
ABSTRACT | FULL TEXT  

Development and validation of a survey instrument for assessing prescribers' perception of computerized drug-drug interaction alerts
Zheng et al.
J Am Med Inform Assoc 2011;18:i51-i61.
ABSTRACT | FULL TEXT  

A clinical decision support needs assessment of community-based physicians
Richardson and Ash
J Am Med Inform Assoc 2011;18:i28-i35.
ABSTRACT | FULL TEXT  

Point-of-Care Electronic Prompts: An Effective Means of Increasing Compliance, Demonstrating Quality, and Improving Outcome
Schwann et al.
Anesth. Analg. 2011;113:869-876.
ABSTRACT | FULL TEXT  

Prescribers' expectations and barriers to electronic prescribing of controlled substances
Thomas et al.
J Am Med Inform Assoc 2011;0:amiajnl-2011-000209v1-amiajnl-2011-000209.
ABSTRACT | FULL TEXT  

A framework for evaluating the appropriateness of clinical decision support alerts and responses
McCoy et al.
J Am Med Inform Assoc 2011;0:amiajnl-2011-000185v1-amiajnl-2011-000185.
ABSTRACT | FULL TEXT  

Factors influencing alert acceptance: a novel approach for predicting the success of clinical decision support
Seidling et al.
J Am Med Inform Assoc 2011;18:479-484.
ABSTRACT | FULL TEXT  

Critical issues associated with drug-drug interactions: Highlights of a multistakeholder conference
Hines et al.
Am J Health Syst Pharm 2011;68:941-946.
FULL TEXT  

Can an electronic prescribing system detect doctors who are more likely to make a serious prescribing error?
Coleman et al.
JRSM 2011;104:208-218.
ABSTRACT | FULL TEXT  

Development and evaluation of a comprehensive clinical decision support taxonomy: comparison of front-end tools in commercial and internally developed electronic health record systems
Wright et al.
J Am Med Inform Assoc 2011;18:232-242.
ABSTRACT | FULL TEXT  

Customizing clinical decision support to prevent excessive drug-drug interaction alerts
Horn et al.
Am J Health Syst Pharm 2011;68:662-664.
FULL TEXT  

Ability of pharmacy clinical decision-support software to alert users about clinically important drug-drug interactions
Saverno et al.
J Am Med Inform Assoc 2011;18:32-37.
ABSTRACT | FULL TEXT  

Randomized clinical trial of a customized electronic alert requiring an affirmative response compared to a control group receiving a commercial passive CPOE alert: NSAID-warfarin co-prescribing as a test case
Strom et al.
J Am Med Inform Assoc 2010;17:411-415.
ABSTRACT | FULL TEXT  

Future of clinical decision support in computerized prescriber order entry
Chaffee
Am J Health Syst Pharm 2010;67:932-935.
FULL TEXT  

Alert fatigue
Cash
Am J Health Syst Pharm 2009;66:2098-2101.
FULL TEXT  

Clinicians' Assessments of Electronic Medication Safety Alerts in Ambulatory Care
Weingart et al.
Arch Intern Med 2009;169:1627-1632.
ABSTRACT | FULL TEXT  

An Empirical Model to Estimate the Potential Impact of Medication Safety Alerts on Patient Safety, Health Care Utilization, and Cost in Ambulatory Care
Weingart et al.
Arch Intern Med 2009;169:1465-1473.
ABSTRACT | FULL TEXT  

Overrides of Medication Alerts in Ambulatory Care
Rosenberg et al.
Arch Intern Med 2009;169:1337-1337.
FULL TEXT  

Consider the Content of Drug-Drug Interaction Alerts
Sweidan et al.
Arch Intern Med 2009;169:1338-1338.
FULL TEXT  





HOME | CURRENT ISSUE | PAST ISSUES | TOPIC COLLECTIONS | CME | PHYSICIAN JOBS | SUBMIT | SUBSCRIBE | HELP
CONDITIONS OF USE | PRIVACY POLICY | CONTACT US | SITE MAP
 
© 2009 American Medical Association. All Rights Reserved.