The specificity of medication-related alerts must be improved to overcome the pernicious effects of alert fatigue. A systematic comparison of new drug orders to historical orders could improve alert specificity and relevance. Using historical order data from a computerized provider order entry system, we alerted physicians to atypical orders during the prescribing of five medications: calcium, clopidogrel, heparin, magnesium, and potassium. The percentage of atypical orders placed for these five medications decreased during the 92 days the alerts were active when compared to the same period in the previous year (from 0.81% to 0.53%; p=0.015). Some atypical orders were appropriate. Fifty of the 68 atypical order alerts were over-ridden (74%). However, the over-ride rate is misleading because 28 of the atypical medication orders (41%) were changed. Atypical order alerts were relatively few, identified problems with frequencies as well as doses, and had a higher specificity than dose check alerts.
Keywords: clinical decision support systems; clinical pharmacy information systems; computer-assisted; drug therapy; medical order entry systems; pharmacy service.