Sensitivity and specificity of dosing alerts for dosing errors among hospitalized pediatric patients.

Jeremy Stultz, Kyle Porter, Milap C. Nahata

Research output: Contribution to journalArticle

13 Citations (Scopus)

Abstract

To determine the sensitivity and specificity of a dosing alert system for dosing errors and to compare the sensitivity of a proprietary system with and without institutional customization at a pediatric hospital. A retrospective analysis of medication orders, orders causing dosing alerts, reported adverse drug events, and dosing errors during July, 2011 was conducted. Dosing errors with and without alerts were identified and the sensitivity of the system with and without customization was compared. There were 47,181 inpatient pediatric orders during the studied period; 257 dosing errors were identified (0.54%). The sensitivity of the system for identifying dosing errors was 54.1% (95% CI 47.8% to 60.3%) if customization had not occurred and increased to 60.3% (CI 54.0% to 66.3%) with customization (p=0.02). The sensitivity of the system for underdoses was 49.6% without customization and 60.3% with customization (p=0.01). Specificity of the customized system for dosing errors was 96.2% (CI 96.0% to 96.3%) with a positive predictive value of 8.0% (CI 6.8% to 9.3). All dosing errors had an alert over-ridden by the prescriber and 40.6% of dosing errors with alerts were administered to the patient. The lack of indication-specific dose ranges was the most common reason why an alert did not occur for a dosing error. Advances in dosing alert systems should aim to improve the sensitivity and positive predictive value of the system for dosing errors. The dosing alert system had a low sensitivity and positive predictive value for dosing errors, but might have prevented dosing errors from reaching patients. Customization increased the sensitivity of the system for dosing errors. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Original languageEnglish (US)
JournalJournal of the American Medical Informatics Association : JAMIA
Volume21
Issue numbere2
DOIs
StatePublished - Jan 1 2014
Externally publishedYes

Fingerprint

Licensure
Pediatrics
Sensitivity and Specificity
Pediatric Hospitals
Drug-Related Side Effects and Adverse Reactions
Inpatients

All Science Journal Classification (ASJC) codes

  • Health Informatics

Cite this

Sensitivity and specificity of dosing alerts for dosing errors among hospitalized pediatric patients. / Stultz, Jeremy; Porter, Kyle; Nahata, Milap C.

In: Journal of the American Medical Informatics Association : JAMIA, Vol. 21, No. e2, 01.01.2014.

Research output: Contribution to journalArticle

@article{32bb6bf1d5e743a4a658b48c443fc7c4,
title = "Sensitivity and specificity of dosing alerts for dosing errors among hospitalized pediatric patients.",
abstract = "To determine the sensitivity and specificity of a dosing alert system for dosing errors and to compare the sensitivity of a proprietary system with and without institutional customization at a pediatric hospital. A retrospective analysis of medication orders, orders causing dosing alerts, reported adverse drug events, and dosing errors during July, 2011 was conducted. Dosing errors with and without alerts were identified and the sensitivity of the system with and without customization was compared. There were 47,181 inpatient pediatric orders during the studied period; 257 dosing errors were identified (0.54{\%}). The sensitivity of the system for identifying dosing errors was 54.1{\%} (95{\%} CI 47.8{\%} to 60.3{\%}) if customization had not occurred and increased to 60.3{\%} (CI 54.0{\%} to 66.3{\%}) with customization (p=0.02). The sensitivity of the system for underdoses was 49.6{\%} without customization and 60.3{\%} with customization (p=0.01). Specificity of the customized system for dosing errors was 96.2{\%} (CI 96.0{\%} to 96.3{\%}) with a positive predictive value of 8.0{\%} (CI 6.8{\%} to 9.3). All dosing errors had an alert over-ridden by the prescriber and 40.6{\%} of dosing errors with alerts were administered to the patient. The lack of indication-specific dose ranges was the most common reason why an alert did not occur for a dosing error. Advances in dosing alert systems should aim to improve the sensitivity and positive predictive value of the system for dosing errors. The dosing alert system had a low sensitivity and positive predictive value for dosing errors, but might have prevented dosing errors from reaching patients. Customization increased the sensitivity of the system for dosing errors. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.",
author = "Jeremy Stultz and Kyle Porter and Nahata, {Milap C.}",
year = "2014",
month = "1",
day = "1",
doi = "10.1136/amiajnl-2013-002161",
language = "English (US)",
volume = "21",
journal = "Journal of the American Medical Informatics Association : JAMIA",
issn = "1067-5027",
publisher = "Oxford University Press",
number = "e2",

}

TY - JOUR

T1 - Sensitivity and specificity of dosing alerts for dosing errors among hospitalized pediatric patients.

AU - Stultz, Jeremy

AU - Porter, Kyle

AU - Nahata, Milap C.

PY - 2014/1/1

Y1 - 2014/1/1

N2 - To determine the sensitivity and specificity of a dosing alert system for dosing errors and to compare the sensitivity of a proprietary system with and without institutional customization at a pediatric hospital. A retrospective analysis of medication orders, orders causing dosing alerts, reported adverse drug events, and dosing errors during July, 2011 was conducted. Dosing errors with and without alerts were identified and the sensitivity of the system with and without customization was compared. There were 47,181 inpatient pediatric orders during the studied period; 257 dosing errors were identified (0.54%). The sensitivity of the system for identifying dosing errors was 54.1% (95% CI 47.8% to 60.3%) if customization had not occurred and increased to 60.3% (CI 54.0% to 66.3%) with customization (p=0.02). The sensitivity of the system for underdoses was 49.6% without customization and 60.3% with customization (p=0.01). Specificity of the customized system for dosing errors was 96.2% (CI 96.0% to 96.3%) with a positive predictive value of 8.0% (CI 6.8% to 9.3). All dosing errors had an alert over-ridden by the prescriber and 40.6% of dosing errors with alerts were administered to the patient. The lack of indication-specific dose ranges was the most common reason why an alert did not occur for a dosing error. Advances in dosing alert systems should aim to improve the sensitivity and positive predictive value of the system for dosing errors. The dosing alert system had a low sensitivity and positive predictive value for dosing errors, but might have prevented dosing errors from reaching patients. Customization increased the sensitivity of the system for dosing errors. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

AB - To determine the sensitivity and specificity of a dosing alert system for dosing errors and to compare the sensitivity of a proprietary system with and without institutional customization at a pediatric hospital. A retrospective analysis of medication orders, orders causing dosing alerts, reported adverse drug events, and dosing errors during July, 2011 was conducted. Dosing errors with and without alerts were identified and the sensitivity of the system with and without customization was compared. There were 47,181 inpatient pediatric orders during the studied period; 257 dosing errors were identified (0.54%). The sensitivity of the system for identifying dosing errors was 54.1% (95% CI 47.8% to 60.3%) if customization had not occurred and increased to 60.3% (CI 54.0% to 66.3%) with customization (p=0.02). The sensitivity of the system for underdoses was 49.6% without customization and 60.3% with customization (p=0.01). Specificity of the customized system for dosing errors was 96.2% (CI 96.0% to 96.3%) with a positive predictive value of 8.0% (CI 6.8% to 9.3). All dosing errors had an alert over-ridden by the prescriber and 40.6% of dosing errors with alerts were administered to the patient. The lack of indication-specific dose ranges was the most common reason why an alert did not occur for a dosing error. Advances in dosing alert systems should aim to improve the sensitivity and positive predictive value of the system for dosing errors. The dosing alert system had a low sensitivity and positive predictive value for dosing errors, but might have prevented dosing errors from reaching patients. Customization increased the sensitivity of the system for dosing errors. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

UR - http://www.scopus.com/inward/record.url?scp=84908144002&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84908144002&partnerID=8YFLogxK

U2 - 10.1136/amiajnl-2013-002161

DO - 10.1136/amiajnl-2013-002161

M3 - Article

C2 - 24496386

AN - SCOPUS:84908144002

VL - 21

JO - Journal of the American Medical Informatics Association : JAMIA

JF - Journal of the American Medical Informatics Association : JAMIA

SN - 1067-5027

IS - e2

ER -