Conflicts and concordance between measures of medication prescribing quality

Michael A. Steinman, Gary E. Rosenthal, C. Seth Landefeld, Daniel Bertenthal, Saunak Sen, Peter J. Kaboli

Research output: Contribution to journalArticle

51 Citations (Scopus)

Abstract

BACKGROUND: Several instruments commonly are used to assess the quality of medication prescribing. However, little is known about the relationship between these instruments or the concordance of their quality assessments when applied to the same group of patients. METHODS: We assessed 3 indicators of prescribing quality in a cohort of 196 veterans age 65 and older who were taking 5 or more medications. These 3 indicators assessed whether each patient was (1) taking any medication from the drugs-to-avoid criteria of Beers et al, (2) taking any medication with a score of 3 or more on the Medication Appropriateness Index (MAI), and/or (3) taking 9 or more medications (polypharmacy). Kappa statistics were used to assess agreement between measures. RESULTS: Mean age was 74.6 years, and patients used a mean of 8.1 medications. Six percent of drugs were rated inappropriate by the Beers drugs-to-avoid criteria, whereas 23% of drugs received an MAI score of 3 or more. Overall agreement between these metrics was 78%, little more than expected by chance (kappa statistic 0.14, P < 0.01). At the level of the patient, the proportion of subjects taking one or more inappropriate drugs was 37% by drugs-to-avoid criteria and 82% by MAI, whereas 37% had polypharmacy of ≥9 drugs. Prescribing was classified as inappropriate by all 3 metrics in 18% of patients and as appropriate by all 3 metrics in 13%. Together, this level of agreement was slightly better than chance (3-way kappa statistic 0.08, P = 0.03). Agreement remained low in sensitivity analyses using different cutoffs for the Beers criteria, a range of thresholds for MAI scores, and different definitions of polypharmacy, with kappa statistics ≤0.30 for all comparisons. CONCLUSIONS: Commonly used measures of drug prescribing quality yield widely discordant results. Because the overall quality of prescribing may not be readily inferred from a single measure, multidimensional approaches will likely be necessary for robust assessment of prescribing quality.

Original languageEnglish (US)
Pages (from-to)95-99
Number of pages5
JournalMedical Care
Volume45
Issue number1
DOIs
StatePublished - Jan 1 2007

Fingerprint

Polypharmacy
Pharmaceutical Preparations
Drug Prescriptions
Veterans
Potentially Inappropriate Medication List

All Science Journal Classification (ASJC) codes

  • Public Health, Environmental and Occupational Health

Cite this

Steinman, M. A., Rosenthal, G. E., Landefeld, C. S., Bertenthal, D., Sen, S., & Kaboli, P. J. (2007). Conflicts and concordance between measures of medication prescribing quality. Medical Care, 45(1), 95-99. https://doi.org/10.1097/01.mlr.0000241111.11991.62

Conflicts and concordance between measures of medication prescribing quality. / Steinman, Michael A.; Rosenthal, Gary E.; Landefeld, C. Seth; Bertenthal, Daniel; Sen, Saunak; Kaboli, Peter J.

In: Medical Care, Vol. 45, No. 1, 01.01.2007, p. 95-99.

Research output: Contribution to journalArticle

Steinman, MA, Rosenthal, GE, Landefeld, CS, Bertenthal, D, Sen, S & Kaboli, PJ 2007, 'Conflicts and concordance between measures of medication prescribing quality', Medical Care, vol. 45, no. 1, pp. 95-99. https://doi.org/10.1097/01.mlr.0000241111.11991.62
Steinman, Michael A. ; Rosenthal, Gary E. ; Landefeld, C. Seth ; Bertenthal, Daniel ; Sen, Saunak ; Kaboli, Peter J. / Conflicts and concordance between measures of medication prescribing quality. In: Medical Care. 2007 ; Vol. 45, No. 1. pp. 95-99.
@article{28b0c41f42f44c0d91a6fc961b19b556,
title = "Conflicts and concordance between measures of medication prescribing quality",
abstract = "BACKGROUND: Several instruments commonly are used to assess the quality of medication prescribing. However, little is known about the relationship between these instruments or the concordance of their quality assessments when applied to the same group of patients. METHODS: We assessed 3 indicators of prescribing quality in a cohort of 196 veterans age 65 and older who were taking 5 or more medications. These 3 indicators assessed whether each patient was (1) taking any medication from the drugs-to-avoid criteria of Beers et al, (2) taking any medication with a score of 3 or more on the Medication Appropriateness Index (MAI), and/or (3) taking 9 or more medications (polypharmacy). Kappa statistics were used to assess agreement between measures. RESULTS: Mean age was 74.6 years, and patients used a mean of 8.1 medications. Six percent of drugs were rated inappropriate by the Beers drugs-to-avoid criteria, whereas 23{\%} of drugs received an MAI score of 3 or more. Overall agreement between these metrics was 78{\%}, little more than expected by chance (kappa statistic 0.14, P < 0.01). At the level of the patient, the proportion of subjects taking one or more inappropriate drugs was 37{\%} by drugs-to-avoid criteria and 82{\%} by MAI, whereas 37{\%} had polypharmacy of ≥9 drugs. Prescribing was classified as inappropriate by all 3 metrics in 18{\%} of patients and as appropriate by all 3 metrics in 13{\%}. Together, this level of agreement was slightly better than chance (3-way kappa statistic 0.08, P = 0.03). Agreement remained low in sensitivity analyses using different cutoffs for the Beers criteria, a range of thresholds for MAI scores, and different definitions of polypharmacy, with kappa statistics ≤0.30 for all comparisons. CONCLUSIONS: Commonly used measures of drug prescribing quality yield widely discordant results. Because the overall quality of prescribing may not be readily inferred from a single measure, multidimensional approaches will likely be necessary for robust assessment of prescribing quality.",
author = "Steinman, {Michael A.} and Rosenthal, {Gary E.} and Landefeld, {C. Seth} and Daniel Bertenthal and Saunak Sen and Kaboli, {Peter J.}",
year = "2007",
month = "1",
day = "1",
doi = "10.1097/01.mlr.0000241111.11991.62",
language = "English (US)",
volume = "45",
pages = "95--99",
journal = "Medical Care",
issn = "0025-7079",
publisher = "Lippincott Williams and Wilkins",
number = "1",

}

TY - JOUR

T1 - Conflicts and concordance between measures of medication prescribing quality

AU - Steinman, Michael A.

AU - Rosenthal, Gary E.

AU - Landefeld, C. Seth

AU - Bertenthal, Daniel

AU - Sen, Saunak

AU - Kaboli, Peter J.

PY - 2007/1/1

Y1 - 2007/1/1

N2 - BACKGROUND: Several instruments commonly are used to assess the quality of medication prescribing. However, little is known about the relationship between these instruments or the concordance of their quality assessments when applied to the same group of patients. METHODS: We assessed 3 indicators of prescribing quality in a cohort of 196 veterans age 65 and older who were taking 5 or more medications. These 3 indicators assessed whether each patient was (1) taking any medication from the drugs-to-avoid criteria of Beers et al, (2) taking any medication with a score of 3 or more on the Medication Appropriateness Index (MAI), and/or (3) taking 9 or more medications (polypharmacy). Kappa statistics were used to assess agreement between measures. RESULTS: Mean age was 74.6 years, and patients used a mean of 8.1 medications. Six percent of drugs were rated inappropriate by the Beers drugs-to-avoid criteria, whereas 23% of drugs received an MAI score of 3 or more. Overall agreement between these metrics was 78%, little more than expected by chance (kappa statistic 0.14, P < 0.01). At the level of the patient, the proportion of subjects taking one or more inappropriate drugs was 37% by drugs-to-avoid criteria and 82% by MAI, whereas 37% had polypharmacy of ≥9 drugs. Prescribing was classified as inappropriate by all 3 metrics in 18% of patients and as appropriate by all 3 metrics in 13%. Together, this level of agreement was slightly better than chance (3-way kappa statistic 0.08, P = 0.03). Agreement remained low in sensitivity analyses using different cutoffs for the Beers criteria, a range of thresholds for MAI scores, and different definitions of polypharmacy, with kappa statistics ≤0.30 for all comparisons. CONCLUSIONS: Commonly used measures of drug prescribing quality yield widely discordant results. Because the overall quality of prescribing may not be readily inferred from a single measure, multidimensional approaches will likely be necessary for robust assessment of prescribing quality.

AB - BACKGROUND: Several instruments commonly are used to assess the quality of medication prescribing. However, little is known about the relationship between these instruments or the concordance of their quality assessments when applied to the same group of patients. METHODS: We assessed 3 indicators of prescribing quality in a cohort of 196 veterans age 65 and older who were taking 5 or more medications. These 3 indicators assessed whether each patient was (1) taking any medication from the drugs-to-avoid criteria of Beers et al, (2) taking any medication with a score of 3 or more on the Medication Appropriateness Index (MAI), and/or (3) taking 9 or more medications (polypharmacy). Kappa statistics were used to assess agreement between measures. RESULTS: Mean age was 74.6 years, and patients used a mean of 8.1 medications. Six percent of drugs were rated inappropriate by the Beers drugs-to-avoid criteria, whereas 23% of drugs received an MAI score of 3 or more. Overall agreement between these metrics was 78%, little more than expected by chance (kappa statistic 0.14, P < 0.01). At the level of the patient, the proportion of subjects taking one or more inappropriate drugs was 37% by drugs-to-avoid criteria and 82% by MAI, whereas 37% had polypharmacy of ≥9 drugs. Prescribing was classified as inappropriate by all 3 metrics in 18% of patients and as appropriate by all 3 metrics in 13%. Together, this level of agreement was slightly better than chance (3-way kappa statistic 0.08, P = 0.03). Agreement remained low in sensitivity analyses using different cutoffs for the Beers criteria, a range of thresholds for MAI scores, and different definitions of polypharmacy, with kappa statistics ≤0.30 for all comparisons. CONCLUSIONS: Commonly used measures of drug prescribing quality yield widely discordant results. Because the overall quality of prescribing may not be readily inferred from a single measure, multidimensional approaches will likely be necessary for robust assessment of prescribing quality.

UR - http://www.scopus.com/inward/record.url?scp=33847123695&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33847123695&partnerID=8YFLogxK

U2 - 10.1097/01.mlr.0000241111.11991.62

DO - 10.1097/01.mlr.0000241111.11991.62

M3 - Article

VL - 45

SP - 95

EP - 99

JO - Medical Care

JF - Medical Care

SN - 0025-7079

IS - 1

ER -