Multinational assessment of accuracy of equations for predicting risk of kidney failure ameta-analysis

Navdeep Tangri, Morgan E. Grams, Andrew S. Levey, Josef Coresh, Lawrence J. Appel, Brad C. Astor, Gabriel Chodick, Allan J. Collins, Ognjenka Djurdjev, C. Raina Elley, Marie Evans, Amit X. Garg, Stein I. Hallan, Lesley A. Inker, Sadayoshi Ito, Sun Ha Jee, Csaba Kovesdy, Florian Kronenberg, Hiddo J.Lambers Heerspink, Angharad Marks & 8 others Girish N. Nadkarni, Sankar D. Navaneethan, Robert G. Nelson, Stephanie Titze, Mark J. Sarnak, Benedicte Stengel, Mark Woodward, Kunitoshi Iseki

Research output: Contribution to journalArticle

100 Citations (Scopus)

Abstract

Importance Identifying patients at risk of chronic kidney disease (CKD) progression may facilitate more optimal nephrology care. Kidney failure risk equations were previously developed and validated in 2 Canadian cohorts. Validation in other regions and in CKD populations not under the care of a nephrologist is needed. Objective To evaluate the accuracy of the risk equations across different geographic regions and patient populations through individual participant data meta-analysis. DATA SOURCES Thirty-one cohorts, including 721 357 participants with CKD stages 3 to 5 in more than 30 countries spanning 4 continents, were studied. These cohorts collected data from 1982 through 2014. STUDY SELECTION Cohorts participating in the CKD Prognosis Consortium with data on end-stage renal disease. DATA EXTRACTION AND SYNTHESIS Datawere obtained and statistical analyseswere performed between July 2012 and June 2015. Using the risk factors from the original risk equations, cohort-specific hazard ratios were estimated and combined in meta-analysis to form new pooled kidney failure risk equations. Original and pooled kidney failure risk equation performance was compared, and the need for regional calibration factors was assessed. Main Outcomes and Measures Kidney failure (treatment by dialysis or kidney transplant). Results During a median follow-up of 4 years, 23 829 cases of kidney failure were observed. The original risk equations achieved excellent discrimination (ability to differentiate those who developed kidney failure from those who did not) across all cohorts (overall C statistic, 0.90; 95%CI, 0.89-0.92 at 2 years; C statistic, 0.88; 95%CI, 0.86-0.90 at 5 years); discrimination in subgroups by age, race, and diabetes status was similar. There was no improvement with the pooled equations. Calibration (the difference between observed and predicted risk) was adequate in North American cohorts, but the original risk equations overestimated risk in some non-North American cohorts. Addition of a calibration factor that lowered the baseline risk by 32.9%at 2 years and 16.5%at 5 years improved the calibration in 12 of 15 and 10 of 13 non-North American cohorts at 2 and 5 years, respectively (P =.04 and P =.02). Conclusions and Relevance Kidney failure risk equations developed in a Canadian population showed high discrimination and adequate calibration when validated in 31 multinational cohorts. However, in some regions the addition of a calibration factor may be necessary.

Original languageEnglish (US)
Pages (from-to)164-174
Number of pages11
JournalJAMA - Journal of the American Medical Association
Volume315
Issue number2
DOIs
StatePublished - Jan 12 2016

Fingerprint

Renal Insufficiency
Calibration
Chronic Renal Insufficiency
Meta-Analysis
Population
Nephrology
Chronic Kidney Failure
Disease Progression
Dialysis
Outcome Assessment (Health Care)
Transplants
Kidney

All Science Journal Classification (ASJC) codes

  • Medicine(all)

Cite this

Multinational assessment of accuracy of equations for predicting risk of kidney failure ameta-analysis. / Tangri, Navdeep; Grams, Morgan E.; Levey, Andrew S.; Coresh, Josef; Appel, Lawrence J.; Astor, Brad C.; Chodick, Gabriel; Collins, Allan J.; Djurdjev, Ognjenka; Raina Elley, C.; Evans, Marie; Garg, Amit X.; Hallan, Stein I.; Inker, Lesley A.; Ito, Sadayoshi; Jee, Sun Ha; Kovesdy, Csaba; Kronenberg, Florian; Heerspink, Hiddo J.Lambers; Marks, Angharad; Nadkarni, Girish N.; Navaneethan, Sankar D.; Nelson, Robert G.; Titze, Stephanie; Sarnak, Mark J.; Stengel, Benedicte; Woodward, Mark; Iseki, Kunitoshi.

In: JAMA - Journal of the American Medical Association, Vol. 315, No. 2, 12.01.2016, p. 164-174.

Research output: Contribution to journalArticle

Tangri, N, Grams, ME, Levey, AS, Coresh, J, Appel, LJ, Astor, BC, Chodick, G, Collins, AJ, Djurdjev, O, Raina Elley, C, Evans, M, Garg, AX, Hallan, SI, Inker, LA, Ito, S, Jee, SH, Kovesdy, C, Kronenberg, F, Heerspink, HJL, Marks, A, Nadkarni, GN, Navaneethan, SD, Nelson, RG, Titze, S, Sarnak, MJ, Stengel, B, Woodward, M & Iseki, K 2016, 'Multinational assessment of accuracy of equations for predicting risk of kidney failure ameta-analysis', JAMA - Journal of the American Medical Association, vol. 315, no. 2, pp. 164-174. https://doi.org/10.1001/jama.2015.18202
Tangri, Navdeep ; Grams, Morgan E. ; Levey, Andrew S. ; Coresh, Josef ; Appel, Lawrence J. ; Astor, Brad C. ; Chodick, Gabriel ; Collins, Allan J. ; Djurdjev, Ognjenka ; Raina Elley, C. ; Evans, Marie ; Garg, Amit X. ; Hallan, Stein I. ; Inker, Lesley A. ; Ito, Sadayoshi ; Jee, Sun Ha ; Kovesdy, Csaba ; Kronenberg, Florian ; Heerspink, Hiddo J.Lambers ; Marks, Angharad ; Nadkarni, Girish N. ; Navaneethan, Sankar D. ; Nelson, Robert G. ; Titze, Stephanie ; Sarnak, Mark J. ; Stengel, Benedicte ; Woodward, Mark ; Iseki, Kunitoshi. / Multinational assessment of accuracy of equations for predicting risk of kidney failure ameta-analysis. In: JAMA - Journal of the American Medical Association. 2016 ; Vol. 315, No. 2. pp. 164-174.
@article{e5b4d1cf3612417d9f0a1d0c2dc53203,
title = "Multinational assessment of accuracy of equations for predicting risk of kidney failure ameta-analysis",
abstract = "Importance Identifying patients at risk of chronic kidney disease (CKD) progression may facilitate more optimal nephrology care. Kidney failure risk equations were previously developed and validated in 2 Canadian cohorts. Validation in other regions and in CKD populations not under the care of a nephrologist is needed. Objective To evaluate the accuracy of the risk equations across different geographic regions and patient populations through individual participant data meta-analysis. DATA SOURCES Thirty-one cohorts, including 721 357 participants with CKD stages 3 to 5 in more than 30 countries spanning 4 continents, were studied. These cohorts collected data from 1982 through 2014. STUDY SELECTION Cohorts participating in the CKD Prognosis Consortium with data on end-stage renal disease. DATA EXTRACTION AND SYNTHESIS Datawere obtained and statistical analyseswere performed between July 2012 and June 2015. Using the risk factors from the original risk equations, cohort-specific hazard ratios were estimated and combined in meta-analysis to form new pooled kidney failure risk equations. Original and pooled kidney failure risk equation performance was compared, and the need for regional calibration factors was assessed. Main Outcomes and Measures Kidney failure (treatment by dialysis or kidney transplant). Results During a median follow-up of 4 years, 23 829 cases of kidney failure were observed. The original risk equations achieved excellent discrimination (ability to differentiate those who developed kidney failure from those who did not) across all cohorts (overall C statistic, 0.90; 95{\%}CI, 0.89-0.92 at 2 years; C statistic, 0.88; 95{\%}CI, 0.86-0.90 at 5 years); discrimination in subgroups by age, race, and diabetes status was similar. There was no improvement with the pooled equations. Calibration (the difference between observed and predicted risk) was adequate in North American cohorts, but the original risk equations overestimated risk in some non-North American cohorts. Addition of a calibration factor that lowered the baseline risk by 32.9{\%}at 2 years and 16.5{\%}at 5 years improved the calibration in 12 of 15 and 10 of 13 non-North American cohorts at 2 and 5 years, respectively (P =.04 and P =.02). Conclusions and Relevance Kidney failure risk equations developed in a Canadian population showed high discrimination and adequate calibration when validated in 31 multinational cohorts. However, in some regions the addition of a calibration factor may be necessary.",
author = "Navdeep Tangri and Grams, {Morgan E.} and Levey, {Andrew S.} and Josef Coresh and Appel, {Lawrence J.} and Astor, {Brad C.} and Gabriel Chodick and Collins, {Allan J.} and Ognjenka Djurdjev and {Raina Elley}, C. and Marie Evans and Garg, {Amit X.} and Hallan, {Stein I.} and Inker, {Lesley A.} and Sadayoshi Ito and Jee, {Sun Ha} and Csaba Kovesdy and Florian Kronenberg and Heerspink, {Hiddo J.Lambers} and Angharad Marks and Nadkarni, {Girish N.} and Navaneethan, {Sankar D.} and Nelson, {Robert G.} and Stephanie Titze and Sarnak, {Mark J.} and Benedicte Stengel and Mark Woodward and Kunitoshi Iseki",
year = "2016",
month = "1",
day = "12",
doi = "10.1001/jama.2015.18202",
language = "English (US)",
volume = "315",
pages = "164--174",
journal = "JAMA - Journal of the American Medical Association",
issn = "0002-9955",
publisher = "American Medical Association",
number = "2",

}

TY - JOUR

T1 - Multinational assessment of accuracy of equations for predicting risk of kidney failure ameta-analysis

AU - Tangri, Navdeep

AU - Grams, Morgan E.

AU - Levey, Andrew S.

AU - Coresh, Josef

AU - Appel, Lawrence J.

AU - Astor, Brad C.

AU - Chodick, Gabriel

AU - Collins, Allan J.

AU - Djurdjev, Ognjenka

AU - Raina Elley, C.

AU - Evans, Marie

AU - Garg, Amit X.

AU - Hallan, Stein I.

AU - Inker, Lesley A.

AU - Ito, Sadayoshi

AU - Jee, Sun Ha

AU - Kovesdy, Csaba

AU - Kronenberg, Florian

AU - Heerspink, Hiddo J.Lambers

AU - Marks, Angharad

AU - Nadkarni, Girish N.

AU - Navaneethan, Sankar D.

AU - Nelson, Robert G.

AU - Titze, Stephanie

AU - Sarnak, Mark J.

AU - Stengel, Benedicte

AU - Woodward, Mark

AU - Iseki, Kunitoshi

PY - 2016/1/12

Y1 - 2016/1/12

N2 - Importance Identifying patients at risk of chronic kidney disease (CKD) progression may facilitate more optimal nephrology care. Kidney failure risk equations were previously developed and validated in 2 Canadian cohorts. Validation in other regions and in CKD populations not under the care of a nephrologist is needed. Objective To evaluate the accuracy of the risk equations across different geographic regions and patient populations through individual participant data meta-analysis. DATA SOURCES Thirty-one cohorts, including 721 357 participants with CKD stages 3 to 5 in more than 30 countries spanning 4 continents, were studied. These cohorts collected data from 1982 through 2014. STUDY SELECTION Cohorts participating in the CKD Prognosis Consortium with data on end-stage renal disease. DATA EXTRACTION AND SYNTHESIS Datawere obtained and statistical analyseswere performed between July 2012 and June 2015. Using the risk factors from the original risk equations, cohort-specific hazard ratios were estimated and combined in meta-analysis to form new pooled kidney failure risk equations. Original and pooled kidney failure risk equation performance was compared, and the need for regional calibration factors was assessed. Main Outcomes and Measures Kidney failure (treatment by dialysis or kidney transplant). Results During a median follow-up of 4 years, 23 829 cases of kidney failure were observed. The original risk equations achieved excellent discrimination (ability to differentiate those who developed kidney failure from those who did not) across all cohorts (overall C statistic, 0.90; 95%CI, 0.89-0.92 at 2 years; C statistic, 0.88; 95%CI, 0.86-0.90 at 5 years); discrimination in subgroups by age, race, and diabetes status was similar. There was no improvement with the pooled equations. Calibration (the difference between observed and predicted risk) was adequate in North American cohorts, but the original risk equations overestimated risk in some non-North American cohorts. Addition of a calibration factor that lowered the baseline risk by 32.9%at 2 years and 16.5%at 5 years improved the calibration in 12 of 15 and 10 of 13 non-North American cohorts at 2 and 5 years, respectively (P =.04 and P =.02). Conclusions and Relevance Kidney failure risk equations developed in a Canadian population showed high discrimination and adequate calibration when validated in 31 multinational cohorts. However, in some regions the addition of a calibration factor may be necessary.

AB - Importance Identifying patients at risk of chronic kidney disease (CKD) progression may facilitate more optimal nephrology care. Kidney failure risk equations were previously developed and validated in 2 Canadian cohorts. Validation in other regions and in CKD populations not under the care of a nephrologist is needed. Objective To evaluate the accuracy of the risk equations across different geographic regions and patient populations through individual participant data meta-analysis. DATA SOURCES Thirty-one cohorts, including 721 357 participants with CKD stages 3 to 5 in more than 30 countries spanning 4 continents, were studied. These cohorts collected data from 1982 through 2014. STUDY SELECTION Cohorts participating in the CKD Prognosis Consortium with data on end-stage renal disease. DATA EXTRACTION AND SYNTHESIS Datawere obtained and statistical analyseswere performed between July 2012 and June 2015. Using the risk factors from the original risk equations, cohort-specific hazard ratios were estimated and combined in meta-analysis to form new pooled kidney failure risk equations. Original and pooled kidney failure risk equation performance was compared, and the need for regional calibration factors was assessed. Main Outcomes and Measures Kidney failure (treatment by dialysis or kidney transplant). Results During a median follow-up of 4 years, 23 829 cases of kidney failure were observed. The original risk equations achieved excellent discrimination (ability to differentiate those who developed kidney failure from those who did not) across all cohorts (overall C statistic, 0.90; 95%CI, 0.89-0.92 at 2 years; C statistic, 0.88; 95%CI, 0.86-0.90 at 5 years); discrimination in subgroups by age, race, and diabetes status was similar. There was no improvement with the pooled equations. Calibration (the difference between observed and predicted risk) was adequate in North American cohorts, but the original risk equations overestimated risk in some non-North American cohorts. Addition of a calibration factor that lowered the baseline risk by 32.9%at 2 years and 16.5%at 5 years improved the calibration in 12 of 15 and 10 of 13 non-North American cohorts at 2 and 5 years, respectively (P =.04 and P =.02). Conclusions and Relevance Kidney failure risk equations developed in a Canadian population showed high discrimination and adequate calibration when validated in 31 multinational cohorts. However, in some regions the addition of a calibration factor may be necessary.

UR - http://www.scopus.com/inward/record.url?scp=84954475129&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84954475129&partnerID=8YFLogxK

U2 - 10.1001/jama.2015.18202

DO - 10.1001/jama.2015.18202

M3 - Article

VL - 315

SP - 164

EP - 174

JO - JAMA - Journal of the American Medical Association

JF - JAMA - Journal of the American Medical Association

SN - 0002-9955

IS - 2

ER -