Research Paper Volume 12, Issue 5 pp 4230—4246

Development, validation and clinical impact of a prediction model for 6-month mortality in older cancer patients: the GRADE

Eurydice Angeli1,2, , Kader Chouahnia1, , Florence Canoui-Poitrine3,4, , Boris Duchemann1,5, , Thomas Aparicio6, , Elena Paillaud4,7, , Laurent Zelek1,5, , Guilhem Bousquet1,2,5, *, , Frédéric Pamoukdjian4,5,8, *, ,

  • 1 APHP, Avicenne Hospital, Department of Medical Oncology, Bobigny F-93000, France
  • 2 INSERM, U942, Paris F-75010, France
  • 3 APHP, Henri-Mondor Hospital, Public Health Department, Créteil F-94000, France
  • 4 Université Paris-Est, UPEC, DHU A-TVB, IMRB- EA 7376 CEpiA (Clinical Epidemiology And Ageing Unit), Créteil F-94000, France
  • 5 Université Paris 13, Sorbonne Paris Cite, Villetaneuse F-93000, France
  • 6 APHP, Avicenne Hospital, Department of Gastroenterology, Bobigny F-93000, France
  • 7 APHP, Georges Pompidou European Hospital, Geriatric Department, Paris F-75015, France
  • 8 APHP, Avicenne Hospital, Geriatric department, Coordination Unit in Geriatric Oncology, Bobigny F-93000, France
* Co-senior authors

Received: January 3, 2020       Accepted: February 20, 2020       Published: March 10, 2020      

https://doi.org/10.18632/aging.102876
How to Cite

Copyright © 2020 Angeli et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY 3.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Abstract

Background: To develop, validate, and assess the clinical impact of a clinical score to predict a 6-month mortality risk among older cancer patients.

Results: The mean age was 81.2 ± 6.1 years (women: 54%, various cancers, metastatic cancer: 45%). The score, namely the GRADE, included two geriatric variables (unintentional weight loss, impaired mobility), two oncological variables (cancer site, cancer extension), and exclusively supportive care. Up to a 14% risk of early death, the decision curves suggest that cancer treatment should be instated.

Conclusion: We have developed and validated a simple score, easy to implement in daily oncological practice, to predict early death among older cancer patients which could guide oncologists in their treatment decisions.

Methods: 603 outpatients prospectively included in the Physical Frailty in Elderly Cancer patients cohort study. We created a multivariate prediction model by evaluating the strength of the individual components of the Geriatric Assessment regarding risk of death at 6 months. Each component was evaluated by univariate analysis and the significant variables (P ≤ 0.20) were carried on as covariates in the multivariate cox proportion hazard analysis. The beta coefficients from the model were used to build a point-based scoring system. Clinical impact was assessed using decision curves.

Introduction

Cancer is a common disease among the elderly, as two-thirds of newly diagnosed cancers and three-quarters of cancer-related deaths occur after 65 years of age in Western countries [1]. However, older cancer patients are usually excluded from clinical trials, mainly because of comorbidities and functional impairment [2, 3]. Data from evidence-based-medicine is thus lacking for therapeutic decisions in this population, and one of the main issues is to avoid situations of over- and under-treatment, and to provide guidance for clinicians in the decision to instate exclusively supportive care [4, 5]. Cancer treatment decisions in this setting mainly rely on the Geriatric Assessment (GA) recommended by the International Society of Geriatric Oncology (SIOG) [6]. By assessing patient heterogeneity in terms of social environment, comorbidities, dependency, nutrition, mobility, mood and cognition, the GA detects vulnerabilities that are linked to poor outcomes and treatment complications [6]. In particular, impaired mobility is an independent predictor of early death among older cancer patients [7], assessed among other things by walking speed (also named gait speed) over a short distance of 4 meters [8]. This is a simple clinical and geriatric tool, easy to implement in daily oncological practice, and we have previously shown that a slow gait speed is significantly associated with geriatric impairments, which are in turn predictive of early death at 6 months [8, 9]. In contrast, the feasibility of administration of the GA depends on the local availability of geriatric expertise. Four clinical and biological scores predictive of early death alongside some items from the GA have been suggested, but they lack of simplicity, and thus remain difficult to implement in daily practice [1013].

In this study, we propose a simple score with five clinical items to predict 6-month mortality risk among older cancer patients, and to guide therapeutic decisions.

Results

Patients and their baseline characteristics

Among the 959 consecutive older cancer in- and out-patients from the PF-EC cohort study, aged ≥ 65 years who were referred for GA up to September 30 2017, we excluded 356 inpatients. A total of 603 outpatients were included, 439 patients for the development cohort, and 164 for the validation cohort (Figure 1).

Consort diagram for the patient selection.

Figure 1. Consort diagram for the patient selection.

In the whole cohort, the mean age was 81.2 ± 6.1 years. The mean time lapse between the initial oncology consultation and the geriatric oncology consultation was 6.6 days ± 2.0. Most patients were West European (62.7%), women (53.5%), and had locally advanced (38%) or metastatic cancers (45%). As expected, colorectal, breast and lung cancers were the most common cancer types, whereas prostate cancer was uncommon because of the absence of urological departments in our two centers (3%). The Frailty phenotype concerned 58% of the overall cohort [14]. The geriatric domains impaired concerned 13.5% (BMI < 21 kg/m2) to 67.5% (grade 3 and/or 4 comorbidities) of the sample according to the measures and thresholds used (Table 1, Supplementary Table 1).

Table 1. Baseline characteristics of 603 older patients with cancer.

VariablesDevelopment cohort n=439%Validation cohort n=164%P*
Age (y).5
 65-76100233924
 77-81114264427
 82-85111254024
 86-103114264125
Sex (men)21348.56640.2.06
Cancer site.2
 Colorectal7817.83119
 Breast7517.13018.3
 Lung6815.52414.6
 Liver6013.72515.2
 Digestive non-colorectal**5813.22112.8
 Genito or Urinary337.574.2
 Hematological235.2116.7
 Skin with melanoma133.031.8
 Prostate122.742.4
 Other†194.385
Cancer extension.1
 Local82192213
 Locally-advanced158367043
 Metastatic199457244
Decision to instate exclusively supportive care8619.53823.3
ECOG-PS ≥ 3131307344.5.007
Patients living alone181416036.5.2
Comorbidities (CIRSG):
 Total ≥ 142174910363.003
 Number of grade 3 and/or 43077010061.03
Dependency
 ADL ≤ 5/6146335835.4
 IADL ≤ 3/42846510262.5
Nutrition
 BMI <21 kg/m253122918.08
 Unintentional weight loss ≥5% (yes)225516741.01
Mobility
 Gait Speed < 0.8 m/s2425510363.06
Depressed mood
 Mini GDS ≥ ¼195446640.3
Cognition
 MMSE < 24/30166385030.04
*chi-square test or Fisher’s exact test for categorical variables as appropriate; ** Oesophagus (n=9), gastric (n=20), pancreas (n=25), bile duct (n=15), duodenum (n=3), anus (n=3), gastro intestinal and stromal tumours (GIST) (n=4); † Sarcoma (n=5), mesothelioma (n=8), unknown primary site (n=10), head and neck (n=3), thymus (n=1); ECOG-PS: Eastern Cooperative Oncology Group Performance Status; CIRS-G: Cumulative Illness Rating Scale Geriatric; ADL: Activity of Daily Living; IADL: Instrumental ADL; BMI: Body Mass Index; Mini-GDS: Mini Geriatric Depression Scale; MMSE: Mini Mental State Examination.

There was no difference between the development and validation subsets for cancer-related and demographic data. Significant differences were found for comorbidities, weight loss, and cognitive impairment. There was a larger proportion of patients presenting weight loss (≥ 5%), cognitive impairment and overall co-morbidities in the development cohort, while there were more severe comorbidities in the validation cohort (Table 1).

Development of a multivariate prediction model for 6-month mortality

At 6 months, the mortality rate was 17.5% (n=77/439). In univariate analysis, male gender, cancer site, cancer extension, exclusively supportive care, malnutrition (BMI < 21 kg/m2 and weight loss ≥ 5%), and impaired mobility (gait speed < 0.8 m/s) were significantly associated with 6-month mortality. Age, comorbidities, dependency, depressed mood and cognitive impairment were not associated with 6-month mortality (Table 2). The final multivariate prediction model included two geriatric variables, malnutrition (unintentional weight loss) and impaired mobility (slow gait speed); two oncological variables (cancer site, cancer extension), and the decision whether or not to instate exclusively supportive care (Figure 2, Table 3). There was no interaction between cancer site, cancer extension, and exclusively supportive care. The final scores ranged from 2 to 19 with a median of 9 (6-11). Four groups at increasing risk were identified: 118 patients (25%) were at low risk (2 to 6), 196 (45%) at medium risk (7 to 10), 102 (23%) at high risk (11 to 14), and 23 (5%) at very-high risk (15 and over). Overall, the risk of early death ranged from 2% to 61%. The score was well calibrated (Figure 3A), and discrimination was good, with a Harrell’s C index of 0.75 (0.69-0.81). The Kaplan-Meier plot showed significant discrimination across the four risk groups. In particular, the 6-month risk of death was 2%, 14%, 32% and 61% for the low, medium, high and very high-risk groups respectively (Figure 3C).

Table 2. Univariate predictors of 6-month mortality in the 439 older patients with cancer in the development cohort.

VariablesNon-survivors
n= 77
%Survivors
n= 362
%Non-adjusted
HR [95% CI]
P*
Age (y).5
 65 to 76172283231 (reference)
 77 to 81222992251.2 [0.6-2.2]
 82 to 85151996270.8 [0.4-1.6]
 86 to 103233091251.3 [0.7-2.4]
Sex (men)4659.716846.41.7 [1-2.6].03
Cancer site<.0001
 Breast45.271201 (reference)
 Colorectal1114.367192.8 [0.9-8.7]
 Lung1823.450145.7 [1.9-16.8]
 Liver810.452142.6 [0.8-8.8]
 Digestive non-colorectal**1418.244125.1 [1.7-15.6]
 Genito or Urinary792674.2 [1.2-14.5]
 Hematological11.32260.8 [0.1-7.3]
 Skin with melanoma22.61133.4 [0.6-18.6]
 Prostate45.2826.8 [1.7-27.0]
 Others †810.411311.4 [3.4-37.9]
Cancer extension<.0001
 Local6876211 (reference)
 Locally-advanced2127137381.8 [0.7-4.5]
 Metastatic5065149413.8 [1.6-8.8]
Decision to instate exclusively supportive care26346016.52.5 [1.5-4.0].0001
ECOG ≥ 335459626.52.2 [1.4-3.5].0005
Patients living alone3140150411.0 [0.7-1.4].9
Comorbidities (CIRS-G)
 Total ≥ 143748142391.4 [0.9-2.2].1
 Number of grade 3 and/or 41925113311.3 [0.8-2.3].2
Dependency
 ADL ≤ 5/63241.511431.51.5 [1.0-2.4].06
 IADL ≤ 3/45673228631.5 [0.9-2.5].1
Nutrition
 BMI < 21 kg/m2162140112.0 [1.1-3.4].01
 Unintentional weight loss ≥5%5267. 5174482.0 [1.2-3.3].002
Mobility
 Gait Speed < 0.8 m/s5875184512.7 [1.6-4.6].0001
Depressed Mood
 Mini-GDS ≥ 1/43748158441.2 [0.8-1.9].4
Cognition
 MMSE < 24/304558182501.4 [0.9-2.0].1
*Log rank test; HR: hazard ratio; ** Oesophagus (n=9), gastric (n=20), pancreas (n=25), bile duct (n=15), duodenum (n=3), anus (n=3), gastro intestinal and stromal tumours (GIST) (n=4); † Sarcoma (n=5), mesothelioma (n=8), unknown primary site (n=10), head and neck (n=3), thymus (n=1); ECOG-PS: Eastern Cooperative Oncology Group Performance Status; CIRS-G: Cumulative Illness Rating Scale Geriatric; ADL: Activity of Daily Living; IADL: Instrumental ADL; BMI: Body Mass Index; Mini-GDS: Mini Geriatric Depression Scale; MMSE: Mini Mental State Examination.
Forest plot of the multivariate prediction model.

Figure 2. Forest plot of the multivariate prediction model.

Table 3. Multivariate predictors of 6-months mortality and scoring system based on the development cohort of 439 patients.

VariablesBeta-coefficientStandard errorScoring
Unintentional loss weight ≥ 5%0.20.21
Gait speed < 0.8 m/s1.00.23
Cancer site
 BreastReferenceReference0
 Hematological-0.81.1-3
 Colorectal0.80.53
 Liver0.70.62
 Skin with melanoma0.50.82
 Genito or Urinary1.00.63
 Digestive non-colorectal1.30.54
 Lung1.30.54
 Prostatic1.40.75
 Others2.20.67
Cancer extension
 LocalReferenceReference0
 Locally-advanced1.00.43
 Metastatic1.60.45
Decision to instate exclusively supportive care0.80.23
(A, B) Calibration curves in the development cohort (A), and in the validation cohort (B). The grey line indicates the ideal prediction; The black line indicates prediction with the GRADE; The dashed line indicates prediction with optimism correction. (C, D) Kaplan Meyer survival curves for 6-month mortality according to risk-groups in the development cohort (C), and in the validation cohort (D).

Figure 3. (A, B) Calibration curves in the development cohort (A), and in the validation cohort (B). The grey line indicates the ideal prediction; The black line indicates prediction with the GRADE; The dashed line indicates prediction with optimism correction. (C, D) Kaplan Meyer survival curves for 6-month mortality according to risk-groups in the development cohort (C), and in the validation cohort (D).

Internal validity and clinical impact of the final multivariate prediction model

In the validation cohort, the 6-month mortality rate was 18.9% (n=31/164). The score ranged from 0 to 18 with a median of 9 (6-11). 43 patients (26%) were at low risk, 68 (41%) at medium risk, 41 (25%) at high risk, and 12 (7%) at very high-risk. Overall, the risk of early death ranged from 0% to 58%. The score was also well calibrated (Figure 3B) and discrimination was good, with a Harrell’s C index of 0.76 (0.66-0.86), close to that for the development cohort. The Kaplan-Meier plot showed significant discrimination across the four risk groups (Figure 3D).

In stratified analyses, discrimination showed consistent results, with the best Harrell’s C index at 0.81 (0.63-0.98) in the 77- to 81-year-old subset (Table 4).

Table 4. Discrimination of the GRADE in the validation cohort.

SubgroupsN° of patients (n)Harrell’s C index [95% CI]
Age (y):
 65-76(n=39)0.78 [0.5-1.0]
 77-81(n=44)0.81 [0.6-0.9]
 82-85(n=40)0.66 [0.4-0.8]
 86-103(n=41)0.79 [0.5-0.9]
Cancer extension:
 Non-metastatic(n=92)0.77 [0.6-0.9]
 Metastatic(n=72)0.70 [0.5-0.8]
Functional status:
 ECOG-PS < 3(n=91)0.76 [0.6-0.9]
 ECOG-PS ≥ 3(n=73)0.73 [0.6-0.8]
ECOG-PS: Eastern Cooperative Oncology Group Performance Status.

The decision curves provided better performances for our scoring system than for the ECOG-PS in accurately identifying the risk thresholds for purpose of therapeutic-decisions (Figure 4). In particular, at the 2% and 14% risk thresholds for early death our scoring system points the need for cancer treatment and is related to a favorable C/B ratio among older patients. At the 32% risk threshold for early death our scoring system yields a less favorable C/B ratio for cancer treatment among older patients and suggests the need for caution in therapeutic decisions (tailored case by). At 61% risk threshold for early death our scoring system discourages cancer treatment among older patients, since the C/B ratio is not in favor of these patients. One the basis of these considerations, 23/38 (60%) patients in the exclusively supportive care subset would be less likely to be undertreated. Conversely, 26/126 (21%) patients in the active treatment subset would be less likely to be overtreated. Overall, according to the GRADE, 49/164 (30%) patients would be misclassified for the final therapeutic decision.

The decision curves show estimates of the SNB (%) over a range of probability thresholds used to categorize observations as “high risk”. The curves help to evaluate a treatment policy that recommends treatment for patients who are considered to be “high risk” by comparing the population impact of a risk-based policy to “treat all” (cross line in grey) and “treat none” (baseline) intervention policies. A model for prediction of early death (curves in black) according to ECOG-PS, and the GRADE. At a given risk threshold for early death, the graph gives the expected SNB per patient for “treat none”, “treat all”, and to treatment according to the ECOG-PS, and the GRADE, in relation to the related Cost/Benefit (C/B) ratio.

Figure 4. The decision curves show estimates of the SNB (%) over a range of probability thresholds used to categorize observations as “high risk”. The curves help to evaluate a treatment policy that recommends treatment for patients who are considered to be “high risk” by comparing the population impact of a risk-based policy to “treat all” (cross line in grey) and “treat none” (baseline) intervention policies. A model for prediction of early death (curves in black) according to ECOG-PS, and the GRADE. At a given risk threshold for early death, the graph gives the expected SNB per patient for “treat none”, “treat all”, and to treatment according to the ECOG-PS, and the GRADE, in relation to the related Cost/Benefit (C/B) ratio.

Practical clinical application

For therapeutic decision purposes, the GRADE should be used in a two-step approach: the sum of the first four variables (i.e. weight, gait speed, cancer site and extension) gives a risk of death at baseline; then the addition of the last variable enables the final decision on whether or not it is exclusively supportive care that is required. This dynamic process is expected to help with weighing up therapeutic decisions, to avoid under- and over-treatment situations. We also created a nomogram using the five clinical variables (Figure 5) with a free website link to be used by clinicians in their daily practice: https://grade.shinyapps.io/dynnomapp/. In brief, the website gives the patient’s expected survival by way of click-check variables.

A nomogram is a graphical calculating device based on the results of a multivariate Cox regression. It is a quick way to interpret the 6-month mortality risk predicted by the multivariate Cox model. A numerical scale was created allocating scores for each predictor: Unintentional weight loss (“Yes”: 37; “No”: 28); Slow gait speed (“Yes”: 60; “No”: 28); Site (Hematological: “0”; Breast: “28”; Skin: “46”; Liver: “51”; CR: “55”; GU: “62”; Dig: “70”; Lung: “71”; Prostate: “74”; Other: “100”); Extension (Local: “28”; Locally-Advanced: “60”; Metastatic: “81”); and Exclusively supportive cares (“Yes”: 55; “No”: 28). The total score derived from all the covariates ranges from 112 to 333 points and indicates the probabilities (Pr) of dying in the 6-month follow-up. This device is available on the website: https://grade.shinyapps.io/dynnomapp/ Skin: skin with melanoma; CR: colorectal; GU: genito-urinary; Dig: digestive non-colorectal.

Figure 5. A nomogram is a graphical calculating device based on the results of a multivariate Cox regression. It is a quick way to interpret the 6-month mortality risk predicted by the multivariate Cox model. A numerical scale was created allocating scores for each predictor: Unintentional weight loss (“Yes”: 37; “No”: 28); Slow gait speed (“Yes”: 60; “No”: 28); Site (Hematological: “0”; Breast: “28”; Skin: “46”; Liver: “51”; CR: “55”; GU: “62”; Dig: “70”; Lung: “71”; Prostate: “74”; Other: “100”); Extension (Local: “28”; Locally-Advanced: “60”; Metastatic: “81”); and Exclusively supportive cares (“Yes”: 55; “No”: 28). The total score derived from all the covariates ranges from 112 to 333 points and indicates the probabilities (Pr) of dying in the 6-month follow-up. This device is available on the website: https://grade.shinyapps.io/dynnomapp/ Skin: skin with melanoma; CR: colorectal; GU: genito-urinary; Dig: digestive non-colorectal.

Discussion

Here, we provided a simple geriatric score namely GRADE to predict 6-month mortality, and to guide oncologists in their therapeutic decisions.

In our study, for all 603 patients in the two cohorts, therapeutic decisions were made in a multidisciplinary consultation meeting, which reflects the real-life situation of older patients with cancer.

Our score is composed of five clinical variables, including cancer site and extension, non-intentional weight loss ≥5%, gait speed <0.8 m/s and the decision or not to instate exclusively supportive care. This is the main strength of our simple score, since it is easy to perform in daily oncological practice with only a few additional minutes to a normal consultation. Particularly, in our experience, the mean time to measure gait speed is 69.5 seconds, ideally measured during the time spent between the waiting room and the consultation room. In addition, we found that gait speed < 0.8 m/s was an independent, strong covariate in our scoring system. A slow gait speed is a well-known predictive factor for mortality among older adults, and it is strongly associated with frailty and treatment complications [8, 1416]. We have previously shown that a gait speed <1m/s is significantly associated with at least one geriatric impairment on the GA, and thus takes the heterogeneity of ageing with cancer into account [18]. A slow gait speed was also found to be independently associated with early death in the recently published Nice Cancer Ageing Survival (NCAS) score [13]. This score predicts early death at 100 days for older cancer patients, but it is not feasible in daily practice since it uses the mini nutritional assessment (MNA) instead of weight loss as the nutrition parameter. In a first oncological consultation, MNA scoring would require up to 15 additional minutes [17]. A limitation of our score could be its poorer discrimination compared to the NCAS score [13]. However, we chose a compromise between feasibility in daily practice, and the predictive performances of a survival score of this type. In addition to the NCAS score, other scoring systems have been specifically developed for older cancer patients for the prediction of longer-term mortality. (Table 5).

Table 5. Comparison of baseline characteristics and predictive performances of scoring systems for mortality designed for older patients with cancer.

Scoring systemsNumber of patients EthnicityAge (y) Median age (range)Outcome (mortality rate)VariablesDiscrimination, C index (95%CI) Very good (VG) Good (G) Moderate (M)AdvantagesDisadvantages
CGA-based score 2011 [10]n=249 Asian≥70 77 (70-94)1-, 2-, and 3-year (69%)Total = 6 Age, Albumin, GDS, DETERMINE nutritional index, ECOG-PS, cancer-extensionHarrell’s C index * 0.71(NA) GShort to long term survival estimation Internal validityTime to scoring with biological variable (1 day at least) Asian population only
Onco-MPI 2016 [11]n=658 Not reported≥70 77 (70-96)1-year (17.4%)Total = 12 Age, sex, BMI, ADL, IADL, ECOG-PS, CIRSG, number of drugs, MMSE, caregivers, cancer-site, cancer-extensionHarrell’s C index 0.86 (0.84-0.89) ** VGThe best discriminationNo validation Time to scoring based on geriatric assessment (45 min at least)
MNA-based sore 2016 [12]n=606 Not reported≥70 NA1-year (37%)Total = 4 MNA-modified version, cancer-site, cancer-extension, lymphocytes.AUC 0.69 (NA) † MExternal validityTime to scoring with biological variable (1 day at least) Moderate discrimination
NCASS 2018 [13]n=1050 Not reported≥70 81.8 (70-100)100-day (20%)Total = 5 MNA-full version, Gait speed, ECOG-PS, cancer-site, cancer extensionAUC 0.79 (0.76-0.83) * GInternal validity Good discrimination Large sampleTime to scoring with MNA-full version (15 min at least)
GRADE 2019n=603 Various ethnicity≥ 65 82 (65-103)6-month (17.5%)Total = 5 Weight loss, Gait speed, cancer-site, cancer-extension, exclusively supportive caresHarrell’s C index 0.75 (0.65-0.84) * GInternal validity Good discrimination Various ethnicity Time to scoring (3 min at most) Cost/benefit ratio to treatExternal validity missing
*internal validity; **no validation; † external validity; ADL: Activity of Daily Living; BMI: Body Mass Index; CGA: Comprehensive Geriatric Assessment; CIRSG: Cumulative Illness Rating Scale Geriatric; DETERMINE: Disease Eating poorly Tooth loss/mouth pain Economic hardship Reduced social contact Multiple medicines Involuntary weight loss/gain Needs assistance in self-care Elder years > 80; ECOG-PS: Eastern Cooperative Oncology Group Performance Status; GRADE: onco-Geriatric scoRe of eArly DEath; GDS: Geriatric Depression Scale; IADL: Instrumental-ADL; MMSE: Mini Mental State Examination; MNA: Mini Nutritional Assessment; NCASS: Nice Cancer Ageing Survival Score; Onco-MPI: Oncologic Multidimensional Prognostic Index.

Another strength of our study is the robust methodology that we used as recommended for the development and validation of a multivariate prediction model (TRIPOD guidelines) [18]. We prospectively enrolled patients and assessed development and internal validity with a non-random split sample of patients. We used a Cox proportional hazard regression model that took into account the time to death and selected the five variables to maximize the likelihood. We validated the clinical impact of our score with decision curves, and we showed better performances than the ECOG-PS for cancer treatment decisions, since it is an unreliable clinical scale in older cancer patients [19]. Our score could also be useful for risk adjustment when a clinical trial on cancer is to be performed among older patients. Finally, our score could be useful in epidemiological studies to compare study populations, and patient outcomes across different health-care organizations.

Our population is ethnically diverse and the population characteristics are similar to those in other large studies on older cancer patients (e.g. ONCODAGE and ELCAPA) [7, 20].

Among older cancer patients, the therapeutic decision is a complex process that relies on multidisciplinary expertise, cancer-related symptoms, the specific type of treatment for the cancer, and the patient’s preference, so that a prognostic score cannot be the sole component in the decision-making process. Our score provides three levels of information for the clinician: the risk of death linked to geriatric health (i.e. weight loss and gait speed) and to the cancer extension; the benefit of treating according to the GRADE (i.e. life extended); and the treatment cost in terms of morbidity (i.e. side effects). Thus, our score accurately identifies four groups at risk for death and increasing cost. Moreover, the originality of the GRADE is that it takes into account the decision whether or not to choose exclusively supportive care for a patient. This is particularly important for therapeutic decision-making, in metastatic settings, when the question of whether to treat or not is a daily challenge to avoid under- or over-treatment of older cancer patients. It is now well-known that older cancer patients can be under-treated, usually with sub-optimal-dose treatments if they are not too frail [21, 22]. They can also be over-treated, particularly if exclusively supportive care should be preferred. Our score is helpful in that it contributes to the therapeutic decision using the variable “exclusively supportive care”. This is particularly true for medium risk groups for whom a “supportive care” decision would put them in a high-risk group, and therefore a missed chance. We are aware that breaking bad news such as the decision to instate exclusively supportive care (i.e. treatment of symptoms) is difficult for the patient but also for the oncologist [23]. However, even a less aggressive chemotherapy regimen is potentially morbid, and usually non-beneficial in this setting (i.e. metastatic cancer patients with a high or very-high risk according to the GRADE) [24, 25].

Let us consider the real case of an 87-year-old man with metastatic lung cancer with a 15% weight loss, and a gait speed ≥ 0.8 m/s. Thus, the GRADE is 10 (medium risk), with a 6-month mortality risk of 14%. If this patient is offered exclusively supportive care, he would be up-graded to 13 in the high-risk group, meaning decreased survival and increased cost. For this reason, he should be offered chemotherapy. Now, let us look at the same patient with a gait speed < 0.8 m/s. Before any treatment decision, the GRADE is 13 (high-risk), with a 6-month mortality risk of 32% and an unfavorable cost/benefit ratio. Even low-dose chemotherapy would lead to a greater cost and morbidity for a small benefit. The decision to instate exclusively supportive care should thus be preferred in this clinical situation.

We encourage active treatment for patients with an estimated risk of early death up to 14%, since in this situation, there is a cost/benefit ratio in favor of active treatment.

Conclusion

In this study, we developed and validated a simple score easy to implement in daily oncological practice, to predict early death among older cancer patients and to guide oncologists in their treatment decisions.

Materials and Methods

Reporting

We followed the Transparent Reporting of a multivariate prediction model for Individual Prognosis Or Diagnosis (TRIPOD) guidelines [18].

Study design and population

Patients were recruited from the Physical Frailty in Elderly Cancer patients (PF-EC) cohort. This prospective, observational two-center cohort study started in November 2013, and is described in detail elsewhere [9]. Briefly, all consecutive older in- and out-patients referred for a geriatric oncology assessment were prospectively included in a registry when a diagnosis of cancer was established and when a frailty was suspected, before any cancer treatment decision.

For the present study, we analyzed all outpatients who presented up to September 30 2017, regardless of tumor site or stage. We excluded inpatients because of the impracticality of conducting mobility tests (e.g. infusions limiting walking measures). The inclusion date was the date of the first geriatric oncology visit.

Informed consent was obtained from the patients before inclusion. The study was approved by the local ethics committee (CLEA-2015-019, Avicenne Hospital, Bobigny, France).

Cancer-related and demographic data

Demographic data (age, sex, region of origin classified as follows: West Europeans, East Europeans, Latin Europeans, North Africans, Sub-Saharan Africans, and Asians), tumor characteristics (site, extension: local, locally advanced i.e. unresectable tumor with no distant metastases, or metastatic disease stricto sensu) and Eastern Cooperative Oncology Group Performance Status (ECOG-PS) were obtained at the first geriatric oncology visit as part of the GA. Cancer treatment modes were categorized as exclusively supportive care or not, and were prospectively collected in the 6-month follow-up according to the treatment finally administered (i.e. supportive care only vs. at least one of the following treatment modes: surgery, chemotherapy, targeted therapy, hormonotherapy, radiotherapy, percutaneous treatment, and intra-arterial treatment). All treatment regimens, including exclusively supportive care, were validated in weekly institutional multidisciplinary meetings.

The geriatric assessment (GA)

The GA was performed at the first geriatric oncology visit and included seven domains (social environment, comorbidities, functional status, mobility, nutrition, mood, and cognition) [8, 14, 2631] (Table 6).

Table 6. The geriatric assessment in the PF-EC cohort.

DomainsToolsRangeAbnormal ifReference
Social environmentQuestion: Are you living alone?-Yes-
ComorbiditiesCIRSG
No. of grade 3 (severe)
No. of grade 4 (very severe)
0-56
-
-
≥ 14 (median)
≥ 1
≥ 1
[26]
Functional statusADL
IADL
0-6
0-4
≤5
≤ 4
[27]
[28]
MobilityGS (m/s)-< 0.8[8]
NutritionBMI (kg/m2)
Unintentional weight loss in the previous year (%)
-
-
< 21
≥ 5
[29]
[14]
MoodMini-GDS0-4≥ 1[30]
CognitionMMSE0-30< 24[31]
CIRSG: Cumulative illness Rating Scale Geriatric; ADL: Activity of Daily Living; IADL: Instrumental ADL; GS: gait speed; BMI: Body Mass Index; Mini-GDS: mini Geriatric Depression Scale; MMSE: Mini Mental State Examination.

Outcome

Overall 6-month mortality following the GA was recorded to assess predictors of early death. Vital status was determined from medical records or by telephoning patients or their families.

Statistical analyses

We allocated patients included up to July 30 2016 to the development cohort, and the remaining patients up to September 30 2017 to the validation cohort.

Categorical data are expressed as numbers and proportions, and continuous data as means and standard deviation (SD) or medians and quartiles (25th-75th).

Comparisons of baseline characteristics (cancer, demographic data, and GA-components) between the development and validation subsets were performed using the chi-square test or Fisher’s exact test for categorical variables, as appropriate.

We performed a correlation assessment using the Spearman’s rho test as appropriate for categorical variables. Multicollinearity between variables was defined as a rho test value ≥ 0.50.

Development of the onco-Geriatric scoRe of eArly DEath (GRADE)

A comparison of baseline characteristics (cancer, demographic data, GA-components) between six-month survivors and non-survivors in the development subset was performed using the log rank test. Univariate predictors of six-month non-survival were expressed using non-adjusted Hazard Ratios (HR) and 95% confidence intervals (95%CI). Variables yielding P values under 0.20 in the univariate analysis were considered for inclusion in the multivariate analysis. Because of multicollinearity between the GS and the IADL, the ADL and the ECOG-PS, we choose GS as a covariate of functional status. We therefore created a Cox multivariate proportional-hazard regression model to assess multivariate factors associated with 6-month mortality. Multivariate predictors were expressed by the beta-coefficient with standard error, and by adjusted HR (aHR) with 95%CI. Graphically, multivariate predictors were presented in a forest-plot. Model assumptions were verified. To maximize likelihood while minimizing losses in prediction, a final multivariate prediction model was created with a backward selection procedure according to the lowest Akaïke Information Criterion (AIC) [32]. A scoring of each predictor was performed using Schneeweiss’s beta-coefficient point-based scoring system [32]. This scoring system weights by 1 unit more or less with each 0.3 increase or decrease in the beta-coefficient. We categorized this score into four groups of increasing risk on the basis of the lowest AIC value in Cox regression. Graphically, we assessed the calibration slope in the final multivariate prediction model. Discrimination by the final multivariate prediction model was assessed using Harrell’s C index with 95%CI. Given the current lack of consensus on the best threshold to consider for the quality of discrimination for survival prediction models, we used a previously described categorization of Harrell’s C index discrimination as well: 0.5-0.59 (poor), 0.6-0.69 (moderate), 0.7-0.79 (good), 0.8-0.89 (very good), and ≥ 0.90 (excellent) [33]. Survival curves were plotted according to the Kaplan-Meier method with the final score divided into four groups.

Internal validation

we assessed the calibration and discrimination of the final score in the validation subset with the same methods as described above. Stratified discrimination analyses were performed in age quartiles, for an ECOG-PS ≤ 2 vs > 2, and for non-metastatic vs metastatic cancers. To assess the clinical impact of our score, we used the standardized net benefit (SNB) derived from decision curves [34, 35] (Supplementary Methods).

All tests were two-sided, and the threshold for statistical significance was set at P<0.05. The data was analyzed using R statistical software (version 3.4.3, R Foundation for Statistical Computing, Vienna, Austria; http://www.r-project.org). A multivariate imputation by chained equations was used to handle missing data for weight loss (n=9), and GS (n=3), via the MICE package in R.

Author Contributions

Conception and design: EA, GB, FP; Acquisition of data: KC, BD, TA, LZ, GB, FP; Analysis and interpretation of data: EA, KC, FCP, BD, TA, EP, LZ, GB, FP; Drafting the article: EA, GB, FP; Reviewing the article: EA, KC, FCP, BD, TA, EP, LZ, GB, FP; Final approval: EA, KC, FCP, BD, TA, EP, LZ, GB, FP.

Acknowledgments

We thank Angela Swaine and Sarah Leyshon for revising the manuscript.

Conflicts of Interest

The authors have no conflicts of interest to report.

References

  • 1. Ferlay J, Soerjomataram I, Dikshit R, Eser S, Mathers C, Rebelo M, Parkin DM, Forman D, Bray F. Cancer incidence and mortality worldwide: sources, methods and major patterns in GLOBOCAN 2012. Int J Cancer. 2015; 136:E359–86. https://doi.org/10.1002/ijc.29210 [PubMed]
  • 2. Lewis JH, Kilgore ML, Goldman DP, Trimble EL, Kaplan R, Montello MJ, Housman MG, Escarce JJ. Participation of patients 65 years of age or older in cancer clinical trials. J Clin Oncol. 2003; 21:1383–89. https://doi.org/10.1200/JCO.2003.08.010 [PubMed]
  • 3. Le Saux O, Falandry C, Gan HK, You B, Freyer G, Péron J. Inclusion of elderly patients in oncology clinical trials. Ann Oncol. 2016; 27:1799–804. https://doi.org/10.1093/annonc/mdw259 [PubMed]
  • 4. Glaser R, Marinopoulos S, Dimitrakakis C. Breast cancer treatment in women over the age of 80: A tailored approach. Maturitas. 2018; 110:29–32. https://doi.org/10.1016/j.maturitas.2018.01.014 [PubMed]
  • 5. Gennari R, Curigliano G, Rotmensz N, Robertson C, Colleoni M, Zurrida S, Nolè F, de Braud F, Orlando L, Leonardi MC, Galimberti V, Intra M, Veronesi P, et al. Breast carcinoma in elderly women: features of disease presentation, choice of local and systemic treatments compared with younger postmenopasual patients. Cancer. 2004; 101:1302–10. https://doi.org/10.1002/cncr.20535 [PubMed]
  • 6. Wildiers H, Heeren P, Puts M, Topinkova E, Janssen-Heijnen ML, Extermann M, Falandry C, Artz A, Brain E, Colloca G, Flamaing J, Karnakis T, Kenis C, et al. International Society of Geriatric Oncology consensus on geriatric assessment in older patients with cancer. J Clin Oncol. 2014; 32:2595–603. https://doi.org/10.1200/JCO.2013.54.8347 [PubMed]
  • 7. Soubeyran P, Fonck M, Blanc-Bisson C, Blanc JF, Ceccaldi J, Mertens C, Imbert Y, Cany L, Vogt L, Dauba J, Andriamampionona F, Houédé N, Floquet A, et al. Predictors of early death risk in older patients treated with first-line chemotherapy for cancer. J Clin Oncol. 2012; 30:1829–34. https://doi.org/10.1200/JCO.2011.35.7442 [PubMed]
  • 8. Pamoukdjian F, Lévy V, Sebbane G, Boubaya M, Landre T, Bloch-Queyrat C, Paillaud E, Zelek L. Slow Gait Speed Is an Independent Predictor of Early Death in Older Cancer Outpatients: Results from a Prospective Cohort Study. J Nutr Health Aging. 2017; 21:202–06. https://doi.org/10.1007/s12603-016-0734-x [PubMed]
  • 9. Pamoukdjian F, Canoui-Poitrine F, Longelin-Lombard C, Aparicio T, Ganne N, Wind P, Martinez-Tapia C, Audureau E, Sebbane G, Zelek L, Paillaud E. Diagnostic performance of gait speed, G8 and G8 modified indices to screen for vulnerability in older cancer patients: the prospective PF-EC cohort study. Oncotarget. 2017; 8:50393–402. https://doi.org/10.18632/oncotarget.17361 [PubMed]
  • 10. Kanesvaran R, Li H, Koo KN, Poon D. Analysis of prognostic factors of comprehensive geriatric assessment and development of a clinical scoring system in elderly Asian patients with cancer. J Clin Oncol. 2011; 29:3620–27. https://doi.org/10.1200/JCO.2010.32.0796 [PubMed]
  • 11. Brunello A, Fontana A, Zafferri V, Panza F, Fiduccia P, Basso U, Copetti M, Lonardi S, Roma A, Falci C, Monfardini S, Cella A, Pilotto A, Zagonel V. Development of an oncological-multidimensional prognostic index (Onco-MPI) for mortality prediction in older cancer patients. J Cancer Res Clin Oncol. 2016; 142:1069–77. https://doi.org/10.1007/s00432-015-2088-x [PubMed]
  • 12. Bourdel-Marchasson I, Diallo A, Bellera C, Blanc-Bisson C, Durrieu J, Germain C, Mathoulin-Pélissier S, Soubeyran P, Rainfray M, Fonck M, Doussau A. One-Year Mortality in Older Patients with Cancer: Development and External Validation of an MNA-Based Prognostic Score. PLoS One. 2016; 11:e0148523. https://doi.org/10.1371/journal.pone.0148523 [PubMed]
  • 13. Boulahssass R, Gonfrier S, Ferrero JM, Sanchez M, Mari V, Moranne O, Rambaud C, Auben F, Hannoun Levi JM, Bereder JM, Bereder I, Baque P, Turpin JM, et al. Predicting early death in older adults with cancer. Eur J Cancer. 2018; 100:65–74. https://doi.org/10.1016/j.ejca.2018.04.013 [PubMed]
  • 14. Fried LP, Tangen CM, Walston J, Newman AB, Hirsch C, Gottdiener J, Seeman T, Tracy R, Kop WJ, Burke G, McBurnie MA, and Cardiovascular Health Study Collaborative Research Group. Frailty in older adults: evidence for a phenotype. J Gerontol A Biol Sci Med Sci. 2001; 56:M146–56. https://doi.org/10.1093/gerona/56.3.M146 [PubMed]
  • 15. Studenski S, Perera S, Patel K, Rosano C, Faulkner K, Inzitari M, Brach J, Chandler J, Cawthon P, Connor EB, Nevitt M, Visser M, Kritchevsky S, et al. Gait speed and survival in older adults. JAMA. 2011; 305:50–58. https://doi.org/10.1001/jama.2010.1923 [PubMed]
  • 16. Pamoukdjian F, Paillaud E, Zelek L, Laurent M, Lévy V, Landre T, Sebbane G. Measurement of gait speed in older adults to identify complications associated with frailty: A systematic review. J Geriatr Oncol. 2015; 6:484–96. https://doi.org/10.1016/j.jgo.2015.08.006 [PubMed]
  • 17. Cereda E. Mini nutritional assessment. Curr Opin Clin Nutr Metab Care. 2012; 15:29–41. https://doi.org/10.1097/MCO.0b013e32834d7647 [PubMed]
  • 18. Collins GS, Reitsma JB, Altman DG, Moons KG. Transparent reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD): the TRIPOD statement. J Clin Epidemiol. 2015; 68:134–43. https://doi.org/10.1016/j.jclinepi.2014.11.010 [PubMed]
  • 19. Repetto L, Fratino L, Audisio RA, Venturino A, Gianni W, Vercelli M, Parodi S, Dal Lago D, Gioia F, Monfardini S, Aapro MS, Serraino D, Zagonel V. Comprehensive geriatric assessment adds information to Eastern Cooperative Oncology Group performance status in elderly cancer patients: an Italian Group for Geriatric Oncology Study. J Clin Oncol. 2002; 20:494–502. https://doi.org/10.1200/JCO.20.2.494 [PubMed]
  • 20. Ferrat E, Paillaud E, Laurent M, Le Thuaut A, Caillet P, Tournigand C, Lagrange JL, Canouï-Poitrine F, Bastuji-Garin S, and ELPACA Study Group. Predictors of 1-Year Mortality in a Prospective Cohort of Elderly Patients with Cancer. J Gerontol A Biol Sci Med Sci. 2015; 70:1148–55. https://doi.org/10.1093/gerona/glv025 [PubMed]
  • 21. Fakhri B, Fiala MA, Tuchman SA, Wildes TM. Undertreatment of Older Patients With Newly Diagnosed Multiple Myeloma in the Era of Novel Therapies. Clin Lymphoma Myeloma Leuk. 2018; 18:219–24. https://doi.org/10.1016/j.clml.2018.01.005 [PubMed]
  • 22. Wallwiener CW, Hartkopf AD, Grabe E, Wallwiener M, Taran FA, Fehm T, Brucker SY, Krämer B. Adjuvant chemotherapy in elderly patients with primary breast cancer: are women ≥65 undertreated? J Cancer Res Clin Oncol. 2016; 142:1847–53. https://doi.org/10.1007/s00432-016-2194-4 [PubMed]
  • 23. Bousquet G, Orri M, Winterman S, Brugière C, Verneuil L, Revah-Levy A. Breaking Bad News in Oncology: A Metasynthesis. J Clin Oncol. 2015; 33:2437–43. https://doi.org/10.1200/JCO.2014.59.6759 [PubMed]
  • 24. Bonadonna G, Valagussa P. Dose-response effect of adjuvant chemotherapy in breast cancer. N Engl J Med. 1981; 304:10–15. https://doi.org/10.1056/NEJM198101013040103 [PubMed]
  • 25. Hryniuk W, Bush H. The importance of dose intensity in chemotherapy of metastatic breast cancer. J Clin Oncol. 1984; 2:1281–88. https://doi.org/10.1200/JCO.1984.2.11.1281 [PubMed]
  • 26. Miller MD, Paradis CF, Houck PR, Mazumdar S, Stack JA, Rifai AH, Mulsant B, Reynolds CF 3rd. Rating chronic medical illness burden in geropsychiatric practice and research: application of the Cumulative Illness Rating Scale. Psychiatry Res. 1992; 41:237–48. https://doi.org/10.1016/0165-1781(92)90005-N [PubMed]
  • 27. Katz S, Downs TD, Cash HR, Grotz RC. Progress in development of the index of ADL. Gerontologist. 1970; 10:20–30. https://doi.org/10.1093/geront/10.1_Part_1.20 [PubMed]
  • 28. Lawton MP, Brody EM. Assessment of older people: self-maintaining and instrumental activities of daily living. Gerontologist. 1969; 9:179–86. https://doi.org/10.1093/geront/9.3_Part_1.179 [PubMed]
  • 29. Raynaud-Simon A, Revel-Delhom C, Hébuterne X, and French Nutrition and Health Program, French Health High Authority. Clinical practice guidelines from the French Health High Authority: nutritional support strategy in protein-energy malnutrition in the elderly. Clin Nutr. 2011; 30:312–19. https://doi.org/10.1016/j.clnu.2010.12.003 [PubMed]
  • 30. Clément JP, Nassif RF, Léger JM, Marchan F. [Development and contribution to the validation of a brief French version of the Yesavage Geriatric Depression Scale]. Encephale. 1997; 23:91–99. [PubMed]
  • 31. Folstein MF, Folstein SE, McHugh PR. “Mini-mental state”. A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975; 12:189–98. https://doi.org/10.1016/0022-3956(75)90026-6 [PubMed]
  • 32. Mehta HB, Mehta V, Girman CJ, Adhikari D, Johnson ML. Regression coefficient-based scoring system should be used to assign weights to the risk index. J Clin Epidemiol. 2016; 79:22–28. https://doi.org/10.1016/j.jclinepi.2016.03.031 [PubMed]
  • 33. Yourman LC, Lee SJ, Schonberg MA, Widera EW, Smith AK. Prognostic indices for older adults: a systematic review. JAMA. 2012; 307:182–92. https://doi.org/10.1001/jama.2011.1966 [PubMed]
  • 34. Vickers AJ, Elkin EB. Decision curve analysis: a novel method for evaluating prediction models. Med Decis Making. 2006; 26:565–74. https://doi.org/10.1177/0272989X06295361 [PubMed]
  • 35. Kerr KF, Brown MD, Zhu K, Janes H. Assessing the Clinical Impact of Risk Prediction Models With Decision Curves: Guidance for Correct Interpretation and Appropriate Use. J Clin Oncol. 2016; 34:2534–40. https://doi.org/10.1200/JCO.2015.65.5654 [PubMed]