- Original article
- Open Access
A novel nomogram individually predicting disease-specific survival after D2 gastrectomy for advanced gastric cancer
- Wei Wang†1,
- Zhe Sun†2,
- Jing-Yu Deng†3,
- Xiao-Long Qi4,
- Xing-Yu Feng5,
- Cheng Fang1,
- Xing-Hua Ma6,
- Zhen-Ning Wang2,
- Han Liang3Email author,
- Hui-Mian Xu2Email author and
- Zhi-Wei Zhou1Email authorView ORCID ID profile
© The Author(s) 2018
- Received: 4 September 2017
- Accepted: 9 November 2017
- Published: 15 May 2018
Few studies have shown nomograms that may predict disease-specific survival (DSS) probability after curative D2 gastrectomy for advanced gastric cancer (AGC), particularly among Chinese patients. This study sought to develop an elaborative nomogram that predicts long-term DSS for AGC in Chinese patients.
A retrospective study was conducted on 6753 AGC patients undergoing D2 gastrectomy between January 1, 2000 and December 31, 2012 from three large medical hospitals in China. We assigned patients from Sun Yat-sen University Cancer Center to the training set, and patients from the First Affiliated Hospital of China Medical University and Tianjin Medical University Cancer Hospital to two separate external validation sets. A multivariate survival analysis was performed using Cox proportional hazards regression model in a training set, and a nomogram was constructed. Harrell’s C-index was used to evaluate discrimination and calibration plots were used to validate similarities between survival probabilities predicted by the nomogram model and actual survival rates in two validation sets.
The multivariate Cox regression model identified age, tumor size, location, Lauren classification, lymphatic/venous invasion, depth of invasion, and metastatic lymph node ratio as covariates associated with survival. In the training set, the nomogram exhibited superior discrimination power compared with the 8th American Joint Committee on Cancer TNM classification (Harrell’s C-index, 0.82 vs. 0.74; P < 0.001). In two validation sets, the nomogram’s discrimination power was also excellent relative to TNM classification (C-index, 0.83 vs. 0.75 and 0.81 vs. 0.74, respectively; P < 0.001 for both). After calibration, the nomogram produced survival predictions that corresponded closely with actual survival rate.
The established nomogram was able to predict 3-, 5-, and 10-year DSS probabilities for AGC patients. Validation revealed that this nomogram exhibited excellent discrimination and calibration capacity, suggesting its clinical utility.
- Advanced gastric cancer
- Disease-specific survival
- Prognostic nomogram
Despite a downward trend in incidence worldwide, gastric cancer remains both the second most prevalent cancer and the second most frequent cause of cancer-related death in China . Annually, nearly one-half of the gastric cancer patients diagnosed worldwide are in China . Unlike in Japan and Korea, where the majority of gastric cancers are identified at early stages , nearly 90% of gastric cancer patients in China are diagnosed with advanced or metastatic disease .
The only proven curative treatment of gastric cancer without distant metastasis is radical resection combined with regional lymphadenectomy (mostly with D2 resection in Asian countries) . According to the eighth edition of the American Joint Committee on Cancer (AJCC) TNM classification, which is considered the classic cancer prediction system, the prognosis of patients with curative gastric cancer differs based on the depth of invasion and the number of metastatic lymph nodes .
Our previous study demonstrated that age, sex, tumor size, tumor location, and lymphatic/venous invasion (LVI) could also be considered for predicting survival probabilities . Therefore, an individual predictive system beyond or combined with the TNM staging system could be useful for clinical practice and decision-making. Furthermore, accurate risk estimates may help to identify homogeneous patients at high risk to assist with clinical trial design and accrual.
Among the available decision aids, nomograms currently represent the most accurate and discriminatory tools for predicting outcomes in patients with cancer . According to the strict definition, a nomogram is a graphical calculation instrument that can be based on any type of function, such as logistic regression or Cox proportional hazards regression models. The effect of the variables on the specific outcome is represented on the axes, and risk points are attributed according to the prognostic or predictive importance of the variable of interest .
In the past few years, nomograms have been successfully established to quantify risk by combining prognostic factors in certain malignancies [10–14]. However, few studies have used a nomogram to predict outcomes for gastric cancer patients [3, 15, 16]. The first study reporting the predictive ability of a nomogram for gastric cancer was based on a Western database  and was externally validated for accuracy . Subsequently, studies from Korea  and Japan  were conducted to establish a nomogram based on their own databases, which mainly consisted of patients with early-stage gastric cancer and serosa-negative, locally advanced gastric cancer (AGC).
To date, no large cohort study has been conducted to establish the nomogram for the Chinese population with gastric cancer. Additionally, the demographic features, staging distributions, and treatment strategies in Chinese population differ from those in Western and Korean/Japanese populations.
In the present study, we aimed to develop and externally validate a more elaborative nomogram that predicts 3-, 5-, and 10-year disease-specific survival (DSS) probabilities in Chinese patients who have undergone curative resection for AGC. This study included a large cohort of patients from three high-capacity hospitals from southern to northern China obtained over a relatively short period of time (2000–2012). This study represented the current treatment protocol in China.
Between January 1, 2000 and December 31, 2012, patients who underwent gastric cancer resection at the Department of Gastric and Pancreatic Surgery at Sun Yat-sen University Cancer Center (SYSUCC; Guangzhou, China), the Department of Surgical Oncology at the First Affiliated Hospital of China Medical University (CMU; Shenyang, China), and the Department of Gastric Cancer Surgery at Tianjin Medical University Cancer Hospital (TJMU; Tianjin, China) were included in the study. Data from patients who met the following criteria were collected: the pathologic diagnosis of primary gastric adenocarcinoma; absence of residual gastric cancer after surgery; no other synchronous malignancy; no preoperative chemotherapy; no distant metastasis; postoperative advanced disease (tumor invasion beyond the submucosa); D2 lymphadenectomy (Japanese Gastric Cancer Treatment Guideline 2010, Version 3) ; R0 resection (no residual macroscopic or microscopic tumor); postoperative survival of at least 3 months; and no missing data.
The DSS was defined as interval between the date of diagnosis and the date of gastric cancer-related death. Patients with no documented evidence of death were censored at the date of last follow-up. To determine prognostic values related to DSS, we collected the following variables for survival analysis and the further establishment of the nomogram: sex, age, tumor size (the longest diameter of tumor), primary site (the cardia/fundus, body, antrum, or whole stomach), Lauren classification (intestinal or diffuse), lymphatic/venous invasion (present or absent), depth of invasion (proper muscle, T2; subserosa, T3; serosa, T4a; or adjacent organ invasion, T4b), number of metastatic lymph nodes resected, and number of total lymph nodes resected. As part of our surgical procedure, accurate count of all resected lymph nodes, which were carefully retrieved by the surgeon, was recorded. The exact number of retrieved lymph nodes and detailed information about the tumors were recorded in the pathologic results.
A strict disease monitoring program was conducted every 3 months for the first 2 years after surgery, every 6 months from the third year through the fifth year, and annually after 5 years. The monitoring program included abdominal ultrasonography (or computed tomography [CT] if necessary), chest radiographs, gastroduodenal endoscopy examinations, and blood examinations for carcinoembryonic antigens CA199 and CA724. Regular follow-up results were obtained from outpatient records, telephone interviews, and brief messages. This study was approved by the institutional review boards of SYSUCC, CMU, and TJMU.
The present study was approved by the ethics committees of the three hospitals and complied with the seventh version of Declaration of Helsinki in 2013.
Construction of the nomogram
For nomogram construction and external validation, we assigned patients from SYSUCC to the training set and patients from CMU to TJMU to two separate external validation sets. A multivariate survival analysis was conducted using a Cox proportional hazards regression model without violation of the proportional hazards assumption.
The clinicopathologic characteristics of the training and validation sets were evaluated. The proportional hazards (PH) assumption and linearity assumption for continuous variables (age, tumor size, and metastatic lymph node ratio) were examined using restricted cubic splines. To maximize predictive ability, continuous variables were transformed to adequately fit the PH and linearity assumptions, if possible (based on the optimal Akaike Information Criterion value ). Using numerous different algorithms, the results showed that linear modeling was associated with higher predictive ability and was more appropriate for further analysis. Categorical variables were grouped based on clinical reasoning, and decisions regarding grouping were made before modeling. For the categorical variables, a log–log survival plot was used for identifying the PH assumption, and all variables were fitted to the PH assumption. Variables were selected using the forward stepwise selection method in the Cox PH regression model. Based on the predictive model with the identified prognostic factors, a nomogram was constructed for predicting 3-, 5-, and 10-year DSS probabilities.
Validation of the nomogram
The performance of the nomogram consisted of discrimination and calibration using the external validation set. Discrimination was evaluated using a concordance index (C-index), which quantifies the probability that given two random patients, and the patient who relapses first had a higher probability of the event of interest. Harrell’s C-index, which is appropriate for censored data, was used for evaluating discrimination . Calibration was performed by comparing the mean predicted survival probability with the mean actual survival rate observed by Kaplan–Meier analysis after grouping the nomogram-predicted survival probabilities by decile. Our nomogram was validated using two independent validation sets that satisfied the previously mentioned inclusion criteria. The first validation was performed using the CMU validation set, and the second validation was performed using a dataset from TJMU. All three hospitals have the same operation criteria and comprise nearly the largest gastric cancer dataset in China. Statistical significance was set as P < 0.05 in a two-tailed test. All statistical analyses were performed using SPSS version 20 (SPSS, Chicago, IL, USA) and R software version 2.13.2 (http://www.r-project.org) with the design and survival packages.
Demographic and clinicopathologic variables of 6753 patients with advanced gastric cancer in the training and validation sets
SYSUCC training set (n = 2169)
CMU validation set (n = 2353)
TJMU validation set (n = 2231)
Tumor size (cm)a
No. of metastatic lymph nodesa
No. of lymph nodes dissecteda
Metastatic lymph node ratioa
Establishment of nomogram
Selected variables according to the Cox proportional hazards regression model to construct nomogram model
Tumor size (continuous)
Metastatic lymph node ratio (continuous)
Validation and performance of the nomogram
In the CMU and TJMU validation sets, discrimination was also better for the nomogram than for AJCC TNM staging (C-index, 0.83 [95% CI, 0.80–0.86] vs. 0.75 [95% CI, 0.72–0.77] and 0.81 [95% CI, 0.78–0.83] vs. 0.74 [95% CI, 0.71–0.76], respectively; P < 0.001 for both comparisons).
In the present study, we established and externally validated a nomogram model for predicting DSS after D2 gastrectomy for AGC based on a large Chinese cohort. This nomogram was more significantly predictive than the eighth edition AJCC staging, with a C-index of 0.82 and good calibration. Compared with previous studies [3, 15, 16], this study included a larger number of patients with AGC (n = 6753), and the nomogram had a higher precision. Furthermore, our nomogram considered the unique characteristics of the patient population, thus addressing discrepancies in previous models regarding demographic features, stage distribution, and treatment strategies of US, Korean, or Japanese gastric cancer patients.
In contrast to the previous nomogram based on US , Korean , or Japanese  studies, sex was excluded from the nomogram in our present study. This is interesting because female gastric cancer patients had better prognoses in both the univariate and multivariate analyses in all of the previously mentioned databases. However, in our study cohort, the superior survival rate of female patients was insignificant (P = 0.360). We believe that this finding represents one of the most important differences in demographic features and that it may be due, in part, to disadvantages in terms of socioeconomic status of the female population in China.
In our nomogram, Lauren classification was included because of its independent prognostic effect, which corresponds with the US  database but not the Korean  and Japanese  databases. This variable was excluded from the Korean database due to a large percentage of missing data and was replaced with macroscopic and histologic types in the model from the Japanese database. Previous research demonstrated a relationship between Lauren classification and the effect of trastuzumab in gastric cancer patients . Therefore, because one purpose of the nomogram was to guide clinical practice, we chose to include the Lauren classification as an important predictive variable in our nomogram.
One important improvement of our nomogram is that we chose to include metastatic lymph node ratio, which refers to the number of metastatic lymph nodes resected divided by the number of total lymph nodes resected. In our previous studies, we successfully verified that the metastatic lymph node ratio had theoretical and practical advantages for decreasing the staging migration phenomenon and improving prognostic prediction [22–24]. However, based on the independent datasets from the three hospitals included in the present study, the optimal cutoff values of metastatic lymph node ratio for prediction were different. In contrast to models based on the TNM staging system, the predictive model based on the nomogram can directly use a continuous variable without requiring this variable to be converted into a categorical variable. We believe that this model may be considered a general predictive tool for future clinical use. Another important improvement of our nomogram is the use of continuous variables for the establishment of the model. In the present study, we tested various methods of treating or converting continuous variables such as age, tumor size, and metastatic lymph node ratio. We determined that the use of continuous variables resulted in the most precise predictions.
The accuracy of a predictive model refers to the ability of the model to discriminate between patients with or without the outcome of interest, which is demonstrated by the C-index for censored data. In our nomogram model, the C-index values were high: 0.82 in the training set and 0.83 and 0.81 in validation sets. Furthermore, a model’s accuracy indicates not only the overall ability to predict the outcome of interest but also the ability to predict the outcome of interest in specific patient groups or according to risk level. For this purpose, calibration plots should be obtained for both internal and external data. Unlike previous studies, our study investigated all three independent datasets.
We hypothesize that the inclusion of complete and precise data (including all follow-up data), the conversion of continuous data, and the stage distribution contributed to that our study has a higher C-index value compared with previous studies [3, 15, 16]. In our research dataset, we excluded all cases with missing data to improve the precision of the predictive model. For the same reason, we tried various methods to convert the continuous variables (including age, tumor size, and metastatic lymph node ratio) to maximize the predictive ability of the model. The predictive ability increased gradually from 0.76 to 0.82. Furthermore, the stage distribution was distinct from that observed in previous studies [3, 15, 16], for example, in studies using a dataset including early-stage gastric cancers (the US and Korean datasets) or excluding locally AGC (the Japanese dataset). On the other hand, with advanced disease, the demand for precise prediction of survival probability becomes increasingly important for clinical decisions regarding the use of adjuvant chemotherapy or chemoradiotherapy. For this reason, we think that precise prediction tools are more important in AGC patients than in patients with relatively early-stage diseases.
This study has some limitations. The main limitation of the present study was that adjuvant therapy, such as chemotherapy or chemoradiotherapy, was not included as a variable in the predictive model. In the multivariate analysis using the Cox regression model, adjuvant therapy did not appear to be important for prognosis. In clinical practice in China, patients with stage II or III disease usually receive adjuvant chemotherapy with a relatively uniform protocol including 5-fluorouracil- and/or platinum-based therapeutics. In some patients with high-risk recurrent diseases, adjuvant chemoradiotherapy is also recommended. Therefore, adjuvant therapy was not included as a variable in the present study. Another limitation was that our external validation set was based on the Chinese population. This is a large and multicenter database on Chinese patients has been used to establish such a model. In addition, the baseline parameters at the three hospitals were different because the patients from each hospital come from specific regions of China and thus have comparatively different demographics. However, despite these differences, the nomogram demonstrated great accuracy as shown by the C-indexes (SYSUCC: 0.82; CMU: 0.83; and TJMU: 0.81). Whether this predictive model is suitable for Western, US, or other Asian countries is unknown. Therefore, in future studies, it will be necessary to validate this model using data from other countries.
In conclusion, in the present study, we established a nomogram for precisely and individually predicting DSS for Chinese patients with AGC who underwent radical resection with D2 lymphadenectomy based on databases from multiple centers. Its superiority to the traditional TNM staging system may enhance its clinical use in the near future.
WW, ZWZ, HMX, HL and ZNW contributed to conception and design of the study; WW, ZS and JYD collected data; CF and XHM performed data analysis and interpretation; WW, XLQ and XYF drafted the manuscript; ZWZ, HMX, HL and ZNW made critical revision. All authors read and approved the final manuscript.
The authors would like to thank Medbanks (Beijing) Network Technology Co., Ltd for data collection, data entry and data management.
The authors declare that they have no competing interests.
Availability of data and materials
The key raw data have been deposited into the Research Data Deposit (http://www.researchdata.org.cn), with the Approval Number of DDA201800482.
Consent for publication
All authors have approved the publication of our manuscript in Chinese Journal of Cancer.
Ethics approval and consent to participate
The present study was approved by the ethics committees of Sun Yat-sen University Cancer Center, the First Affiliated Hospital of China Medical University, and Tianjin Medical University Cancer Hospital and complied with the Declaration of Helsinki.
This work was supported by the Natural Science Foundation of Guangdong Province (No. 2015A030313089) and the Major Program of Collaborative Innovation of Guangzhou (No. 201508030042).
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Chen W, Zheng R, Baade PD, et al. Cancer statistics in China, 2015. CA Cancer J Clin. 2016;66(2):115–32.View ArticlePubMedGoogle Scholar
- Torre LA, Bray F, Siegel RL, Ferlay J, Lortet-Tieulent J, Jemal A. Global cancer statistics, 2012. CA Cancer J Clin. 2015;65(2):87–108.View ArticlePubMedGoogle Scholar
- Han DS, Suh YS, Kong SH, et al. Nomogram predicting long-term survival after D2 gastrectomy for gastric cancer. J Clin Oncol. 2012;30(31):3834–40.View ArticlePubMedGoogle Scholar
- Wang W, Li YF, Sun XW, et al. Prognosis of 980 patients with gastric cancer after surgical resection. Chin J Cancer. 2010;29(11):923–30.View ArticlePubMedGoogle Scholar
- Shiozaki H, Shimodaira Y, Elimova E, et al. Evolution of gastric surgery techniques and outcomes. Chin J Cancer. 2016;35(1):69.View ArticlePubMedPubMed CentralGoogle Scholar
- Amin MB, Edge S, Greene F, et al., editors. AJCC cancer staging manual. 8th ed. New York: Springer; 2017.Google Scholar
- Wang W, Sun XW, Li CF, et al. Comparison of the 6th and 7th editions of the UICC TNM staging system for gastric cancer: results of a Chinese single-institution study of 1503 patients. Ann Surg Oncol. 2011;18(4):1060–7.View ArticlePubMedGoogle Scholar
- Shariat SF, Karakiewicz PI, Suardi N, et al. Comparison of nomograms with other methods for predicting outcomes in prostate cancer: a critical analysis of the literature. Clin Cancer Res. 2008;14(14):4400–7.View ArticlePubMedGoogle Scholar
- Kattan MW. Nomograms. Introduction. Semin Urol Oncol. 2002;20(2):79–81.PubMedGoogle Scholar
- Wang SJ, Lemieux A, Kalpathy-Cramer J, et al. Nomogram for predicting the benefit of adjuvant chemoradiotherapy for resected gallbladder cancer. J Clin Oncol. 2011;29(35):4627–32.View ArticlePubMedPubMed CentralGoogle Scholar
- Rudloff U, Jacks LM, Goldberg JI, et al. Nomogram for predicting the risk of local recurrence after breast-conserving surgery for ductal carcinoma in situ. J Clin Oncol. 2010;28(23):3762–9.View ArticlePubMedGoogle Scholar
- Anaya DA, Lahat G, Wang X, et al. Postoperative nomogram for survival of patients with retroperitoneal sarcoma treated with curative intent. Ann Oncol. 2010;21(2):397–402.View ArticlePubMedGoogle Scholar
- Weiser MR, Landmann RG, Kattan MW, et al. Individualized prediction of colon cancer recurrence using a nomogram. J Clin Oncol. 2008;26(3):380–5.View ArticlePubMedGoogle Scholar
- Wierda WG, O’Brien S, Wang X, et al. Prognostic nomogram and index for overall survival in previously untreated patients with chronic lymphocytic leukemia. Blood. 2007;109(11):4679–85.View ArticlePubMedGoogle Scholar
- Kattan MW, Karpeh MS, Mazumdar M, et al. Postoperative nomogram for disease-specific survival after an R0 resection for gastric carcinoma. J Clin Oncol. 2003;21(19):3647–50.View ArticlePubMedGoogle Scholar
- Hirabayashi S, Kosugi S, Isobe Y, et al. Development and external validation of a nomogram for overall survival after curative resection in serosa-negative, locally advanced gastric cancer. Ann Oncol. 2014;25(6):1179–84.View ArticlePubMedGoogle Scholar
- Novotny AR, Schuhmacher C, Busch R, et al. Predicting individual survival after gastric cancer resection: validation of a US-derived nomogram at a single high-volume center in Europe. Ann Surg. 2006;243(1):74–81.View ArticlePubMedPubMed CentralGoogle Scholar
- Association Japanese Gastric Cancer. Japanese gastric cancer treatment guidelines 2010 (ver. 3). Gastric Cancer. 2011;14(2):113–23.View ArticleGoogle Scholar
- Harrell FE Jr, Califf RM, Pryor DB, et al. Evaluating the yield of medical tests. JAMA. 1982;247:2543–6.View ArticlePubMedGoogle Scholar
- Harrell FE Jr, Lee KL, Mark DB. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med. 1996;15(4):361–87.View ArticlePubMedGoogle Scholar
- Bang YJ, Van Cutsem E, Feyereislova A, et al. Trastuzumab in combination with chemotherapy versus chemotherapy alone for treatment of HER2-positive advanced gastric or gastro-oesophageal junction cancer (ToGA): a phase 3, open-label, randomised controlled trial. Lancet. 2010;376(9742):687–97.View ArticlePubMedGoogle Scholar
- Sun Z, Zhu GL, Lu C, et al. The impact of N-ratio in minimizing stage migration phenomenon in gastric cancer patients with insufficient number or level of lymph node retrieved: results from a Chinese mono-institutional study in 2159 patients. Ann Oncol. 2009;20(5):897–905.View ArticlePubMedGoogle Scholar
- Deng J, Liang H, Wang D, et al. Enhancement the prediction of postoperative survival in gastric cancer by combining the negative lymph node count with ratio between positive and examined lymph nodes. Ann Surg Oncol. 2010;17(4):1043–51.View ArticlePubMedGoogle Scholar
- Wang W, Xu DZ, Li YF, et al. Tumor-ratio-metastasis staging system as an alternative to the 7th edition UICC TNM system in gastric cancer after D2 resection–results of a single-institution study of 1343 Chinese patients. Ann Oncol. 2011;22(9):2049–56.View ArticlePubMedGoogle Scholar