Skip to main content
  • Research article
  • Open access
  • Published:

Signaling protein signature predicts clinical outcome of non-small-cell lung cancer

Abstract

Background

Non-small-cell lung cancer (NSCLC) is characterized by abnormalities of numerous signaling proteins that play pivotal roles in cancer development and progression. Many of these proteins have been reported to be correlated with clinical outcomes of NSCLC. However, none of them could provide adequate accuracy of prognosis prediction in clinical application.

Methods

A total of 384 resected NSCLC specimens from two hospitals in Beijing (BJ) and Chongqing (CQ) were collected. Using immunohistochemistry (IHC) staining on stored formalin-fixed paraffin-embedded (FFPE) surgical samples, we examined the expression levels of 75 critical proteins on BJ samples. Random forest algorithm (RFA) and support vector machines (SVM) computation were applied to identify protein signatures on 2/3 randomly assigned BJ samples. The identified signatures were tested on the remaining BJ samples, and were further validated with CQ independent cohort.

Results

A 6-protein signature for adenocarcinoma (ADC) and a 5-protein signature for squamous cell carcinoma (SCC) were identified from training sets and tested in testing sets. In independent validation with CQ cohort, patients can also be divided into high- and low-risk groups with significantly different median overall survivals by Kaplan-Meier analysis, both in ADC (31 months vs. 87 months, HR 2.81; P <  0.001) and SCC patients (27 months vs. not reached, HR 9.97; P <  0.001). Cox regression analysis showed that both signatures are independent prognostic indicators and outperformed TNM staging (ADC: adjusted HR 3.07 vs. 2.43, SCC: adjusted HR 7.84 vs. 2.24). Particularly, we found that only the ADC patients in high-risk group significantly benefited from adjuvant chemotherapy (P = 0.018).

Conclusions

Both ADC and SCC protein signatures could effectively stratify the prognosis of NSCLC patients, and may support patient selection for adjuvant chemotherapy.

Peer Review reports

Background

Lung cancer is the most common cause of cancer-related mortality worldwide, and approximately 80% cases are non-small-cell lung cancer (NSCLC) mainly including adenocarcinomas (ADC) and squamous cell carcinomas (SCC) [1, 2]. The tumor-node-metastasis (TNM) staging system is currently adopted to predict prognosis and guide treatment decisions for patients with NSCLC [3, 4]. However, the current staging system is not always accurate [5, 6]. After complete surgical resection of NSCLC, about 30% pathologic stage IA patients die of relapse within five years, while nearly 50% of stage IIA and 24% stage IIIA patients can survive [6].

To improve the outcome prediction of NSCLC, tremendous efforts have been made to identify prognostic markers. Based on gene microarray analysis, many groups have identified different gene signatures [7,8,9,10,11,12,13,14,15,16,17,18,19]. These signatures were usually identified on fresh or frozen tissue samples, the mixture of stroma, tumor and normal cells. In addition, mRNA levels in gene-based signatures are not always consistent with protein expression levels. Until now, this approach has not yielded a signature that could be applied in NSCLC clinical practice [13]. On the other hand, the management of cancer patients is still mainly guided based on combinations of clinicopathological features, including prognostic markers derived from careful histopathological analysis of tumors. For breast cancer, the combination of three protein markers, oestrogen receptor (ER), progesterone receptor (PR) and human epidermal growth factor receptor 2 (HER2), has been successfully utilized for clinical decision making and the use of this framework has contributed to the steady decline in the mortality of breast cancer patients. For lung cancer, numerous signaling proteins have been identified as abnormal in cancer development and progression [1, 20,21,22], and many of them have been reported to be correlated with clinical outcome of NSCLC [23]. However, none of them could provide adequate accuracy in clinical application. Based on these proteins, we attempt to identify a multi-protein signature to improve the prognosis prediction of NSCLC.

In this study, we performed an immunohistochemistry (IHC) analysis of 75 signaling proteins in paraffin-embedded surgical specimens of NSCLCs. These proteins represent the most important signaling pathways involved in cancer development [20, 21, 24]. Using random forest algorithm (RFA) and support vector machines (SVM), we successfully identified a 6-protein signature for ADC and a 5-protein signature for SCC that accurately predicted prognosis of ADC and SCC respectively.

Methods

Study design

The objective of this study was to identify signaling protein signature for NSCLC prognosis. Patients were eligible to enter the study if they underwent complete resection of invasive NSCLC at People’s Hospital of Peking University in Beijing (BJ) and Southwest Hospital of Chongqing (CQ) between January, 2004, and December, 2010. Information on the clinical variables and follow-up data were obtained from a prospectively maintained database of individual hospitals. We then excluded the patients who received any treatment prior to resection, received epidermal growth factor receptor tyrosine kinase inhibitor (EGFR TKI), died within 30 days of resection, or had no follow-up information. In total, 211 samples of patients from BJ hospital and 173 samples of patients from CQ hospital who fulfilled the inclusion criteria were collected for our study. The protocols of this study were approved by the Institutional Review Board of People’s Hospital and Southwest Hospital. Written consent for the use of the resected tissue for research purposes was obtained at time of surgery.

We assessed the expression levels of 75 signaling proteins via immunohistochemistry (IHC) on BJ samples. BJ samples were randomly partitioned into training (2/3 samples) and testing (1/3 samples) sets. Random forest algorithm and support vector machines were employed to identify prognostic signatures. Since previous studies have suggested fundamental differences between ADC and SCC regarding their molecular make-ups [2, 25], we separately identified the signature for ADC and SCC patients. CQ cohort was used for independent validation.

Selection of IHC markers

To create the panel of IHC markers, we started with all of the 1027 proteins in “pathways in cancer” (Entry No. map05200) and “non-small cell lung cancer” (Entry No. map05223) of KEGG (Kyoto Encyclopedia of Genes and Genomes) pathway database. After searching NCBI Gene database using gene IDs and the related articles in PubMed (“See all citations in PubMed” under item “Bibliography” in the webpages), we found that 765 of 1027 candidates were associated with prognosis of cancer. After further filtering with “IHC” and “FFPE” and checking the existing literature, we found that 103 of the 765 proteins had been tested with IHC assay on FFPE samples in prognosis analysis.

We then purchased antibodies against all these 103 proteins and tested them by Western blot and immunofluorescence analysis. Seventy-four antibodies against 74 different proteins/phospho-proteins were found with high specificity/sensitivity and were used in our subsequent study. These 74 proteins/phospho-proteins plus CUEDC2, a potential oncogene that we identified and studied extensively [26,27,28,29], were the final members of the IHC marker panel. Schematic diagram of IHC marker selection is depicted in Additional file 1: Figure S1.

Tissue microarray

All hematoxylin and eosin (H&E) slides were centrally reviewed at Department of Pathology in People’s Hospital according to the histopathological classification system adopted by the World Health Organization (WHO) to confirm tumor type and differentiation grade. Tissue microarrays were prepared as previously described [30]. Representative areas of each tissue sample were identified and carefully marked on H&E-stained sections. Core-tissue specimens (2 mm in diameter) were punched from the corresponding individual donor tissue blocks and rearranged in recipient blocks using a trephine apparatus (SuperBioChips Laboratories, Seoul, Korea) [31].

IHC analysis

IHC staining was performed and evaluated as previously described [32]. The consecutive 4-μm-thick sections of tissue array were cut and mounted on glass slides. The slides were baked at 60 °C for 2 h prior to the high-throughput IHC procedure. The arrays were deparaffinized via sequential washing with xylene, graded ethanol and water. Antigens were retrieved (or not) for 15 min at 95 °C (see Additional file 1: Table S1 for detail). Endogenous peroxidase was blocked with 3% H2O2 for 30 min. Nonspecific staining was blocked using 10% normal goat serum (in 1× PBS) for 1 h at room temperature. The slides were incubated overnight at 4 °C with various antibodies (diluted in 1× PBS, see Additional file 1: Table S1 for dilution). The enhancing step, incubation with the secondary antibody (1 h at room temperature) and the diaminobenzidine (DAB) substrate (5 min at room temperature) were all performed following the protocol of ABC kit (Vector Laboratories, Burlingame, CA). Hematoxylin was used as a counterstain in the last step. The slides were then rinsed, cleared and mounted. The staining of each antibody was optimized based on negative and positive controls. For complete data of optimal antibody dilutions and assay conditions, see Additional file 1: Table S1. The flurescent images and Westhern blot results for specificity/sensitivity validation of each antibody are deposited in Clinical Research Database (CRD, see http://202.38.152.246:81/crd2/frontend/www/, username: nsclc, password: nsclcnsclc).

Semiquantative analysis of the immunostained slides was performed using a modified histochemical scoring (H-score) system to assess both the intensity of the staining and the percentage of positively-stained cells, as previously described [32]. Briefly, for the intensity, a score of 0 to 3 (corresponding to negative, weak, moderate or strong staining) was recorded. The scoring was normalized with controls. In addition, the percentage of positively-stained cells at each intensity was estimated. The H-score was calculated as 1 × (weak %) + 2 × (moderate %) + 3 × (strongly stained %). All slides were concurrently evaluated by three certified pathologists (Y.H.T., D.H.S and K.K.S), blinded to clinical data, to improve the accuracy of the results. The evaluation was repeated under multi-headed microscope if there was a discrepancy between the pathologists in the interpretation of the slides until consensus was achieved. All the digital images and the results of IHC evaluation are deposited in CRD.

Data process of protein expression profiles

The expression score of each protein was processed for further analysis. Missing values were replaced with the median score of the respective protein in all tumors (see Supplementary methods for the details). The ratio of the expression score of each protein in a single sample to the mean score of that protein was calculated. The expression level was then quantified as log10 (expression ratio). To avoid zeros in the logarithm, a score of 0.01 was added to all scores. For independent validation, missing values were replaced with the median score. The expression profiles were processed as described above.

Signature identification and model development

The patients were grouped according to the survival status at three years for modeling. Two-thirds of ADC and SCC patients from BJ cohort were assigned as training sets by computer-generated random numbers. Random forest algorithm was used to identify protein signatures in the training sets [33]. The procedure was implemented using the R varSelRF package with parameters “ntree = 5000, ntreeIterat = 2000, vars.drop.frac = 0.2”, which was built upon the randomForest package [34, 35]. The set of proteins with the smallest out-of-bag error rate among all the forests were returned and selected as signatures.

After signatures were identified, SVM was employed to develop the classification models in the training sets. The radial basis function (RBF) kernel was chosen for SVM training. The parameters C and γ for RBF kernel were tuned using the grid search strategy [36]. The parameter C was tuned from 2− 5 to 215 with the step of 22. The parameter γ was tuned from 23 to 2− 15 with the step of 2− 2. During the training phase, the performance of SVM was evaluated using 5-fold cross-validation accuracy. The classification model was trained using SVM with the optimal C and γ. All the procedure was implemented using libSVM, a library for support vector machines [36].

To analyze the robustness of our signatures, enrichment analysis was performed. Ten thousand training sets were generated from BJ ADC and BJ SCC patients respectively, by randomly partitioning BJ ADC and BJ SCC patients into training set and testing set for 10,000 times. Each training set involved 2/3 ADC or SCC patients. A signature was identified on each training set using random forest algorithm. For each protein, the fraction of the signatures containing the protein (i.e. percentage of subsets) in all 10,000 subsets in ADC or SCC patients from BJ cohort was calculated. The proteins were sorted in descending order of the percentages.

Statistical analysis

Overall survival (OS) from the time of resection was chosen as the primary endpoint since it is verifiable through multiple sources and less subject to interpretation bias [14]. Differences in survival between patients with good and poor prognosis and between patients treated with adjuvant chemotherapy or not were analyzed using Kaplan-Meier analysis and the two-sided log-rank test. Related covariates in this study were compared with clinical outcome using univariate and multivariate Cox regression analysis. A Wald likelihood ratio test was performed to assess statistical significance. For all statistical tests, a two-sided α of 0.05 was regarded as statistically significant. The analyses were performed in the R programming language (version 3.0.2).

Results

Patient characteristics

In this study, 211 patients who fulfilled the inclusion criteria from Beijing People’s Hospital were used as the training and testing sets (BJ cohort) (Table 1). A total of 173 patients from Chongqing Southwest Hospital were used as the independent validation cohort (CQ cohort) (Table 1). All the samples are resected tissues from patients underwent surgery at TNM stages I-IIIA. Of the total cases, 63% (243 of 384) patients received adjuvant platinum-based doublet chemotherapy. The median duration of follow-up was 58 months (interquartile range, 22 to 75), and during the follow-up period, 175 patients died (Table 1). Because previous studies have suggested fundamental differences between ADC and SCC regarding their molecular make-ups [2, 25], we separately identified the prognostic signature for ADC and SCC patients based on the expression levels of the detected signaling proteins.

Table 1 Clinical-pathological characteristics of non-small-cell lung cancer patients

Identification of the ADC signature

In our experiments, all the antibodies used were commercially available and were validated by Western blot and immunofluorescence analysis (Additional file 1: Table S1). Using IHC, we investigated the expression levels of 75 signature protein candidates in BJ cohort (Additional file 1: Table S1). To make the detailed staining and clinical information of each case accessible to the public, we developed a clinical research database (CRD) and all the results were deposited in it (http://202.38.152.246:81/crd2/frontend/www/, username: nsclc, password: nsclcnsclc). Two thirds of ADC patients from BJ cohort were randomly assigned as the training set, and the remaining 1/3 as the testing set (Fig. 1, BJ cohort). We performed signature discovery using random forest algorithm on the training set. The identified signature of ADC comprised six proteins: c-SRC, Cyclin E1, TTF1, p65, CHK1, and JNK1. We developed a classification model with the 6-protein signature using SVM algorithm (Additional file 1: Tables S2 and S3). For each patient, the model was used to calculate a prognosis score, which represents the combined information of the six proteins in the signature.

Fig. 1
figure 1

Flow chart of signature identification and validation strategy. Abbreviations: BJ cohort, patients from Peking University People’s Hospital; CQ cohort, patients from Southwest Hospital of Chongqing; ADC, adenocarcinoma; SCC, squamous cell carcinoma; IHC, immunohistochemistry; EGFR-TKI, epidermal growth factor receptor tyrosine kinase inhibitor

The performance of the ADC signature in the training set was evaluated by receiver-operating characteristic (ROC) analysis. The value of area under the ROC curve (AUC) of the signature on training set was 0.967 (Fig. 2a), indicating that the signature accurately predicted the prognosis in the training set. Based on the ROC curve, the optimal cutoff point of the prognosis score was calculated as 0.710 to separate good and poor prognosis. A patient with a prognosis score smaller than 0.710 was classified into poor-prognosis group; otherwise, the patient was classified into good-prognosis group. In the training set, the good-prognosis group showed a three-year survival of 91.9% (95% CI, 81.7 to 96.6%) and 11.1% (95% CI, 1.9 to 29.8%) in the poor-prognosis group in Kaplan-Meier analysis (HR 14.54; 95% CI, 6.35 to 33.31; P <  0.001, Fig. 2b).

Fig. 2
figure 2

Identification and validation of the 6-protein signature for adeno-carcinoma (ADC). a The ROC curve of the ADC training set. The cutoff point of prognosis scores is shown. b-c Patients of the training set (b) and testing set (c) were classified into poor- and good-prognosis groups using the 6-protein ADC signature. The Kaplan-Meier estimates of overall survival for the two predicted prognosis groups are shown. (d) The prognosis score distribution, prognosis prediction using the ADC signature, the three-year survival status and the expression profile of the 6-protein signature proteins were summarized on ADC patients of BJ cohort. Each column represents an individual patient. e ADC patients of the independent CQ validation cohort were classified into poor- and good-prognosis groups using the 6-protein ADC signature. The Kaplan-Meier survival curves for the two prognosis groups are shown. f The prognosis score distribution, prognosis prediction using the signature, the three-year survival status and the expression profile of the 6-protein signature proteins of CQ ADC patients are shown

We next evaluated the prognostic performance of this 6-protein signature in the testing set. The result indicated that the ADC signature was strongly associated with overall survival of these patients. Kaplan-Meier analysis showed a three-year overall survival of 96.0% (95% CI, 74.8 to 99.4%) in good-prognosis group, but just 37.5% (95% CI, 15.4 to 59.8%) in poor-prognosis group (HR 7.67; 95% CI, 3.96 to 39.34; P <  0.001, Fig. 2c).

The prognosis score distribution, prognosis prediction, three-year survival status and the expression profile of the signature proteins of the ADC patients from BJ cohort are summarized in Fig. 2d. The comparison of the prognosis score distribution (top panel) and the three-year survival data (middle panel) indicated that the 6-protein signature accurately predicted the three-year survival of patients. Particularly, in the distribution of prognosis scores, the top part (32%) and the bottom part (15%) are completely correct in predicting three-year survival, suggesting that the prognosis score is a reliable predictor for prognosis. The expression profile of the six signature proteins was shown in the bottom panel.

Independent validation of the ADC signature

To further verify the performance of the ADC signature, we used another cohort (CQ cohort) of ADC patients as an independent validation set (Fig. 1, CQ cohort). Kaplan-Meier analysis showed a significant difference in overall survival between the predicted good- and poor-prognosis groups (HR 2.81; 95% CI, 1.65 to 6.05; P <  0.001; Fig. 2e). The good-prognosis group had a three-year survival of 97.3% (95% CI, 82.3 to 99.6%), and the poor-prognosis group had a rate of 42.9% (95% CI, 26.4 to 58.3%; Fig. 2e). The prognosis score distribution, prognosis prediction, the survival status, and the expression profile of the six signature proteins of CQ cohort were presented in Fig. 2f. These results further demonstrated the effectiveness of the 6-protein signature in the prognosis prediction of ADC patients.

We compared the prognostic value of ADC signature with that of clinical risk factors, including pathologic stage, age, tumor size, smoking index, and chemotherapy, by both univariate and multivariate Cox regression analysis in independent CQ cohort. The univariate analysis indicated that the 6-protein signature is a better prognostic predictor of three-year overall survival (HR 2.89; 95% CI, 1.52 to 5.48; P = 0.001) than the pathologic stage (HR 2.43; 95% CI, 1.64 to 3.60; P <  0.001), although both of them are statistically significant (Table 2). The multivariate analysis further showed that the 6-protein signature is an independent predictor (HR 3.07; 95% CI, 1.29 to 7.32; P = 0.011) after adjusting for the above risk factors (Table 2).

Table 2 Cox regression analysis of overall survival in the independent CQ validation cohort

Identification and independent validation of the SCC signature

Using a similar procedure as in the discovery of the ADC signature, we also identified a protein signature for SCC with BJ cohort (Table 1; Fig. 1; CRD; Additional file 1: Tables S4 and S5). The SCC signature is distinct from the ADC signature and consists of five proteins: EGFR, p38α, AKT1, SOX2, and E-cadherin. An ROC analysis on the training set showed an AUC value of 0.913 and the optimal cutoff point of the prognosis score was 0.597 (Fig. 3a). With this cutoff point, the prognosis prediction of the 5-protein SCC signature in the training set showed a three-year survival of 96.2% (95% CI, 75.7 to 99.5%) in good-prognosis group and 25.0% (95% CI, 11.8 to 40.7%) in poor-prognosis group (HR 11.65; 95% CI, 3.65 to 16.41; P < 0.001, Fig. 3b).

Fig. 3
figure 3

Identification and validation of the 5-protein signature for squamous cell carcinoma (SCC). a The ROC curve of the SCC training set. The cutoff point of prognosis scores is shown. b-c Patients of the training set (b) and testing set (c) were classified into poor- and good-prognosis groups using the 5-protein SCC signature. The Kaplan-Meier estimates of overall survival for the two predicted prognosis groups are shown. d The prognosis score distribution, prognosis prediction using the signature, the three-year survival status and the expression profile of the 5-protein signature proteins were summarized on SCC patients of BJ cohort. Each column represents an individual patient. e SCC patients of the independent CQ validation cohort were classified into poor- and good-prognosis groups using the 5-protein SCC signature. The Kaplan-Meier survival curves for the two prognosis groups are shown. f Prognosis score distribution, prognosis prediction using the SCC protein signature, patient survival status and the expression profile of the 5-protein signature proteins of CQ SCC patients are shown

The evaluation result of this signature on the testing set indicated that it was strongly associated with overall survival of SCC patients. The three-year overall survival in good-prognosis group was 72.7% (95% CI, 37.1 to 90.3%) and 15.8% (95% CI, 3.9 to 34.9%) in poor-prognosis group (HR 3.51; 95% CI, 1.39 to 7.73; P = 0.008; Fig. 3c). The patients with low prognosis scores had significantly more death events than those with high scores, indicating that the SCC signature effectively predicted prognosis (Fig. 3d).

We further used the SCC patients from CQ cohort for independent validation (Fig. 1, CQ cohort). A significant difference in overall survival between the predicted good- and poor-prognosis groups was shown by Kaplan-Meier analysis (HR 9.97; 95% CI, 4.46 to 17.99; P < 0.001; Fig. 3e). 97.6% (95% CI, 83.9 to 99.7%) of the patients in good-prognosis group survived at least three years, but only 29.3% (95% CI, 16.4 to 43.4%) of the patients in poor-prognosis group did so (Fig. 3e). Figure 3f showed the prognosis score distribution, prognosis prediction, the survival status, and the expression profile of the five proteins in CQ cohort. Notably, in the distribution of prognosis scores, the top part (50%) and the bottom part (20%) are completely correct in predicting the three-year survival. These results showed that the 5-protein SCC signature accurately predicted the prognosis of patients of CQ cohort. Cox regression analysis further showed that the SCC signature is an independent prognostic factor and has a greater prognostic power than TNM staging system (Table 2).

Both signatures distinguish between good and poor prognosis within TNM stages

We next investigated whether our signatures could be used to further distinguish between poor- versus good-prognosis groups in each TNM stage (stage I, II, or IIIA). Using the combined samples of the ADC patients from BJ and CQ cohorts, we found that the 6-protein ADC signature could clearly divide the patients into poor- and good-prognosis groups within each stage (Additional file 1: Figure S2 A to C. HR 6.1; 95% CI, 1.81 to 20.27; P < 0.0001 for Stage I; HR 3.59; 95% CI, 1.72 to 7.51; P = 0.0007 for Stage II; and HR 2.96; 95% CI, 1.43 to 6.11; P = 0.015 for Stage IIIA). Similarly, the 5-protein SCC signature also markedly classified SCC patients into good- and poor-prognosis groups within each stage (Additional file 1: Figure S2 D to F. HR 7.36; 95% CI, 2.76 to 19.68; P < 0.0001 for Stage I; HR 7.27; 95% CI, 3.28 to 16.08; P < 0.0001 for Stage II; and HR 5.13; 95% CI, 2.56 to 10.29; P = 0.0020 for Stage IIIA). Taken together, these results indicate that both the ADC and SCC signatures can distinguish between good and poor prognosis within each stage.

Predicted poor-prognosis ADC patients benefited from adjuvant chemotherapy

According to the American Society of Clinical Oncology (ASCO) guidelines, adjuvant chemotherapy is recommended for routine use in stage II and IIIA patients [37]. Reports also showed that adjuvant chemotherapy can improve overall survival of NSCLCs in stage IB [38, 39]. However, only a small portion of these patients gain benefit in terms of 5-year survival [40]. To test whether our protein signatures are valuable in selecting patients for adjuvant chemotherapy, we did an exploratory analysis of the predictive value of our prognostic signatures of NLCSCs in stage IB, II and IIIA. For the good-prognosis group classified by the ADC signature, adjuvant chemotherapy did not significantly prolong overall survival of the patients (HR 0.99; 95% CI, 0.40 to 2.46; P = 0.987; Fig. 4a). However, for the poor-prognosis group, adjuvant chemotherapy significantly improved survival (HR 0.51; 95% CI, 0.24 to 0.86; P = 0.018; Fig. 4b).

Fig. 4
figure 4

Analysis of adjuvant chemotherapy benefit based on the 6-protein adenocarcinoma (ADC) signature. Kaplan-Meier estimates of overall survival for the patients at stages IB, II and IIIA with or without adjuvant chemotherapy in the good-prognosis (a) and poor-prognosis (b) group was analyzed

We further assessed the capacity of 6-protein ADC and 5-protein SCC signatures to predict benefit from adjuvant therapy when the different stages are analyzed separately. In ADC, we found that adjuvant chemotherapy did not significantly prolong overall survival in either good-prognosis group classified by the ADC signature or poor-prognosis group in stage IB (Additional file 1: Figure S3 A to D). But significant benefit from adjuvant therapy was observed for the poor-prognosis group in stage II and stage IIIA (Additional file 1: Figure S3 E and F. HR 0.36; 95% CI, 0.15 to 0.90; P = 0.0134 for Stage II; HR 0.183; 95% CI, 0.02 to 1.56; P = 0.0003 for Stage IIIA).

For SCC, we performed similar analysis in all patients or patients within different stages, and did not observe any significant benefit in either good- or poor-prognosis groups. (Additional file 1: Figure S4 and Additional file 1: Figure S5).

Permutation validation and enrichment analysis

The optimal signature proteins were identified using random forest algorithm (RFA) through a large number iterations of signature building and evaluation. RFA is an ensemble learning method composing of thousands of decision trees [33]. In this study, the decision trees were built with patients and proteins selected randomly and independently. RFA can avoid over-fitting and yield small number protein-contained signatures that retain a high predictive accuracy [41]. Permutation analysis showed the efficacy of RFA in our study (Fig. 5a and b). The performances of ADC and SCC signatures were among the top 2.68% and 1.82% in 10,000 randomly generated protein combinations respectively. For each protein, we calculated the percentage of the signatures containing this protein in 10,000 signatures identified using RFA from 10,000 randomly partitioned training sets. The six proteins of the ADC signature are present on the top 15 most highly enriched proteins (Fig. 5c). Especially, the proteins c-SRC, TTF1 and CHK1 are ranked in the top 3. Meanwhile, the five proteins of the SCC signature are among the top five proteins (Fig. 5d). The high frequencies of our signature proteins demonstrated the robustness and the low bias of our signatures.

Fig. 5
figure 5

Permutation validation and enrichment analysis. In permutation validation, ten thousand protein combinations were generated randomly. The model with each combination was trained on the training set using SVM. The ability of each combination to separate the testing set into good- and poor-prognosis groups was evaluated using the log-rank test. Histograms of the χ2 value from the log-rank test on ADC testing set (a) and SCC testing set (b) were illustrated. The x axis indicates the χ2 value. A larger χ2 value indicates a lower P value and a more statistically significant ability to separate the testing set. The y axis shows the frequency and higher values indicate a larger fraction of the population. The performance of the ADC/SCC signature is marked with a red arrow. In enrichment analysis, ten thousand signatures were identified on 10,000 randomly partitioned training sets using random forest algorithm. For each protein, the fraction of the signatures containing the protein (i.e. percentage of subsets) in ADC (c) and SCC (d) patients from BJ cohort was calculated. A zoom-in on the 15 most enriched proteins is also shown. Each column corresponds to a protein, the signature proteins are denoted in red

Discussion

IHC is currently the most practical method of assessing the expression levels of prognostic and predictive protein biomarkers in tumor cells [42, 43]. Due to the heterogeneity of protein expressions in tumors, the IHC scoring system used in this study considered both the intensity of the staining (richness) and the percentage of positively-stained tumor cells (evenness). We examined the expression levels of 75 signaling proteins representing the most important pathways involved in cancer development (Additional file 1: Table S1). Based on the expression scores of these proteins in lung cancer tissues, we calculated a prognostic score using the SVM algorithm-based model for each patient (Figs. 2 and 3). This score represents the combined information of the expression levels of the signature proteins, 6 proteins for ADC and 5 proteins for SCC. As shown in the distribution of prognosis scores (Fig. 2d and f; Fig. 3d and f), the higher prognostic score indicates more chance of good survival. The results indicated that the prognostic scores might be actionable in the NSCLCs prognosis.

The successful identification of the signatures with excellent performances strongly suggests that NSCLCs at different stages are featured by their specific signaling status, which is represented by expression levels of certain signaling proteins [41, 42]. The good performance of the signatures owed to three important aspects: selection of signaling proteins that play pivotal roles in lung cancer development, reliable and accurate assessment of protein expression levels with IHC staining that distinguishes cancer cells from stromal cells, and the implementation of high-efficient signature identification methods: random forest algorithm and SVM computation.

The prognostic signatures with excellent performance were identified from 75 signaling proteins. The selection of the proteins was based on their known importance in cancer development and prognosis prediction, and availability and suitability of a corresponding antibody for paraffin-embedded tissues. Although these proteins show some prognostic values, however, none of them individually predicts accurately in clinical practice [5, 43], as CQ Zhu et al. summarized. Using a signature of multiple proteins will likely overcome the limitation of single protein as prognostic predictors because the multiple-protein signature may reflect the heterogeneity of tumourigenesis. In this study, we identified the signatures with multiple proteins which have effective prognostic values in NSCLCs. Both 6-protein ADC signature and 5-protein SCC signature performed much better than each of the signature protein (Additional file 1: Figure S6 and Additional file 1: Figure S7). We noticed that the ADC signature does not include some top ranked proteins. One possible reason is that these proteins have functional redundancies with some ADC signature proteins. For example, CDK1 correlates with CHK1 in regulating G2/M transition and SKP2 is also a key regulator of cell cycle [44, 45]. The inclusion of these redundant proteins in the signature will limit its ability to reflect the contribution of multiple important pathways to the complexity of cancer.

Over-treating with adjuvant chemotherapy of cancer patients is a major concern. Only a survival advantage of 5.4% was found in Lung Adjuvant Cisplatin Evaluation meta-analysis [40]. Therefore, it is necessary to develop more accurate tool for identifying patients most likely to benefit from adjuvant chemotherapy. The ADC prognostic signature in this study can identify a poor-prognosis subset from stage II-IIIA patients who could benefit from adjuvant chemotherapy. Meantime, the ADC signature also showed that the good-prognosis patients do not benefit from adjuvant chemotherapy. Hence, using ADC signature to identify patients for the treatment may spare the patients with good prognosis from adjuvant chemotherapy and avoid over-treatment of lung cancer patients.

The signatures identified in the study not only provide a tool for better prognosis prediction, but also help to reveal novel roles of the signature proteins in the development of lung cancer (Additional file 1: Table S6). For example, the upregulation of JNK1 and CHK1 are known to promote breast cancer metastasis [46]. Our study suggests that they might play similar roles in lung cancer metastasis, as the majority of ADC patients with poor prognosis had high JNK1 and CHK1 expression levels, whereas most ADC patients with good prognosis had low CHK1 expression. As we have identified several patients with good prognosis but high JNK1 expression, low CHK1 expression may have a dominant effect on tumor progression, possibly by promoting metastasis (Fig. 2d and f). Further studies will help to determine how these signature proteins cooperate to regulate NSCLC progression.

Conclusions

To our knowledge, this is one of the best identification of protein signatures that precisely predict the prognosis of NSCLC patients. Both signatures contain only a small number of proteins, six for ADC and five for SCC. This makes the application of the signatures more practical in routine clinical application. However, a prospective study with larger sample size cohorts from multiple centers, especially including non-Asian cohorts, will be needed to further validate the performance of the signatures. Nevertheless, our study demonstrated that signaling protein signatures are obviously valuable in prognosis prediction of lung cancer.

Abbreviations

ADC:

Adenocarcinoma

ASCO:

American Society of Clinical Oncology

AUC:

Area under the curve

BJ:

Beijing

CI:

Confidence interval

CQ:

Chongqing

CRD:

Clinical research database

H&E:

Hematoxylin and eosin

HR:

Hazard ratio

IHC:

Immunohistochemistry

NSCLC:

Non-small-cell lung cancer

OS:

Overall survival

RBF:

Radial basis function

RFA:

Random forest algorithm

ROC:

Receiver-operating characteristic

SCC:

Squamous cell carcinoma

SVM:

Support vector machines

TNM:

Tumor-node-metastasis

References

  1. Schiller JH, Gandara DR, Goss GD, Vokes EE. Non-small-cell lung cancer: then and now. J Clin Oncol. 2013;31:981–3.

    Article  PubMed  Google Scholar 

  2. Campbell JD, Alexandrov A, Kim J, Wala J, Berger AH, Pedamallu CS, et al. Distinct patterns of somatic genome alterations in lung adenocarcinomas and squamous cell carcinomas. Nat Genet. 2016;48:607–16.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  3. Goldstraw P. New staging system: how does it affect our practice? J Clin Oncol. 2013;31:984–91.

    Article  CAS  PubMed  Google Scholar 

  4. Rusch VW, Crowley J, Giroux DJ, Goldstraw P, Im J-G, Tsuboi M, et al. The IASLC lung cancer staging project: proposals for the revision of the N descriptors in the forthcoming seventh edition of the TNM classification for lung cancer. J Thorac Oncol. 2007;2:603–12.

    Article  PubMed  Google Scholar 

  5. Crosbie PAJ, Shah R, Summers Y, Dive C, Blackhall F. Prognostic and predictive biomarkers in early stage NSCLC: CTCs and serum/plasma markers. Transl Lung Cancer Res. 2013;2:382–97.

    CAS  PubMed  PubMed Central  Google Scholar 

  6. Rusch VW, Asamura H, Watanabe H, Giroux DJ, Rami-Porta R, Goldstraw P, et al. The IASLC lung cancer staging project: a proposal for a new international lymph node map in the forthcoming seventh edition of the TNM classification for lung cancer. J Thorac Oncol. 2009;4:568–77.

    Article  PubMed  Google Scholar 

  7. Yanagisawa K, Tomida S, Shimada Y, Yatabe Y, Mitsudomi T, Takahashi T. A 25-signal proteomic signature and outcome for patients with resected non-small-cell lung cancer. J Natl Cancer Inst. 2007;99:858–67.

    Article  CAS  PubMed  Google Scholar 

  8. Lu Y, Lemon W, Liu P-Y, Yi Y, Morrison C, Yang P, et al. A gene expression signature predicts survival of patients with stage I non-small cell lung cancer. PLoS Med. 2006;3:e467.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Raz DJ, Ray MR, Kim JY, He B, Taron M, Skrzypski M, et al. A multigene assay is prognostic of survival in patients with early-stage lung adenocarcinoma. Clin Cancer Res. 2008;14:5565–70.

    Article  CAS  PubMed  Google Scholar 

  10. Roepman P, Jassem J, Smit EF, Muley T, Niklinski J, van de Velde T, et al. An immune response enriched 72-gene prognostic profile for early-stage non-small-cell lung cancer. Clin Cancer Res. 2009;15:284–90.

    Article  CAS  PubMed  Google Scholar 

  11. Beer DG, Kardia SLR, Huang C-C, Giordano TJ, Levin AM, Misek DE, et al. Gene-expression profiles predict survival of patients with lung adenocarcinoma. Nat Med. 2002;8:816–24.

    Article  CAS  PubMed  Google Scholar 

  12. Yu S-L, Chen H-Y, Chang G-C, Chen C-Y, Chen H-W, Singh S, et al. MicroRNA signature predicts survival and relapse in lung cancer. Cancer Cell. 2008;13:48–57.

    Article  CAS  PubMed  Google Scholar 

  13. Subramanian J, Simon R. Gene expression-based prognostic signatures in lung cancer: ready for clinical use? J Natl Cancer Inst. 2010;102:464–74.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  14. Kratz JR, He J, Van Den Eeden SK, Zhu Z-H, Gao W, Pham PT, et al. A practical molecular assay to predict survival in resected non-squamous, non-small-cell lung cancer: development and international validation studies. Lancet Lond Engl. 2012;379:823–32.

    Article  Google Scholar 

  15. Zhu Z-H, Sun B-Y, Ma Y, Shao J-Y, Long H, Zhang X, et al. Three immunomarker support vector machines-based prognostic classifiers for stage IB non-small-cell lung cancer. J Clin Oncol. 2009;27:1091–9.

    Article  PubMed  Google Scholar 

  16. Director’s Challenge Consortium for the Molecular Classification of Lung Adenocarcinoma, Shedden K, JMG T, Enkemann SA, Tsao M-S, Yeatman TJ, et al. Gene expression-based survival prediction in lung adenocarcinoma: a multi-site, blinded validation study. Nat Med. 2008;14:822–7.

    Article  Google Scholar 

  17. Boutros PC, Lau SK, Pintilie M, Liu N, Shepherd FA, Der SD, et al. Prognostic gene signatures for non-small-cell lung cancer. Proc Natl Acad Sci U S A. 2009;106:2824–8.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  18. Chen H-Y, Yu S-L, Chen C-H, Chang G-C, Chen C-Y, Yuan A, et al. A five-gene signature and clinical outcome in non-small-cell lung cancer. N Engl J Med. 2007;356:11–20.

    Article  CAS  PubMed  Google Scholar 

  19. Zhu C-Q, Ding K, Strumpf D, Weir BA, Meyerson M, Pennell N, et al. Prognostic and predictive gene signature for adjuvant chemotherapy in resected non-small-cell lung cancer. J Clin Oncol. 2010;28:4417–24.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  20. Oxnard GR, Binder A, Jänne PA. New targetable oncogenes in non-small-cell lung cancer. J Clin Oncol. 2013;31:1097–104.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  21. Stella GM, Luisetti M, Pozzi E, Comoglio PM. Oncogenes in non-small-cell lung cancer: emerging connections and novel therapeutic dynamics. Lancet Respir Med. 2013;1:251–61.

    Article  CAS  PubMed  Google Scholar 

  22. Berger AH, Brooks AN, Wu X, Shrestha Y, Chouinard C, Piccioni F, et al. High-throughput phenotyping of lung cancer somatic mutations. Cancer Cell. 2016;30:214–28.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  23. Zhang B, Zheng A, Hydbring P, Ambroise G, Ouchida AT, Goiny M, et al. PHGDH defines a metabolic subtype in lung adenocarcinomas with poor prognosis. Cell Rep. 2017;19:2289–303.

    Article  CAS  PubMed  Google Scholar 

  24. Kim J, Hu Z, Cai L, Li K, Choi E, Faubert B, et al. CPS1 maintains pyrimidine pools and DNA synthesis in KRAS/LKB1-mutant lung cancer cells. Nature. 2017;546:168–72.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  25. Herbst RS, Heymach JV, Lippman SM. Lung cancer. N Engl J Med. 2008;359:1367–80.

    Article  CAS  PubMed  Google Scholar 

  26. Pan X, Zhou T, Tai Y-H, Wang C, Zhao J, Cao Y, et al. Elevated expression of CUEDC2 protein confers endocrine resistance in breast cancer. Nat Med. 2011;17:708–14.

    Article  CAS  PubMed  Google Scholar 

  27. Gao Y-F, Li T, Chang Y, Wang Y-B, Zhang W-N, Li W-H, et al. Cdk1-phosphorylated CUEDC2 promotes spindle checkpoint inactivation and chromosomal instability. Nat Cell Biol. 2011;13:924–33.

    Article  CAS  PubMed  Google Scholar 

  28. Zhang P-J, Zhao J, Li H-Y, Man J-H, He K, Zhou T, et al. CUE domain containing 2 regulates degradation of progesterone receptor by ubiquitin-proteasome. EMBO J. 2007;26:1831–42.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  29. Chen Y, Wang S-X, Mu R, Luo X, Liu Z-S, Liang B, et al. Dysregulation of the miR-324-5p-CUEDC2 axis leads to macrophage dysfunction and is associated with colon cancer. Cell Rep. 2014;7:1982–93.

    Article  CAS  PubMed  Google Scholar 

  30. Gustavson MD, Rimm DL, Dolled-Filhart M. Tissue microarrays: leaping the gap between research and clinical adoption. Pers Med. 2013;10:441–51.

    Article  CAS  Google Scholar 

  31. Zlobec I, Koelzer VH, Dawson H, Perren A, Lugli A. Next-generation tissue microarray (ngTMA) increases the quality of biomarker studies: an example using CD3, CD8, and CD45RO in the tumor microenvironment of six different solid tumor types. J Transl Med. 2013;11:104.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  32. McCarty KS, Miller LS, Cox EB, Konrath J, McCarty KS. Estrogen receptor analyses. Correlation of biochemical and immunohistochemical methods using monoclonal antireceptor antibodies. Arch. Pathol. Lab. Med. 1985;109:716–21.

    Google Scholar 

  33. Breiman L. Random Forests. Mach Learn. 2001;45:5–32.

    Article  Google Scholar 

  34. Diaz-Uriarte R. GeneSrF and varSelRF: a web-based tool and R package for gene selection and classification using random forest. BMC Bioinformatics. 2007;8:328.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Liaw A, Wiener M. Classification and regression by RandomForest. R News. 2001;2(3):18–22.

  36. Chang C-C, Lin C-J. LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol. 2011;2(27):1–27.

    Article  Google Scholar 

  37. Pisters KMW, Evans WK, Azzoli CG, Kris MG, Smith CA, Desch CE, et al. Cancer Care Ontario and American Society of Clinical Oncology adjuvant chemotherapy and adjuvant radiation therapy for stages I-IIIA resectable non small-cell lung cancer guideline. J Clin Oncol. 2007;25:5506–18.

    Article  PubMed  Google Scholar 

  38. Dediu M. Adjuvant chemotherapy in stage IB NSCLC: implication of the new TNM staging system. Memo - mag. Eur. Med. Oncologia. 2011;4:16–8.

    Google Scholar 

  39. Morgensztern D, Du L, Waqar SN, Patel A, Samson P, Devarakonda S, et al. Adjuvant chemotherapy for patients with T2N0M0 NSCLC. J Thorac Oncol. 2016;11:1729–35.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Pignon J-P, Tribodet H, Scagliotti GV, Douillard J-Y, Shepherd FA, Stephens RJ, et al. Lung adjuvant cisplatin evaluation: a pooled analysis by the LACE collaborative group. J Clin Oncol. 2008;26:3552–9.

    Article  PubMed  Google Scholar 

  41. Díaz-Uriarte R, Alvarez de Andrés S. Gene selection and classification of microarray data using random forest. BMC Bioinformatics. 2006;7:3.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Jacquemier J, Ginestier C, Rougemont J, Bardou V-J, Charafe-Jauffret E, Geneix J, et al. Protein expression profiling identifies subclasses of breast cancer and predicts prognosis. Cancer Res. 2005;65:767–79.

    CAS  PubMed  Google Scholar 

  43. Zhu C-Q, Shih W, Ling C-H, Tsao M-S. Immunohistochemical markers of prognosis in non-small cell lung cancer: a review and proposal for a multiphase approach to marker evaluation. J Clin Pathol. 2006;59:790–800.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  44. Krämer A, Mailand N, Lukas C, Syljuåsen RG, Wilkinson CJ, Nigg EA, et al. Centrosome-associated Chk1 prevents premature activation of cyclin-B-Cdk1 kinase. Nat Cell Biol. 2004;6:884–91.

    Article  PubMed  Google Scholar 

  45. Liao Y-J, Bai H-Y, Li Z-H, Zou J, Chen J-W, Zheng F, et al. Longikaurin a, a natural ent-kaurane, induces G2/M phase arrest via downregulation of Skp2 and apoptosis induction through ROS/JNK/c-Jun pathway in hepatocellular carcinoma cells. Cell Death Dis. 2014;5:e1137.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  46. Wang Y, Shenouda S, Baranwal S, Rathinam R, Jain P, Bao L, et al. Integrin subunits alpha5 and alpha6 regulate cell cycle by modulating the chk1 and Rb/E2F pathways to affect breast cancer metastasis. Mol Cancer. 2011;10:84.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgments

We thank all the patients and their families for their participation. We thank Dr. XM Zhang, Dr. ZG Liu for discussion and critical reading of the manuscript, and thank Dr. XW Bian for providing tissue samples and clinical information of patients.

Funding

This work was supported by grants from China National High Technology Research and Development Program (2014AA020612 and 2014AA020602), National Key Technology R&D Program of China (2015BAK45B01), China National Basic Research Program (2013CB910802), China National Natural Science Foundation (81521064 and 81025010) and Frontier technology of Beijing Municipal Science and Technology Commission (Z141100000214003) and National Science and Technology Major Project (No. 2016ZX08011007). The funding organizations had no role in the design and conduct of the study, collection, management, analysis, and interpretation of the data; or preparation or review of the final manuscript.

Availability of data and materials

The dataset generated and analyzed during the current study are available in the CRD repository (http://202.38.152.246:81/crd2/frontend/www/, username: nsclc, password: nsclcnsclc).

Author information

Authors and Affiliations

Authors

Contributions

Conception and design: BF J, F Y, XM Y, J W, T Z. Financial support: BF J, F Y, XM Y, J W, T Z. Administrative support: J W, T Z. Provision of study materials or patient information: F Y, J W, L C. Collection and assembly of data: L G, Q Z, J C, YH T, YD L, X L, KZ C, Y C, T L, XY Z, XH Q, J W, S C, SS G, YC Z, DH S, KK S, BF J. Data analysis and interpretation: XM Y, SF H, WH L, AL L, Q X, F Y, BF J, T Z. Manuscript writing: BF J, XM Y, F Y, T Z. All authors read and approved the final manuscript.

Corresponding authors

Correspondence to Jun Wang or Tao Zhou.

Ethics declarations

Ethics approval and consent to participate

The Ethics Committee of People’s Hospital of Peking University in Beijing (BJ, Reference No: 2013–55) and Southwest Hospital of Chongqing (CQ, Reference No: 2,013,041) approved the study. Written informed consent was obtained from all the included patients.

Consent for publication

Written informed consent was obtained from all the included patients.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional file

Additional file 1:

Supplementary Figures, Tables and Methods. (PDF 4956 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jin, BF., Yang, F., Ying, XM. et al. Signaling protein signature predicts clinical outcome of non-small-cell lung cancer. BMC Cancer 18, 259 (2018). https://0-doi-org.brum.beds.ac.uk/10.1186/s12885-018-4104-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12885-018-4104-4

Keywords