Skip to main content

Peripheral blood lymphocyte/monocyte ratio at the time of first relapse predicts outcome for patients with relapsed or primary refractory diffuse large B-cell lymphoma

Abstract

Background

Despite the use of modern immunochemotherapy regimens, a significant proportion of diffuse large B-cell lymphoma (DLBCL) patients will relapse. We proposed absolute lymphocyte count/absolute monocyte count ratio (ALC/AMC ratio) as a new prognostic factor in relapsed or primary refractory DLBCL.

Methods

We retrospectively analyzed 163 patients who have been diagnosed with relapsed or primary refractory DLBCL. The overall survival (OS) and progression-free survival (PFS) were measured from the time of first relapse. The Cox proportional hazards model was used to evaluate ALC/AMC ratio as prognostic factors for OS and PFS.

Results

On univariate and multivariate analysis performed with factors included in the saaIPI, early relapse, prior exposure to rituximab and autologous stem-cell transplantation (ASCT), the ALC/AMC ratio at the time of first relapse remained an independent predictor of PFS and OS (PFS: P < 0.001; OS: P < 0.001). Patients with lower ALC/AMC ratio (<2.0) had lower overall response rate, 1-year PFS and 2-year OS rate compared with those with higher ALC/AMC ratio (≥2.0). Moreover, the ALC/AMC ratio can provide additional prognostic information when superimposed on the saaIPI.

Conclusions

Lower ALC/AMC ratio at the time of first relapse is a adverse prognostic factor for OS and PFS in relapsed or primary refractory DLBCL, and leads to the identification of high-risk patients otherwise classified as low/intermediate risk by the saaIPI alone.

Peer Review reports

Background

Diffuse large B-cell lymphoma (DLBCL) is the most common, accounts for 25%-30% of all newly diagnosed cases of adult Non-Hodgkin lymphoma (NHL). It is an aggressive lymphoma, but is potentially curable [1]. Despite the improvements in overall survival of patients with DLBCL with the routine addition of rituximab therapy; approximately one-third of the patients will develop relapsed/refractory disease that remains a major cause of morbidity and mortality [2]. Salvage chemotherapy followed by high-dose therapy and autologous stem-cell transplantation (ASCT) is the standard treatment for chemosensitive relapsed DLBCL [3]. Various parameters that greatly affect the results of salvage treatment in patients who have experienced relapse have been reported. From the Collaborative Trial in Relapsed Aggressive Lymphoma (CORAL) study, early relapse less than 12 months after diagnosis, the International Prognostic Index at relapse (saaIPI) and prior exposure to rituximab were detected as the parameters that affected 3-year event-free survival (EFS), progression-free survival (PFS), and overall survival (OS) [4].

Lymphocytes have an important role in immune surveillance in NHL, a view supported by the observation that lymphopenia is an adverse prognostic factor in NHL of various subtypes, including DLBCL [57]. Monocytes, which are considered immunologically relevant and are regarded as a surrogate marker of the tumor microenvironment, were also recently reported to be a prognostic factor in DLBCL [811], follicular lymphoma (FL) [12, 13], T-cell lymphoma [14], extranodal natural killer/T-cell lymphoma (ENKL) [15] and Hodgkin’s Lymphoma (HL) [16, 17]. Absolute lymphocyte count/absolute monocyte count ratio (ALC/AMC ratio) at diagnosis, as a simple biomarker combining an estimate of host immune homeostasis and tumor microenvironment, was recently shown to be an independent prognostic indicator in HL [16, 17] and DLBCL [10, 11]. However, to our best knowledge, there is no data available on whether the ALC/AMC ratio at the time of first relapse predicts outcome in patients with relapsed/primary refractory DLBCL. We, therefore, assessed the prognostic significance of ALC/AMC ratio at the time of first relapse.

Methods

Ethics statement

This study was approved by the Institutional Review Board (IRB) of the first affiliated and the second affiliated hospital of Anhui medical university. Study was performed in accord with the principles of the Declaration of Helsinki. All patients agreed to use their medical records for research.

Patients

Consecutive 253 patients with DLBCL who had the full information, were evaluated and treated with CHOP (cyclophosphamide, hydroxydaunorubicin, vincristine, prednisone) or R-CHOP (rituximab-cyclophosphamIde, hydroxydaunorubicin, vincristine, prednisone) every 3 weeks for 3 to 8 cycles as first-line therapy and followed up between the years 2001 and 2011 at the first affiliated hospital and the second hospital of Anhui medical university, and 163 patients of them who had been diagnosed with relapsed/primary refractory. The patients who achieved CR/uCR/PR after second-line salvage chemotherapy entered the follow-up or ASCT, and the patients with no response after second-line salvage chemotherapy entered the clinical trial or supportive care. Second-line salvage chemotherapy regimens were: DHAP/R-DHAP (dexamethasone, cytarabine, and cisplatin/rituximab, dexamethasone, cytarabine, and cisplatin); DICE/R-DICE (dexamethasone, ifosfamide, cisplatin, and etoposide/rituximab, dexamethasone, ifosfamide, cisplatin, and etoposide); ICE/R-ICE (ifosfamide, carboplatin, and etoposide/rituximab, ifosfamide, carboplatin, and etoposide); GDP/R-GDP (gemcitabine, cisplatin, and dexamethasone/rituximab, gemcitabine, cisplatin, and dexamethasone). HIV-positive patients were excluded from this study.

Study objective

The absolute lymphocyte count (ALC) and monocyte count (AMC) at the time of first relapse which were obtained from routine automated complete blood count (CBC); The absolute monocyte count/absolute lymphocyte count ratio (ALC/AMC ratio) was calculated by dividing the ALC by the AMC. Response criteria were based on the criteria from the International Harmonization Project [18], and evaluated after the third salvage chemotherapy course. Complete remission (CR) was defined by the disappearance of all documented disease; unconfirmed CR (CRu) was used when a residual mass was present without evidence of active disease. Partial response (PR) was defined as a 50% reduction of measurable disease. The primary endpoints were OS and PFS, defined as the time from the time of first relapse until last follow-up or death, and as the time from the time of first relapse to disease progression, relapse, or death of any cause or the last date of follow-up, respectively. Patient and disease characteristics included in the second-line IPI (sIPI) at the time of relapse or primary refractory disease [age < 60 vs. ≥ 60 years, Ann Arbor stage (III/IV vs. I/II), Karnofsky performance status (KPS) (<80% vs. ≥ 80%), lactate dehydrogenase (LDH) (normal vs. > normal) and number of extra nodal sites (ENS) involved (≤ vs. > 1)] were utilized.

Statistical analysis

The correlation between the ALC, AMC, ALC/AMC ratio and clinical parameters was assessed by the chi-square test or Fisher’s exact test. PFS and OS were estimated using the Kaplan-Meier method and two-tailed log-rank test. Receiver operating characteristics analysis was also performed to determine the optimal cut-point for the ALC, AMC and ALC/AMC ratio. The Cox proportional hazards model was used to evaluate the ALC, AMC and ALC/AMC ratio as prognostic factors for PFS and OS and to adjust for other known prognostic variables included in the sIPI. P-values were not adjusted for multiple comparisons, All two-sided P-values < 0.05 were determined to be statistically significant. Statistical analysis was carried out using SPSS 16.0 software.

Results

Patient characteristics

We retrospectively analyzed data from a total of 253 DLBCL patients in this study, median follow-up following diagnosis was 36 months for the entire cohort (range: 3 month to 118 months) and the estimated 5 year OS for the entire cohort was 56%. Among 163 patients with evidence of first relapse, 42% had relapsed disease and 58% had primary refractory disease. The distribution of baseline characteristics for 163 relapsed/primary refractory patients based on an ALC/AMC ratio ≥ 2.0 versus ALC/AMC ratio < 2.0 at the time of first relapse is presented in Table 1. Eleven, Forty-four, sixty-four and forty-four patients treated with DHAP/R-DHAP, DICE/R-DICE, ICE/R-ICE, and GDP/R-GDP regimens, respectively, there was no significant difference in characteristic based on ALC/AMC ratio at the time of first relapse among the different second-line salvage chemotherapy (Table 1).

Table 1 Baseline characteristics based on relapsed/primary refractory DLBCL patients with an ALC/AMC ratio ≥ 2.0 versus ALC/AMC ratio < 2.0

The ALC and AMC at the time of first relapse were derived from CBC counts. The cutoff points of ALC, AMC and ALC/AMC ratio for survival outcomes were selected by the receiver operating characteristic (ROC) curve analysis. The most discriminative cutoff value of ALC, AMC and ALC/AMC ratio was 1120/ul (area under the curve [AUC]: 0.648, 95% confidence interval: 0.563-0.733, P = 0.001), 530/ul (AUC: 0.734, 95% confidence interval: 0.658-0.811, P < 0.001) and 2.0 (AUC: 0.808, 95% confidence interval: 0.741-0.875, P < 0.001), respectively. In addition, The ALC and AMC at diagnosis were derived from pre-treatment CBC counts, and the cutoff points of ALC (1430/ul), AMC (460/ul) and ALC/AMC ratio (3.8) for survival outcomes were also selected by ROC curve analysis [11].

Lower ALC/AMC ratio at the time of first relapse is a adverse prognostic factor for overall survival and progression free survival of relapsed/primary refractory DLBCL patients after second-line therapy

When the components of the sIPI (age ≥ 60 years; KPS < 80%; LDH > normal; Extranodal sites > 1; Ann Arbor stage III/IV) were assessed in univariate analysis by log rank, age was not predictive of PFS and OS (PFS: P = 0.531; OS: P = 0.693), whereas Extranodal sites (PFS: P = 0.054; OS: P = 0.029), KPS (P < 0.001 for both), LDH (P < 0.001 for both), and Ann Arbor stage (P < 0.001 for both) predicted PFS or OS. When entered into a Cox regression model for multivariate analysis, three factors, KPS, LDH, and Ann Arbor stage remain predictive (Additional file 1: Table S3 and Additional file 2: Table S4). These significant components were identical to those in the saaIPI, which was subsequently used to stratify patients into risk groups.

To determine the prognostic significance of the ALC, AMC and ALC/AMC ratio at the time of first relapse for OS and PFS of relapsed/primary refractory DLBCL patients, on univariate analysis, a relative reduction of ALC (<1120/ul), elevated AMC (≥530/ul) and lower ALC/AMC ratio (<2.0) associated with inferior OS (hazard ratio: 3.060, 95% confidence Interval: 1.878-4.988, P < 0.001; hazard ratio: 3.346, 95% confidence Interval: 2.178-5.141, P < 0.001; hazard ratio: 9.482, 95% confidence Interval: 5.497-16.355, P < 0.001; respectively). For comparison, ALC, AMC, ALC/AMC ratio at diagnosis, each of the three factors that comprise the saaIPI, early relapse (time from diagnosis to relapse of less than 12 months), prior rituximab treatment and ASCT or not was included in the analysis. Of these, ALC (<1430/ul), AMC (≥460/ul), ALC/AMC ratio (<3.8) and LDH (>normal) at diagnosis, LDH (>normal) at the time of first relapse, KPS (<80%), Ann Arbor stage (stage III/IV), time to relapse after diagnosis, months < 12 and ASCT or not were also of prognostic significance on univariate analysis (Table 2).

Table 2 Univariate and multivariate analyses for overall survival

Then we included components of the saaIPI in a multivariate analysis with the ALC, AMC, ALC/AMC ratio at diagnosis and at the time of first relapse, time to relapse after diagnosis, months < 12 and ASCT or not. As summarized in Table 2, the ALC/AMC ratio at the time of first relapse, early relapse (time to relapse after diagnosis, months < 12) and ASCT or not were independently significant prognostic factors for OS, with hazard ratios of 8.758 (95% confidence Interval: 3.917-19.581, P < 0.001), 3.527 (95% confidence Interval: 1.597-7.787, P = 0.002) and 3.877 (95% confidence Interval: 1.310-11.476, P = 0.014), respectively (Table 2). Similarly, the ALC/AMC ratio at the time of first relapse, early relapse (time to relapse after diagnosis, months < 12) and ASCT or not were independently significant predictors of PFS when adjusted for components of the saaIPI on multivariate analysis (Additional file 3: Table S5).

Response and survival rate according to prognostic factors

After platinum-based second-line salvage chemotherapy, the overall response rate, including CR, CRu and PR, was 49%. The factors significantly affecting the overall response rate included early relapse (time to relapse after diagnosis, months < 12), saaIPI of 2 to 3, prior rituximab treatment, ALC/AMC ratio and LDH at the time of first relapse (P < 0.001) (Table 3). After a median follow-up time of 13 months, the 1-year PFS rate was 37% and was significantly different between the ALC/AMC ratio < 2.0 and ALC/AMC ratio ≥ 2.0 (12% and 58%, respectively; P < 0.001). 2-year OS was 26%, with significant difference between the ALC/AMC ratio < 2.0 and ALC/AMC ratio ≥ 2.0 (4% and 43%, respectively; P < 0.001). 1-year PFS and 2-year OS were also affected by early relapse (time to relapse after diagnosis, months < 12), saaIPI, rituximab-containing salvage therapy, the ALC, AMC and LDH at the time of first relapse (Table 3).

Table 3 Response rate and survival according to prognostic factors

The ALC/AMC ratio at the time of first relapse and second-line therapy

The ALC/AMC ratio at the time of first relapse was analyzed to determine whether it could further discriminate for survival when considering second-line therapy with either ASCT or further chemotherapy. In the 18 first relapsed DLBCL treated with ASCT, the median OS and PFS were significantly longer for patients with an ALC/AMC ratio ≥ 2.0 when compared with those patients with an ALC/AMC ratio < 2.0 (median OS: 34 months, 2 years OS rates of 92% versus median OS: 19 months, 2 years OS rates of 17%, P = 0.001; and median PFS: 27 months,1 years PFS rates of 92% versus median PFS: 15 months, 1 years PFS rates of 83%, P = 0.596, respectively). In the 145 first relapsed DLBCL patients that were treated with further chemotherapy, the median OS and PFS were also significantly longer for patients with an ALC/AMC ratio ≥ 2.0 when compared with those patients with an ALC/AMC ratio < 2.0 (median OS: 18 months, 2 years OS rates of 36% versus median OS: 8 months, 2 years OS rates of 3%, P < 0.001; and median PFS: 12 months, 1 years PFS rates of 53% versus median PFS: 5 months, 1 years PFS rates of 6%, P < 0.001, respectively).

The ALC/AMC ratio at the time of first relapse identifies high-risk patients and provides additional prognostic information when superimposed on the saaIPI

PFS and OS were analyzed using the saaIPI in Figure 1A and B. The ALC/AMC ratio at the time of first relapse remains an independently significant prognostic factor when adjusting for the saaIPI. Therefore, we sought to determine whether it may provide additional prognostic information when combined with the saaIPI. The 47 low-risk, 100 intermediate-risk (high-intermediate and low-intermediate were combined) and 16 high-risk patients identified by the saaIPI were subsequently risk stratified using the ALC/AMC ratio. We showed that patients with a low-risk category of saaIPI score (saaIPI = 0) and low-intermediate/high-intermediate (saaIPI = 1–2), the ALC/AMC ratio was a useful way to distinguish those with favorable outcomes from those with adverseand outcomes (OS: P = 0.003, PFS: P = 0.013, Figure 2A and B; OS: P < 0.001, PFS: P < 0.001, Figure 2C and D; respectively), in conclusion, the ALC/AMC ratio was able to further risk-stratify these patients. But in patients with high-risk (saaIPI = 3), the number of the patients were only sixteen, so as likely not to make a similar analysis in this subgroup meaningful (OS: P = 0.102, PFS: P = 0.094, Figure 2E and F). In addition, we analysed 94 primary refractory and 69 relapsed DLBCL patients to seek to determine whether it may provide additional prognostic information when combined with the saaIPI, respectively. We showed that in primary refractory and relapsed patients with a low-intermediate/high-intermediate (saaIPI = 1–2), respectively, the ALC/AMC ratio was a useful way to distinguish those with favorable outcomes from those with adverse outcomes (OS: P < 0.001, PFS: P < 0.001, Additional file 4: Figure S1C and D; OS: P < 0.001, PFS: P < 0.001, Additional file 5: Figure S2C and D; respectively).

Figure 1
figure 1

Kaplan-Meier estimates of overall survival (A) and progression-free survival (B) for the 163 relapsed/primary refractory DLBCL patients stratified by second-line age-adjusted International Prognostic Index (saaIPI) are shown.

Figure 2
figure 2

Kaplan-Meier estimates of overall survival (A, C, E) and progression- free survival (B, D, F) for the 163 relapsed/primary refractory DLBCL patients stratified by the saaIPI as either low- (A, B), low-intermediate/high-intermediate (C, D) or high risk (E, F) were further stratified into low or high groups by the ALC/AMC ratio.

Among the all patients, 8% of patients identified by the saaIPI as ‘low -risk’, upon further risk stratification by the ALC/AMC ratio (<2.0) at the time of first relapse, found to have dismal outcomes, with a median OS of 18 months, a median PFS of 10 months; Moreover, 29% of identified as ‘intermediate -risk’ patients were with a median OS of 8 months, a median PFS of 6 months. Similar results were obtained when intermediate risk patients treated with rituximab-containing salvage therapy were risk-stratified by the ALC/AMC ratio in Figure 3. In this case, 26% of identified as ‘intermediate risk’ patients were with a median OS of 15 months, a median PFS of 12 months.

Figure 3
figure 3

Kaplan-Meier estimates of overall survival (A) and progression-free survival (B) for 43 relapsed/primary refractory DLBCL patients treated with rituximab-salvage therapy identified by the saaIPI as intermediate risk (saaIPI =1-2) were further stratified into low or high groups by the ALC/AMC ratio.

Discussion

The International Prognostic Index (IPI), solely considering patient and tumor characteristics, is currently the standard prognostic tool used to predict clinical outcomes for patients with DLBCL. But recent work, based on gene expression profiling studies in NHL, shows that gene expression by tumor-infiltrating lymphocytes and myeloid-derived cells predict a clinical outcome [19], which implies that a prognostic system that considers features of the tumor- bearing host and the tumor microenvironment may provide prognostic information. The ALC/AMC ratio at diagnosis, as a simple biomarker combining an estimate of host immune homeostasis and tumor microenvironment, was recently shown to be an independent prognostic indicator in HL [16, 17] and DLBCL [10], and combining the dichotomized ALC and AMC to generate the ALC/AMC prognostic score was also provided prognostic information independently of that included in the IPI [8, 9]. Therefore, we first sought to examine the both in our 253 DLBCL patients from the two hospital institution. In our study [11], the results were consistent with the previous findings from Wilcox RA et al., Batty N et al. and Rambaldi A et al. [810].

The international Prognostic Index at relapse (saaIPI), early relapse less than 12 months after diagnosis and prior exposure to rituximab have been demonstrated to be predictors of clinical outcomes in first relapsed DLBCL patients [4, 20]. Biologically, a few parameters at relapse have been reported to be predictive of survival independent of IPI score, including ALC at the time of first relapse [21]. No reports have addressed whether ALC/AMC ratio at the time of first relapse predicts survival in NHL. Thus, we assessed the prognostic significance of ALC/AMC ratio at the time of first relapse in relapsed/primary refractory DLBCL. The present study showed that ALC/AMC ratio at the time of first relapse was a adverse independent prognostic factor for OS and PFS and can identify the high-risk patients otherwise classified as low/intermediate risk by the saaIPI alone. We also found that ALC/AMC ratio at the time of first relapse and several independent factors significantly affected response rates after salvage therapy, including saaIPI score, early relapse less than 12 months after diagnosis, and prior rituximab treatment, which is in agreement with those provided by Gisselbrecht C et al. [4]. ALC/AMC ratio at the time of first relapse, early relapse less than 12 months after diagnosis and saaIPI score, the same independent factors were found for 1-year PFS and 2-year OS rate. But there were no difference between the prior rituximab treatment or not; the fact that most patients in our study who progressed after R-CHOP have late relapse may explain this discrepancy. In accordance with previous reports [22, 23], in our study, those who received rituximab-containing salvage therapy at relapse achieved significantly longer survival (both PFS and OS) and had a significant improvement in the 1-year PFS and 2-year OS rates than those who underwent salvage therapy with chemotherapy alone regardless of the first-line treatment with CHOP or R-CHOP, and ASCT or not. In addition, among patients who received first-line treatment with CHOP, those who received rituximab-containing salvage therapy at relapse achieved significantly improvement in 2-year OS rate than those who underwent salvage therapy with chemotherapy alone.

lymphopenia is considered a surrogate marker of host immunological incompetence, in addition, lymphocytes (including natural killer [NK] cells) are important mediators of antibody-dependent cell-mediated cytotoxicity, and may be required for rituximab-mediated, antibody-dependent cellmediated cytotoxicity-dependent destruction of malignant B cells [24]. Not surprisingly then, lymphopenia is an adverse prognostic factor in indolent and aggressive NHL, including DLBCL. Recently, Dehghani M et al. [25] and Gergely L et al. [26] reported that lower CD4+ lymphocyte, CD3+ and CD8+ lymphocytes were corresponding with significantly inferior overall survival in B-cell NHL, respectively. Głowala-Kosińska M et al. [27] showed that lower number of circulating regulatory T cells (Tregs) was associated with reduced chance of achieving CR and reduced probability of even-free survival (EFS) in newly diagnosed DLBCL, and Shafer D et al. [28] showed that low NK cell counts in peripheral blood were associated with inferior overall survival in patients with FL. However, in the tumor microenvironment, elevated infiltration of FOXP3+ Tregs was correlated with a favorable clinical outcome in different types of lymphoma reported, including DLBCL [2933], and Hasselblom S et al. reported that DLBCL patients with a small number of cytotoxic T-cell intracytoplasmic antigen-1 (TIA-1) + T cellshad significantly better outcome [34].

Myeloid-lineage cells, including monocytes and their progeny, promote tumorigenesis and angiogenesis [35], and contribute to the suppression of host antitumor immunity so that not surprisingly then, development of peripheral blood neutrophilia or monocytosis are adverse prognostic factors in multiple solid tumors [3638]. A new nomenclature defines human monocyte subsets into three, classical (CD14++CD16-), intermediate (CD14++CD16+) and nonclassical (CD14 + CD16++) [39]. CD16+ monocytes recently have shown diagnostic and prognostic potential in malignant disease [4042]. but to date, as far as we know, are not investigated in lymphoma. Monocytes that circulate in the bloodstream are recruited to inflamed tissues and give rise to macrophages. Macrophages, which termed tumour-associated macrophages (TAMs), play an important role in tumor tissues. TAMs can be classified into two functionally distinct types, M1 and M2, which reported to determine the effects against tumors, i.e. promotional (M2) or suppressive (M1) [43]. Hasselblom S et al. [44] reported that the number of TAMs in DLBCL tissues was not correlated with the prognosis, but the recent study of the Osaka Lymphoma Study Group [45] showed that a high number of M2 TAMs, but not of total TAMs, was an independent factor for a significantly poor prognosis in DLBCL patients.

The pattern of human monocytes recruitment in vivo to tumors is not very clear, although Qian et al. [46] recently showed that human CD14 + CD16- inflammatory monocytes recruited by a CCL2 mechanism and differentiate into macrophages that promote the subsequent growth of metastatic cells in vivo. In addition, Nakasone ES et al. [47] reported that infiltration of CCR2- expressing myeloid cells into chemotherapy-treated tumors contributes to tumor regrowth and relapse after treatment; recently, Sanford DE et al. [48] found that inflammatory monocyte (CD14+/CCR2+) recruitment is critical to pancreatic cancer progression, and targeting CCR2 may be an effective immunotherapeutic strategy in this disease. As previously mentioned, We hypothesized that several important questions could remain: How do the subsets of blood monocyte exist in DLBCL patients at the time of first relapse? Do the monocyte subsets vary when compared with the time of diagnosis? Which blood monocyte subsets preferentially recruit to metastatic sites, and involve in tumor microenvironment? Are there novel specific therapeutic strategies to inhibit the monocyte recruitment, which may promote the metastasis and resistance to chemotherapy, so that can increase the response rate of second-line salvage regimens, prolong the overall survival? Thus, more further studies are deserved. In a word, the novel therapy of relapsed DLBCL resulting from better understanding of patient, tumor characteristics, host immunity and tumor microenvironment may be needed.

Our study has some limitations. First, although there was no significant difference in characteristic based on ALC/AMC ratio at the time of first relapse and response rate among different second-line salvage chemotherapy in our study, and no clear superiority of one salvage regimen over another has been demonstrated all over the world, this may lower the quality of the data. Thus, further studies exploring the prognostic significance of ALC/AMC ratio at the time of first relapse in relapsed/primary refractory DLBCL patients with uniform salvage regimens are warranted. Second, on the one hand, as a retrospective study, patients were not randomly assigned to ASCT versus other selvage therapies, which meant that the choice of ASCT or not might have been biased by the treating physician’s preference based on patient’s characteristics. Thus, even though ASCT was found to be a prognostic factor for survival in our study, it is important to reemphasize the potential bias in patient selectivity undergoing ASCT; on the other hand, the number of patients who received ASCT was small in our study, so this should require validation in a larger cohort in the future. However, our study reported a significantly superior OS and PFS in patients who underwent ASCT compared with who received further chemotherapy, which was in agreement with the result of the 1995 PARMA trial [49]. The patients with higher ALC/AMC ratio experienced better OS and PFS regardless of their treatment (ASCT or not), and the ALC/AMC ratio at the time of first relapse was able to discriminate for survival in both groups (ASCT and further chemotherapy).

Conclusions

In conclusion, our study identifies prognostic utility for ALC/AMC ratio at the time of first relapse as a simple tool in relapsed/primary refractory DLBCL patients. Given the limited number of patients included in this retrospective study, the prognostic value will require validation in an independent cohort of patients in prospective trials, especially in chemosensitive relapsed DLBCL followed by high-dose therapy and stem cell transplantation. To our our knowledge, this study is the first to identify ALC/AMC ratio the prognostic significance independent of the saaIPI to predict response rate and survival outcome in relapsed/refractory DLBCL patients and add to its ability to identify high-risk patients. As new immuno-based therapies are developed to treat relapsed NHL, the role of the host immune homeostasis and tumor microenvironment, such as targeting monocyte mobilization, is becoming more important in these treatment modalities.

References

  1. Habermann TM: New developments in the management of diffuse large B-cell lymphoma. Hematology. 2012, S93-S97. 17

  2. Friedberg JW: Relapsed/Refractory Diffuse Large B-Cell Lymphoma. Hematology Am Soc Hematol Educ Program. 2011, 2011: 498-505. 10.1182/asheducation-2011.1.498.

    PubMed  Google Scholar 

  3. Applebaum FR: Hematologic cell transplantation for non-Hodgkin lymphoma: yesterday, today, and tomorrow. J Clin Oncol. 2008, 26: 2927-2929. 10.1200/JCO.2007.15.7479.

    Article  Google Scholar 

  4. Gisselbrecht C, Glass B, Mounier N, Singh Gill D, Linch DC, Trneny M, Bosly A, Ketterer N, Shpilberg O, Hagberg H, Ma D, Brière J, Moskowitz CH, Schmitz N: Salvage regimens with autologous transplantation for relapsed large B-cell lymphoma in the rituximab era. J Clin Oncol. 2010, 28: 4184-4190. 10.1200/JCO.2010.28.1618.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Kim DH, Baek JH, Chae YS, Kim YK, Kim HJ, Park YH, Song HS, Chung JS, Hyun MS, Sohn SK: Absolute lymphocyte counts predicts response to chemotherapy and survival in diffuse large B-cell lymphoma. Leukemia. 2007, 21: 2227-2230. 10.1038/sj.leu.2404780.

    Article  CAS  PubMed  Google Scholar 

  6. Cox MC, Nofroni I, Laverde G, Ferrari A, Amodeo R, Tatarelli C, Saltarelli F, Veggia B, Aloe-Spiriti MA, Ruco L, Monarca B: Absolute lymphocyte count is a prognostic factor in diffuse large B-cell lymphoma. Br J Haematol. 2008, 141: 265-268. 10.1111/j.1365-2141.2008.07028.x.

    Article  PubMed  Google Scholar 

  7. Oki Y, Yamamoto K, Kato H, Kuwatsuka Y, Taji H, Kagami Y, Morishima Y: Low absolute lymphocyte count is a poor prognostic marker in patients with diffuse large B-cell lymphoma and suggests patients’survival benefit from rituximab. Eur J Haematol. 2008, 81: 448-453. 10.1111/j.1600-0609.2008.01129.x.

    Article  PubMed  Google Scholar 

  8. Wilcox RA, Ristow K, Habermann TM, Inwards DJ, Micallef IN, Johnston PB, Colgan JP, Nowakowski GS, Ansell SM, Witzig TE, Markovic SN, Porrata L: The absolute monocyte and lymphocyte prognostic score predicts survival and identifies high-risk patients in diffuse large-B-cell lymphoma. Leukemia. 2011, 25: 1502-1509. 10.1038/leu.2011.112.

    Article  CAS  PubMed  Google Scholar 

  9. Batty N, Ghonimi E, Feng L, Fayad L, Younes A, Rodriguez MA, JE R- u, McLaughlin P, Samaniego F, Kwak LW, Hagemeister FB: The absolute monocyte and lymphocyte prognostic index for patients with diffuse large B-cell lymphoma who receive R-CHOP. Clin Lymphoma Myeloma Leuk. 2013, 13: 15-18. 10.1016/j.clml.2012.09.009.

    Article  PubMed  Google Scholar 

  10. Rambaldi A, Boschini C, Gritti G, Delaini F, Oldani E, Rossi A, Barbui AM, Caracciolo D, Ladetto M, Gueli A, De Crescenzo A, Passera R, Devizzi L, Patti C, Gianni AM, Tarella C: The lymphocyte to monocyte ratio improves the IPI-risk definition of diffuse large B-cell lymphoma when rituximab is added to chemotherapy. Am J Hematol. 2013, 88: 1062-1067. 10.1002/ajh.23566.

    Article  CAS  PubMed  Google Scholar 

  11. Li YL, Pan YY, Jiao Y, Ning J, Fan YG, Zhai ZM: Peripheral blood lymphocyte/monocyte ratio predicts outcome for patients with diffuse large B cell lymphoma after standard first-line regimens. Ann Hematol. 2014, 93: 617-626. 10.1007/s00277-013-1916-9.

    Article  CAS  PubMed  Google Scholar 

  12. Wilcox RA, Ristow K, Habermann TM, Inwards DJ, Micallef IN, Johnston PB, Colgan JP, Nowakowski GS, Ansell SM, Witzig TE, Markovic SN, Porrata L: The absolute monocyte count is associated with overall survival in patients newly diagnosed with follicular lymphoma. Leuk Lymphoma. 2012, 53: 575-580. 10.3109/10428194.2011.637211.

    Article  PubMed  Google Scholar 

  13. Watanabe R, Tomita N, Kishimoto K, Koyama S, Ogusa E, Ishii Y, Miyashita K, Matsuura S, Fujisawa S, Hattori Y, Takasaki H, Fujita A, Ohshima R, Kuwabara H, Hashimoto C, Fujimaki K, Sakai R, Ishigatsubo Y: Absolute monocyte count in follicular lymphoma patients treated with rituximab plus cyclophosphamide, doxorubicin, vincristine, and prednisone. Leuk Res. 2013, 37: 1208-1212. 10.1016/j.leukres.2013.07.015.

    Article  CAS  PubMed  Google Scholar 

  14. Bari A1, Tadmor T, Sacchi S, Marcheselli L, Liardo EV, Pozzi S, Luminari S, Baldini L, Marmiroli S, Federico M, Polliack A: Monocytosis has adverse prognostic significance and impacts survival in patients with T-cell lymphomas. Leuk Res. 2013, 37: 619-623. 10.1016/j.leukres.2013.01.009.

    Article  CAS  PubMed  Google Scholar 

  15. Huang JJ, Li YJ, Xia Y, Wang Y, Wei WX, Zhu YJ, Lin TY, Huang HQ, Jiang WQ, Li ZM: Prognostic significance of peripheral monocyte count in patients with extranodal natural killer/T-cell lymphoma. BMC Cancer. 2013, 13: 222-10.1186/1471-2407-13-222.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  16. Koh YW, Kang HJ, Park C, Yoon DH, Kim S, Suh C, Go H, Kim JE, Kim CW, Huh J: The ratio of the absolute lymphocyte count to the absolute monocyte count is associated with prognosis in Hodgkin's lymphoma: correlation with tumor-associated macrophages. Oncologist. 2012, 17: 871-880. 10.1634/theoncologist.2012-0034.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  17. Porrata LF, Ristow K, Colgan JP, Habermann TM, Witzig TE, Inwards DJ, Ansell SM, Micallef IN, Johnston PB, Nowakowski GS, Thompson C, Markovic SN: Peripheral blood lymphocyte/monocyte ratio at diagnosis and survival in classical Hodgkin's lymphoma. Haematologica. 2012, 97: 262-269. 10.3324/haematol.2011.050138.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Cheson BD, Horning SJ, Coiffier B, Shipp MA, Fisher RI, Connors JM, Lister TA, Vose J, Grillo-López A, Hagenbeek A, Cabanillas F, Klippensten D, Hiddemann W, Castellino R, Harris NL, Armitage JO, Carter W, Hoppe R, Canellos GP: Report of an international workshop to standardize response criteria for non-Hodgkin’s lymphomas: NCI Sponsored International Working Group. J Clin Oncol. 1999, 17: 1244-

    CAS  PubMed  Google Scholar 

  19. Lenz G, Wright G, Dave SS, Xiao W, Powell J, Zhao H, Xu W, Tan B, Goldschmidt N, Iqbal J, Vose J, Bast M, Fu K, Weisenburger DD, Greiner TC, Armitage JO, Kyle A, May L, Gascoyne RD, Connors JM, Troen G, Holte H, Kvaloy S, Dierickx D, Verhoef G, Delabie J, Smeland EB, Jares P, Martinez A, Lopez-Guillermo A, et al: Stromal gene signatures in large-B- cell lymphomas. N Engl J Med. 2008, 359: 2313-2323. 10.1056/NEJMoa0802885.

    Article  CAS  PubMed  Google Scholar 

  20. Martín A, Conde E, Arnan M, Canales MA, Deben G, Sancho JM, Andreu R, Salar A, García-Sanchez P, Vázquez L, Nistal S, Requena MJ, Donato EM, González JA, León A, Ruiz C, Grande C, González-Barca E, Caballero MD: R-ESHAP as salvage therapy for patients with relapsed or refractory diffuse large B-cell lymphoma: the influence of prior exposure to rituximab on outcome. A GEL/TAMO study. Haematologica. 2008, 93: 1829-1836. 10.3324/haematol.13440.

    Article  PubMed  Google Scholar 

  21. Porrata LF, Ristow K, Habermann TM, Witzig TE, Inwards DJ, Markovic SN: Absolute lymphocyte count at the time of first relapse predicts survival in patients with diffuse large B-cell lymphoma. Am J Hematol. 2009, 84: 93-97. 10.1002/ajh.21337.

    Article  PubMed  Google Scholar 

  22. Vellenga E, Putten WL V ‘t, van Veer MB, Zijlstra JM, Fibbe WE, van Oers MH, Verdonck LF, Wijermans PW, van Imhoff GW, Lugtenburg PJ, Huijgens PC: Rituximab improves the treatment results of DHAP-VIM-DHAP and ASCT in relapsed/progressive aggressive CD20 + NHL: a prospective randomized HOVON trial. Blood. 2008, 111: 537-543. 10.1182/blood-2007-08-108415.

    Article  CAS  PubMed  Google Scholar 

  23. Feugier P, Van Hoof A, Sebban C, Solal-Celigny P, Bouabdallah R, Fermé C, Christian B, Lepage E, Tilly H, Morschhauser F, Gaulard P, Salles G, Bosly A, Gisselbrecht C, Reyes F, Coiffier B: Long-term results of the R-CHOP study in the treatment of elderly patients with diffuse large B-cell lymphoma: a study by the Grouped’Etude des Lymphomes de l’Adulte. J Clin Oncol. 2005, 23: 4117-4126. 10.1200/JCO.2005.09.131.

    Article  CAS  PubMed  Google Scholar 

  24. Weiner GJ: Rituximab: mechanism of action. Semin Hematol. 2010, 47: 115-123. 10.1053/j.seminhematol.2010.01.011.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  25. Dehghani M, Sharifpour S, Amirghofran Z, Zare HR: Prognostic significance of T cell subsets in peripheral blood of B cell non-Hodgkin's lymphoma patients. Med Oncol. 2012, 29: 2364-2371. 10.1007/s12032-012-0176-1.

    Article  PubMed  Google Scholar 

  26. Gergely L, Váncsa A, Miltényi Z, Simon Z, Baráth S, Illés Á: PretreatmentT lymphocytenumbers are contributing to the prognostic significance of absolute lymphocyte numbers in B-cell non-Hodgkins lymphomas. Pathol Oncol Res. 2011, 17: 249-255. 10.1007/s12253-010-9306-2.

    Article  PubMed  Google Scholar 

  27. Głowala-Kosińska M, Chwieduk A, Nieckula J, Saduś-Wojciechowska M, Grosicki S, Rusin A, Nowara E, Giebel S: Association of circulating regulatory T cell number with the incidence and prognosis of diffuse large B cell lymphoma. Eur J Haematol. 2013, 91: 122-128. 10.1111/ejh.12144.

    Article  PubMed  Google Scholar 

  28. Shafer D, Smith MR, Borghaei H, Millenson MM, Li T, Litwin S, Anad R, Al-Saleem T: Low NK cell counts in peripheral blood are associated with inferior overall survival in patients with follicular lymphoma. Leuk Res. 2013, 37: 1213-1215. 10.1016/j.leukres.2013.07.038.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Tzankov A, Meier C, Hirschmann P, Went P, Pileri SA, Dirnhofer S: Correlation of highnumbers of intratumoral FOXP3+ regulatory T cells with improved survival in germinal center-like diffuse large B-cell lymphoma, follicular lymphoma and classical Hodgkin's lymphoma. Haematologica. 2008, 93: 193-200. 10.3324/haematol.11702.

    Article  CAS  PubMed  Google Scholar 

  30. Kim WY, Jeon YK, Kim TM, Kim JE, Kim YA, Lee SH, Kim DW, Heo DS, Kim CW: Increased quantity of tumor-infiltrating FOXP3-positive regulatory T cells is an independent predictor for improved clinical outcome in extranodal NK/T-cell lymphoma. Ann Oncol. 2009, 20: 1688-1696. 10.1093/annonc/mdp056.

    Article  CAS  PubMed  Google Scholar 

  31. Kim KH, Kim TM, Go H, Kim WY, Jeon YK, Lee SH, Kim DW, Khwarg SI, Kim CW, Heo DS: Clinical significance of tumor-infiltrating FOXP3+ T cells in patients with ocular adnexal mucosa-associated lymphoid tissue lymphoma. Cancer Sci. 2011, 102: 1972-1976. 10.1111/j.1349-7006.2011.02051.x.

    Article  CAS  PubMed  Google Scholar 

  32. Felcht M, Heck M, Weiss C, Becker JC, Dippel E, Müller CS, Nashan D, Sachse MM, Nicolay JP, Booken N, Goerdt S, Klemke CD: Expression of the T-cell regulatory marker FOXP3 in primary cutaneous large B-cell lymphoma tumour cells. Br J Dermatol. 2012, 167: 348-358. 10.1111/j.1365-2133.2012.10987.x.

    Article  CAS  PubMed  Google Scholar 

  33. Greaves P, Clear A, Coutinho R, Wilson A, Matthews J, Owen A, Shanyinde M, Lister TA, Calaminici M: Gribben JG: Expression of FOXP3, CD68, and CD20 at diagnosis in the microenvironment of classical Hodgkin lymphoma is predictive of outcome. J Clin Oncol. 2013, 31: 256-262. 10.1200/JCO.2011.39.9881.

    Article  CAS  PubMed  Google Scholar 

  34. Hasselblom S, Sigurdadottir M, Hansson U, Nilsson-Ehle H, Ridell B, Andersson PO: The number of tumour-infiltrating TIA-1+ cytotoxic T cells but not FOXP3+ regulatory T cells predicts outcome in diffuse large B-cell lymphoma. Br J Haematol. 2007, 137: 364-373. 10.1111/j.1365-2141.2007.06593.x.

    Article  CAS  PubMed  Google Scholar 

  35. Gabrilovich DI, Nagaraj S: Myeloid-derived suppressor cells as regulators of the immune system. Nat Rev Immunol. 2009, 3: 162-174.

    Article  Google Scholar 

  36. Schmidt H, Bastholt L, Geertsen P, Christensen IJ, Larsen S, Gehl J, von der Maase H: Elevated neutrophil and monocyte counts in peripheral blood are associated with poor survival in patients with metastatic melanoma: a prognostic model. Br J Cancer. 2005, 93: 273-278. 10.1038/sj.bjc.6602702.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  37. Donskov F, von der Maase H: Impact of immune parameters on long-term survival in metastatic renal cell carcinoma. J Clin Oncol. 2006, 24: 1997-2005. 10.1200/JCO.2005.03.9594.

    Article  PubMed  Google Scholar 

  38. Mandrekar SJ, Schild SE, Hillman SL, Allen KL, Marks RS, Mailliard JA, Krook JE, Maksymiuk AW, Chansky K, Kelly K, Adjei AA, Jett JR: A prognostic model for advanced stage nonsmall cell lung cancer: pooled analysis of North Central Cancer Treatment Group trials. Cancer. 2006, 107: 781-792. 10.1002/cncr.22049.

    Article  PubMed  Google Scholar 

  39. Ziegler-Heitbrock L, Ancuta P, Crowe S, Dalod M, Grau V, Hart DN, Leenen PJ, Liu YJ, MacPherson G, Randolph GJ, Scherberich J, Schmitz J, Shortman K, Sozzani S, Strobl H, Zembala M, Austyn JM, Lutz MB: Nomenclature of monocytes and dendritic cells in blood. Blood. 2010, 116: e74-e80. 10.1182/blood-2010-02-258558.

    Article  CAS  PubMed  Google Scholar 

  40. Subimerb C, Pinlaor S, Lulitanond V, Khuntikeo N, Okada S, McGrath MS, Wongkham S: Circulating CD14(+) CD16(+) monocyte levels predict tissue invasive character of cholangiocarcinoma. Clin Exp Immunol. 2010, 16: 471-479.

    Article  Google Scholar 

  41. Schauer D, Starlinger P, Reiter C, Jahn N, Zajc P, Buchberger E, Bachleitner-Hofmann T, Bergmann M, Stift A, Gruenberger T, Brostjan C: Intermediate monocytes but not TIE2-expressing monocytes are a sensitive diagnostic indicator for colorectal cancer. PLoS One. 2012, 7: e44450-10.1371/journal.pone.0044450.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  42. Feng AL, Zhu JK, Sun JT, Yang MX, Neckenig MR, Wang XW, Shao QQ, Song BF, Yang QF, Kong BH, Qu X: CD16+ monocytes in breast cancer patients: expanded by monocyte chemoattractant protein-1 and may be useful for early diagnosis. Clin Exp Immunol. 2011, 164: 57-65. 10.1111/j.1365-2249.2011.04321.x.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  43. Randolph GJ: No need to coax monocytes. Science. 2011, 332: 1268-1269. 10.1126/science.1208480.

    Article  CAS  PubMed  Google Scholar 

  44. Hasselblom S, Hansson U, Sigurdardottir M, Nilsson-Ehle H, Ridell B, Andersson PO: Expression of CD68+ tumor-associated macrophages in patients with diffuse large B-cell lymphoma and its relation to prognosis. Pathol Int. 2008, 58: 529-532. 10.1111/j.1440-1827.2008.02268.x.

    Article  PubMed  Google Scholar 

  45. Wada N, Zaki MA, Hori Y, Hashimoto K, Tsukaguchi M, Tatsumi Y, Ishikawa J, Tominaga N, Sakoda H, Take H, Tsudo M, Kuwayama M, Morii E, Aozasa K: Tumor-associated macrophages in diffuse large B-cell lymphoma: a study of the Osaka Lymphoma Study Group. Histopathology. 2012, 60: 313-319. 10.1111/j.1365-2559.2011.04096.x.

    Article  PubMed  Google Scholar 

  46. Qian BZ, Li J, Zhang H, Kitamura T, Zhang J, Campion LR, Kaiser EA, Snyder LA, Pollard JW: CCL2 recruits inflammatory monocytes to facilitate breast-tumour metastasis. Nature. 2011, 475: 222-225. 10.1038/nature10138.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  47. Nakasone ES, Askautrud HA, Kees T, Park JH, Plaks V, Ewald AJ, Fein M, Rasch MG, Tan YX, Qiu J, Park J, Sinha P, Bissell MJ, Frengen E, Werb Z, Egeblad M: Imaging tumor-stroma interactions during chemotherapy reveals contributions of the microenvironment to resistance. Cancer Cell. 2012, 21: 488-503. 10.1016/j.ccr.2012.02.017.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  48. Sanford DE, Belt BA, Panni RZ, Mayer A, Deshpande AD, Carpenter D, Mitchem JB, Plambeck-Suess SM, Worley LA, Goetz BD, Wang-Gillam A, Eberlein TJ, Denardo DG, Goedegebuure SP, Linehan DC: Inflammatory monocyte mobilization decreases patient survival in pancreatic cancer: a role for targeting the CCL2/CCR2 axis. Clin Cancer Res. 2013, 19: 3404-3415. 10.1158/1078-0432.CCR-13-0525.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  49. Olivieri A, Santini G, Patti C, Chisesi T, De Souza C, Rubagotti A, Aversa S, Billio A, Porcellini A, Candela M, Centurioni R, Congiu AM, Brunori M, Nati S, Spriano M, Vimercati R, Marino G, Contu A, Tedeschi L, Majolino I, Crugnola M, Sertoli MR: Upfront high-dose sequential therapy (HDS) versus VACOP-B with or without HDS in aggressive non-Hodgkin’s lymphoma: long-term results by the NHLCSG. Ann Oncol. 2005, 16: 1941-1948. 10.1093/annonc/mdi399.

    Article  CAS  PubMed  Google Scholar 

Pre-publication history

Download references

Acknowledgements

This work is supported by grants from the key technology projects of Anhui Province of China (11010402168) and the National Natural Science Foundation of China (81141104). The authors thank the patients and their families and all the investigators, including the physicians, nurses, and laboratory technicians in this study.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Zhi-Min Zhai.

Additional information

Competing interests

The authors declared that they have no competing interests.

Authors’ contributions

YLL designed the study, erformed the statistical analysis, and drafted the manuscript. KSG, YYP and YJ participated in the collection of the clinical data. ZMZ conceived of the study, and participated in its design and coordination and helped to draft the manuscript. All authors read and approved the final manuscript.

Electronic supplementary material

Additional file 1: sIPI as predictors of overall survival.(DOC 34 KB)

Additional file 2: sIPI as predictors of progression free survival.(DOC 35 KB)

Additional file 3: Univariate and multivariate analyses for progression free survival.(DOC 53 KB)

12885_2013_4533_MOESM4_ESM.doc

Additional file 4: Kaplan-Meier estimates of overall survival (A, C, E) and progression-free survival (B, D, F) for 94 primary refractory DLBCL patients identified by the saaIPI as either low- (A, B), low-intermediate/high- intermediate (C, D) and high risk (E, F) were further stratified into low or high groups by the ALC/AMC ratio.(DOC 66 KB)

12885_2013_4533_MOESM5_ESM.doc

Additional file 5: Kaplan-Meier estimates of overall survival (A, C) and progression-free survival (B, D) for 69 relapsed DLBCL patients identified by the saaIPI as either low- (A, B), low-intermediate/high-intermediate (C, D) were further stratified into low or high groups by the ALC/AMC ratio.(DOC 51 KB)

Authors’ original submitted files for images

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver ( https://creativecommons.org/publicdomain/zero/1.0/ ) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, YL., Gu, KS., Pan, YY. et al. Peripheral blood lymphocyte/monocyte ratio at the time of first relapse predicts outcome for patients with relapsed or primary refractory diffuse large B-cell lymphoma. BMC Cancer 14, 341 (2014). https://0-doi-org.brum.beds.ac.uk/10.1186/1471-2407-14-341

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/1471-2407-14-341

Keywords