|
|
||||||||
Ann Thorac Surg 2005;80:1215-1223
© 2005 The Society of Thoracic Surgeons
Department of Cardiothoracic Surgery, Division of Thoracic Surgery, Weill Medical College of Cornell University, New York, New York
Accepted for publication April 1, 2005.
* Address reprint requests to Dr Korst, Department of Cardiothoracic Surgery, Suite M404, Weill Medical College of Cornell University, 525 East 68th St, New York, NY 10021 (Email: rjk2002{at}med.cornell.edu).
Presented at the Forty-first Annual Meeting of The Society of Thoracic Surgeons, Tampa, FL, Jan 2426, 2005.
| Abstract |
|---|
|
|
|---|
METHODS: A decision analysis model was created in which a hypothetical cohort of patients underwent annual chest CT after resection of a stage IA NSCLC. The incidence of second primary lung cancer (SPLC), sensitivity and specificity of CT, as well as survival after resection of initial primary and SPLC were derived from published literature. The cost of CT and other procedures prompted by a positive finding on CT was calculated from Medicare reimbursement schedules. Cost effectiveness was defined as a cost of less than $60,000 per quality-adjusted life-year gained in the cohort under surveillance compared with controls under no surveillance.
RESULTS: In the initial (base case) analysis, the cost of surveillance CT was $47,676 per quality-adjusted life-year gained, implying cost effectiveness. However, factors that rendered surveillance CT cost ineffective were (1) age at entry into the surveillance program greater than 65 years, (2) cost of CT greater than $700, (3) incidence of SPLC of less than 1.6% per patient per year of follow-up, and (4) a false positive rate of surveillance CT greater than 14%.
CONCLUSIONS: Surveillance with postoperative CT may be a cost-effective intervention to detect SPLC in selected patients with previously resected stage IA NSCLC.
| Introduction |
|---|
|
|
|---|
Despite these guidelines, many practicing physicians follow up patients with completely resected NSCLC using surveillance chest CT. From the societal perspective, the potential benefit of such a surveillance program can only be expressed within the context of its associated costs. These costs include not only the expense of the CT scans themselves, but also the cost of false positive scans and the potential harm to patients from invasive and unnecessary diagnostic procedures. The ideal method to determine the cost effectiveness of a postoperative surveillance program would be by a prospective, randomized study in which patients are followed up longitudinally, and the costs associated with surveillance and treatment are carefully recorded. Such a trial, however, is unlikely to be completed in the near future. As an example, in the National Lung Screening Trial, designed to determine the role of CT scans to screen smokers for primary lung cancer, more than 50,000 patients are necessary for the study to have adequate power, the results are not expected until the next decade, and the trial is being performed at considerable cost [8].
In the absence of compelling data from a randomized trial, decision analysis may serve as a useful tool to guide clinical practice regarding a large group of patients. Similar models have been used to investigate cost effectiveness of screening for Barrett's esophagus [9], repair of abdominal aortic aneurysms [10], and a multitude of other clinical decisions. Decision analysis has also been utilized by government agencies such as the Health Care Financing Administration and the Food and Drug Administration to inform public policies [11]. In this study, we used a decision analysis model to predict the cost effectiveness of surveillance CT.
| Material and Methods |
|---|
|
|
|---|
Four variables that would affect the cost effectiveness of surveillance CT were considered. These included the age of the patient at the initiation of surveillance, the false positive rate of surveillance CT for detecting SPLC, the cost of surveillance CT, and the annual risk of developing SPLC. The likelihood that patients who develop SPLC would be candidates for curative resection, as well as the stage distribution of these patients and their anticipated survival after treatment were all obtained from the existing literature (as described in the subsequent paragraphs) and inserted into the model. Figure 1 demonstrates the basic model design with the various health states that patients move between.
|
Costs associated with surveillance, such as the cost of CT scans, surgery, and diagnostic procedures were derived from Medicare fee schedules for year 2004 in the State of New York [18]. Cost effectiveness was defined as a cost of less than $60,000 per QALY gained in the cohort under surveillance compared with controls under no surveillance [10, 1316].
Within the model, the value of each variable (eg, the annual incidence of SPLC, or the probability of a false positive CT) could be altered, and its effect on the cost effectiveness of surveillance CT determined. In the base case analysis, the value of each variable was set at the level thought to be the most realistic as determined from the literature. Table 1 displays the values of these four variables used in the base case analysis. Additionally, in one-way sensitivity analysis, the value of a single variable was varied to determine its impact on cost effectiveness.
|
Patients who developed SPLC were considered to fall into one of four groups: (1) localized, resectable disease, (2) unresectable disease owing to advanced stage, (3) unresectable owing to insufficient pulmonary reserve, or (4) unresectable because of other reasons (eg, patient refusal, small-cell histology). The distribution of patients among these groups was derived from a summation of the literature on multiple primary lung cancer, in which no specific surveillance protocol was described (Tables 2 and 3). Survival after resection for SPLC was derived from the largest series on the subject [21]. In that report of 127 patients, the operative mortality was 5%, the 5-year survival after resection of stage IA disease was 40%, and survival after resection of stage IB disease or higher was 18%. For the purposes of the present analysis, patients with early-stage disease who were unresectable owing to pulmonary insufficiency were considered to undergo definitive radiotherapy, with a 5-year survival of 16% [22]. Patients with advanced disease were assigned a median survival of 12 months with no survivors at 5 years.
|
|
|
|
Interpretation of outcomes after detection of cancers within a surveillance protocol is confounded by the biases of overdiagnosis and lead-time. Overdiagnosis is possible when a screen detects an indolent tumor that may never cause symptomatic disease within the lifetime of the patient. Overdiagnosis was not incorporated into the model, because SPLC detected on surveillance CT is, by definition, progressive cancer that was not present on earlier scans. Lead-time bias occurs when diagnosis occurs earlier in the natural history of the disease in the screened group, although the overall survival is equivalent in both groups. A lead-time bias of 1-year was incorporated in the model, based on published lead-time biases from randomized trials of screening using chest radiographs [27] and estimated tumor doubling times [28].
Cost Analysis
The costs of surgery and noninvasive and invasive diagnostic procedures were obtained from Medicare fee schedules for the State of New York for the year 2004 (Table 6) [18]. These costs included the associated surgeon, anesthesia, pathology and facility fees, and represent Medicare reimbursement rates. While this does not represent the actual, realized cost of these procedures that patients and the health care facility incur for these workups, these figures can be viewed as how much these patients' care costs the Medicare system, and are useful for comparative purposes. Patients who were treated with palliative chemotherapy for advanced disease were assigned an overall cost of care of $55,185 (in 2004 dollars), based upon the economic analysis of a recent, randomized clinical trial for advanced-stage lung cancer [29]. This trial was chosen because the costs of nonprotocol care, including radiotherapy and supportive care utilized until the patient's death, were reported. Both costs and utilities were discounted 3% annually.
|
| Results |
|---|
|
|
|---|
Age at Entry Into the Surveillance Program
The age at which patients were entered into surveillance was a significant determinant of cost effectiveness. In the base case analysis, surveillance CT was cost effective at an entry age of nearly 65 (Figure 2A) at $61,775 per QALY (at age 65). However, surveillance of an older cohort of patients was not a cost-effective intervention. For patients aged 70, the cost of surveillance was $84,781 per QALY.
|
Frequency of False Positive Surveillance CT Scans (Specificity)
As expected, the frequency of false positive CT scans significantly impacted on the cost effectiveness of surveillance CT (Figure 2C). That is because of the expense and morbidity of additional and unnecessary procedures prompted by a suspicious surveillance CT scan. These procedures not only include noninvasive (although expensive) studies such as positron emission tomography (PET), but also invasive procedures such as thoracoscopy and even thoracotomy performed for diagnostic purposes (Table 6) [30].
In the base case analysis, it was estimated that 9.5% of surveillance CT scans would represent false positive studies. This figure was based on a retrospective review of the use of surveillance CT conducted at our institution [30]. However, an increase in this estimate of false positivity (to 14%) rendered surveillance CT cost ineffective.
Incidence of Second Primary Lung Cancer
The most influential determinant of cost effectiveness was the annual risk of developing SPLC (Figure 2D). Earlier studies had estimated this risk to be between 1% and 4% per patient-year [31]. A recent prospective study has more precisely defined this risk to be 2% per patient-year of follow-up [1]. Further, in this latter study, the smoking status of the patient at the time of initial surgery significantly impacted this risk. For example, SPLC did not develop in patients who had never smoked. Current smokers faced a risk of 2.7% per year compared with a risk of 1.8% per year for former smokers. In the present study, surveillance CT was cost effective if the annual incidence of SPLC was greater than 1.6%. The cost effectiveness of surveillance CT with an annual incidence of 1.8% was $53,473 per QALY.
| Comment |
|---|
|
|
|---|
From a strictly clinical standpoint, the rationale for offering patients surveillance CT is twofold. First, patients who undergo resection face a high rate of disease recurrence. Surveillance CT may detect recurrence at an asymptomatic, and perhaps more treatable, stage. However, it seems unlikely that surveillance will detect recurrence for which potentially curative treatments, such as re-resection, are possible. In the M.D. Anderson experience, re-resection was offered to only 3% of patients undergoing strict follow-up [33]. A second, and more important justification for performing surveillance CT is the recognition that patients who survive surgical resection of NSCLC face a significant risk of developing another primary lung cancer. In a prospective trial of chemoprevention of second lung cancers, this risk was shown to be 2% per patient-year of follow-up [1]. Furthermore, the risk of developing SPLC accumulates over the lifetime of the patient. Eight years after resection, the risk of developing a SPLC was nearly 25% [1]. To place this figure into perspective, the estimated risk of developing primary lung cancer in current heavy smokers, the population for which screening with chest CT scans has been extensively studied [2326] is only 0.5% per patient-year [17].
In addition to the clinical rationale, however, surveys of thoracic surgeons have demonstrated that the motivation to provide postoperative follow-up is less to offer patients curative interventions for disease recurrence than it is to "please patients, avoid malpractice suits and improve patient quality of life" [34]. Despite this pessimism, surveillance may realize a significant survival benefit if SPLC can be detected at an early, and perhaps more curable stage.
Assumptions of the Decision Analysis Model
Conclusions drawn from a decision analysis model are only relevant to clinical practice if the many assumptions used to create the model are specifically stated, and agreed upon. In the present study, given the lack of prospective data concerning the use of postoperative surveillance CT for detecting SPLC, the following assumptions were necessary.
First, a critical assumption of the model was that surveillance CT would not impact on the outcome of patients who developed a recurrence of their initial lung cancer. This was assumed because no clear evidence exists to support that early detection of recurrences affects long-term survival of patients with NSCLC. Retrospective studies on postoperative surveillance have failed to demonstrate a significant difference in survival among those patients who were in a "strict" or "symptom driven" surveillance program [4] or between those whose recurrences were asymptomatic or symptomatic [33]. Furthermore, it is unlikely that a rigorous surveillance program would in fact detect recurrences at an asymptomatic and localized stage. In the prospective study by Westeel and coworkers [35], a scheduled chest CT scan diagnosed only 10 recurrences among 136 patients. Instead, the majority of patients presented with a symptomatic, distant recurrence independent of the surveillance protocol. Additional rationale for this assumption was to bias the model against a benefit of surveillance CT, making a conclusion that surveillance CT is cost effective as conservative as possible.
Second, it was assumed that data from prospective trials of primary screening for lung cancer could be extrapolated to a model of secondary surveillance. From these studies, the sensitivity of CT for detecting SPLC and the stage distribution of patients in a hypothetical cohort under surveillance was generated [2326]. Given the absence of prospective data regarding the use of surveillance CT for the detection of SPLC, this assumption appears reasonable. In addition, only data from primary screening studies that reported on patients who had undergone incidence scans (eg, those who had a normal baseline scan and were followed up by serial scans) was utilized. This population seemed most comparable to patients in the present hypothetical cohort who had been resected, were free of disease initially postoperatively, and were followed up with annual CT scans.
Third, it was assumed that there would be 100% compliance with the surveillance program. In actual practice, compliance with a surveillance program would most likely be less than 100%. However, compliance with an intensive surveillance program that included annual CT as well as flexible bronchoscopy was reported to be 90% in a recently reported prospective study that spanned 10 years, implying that compliance may indeed be relatively high [35].
Fourth, it was assumed that the use of surveillance CT would not lower the proportion of patients who had insufficient pulmonary reserve to tolerate resection. Although it is conceivable that surveillance CT could detect tumors at an earlier stage for which patients with poor pulmonary reserve may tolerate a more limited resection, this was not incorporated into the model as no data are available to quantify this effect.
In addition to the above assumptions, limitations of the present study include that the decision analysis model does not consider the psychological impact of surveillance on patients. Indeterminate findings on surveillance scans may lead to anxiety and a decline in quality of life that was not modeled. Conversely, close surveillance may lead to an earlier detection of health issues unrelated to lung cancer and a greater sense of well-being in a subset of patients.
Cost Effectiveness of Surveillance CT
It must be emphasized that the cost-effectiveness threshold of $60,000 per QALY is an arbitrary figure. Clearly, our society supports the use of many health care interventions with cost-effectiveness ratios of greater than $60,000 per QALY. As an example, lung volume reduction surgery has been shown to reduce mortality in a subset of patients with severe emphysema, and the cost of surgery is now reimbursed by Medicare. However, the cost-effectiveness ratio of this procedure greatly exceeds $60,000 per QALY [36]. We chose $60,000 per QALY for use in the present analysis because it lies close to the "median" value used in other publications [10, 1316, 37]. Clearly, this figure is meant more as a guideline as opposed to a distinct cutoff value.
In this study, using a cost-effectiveness threshold of $60,000 per QALY, a decision analysis model has suggested that annual surveillance CT is a cost-effective intervention after curative resection of stage IA NSCLC provided several criteria are met: (1) patients are enrolled into a surveillance program at an age of less than 65 years, (2) the cost of a surveillance CT scan is less than $700, (3) the rate of false positive CT scans is less than 14%, and (4) the annual risk of a second primary lung cancer is 1.6% per year or greater.
Given these criteria, it appears that postoperative surveillance CT is not likely to be cost effective for every patient who has undergone resection of an early-stage lung cancer. As an example, the model suggests that surveillance CT is not cost effective for patients over the age of 65. That may not be due to increased costs, but perhaps because surveillance CT may only be beneficial if it is carried out over a lengthy period of time, requiring patients to live longer to reap the benefits of surveillance. Older patients have a shorter life expectancy and face a higher annual mortality from cardiovascular disease and other malignancies that would not be reduced by surveillance CT. As a consequence, these patients may not live long enough for surveillance CT to be cost effective. In addition, the model also suggests that surveillance CT is not cost effective if the rate of false positive scans is 14% or greater. Although our group has reported a false positive rate of 9.5% at our institution [30], this could be higher at centers with less experience in the follow-up care of lung cancer patients. Further, a distinction needs to be made between a "finding" on a scan (eg, a nodule), and a "positive" scan, about which the clinician is suspicious enough to perform additional testing. Clearly, not all findings will be suspicious. Finally, surveillance CT does not appear to be cost effective if the annual rate of developing SPLC is less than 1.6% per year. In the largest prospective report to quantify this risk [1], patients who had quit smoking at the time of their initial resection faced a risk of 1.8% per year compared with a risk of 2.7% per year for those who continued to smoke. As a result, surveillance CT for both current and former smokers appears to be cost effective.
In conclusion, the decision to enroll patients in a surveillance CT program must be made on an individual basis. Older patients, or those with limited life expectancy from other diseases, may not benefit from a surveillance CT program. Conversely, younger patients, including former smokers and (especially) current smokers, may derive the most benefit from surveillance CT. Prospective data collection is necessary to confirm these findings, as well as to address additional variables including the use of adjuvant therapy and the utility of early detection of metastatic disease using surveillance CT.
| Discussion |
|---|
|
|
|---|
DR KENT: Thank you for your comments. I would like to address your points one by one.
Number one, we did only look in this model at stage IA patients, and the reason we did that was because we believed that these patients would be best served by a potential screening program. We did not look at patients who were staged IB or higher, although our feeling would be that, for example, patients with stage IIIA disease who have a very high rate of disease recurrence and metastatic disease would probably not benefit from a screening program, although we did not look at that.
In terms of defining what the rate of a false positive scan would be, I want to take a minute to talk about that. In our study we showed that the false positive rate was 9.5%, and that number was a combination of both the inherent ability of a scan to detect a primary lung cancer and also what the surgeon did with that information. When we looked at our series of patients who underwent surveillance CT scan, about two thirds of those patients had an abnormal scan, either suspicious for recurrent disease or a new primary as read by the radiologist. When we said that our rate of false positive scans was 9.5%, what we meant was that 9.5% of those scans when looked at by the surgeon who initiated further workup was found to be benign disease. So that was a figure that we found at our institution, although clearly that figure would be different based upon the practice philosophy of people following up these patients.
The final issue that you brought up is a very important one, looking at the distinction between recurrence and a new primary. In the model, clearly we did not need to make that distinction. We assumed that patients who developed a recurrence of their disease would go on to die and that patients who developed a new primary would be treated in the manner that we discussed. But clearly, I think in some cases it is very important to make that distinction, although we have all been in scenarios where a patient undergoes resection of a stage IA tumor, a year or two later has what appears to be a new primary, and it can be a difficult distinction between a new primary and a local recurrence.
DR LEWIS WETSTEIN (Freehold, NJ): Congratulations on a nice presentation. I find the results, however, somewhat disconcerting: the impression that it's either all or none. We continuously reevaluate the way we follow patients, and over 25 years have developed an extremely productive protocol. Our protocol includes an initial baseline CT scan of the chest taken at 3 months after resection. We subsequently utilize chest roentgenograms and basic blood work quarterly for 2 years, semiannually for another 2 years, and then yearly. We only resort to repeating the CT scan if we notice either a change on the chest roentgenogram, some new symptomatology that we're confused about, or the blood work has changed. After this protocol, I can't remember a recurrence we've missed. Moreover, I'm confident you will agree that our protocol is even more cost effective.
DR KENT: I think you have raised some very good points. The first point is where do we set that threshold for cost effectiveness and does it matter if a test is $65,000 per quality-adjusted life-year or $40,000. And there's no question that at a very important level, that threshold that we set is an arbitrary one, although it is one which is used really in the majority of publications that are looking at cost effectiveness for other interventions. I think that the decision to offer a patient a surveillance program is really not one that is solely based on cost effectiveness, and that a decision to initiate a health care program is at the one level perhaps a political one and a societal one, and also I think between the individual patient and surgeon or pulmonologist or oncologist following that patient. I think what's important about these studies is that we do have a way to at least determine whether we're in the ballpark of cost effectiveness, and also we can see what factors impact on cost effectiveness. So I think that we did show, for example, that the false positive rate is a significant determinant of cost effectiveness, and clearly if we find that we're pursuing a lot of studies with invasive workups for benign disease, we're probably not helping these patients, or at the very minimum, we're adding cost and certainly adding potential morbidity.
DR H. CHRISHANTHA FERNANDO (Boston, MA): Most local recurrences occur within the first 2 to 3 years, so perhaps you should be doing CT scans more frequently in the first 2 to 3 years. Why in the model did you choose annual CT scans rather than more frequent scans earlier on?
DR KENT: I think that's another good point. The purpose of the model was to look at developing or the detection of a second primary lung cancer, and we really were not able to model whether screening would impact on the survival of patients who developed a recurrence. For simplicity's sake, we assumed that screening would not impact on patients who developed a recurrence of their primary lung cancer, and we did that for two reasons. Number one, there are not a lot of good data to show that screening would impact on the treatment of patients who recur from their primary lung cancer, and those studies that did show a benefit, that benefit may very well be due simply to lead-time bias. The second issue is that we really wanted to bias the model against screening, so that if we were to conclude that screening were cost effective, it would be a conservative estimate. I think if you were to assume that screening may impact on patients who develop a recurrence, then screening would be even more cost effective.
DR DANIEL L. MILLER (Atlanta, GA): Just a real quick poll. How many of you in the audience are involved in the surveillance of your patients for lung cancer? [A show of hands.] How many of you get CT scans? [A show of hands.] About half. Actually, there's discussion now within the American College of Surgeons Oncology Group about this very study of looking at CT surveillance and so forth. So you'll be hearing about that.
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
J. Rubins, M. Unger, and G. L. Colice Follow-up and Surveillance of the Lung Cancer Patient Following Curative Intent Therapy: ACCP Evidence-Based Clinical Practice Guideline (2nd Edition) Chest, September 1, 2007; 132(3_suppl): 355S - 367S. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. K. Gould, C. D. Berg, D. R. Aberle, the National Lung Screening Trial Executive Commit, P. B. Bach, S. Kulaga, I. Karp, A. J. Yee, T. J. Lynch, G. A. Silvestri, et al. CT screening for lung cancer. N. Engl. J. Med., February 15, 2007; 356(7): 743 - 744. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| ANN THORAC SURG | ASIAN CARDIOVASC THORAC ANN | EUR J CARDIOTHORAC SURG |
| J THORAC CARDIOVASC SURG | ICVTS | ALL CTSNet JOURNALS |