YuhJenn Wu^{1}, ChiTian Chen^{2}, HsiaoHui Tsou^{2} and ChinFu Hsiao^{2,3*}  
^{1}Department of Applied Mathematics, Chung Yuan Christian University, Taiwan  
^{2}Division of Biostatistics and Bioinformatics, Institute of Population Health Sciences, National Health Research Institutes, Taiwan  
^{3}Division of Clinical Trial Statistics, Institute of Population Health Sciences, National Health Research Institutes, Taiwan  
Corresponding Author :  ChinFu Hsiao, Ph.D Division of Biostatistics and Bioinformatics Institute of Population Health Sciences National Health Research Institutes 35 Keyan Road, Zhunan Miaoli County 350, Taiwan Tel: +88637246166 Email: [email protected] 
Received December 23, 2014; Accepted February 10, 2015; Published February 16, 2015  
Citation: YuhJenn Wu, ChiTian Chen, HsiaoHui Tsou, ChinFu Hsiao (2015) Evaluating the Relative Cost of a Targeted Design versus an Untargeted Design for Randomized Clinical Trials. Drug Des 4:120. doi:10.4172/21690138.1000120  
Copyright: © 2015 YuhJenn Wu, et al. This is an openaccess article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. 
Visit for more related articles at Drug Designing: Open Access
More and more studies have shown that genetic determinants may mediate variability among persons in the response to a drug, and thus some therapeutics may benefit only a subset of patients. Genomic technologies, such as DNA sequencing, mRNA transcript profiling, and comparative genomic hybridization, are providing biomarkers to predict who are most likely to respond to a given drug, and thus brings opportunity to conduct targeted clinical trials with eligibility restricted to the subset of patients. In this paper, we evaluate the relative cost of a targeted design versus an untargeted design for a randomized phase III clinical trial comparing a new treatment to a control. Our investigation indicates that the effectiveness of the targeted design critically depends upon the difference of treatment effect between patient subsets, the proportion of targeted patients in the population, the diagnostic assay performance, and the relative cost of screening versus drug expenses.
Keywords 
Biomarkers; Clinical trial; Targeted design 
Introduction 
The evidence that genetic determinants may mediate variability among persons in the response to a drug is increasing. After the intake of identical doses of a given agent, some patients may have no therapeutic response, while others may have clinically significant side effects. Caraco [1] points out that some of this diversity in response rates might be attributed to differences in the rate of drug metabolism, especially by the cytochrome P450 superfamily of enzymes. For example, ten isoforms of cytochrome P450 are responsible for the oxidative metabolism of most drugs. The effect of genetic polymorphisms on catalytic activity, however, is most evident for three isoforms: CYP2C9, CYP2C19, and CYP2D6. Among these three, CYP2D6 has been most extensively studied and is involved in the metabolism of about 100 drugs, including betablockers and antiarrhythmic, antidepressant, neuroleptic, and opioid agents. Several studies have classified some patients as having a “poor metabolism” for certain drugs due to lack of CYP2D6 activity [2,3]. On the other hands, patients having some enzyme activity are classified into three subgroups: those with “normal” activity (or extensive metabolism), those with reduced activity (or intermediate metabolism), and those with markedly enhanced activity (or ultrarapid metabolism). Most importantly, the distribution of CYP2D6 phenotypes varies with race. For instance, the frequency of the phenotype associated with poor metabolism is 5 to 10 percent in white populations but only 1 percent in Chinese and Japanese populations. 
Another example regarding the impact of genetic factors on the responses to therapeutics is the epidermal growth factor receptor (EGFR) tyrosine kinase inhibitor gefitinib (Iressa). Recently, Iressa was approved in Japan and the United States for the treatment of nonsmall cell lung cancer (NSCLC). The EGFR is a promising target anticancer therapy because it is more abundantly expressed in lung carcinoma tissue than in adjacent normal lung. Clinical trials, however, have revealed significant variability in the response to gefitinib, with higher responses observed in Japanese patients than in a predominantly Europeanderived population (27.5% versus 10.4%, in a multiinstitutional phase II trial) [4]. Paez et al. [5] also shows that somatic mutations of the EGFR were found in 15 of 58 unselected tumors from Japan and 1 of 61 from the United States. Treatment with Iressa causes tumor regression in some patients with NSCLC; this occurs more frequently in Japan. Finally, the striking differences in the frequency of EGFR mutation and response to Iressa between Japanese and U.S. patients raise general questions regarding variations in the molecular pathogenesis of cancer among patients. 
Genomic technologies such as DNA sequencing, mRNA transcript profiling, and comparative genomic hybridization [6] are providing evidence that many diseases are more molecularly heterogeneous than previously recognized. Efforts are underway to develop mutation signatures and gene expression signatures of tumors [7,8]. Such studies provide comprehensive insights into the heterogeneity of disease pathogenesis and allow molecular disease taxonomies to be defined. Over the past decade, anticancer drug discovery has shifted from an approach based on empirical random screening to a more rational and mechanistic, targetbased one [9]. 
Traditional drug discovery usually takes an empirical approach, characterized by random screening of a variety of natural and synthetic compounds using high throughput cellbased cytotoxicity assays. Also a traditional phase III randomized clinical trial is often conducted to evaluate a test regimen, comparing it with a control regimen for all patients in the disease category. These traditional approaches may lack efficacy, since molecularly targeted drugs may only be effective for a subset set of the patients with a traditionally defined disease. In recent years, successful target based clinical studies can be found in the literature. For example, herceptin increases the clinical benefit of firstline chemotherapy in metastatic breast cancer patients with overexpressed HER2 (the human epidermal growth factor receptor 2) level [10]. Another example is that use of Tafinlar can give a delay of tumor growth (progression free survival) by 2.4 months for unresectable or metastatic melanoma patients with BRAF V600E mutation compared with use of dacarbazine [11]. 
As recognized, pharmaceutical development is a risky, complex, and costly endeavor. The current paradigm for drug development was developed for the twenty century, and is no longer functioning for the 21st century. New concepts, strategies, and methodology are urgently needed to reduce the development cost, to shorten the development cost, and to improve the development success rate. The advances in genomic technologies bring the opportunity to conduct targeted clinical trials with eligibility restricted to the subset of patients predicted to have benefit from the drug. Maitournam and Simon [12] evaluate the relative efficiency of a targeted clinical trial design to an untargeted design for a randomized clinical trial comparing a new treatment to a control with regard to number of patients required for randomization. In this paper, we evaluate the relative cost of the untargeted randomized phase III clinical trial design versus the targeted design based on the required drug cost and the screening cost. 
In this paper, the cost calculation of conducting a targeted clinical trial or an untargeted clinical trial is presented in Section “Cost Calculation”. We compare the cost of the two designs in Section “Comparison of Trial Cost”. Some concluding remarks are given in Section “Discussion”. 
Cost Calculation 
Assume that we focus on only the phase III clinical trials for comparing a test product (T) and a placebo control (C). We also assume that a binary genomic composite biomarker (diagnostic assay) can be used to classify patients potentially eligible for a particular clinical trial into two mutually exclusive genomic subgroups: those classified as marker positive (R_{+}), who are predicted to be responsive to the new drug, and those classified as marker negative (R_{}), who are not predicted to be responsive. The genomic composite biomarker could be either a single biomarker, e.g. HER2 [13], or derived from genomic technologies such as DNA sequencing and mRNA transcript profiling [14,15]. In this study, a continuous efficacy response is chosen as the primary endpoint of the phase III randomized clinical trial. Let μ_{0} and μ_{1} denote the mean responses in the control group for patients in subsets R_{+} and R_{}, respectively, and let γ denote the proportion of patients in R− . For treatment T, the mean responses are denoted by μ_{0T} and μ_{1T} for the R_{} and R_{+} subsets, respectively. For the untargeted trial design, the response of a patient has a mixture distribution with mean γ μ_{0} + (1−γ )μ_{1} for control group C, and γμ_{0T}+(1γ)μ_{1T} for treatment group T. Assume that the responses within each group and subset are normally distributed with constant variance σ^{2}. Let n denote the number of patients per group required to reach power 1β for rejecting the null hypothesis at significance level α, and let n_{t} denote the number of R_{+} patients for the targeted design. Since the assaying of patients as belonging to subset R_{} or R_{+} is based on a genomic composite biomarker, there might exist measure error. Let λ_{sens} denote the sensitivity of the diagnostic assay for diagnosing R_{+} patients and let λ_{spec} denote the corresponding specificity. The mean response for patients selected for the targeted study becomes 
for the control group, and 
for the treatment group, where 
(1) 
is the positive predictive value (PPV) of the diagnostic assay, and ω_{} = 1−ω^{+} . That is, the treatment effect for the targeted design is diluted by ω_{+}. Accordingly, by Maitournam and Simon [12], we can derive that 
(2) 
and 
(3) 
The total number of required randomized patients will be 2n_{t} for the untargeted design, and 2n_{t} for the targeted design. The ratio r between the required numbers of patients for the untargeted design versus the targeted design is r=n/n_{t}. Since there exists measure error in assaying of patients as belonging to subset R_{} or R_{+}, if 2n_{t} is the number of patients required for randomization to the targeted trial, then 
(4) 
is the expected number of patients screened in order to obtain 2n_{t} randomized patients. 
Let c_{d} denote the drug cost for a patient in the clinical trial. For the targeted design, we further need a genomic composite biomarker to classify potentially eligible patients into R_{+} or R_{} . Let c_{s} denote the cost for screening a patient into the subsets R_{+} or R_{}. Note that the cost, c_{s}, only affects the targeted design. Consequently, the cost for conducting an untargeted clinical trial is 2n c_{t} whereas the cost for conducting a targeted clinical trial is 
(5) 
It will be worthwhile to conduct a targeted clinical trial when 
or equivalently, the ratio between the costs for the two designs, denoted by r_{c} , is greater than 1, where 
(6) 
and r=n/n_{t} is the relative efficiency of the targeted versus the untargeted design defined by Maitournam and Simon (2005). As seen in equation (6), the ratio r_{c} depends upon r, c_{s} /c_{d} , λ_{sens}, λ_{spec}, and γ. 
Comparison of Trial Cost 
We assume that the number of patients required for randomization with each design is to achieve 80 percent statistical power at a 5 percent twosided significance level. In other words, α=0.05 and β=0.2, and thus 1 2 z 1.96 −α = and 1 z 0.84 −β = . Here, we consider the cases with c_{s}/c_{d} =0.1, 0.5 and 0.9, respectively. In each case, we consider three scenarios: (I) no treatment effect exists in the R− patients, (II) the treatment effect for the R− patients is half as large as for R_{+} patients, and (III) the treatment effect for the R_{} patients is almost as large as for R_{+} patients, respectively. In the last scenario, we simply assume that the treatment effect for the R_{} patients is fourfifths as large as for the R_{+} patients. In comparing the targeted and the untargeted designs, we explore the following factors: the proportion of R_{+} patients, the relative treatment effect of the R_{} patients versus the R_{+} patients, the sensitivity of the diagnostic assay for detecting R_{+} patients (λ_{sens}), and the specificity of the diagnostic assay (λ_{spec}). Without loss of generality, we assume that μ_{0}=0, and σ=1. 
The relative cost, r_{c}, of conducting an untargeted trial versus a targeted trial is shown in Figures 1, 2, and 3, which corresponds to c_{s}/c_{d}=0.1, 0.5, and 0.9, respectively. The horizontal axis of each plot is the proportion of R_{+} patients, 1 γ. In each figure, the upper panel is scenario I, and based on μ_{1}=0 and μ_{1T}=1. The middle panel corresponds to scenario II. The lower panel represents scenario III. The three columns of panels in each figure correspond to assay specificities of 1, 0.8, and 0.6, respectively; and the three curves in each plot correspond to assay sensitivities of 1, 0.8, and 0.6 (Figure 1). 
We first evaluate the relative cost r_{c} of the untargeted design versus the targeted design with various values of c_{s}/c_{d}. In Figure 1 with c_{s}/ c_{d} =0.1, the upper panel of Figure 1 shows that, under the scenario I (i.e. no treatment effect for R_{} patients), the cost for conducting an untargeted trial is much higher than that for conducting a targeted trial (i.e. ratio r_{c} is greater than 1) even in the worst situation when both the sensitivity and the specificity are 0.6. When the treatment effect for the R_{} patients is half as large as for R_{+} patients (the middle panel) and the assay specificity is 1, conducting the targeted trial is cheaper than the untargeted trial (the relative cost r_{c} is greater than 1), except for the extreme cases where the proportion of patients in R_{+} is close to 0 or close to 1. As the assay specificity decreases to 0.6, the relative cost r_{c} decrease to almost 1; hence, there is no significant benefit in cost to conduct a targeted trial. When the treatment effect for the R− patients is fourfifths as large as for R_{+} patients (cf. the lower panel), the relative cost r_{c} is close to 1 or less than 1. Therefore, it is less worthwhile to conduct a targeted trial. Note that the curves corresponding to different assay specificity have different shapes. Therefore, the specificity plays a more important role than the sensitivity does with regard to r_{c}. If the specificity decreases, r_{c} decreases because some R_{} patients selected for inclusion in the targeted trial will dilute the treatment. 
For c_{s}/c_{d} =0.5, Figure 2 shows that the cost for conducting an untargeted trial is lower (i.e. r_{c} is less than 1) than that for conducting a targeted trial when the R_{} patients have treatment effect (cf. the middle and lower panels). This suggests that there is no substantial advantage to conduct a targeted trial when the treatment effect for R_{} patients is half that of the R_{+} patients or the treatment effect for R_{} patients is as large as the treatment effect for R_{+} patients. However, when there is no treatment effect for the R_{} patients, it may be worthwhile to conduct a targeted trial since ratio r_{c} is greater than 1, especially when the assay specificity is 1 (cf. the first plot of the upper panel of Figure 2). The relative cost r_{c}, however, is not much larger than 1 when the assay specificity decreases to 0.6 (cf. the last plot of the upper panel of Figure 2). Thus, there is no significant benefit to conduct a target trial when the assay specificity λ_{spec}=0.6 given c_{s}/c_{d} =0.5 (Figure 2). 
When c_{s}/c_{d} =0.9, Figure 3 shows that it is not worthwhile to conduct a targeted trial since the ratio r_{c} is much less than 1 in both scenarios II and III (i.e., there is some treatment effect for the R_{} patients). The cost for conducting an untargeted trial is higher (i.e. the ratio r_{c} is greater than 1) than that for conducting a targeted trial only in the best situations when the assay specificity is 1, there is no treatment effect for the R_{} patients, and the proportion of the R_{+} patients is less than 0.6. To sum up, it can be seen from Figures 1, 2, and 3, that as the ratio of screen cost per person and drug cost per person, c_{s}/c_{d} , increases, the savings in trial cost for conducting the targeted trial will decrease significantly (Figure 3). 
We now turn to analyze the trend of the relative cost of conducting an untargeted trial versus a targeted trial given different assumption for the treatment effect in R_{} patients. If γ is close to 0, then most of the patients are in the R_{+} group. Thus the two trial designs are almost equivalent and the cost for targeted design is higher than that for untargeted design since the former spending the additional cost of screening for each patient. We conclude that r_{c} is less than 1 when γ is close to 0 for each scenario. We now consider the scenario (I), i.e., no treatment effect exists in the R_{} patients. In this case, we can assume μ_{1} = μ_{0} = μ_{0T} . When γ is close to 1, there are very few R_{+} patients. The treatment effect for the untargeted trial design can be expressed as 
which is close to zero. Hence, the untargeted trial requires a huge sample size based on equation (2). In this scenario, if the treatment effect in the R_{+} subset is small, then the sample size required for the targeted design will also become very large based on equation (3). That is, both designs require large numbers of patients for the trial. Consequently, conducting a targeted trial will have no advantage. On the other hand, if the treatment effect for R_{+} patients is large, the targeted design may require very few patients. However, the untargeted design may still require a large number of patients due to no treatment effect for the R_{} patients. Accordingly, the cost of the untargeted design is very high due to the large number of required patients. In this case, if the screening cost c_{s} is much lower than the drug cost c_{d}, then the cost of the targeted design will be smaller than that of the untargeted design. In other words, the relative cost r_{c} is much larger than 1 (cf. upper panel in Figures 1, 2 and 3). In this case, conducting a targeted trial is cheaper than conducting an untargeted trial. 
In the scenario II, where the treatment effect for the R_{} patients is half as large as for R_{+} patients, the net treatment effect for the targeted design is 
For γ close to 1, there are very few R_{+} patients, and the treatment effect for the untargeted trial design is again 
which is close to 0 0 ( T ) μ −μ , and the treatment effect for the targeted trial design is 
which is two times larger than that for the untargeted trial design. Hence the untargeted trial requires a sample size approximately twice that of the targeted trial. When both γ and λ_{spec} are close to 1, by equation (4), the expected number of patients screened in order to obtain 2n_{t} randomized patients is enormous. Hence, the total cost of screening 2nts patients could be huge when the screening cost per patient, c_{s}, is not very small relative to the drug cost per patient, c_{d}, in the clinical trial. This implies that the cost of the untargeted trial could be much lower than that of the targeted design when the ratio c_{s}/c_{d} is not very small. Accordingly, the relative cost, r_{c}, of the untargeted design versus the targeted design is less than 1, and thus conducting the targeted trial should have advantage over the untargeted trial. 
In the scenario III, where the treatment effect for the R_{} patients is fourfifths as large as for R_{+} patients, the net treatment effect for the targeted design is 
Again, when γ is close to 1, there are very few R_{+} patients and the treatment effect for the untargeted trial design is 
On the other hand, the treatment effect for the targeted trial design is 
which is slightly larger than that for the untargeted trial design. Hence the untargeted trial requires a slightly larger sample size than the targeted trial. When both γ and λ_{spec} are close to 1, the expected number of patients screened in order to obtain 2n_{t} randomized patients is huge by equation (4). Thus, the cost of conducting an untargeted trial could be lower than that of conducting a targeted trial since the total cost of screening 2nts patients could be huge. Therefore, the relative cost of the untargeted design and the targeted design, r_{c}, could be less than 1. That is, conducting a targeted trial is more expensive than conducting an untargeted trial. 
Discussion 
Clinical trials are evolving. The current paradigm for drug development was developed for the twenty century, and is no longer functioning for the 21st century. Therefore, new concepts, strategies, and methodology are urgently needed to reduce the development cost, to shorten the development cost, and to improve the development success rate. In this paper, we have compared the untargeted randomized phase III clinical trial design to the targeted design based on the required drug cost and the screening cost for both designs. When the treatment effect exists only for R_{+} patients and the specificity of the diagnostic assay is close to 1, untargeted designs would generally cost more than targeted designs. As the specificity of the assay decreases, the cost of the targeted design increases but the cost of the targeted design remains lower than that of the untargeted design. If, however, the screening tool sensitivity is poor (e.g., 0.6), then the cost for the targeted design will increase dramatically. 
When the treatment effect for the R_{} patients is half that of the R_{+} patients or as large as for the R_{+} patients, it can be seen that the number of patients to be screened for the target design is usually larger than the number of patients required for the untargeted design. Consequently, the cost for the targeted design would be much greater than that for the untargeted design unless the screening cost is very cheap. It should also be noted that the increased number of screened patients for the targeted design strongly depends on the sensitivity of the diagnostic assay. That is, the larger the sensitivity of the assay, the less the total screening costs. Thus, the sensitivity of the screening tool has critical impact on the cost for the targeted design. 
Our investigation has also indicated that the specificity of the diagnostic assay and the treatment effect for the R_{} patients play important roles on the relative costs of the untargeted design versus the targeted design. More specifically, the larger the specificity, the larger the relative costs of the untargeted design versus the targeted design. On the other hand, the larger the treatment effects for the R_{}patients, the smaller the relative costs of the untargeted design versus the targeted design. In other words, the targeted design remains advantageous with regard to the cost issue when the diagnostic assay specificity is large, or when the treatment effect for the R_{} patients is not expected. The selection of the preferred design will also depend on the cost of the diagnostic assay. In particular, the advantage of the targeted design increases, as the relative cost of screening versus drug expense decreases. 
In this study, our investigation was only focused on the cost of the diagnostic assay and the drug expenses. However, there will be more time needed for planning and development, and more money spent on clinic staff, lab expenses, and trial management cost for targeted designs. This additional cost may be included in the evaluation of the overall cost of the clinical development. 
References 

Figure 1  Figure 2  Figure 3 