Odds Ratios
  0.25 1.0* 2.0 3.0 4.0 5.0

 
Sensitivity False Positive False Positive Sensitivity False Positive Sensitivity False Positive Sensitivity False Positive Sensitivity False Positive
  Mean (Median;Std) Mean (Median;Std) Mean (Median;Std) Mean (Median;Std) Mean (Median;Std) Mean (Median;Std) Mean (Median;Std) Mean (Median;Std) Mean (Median;Std) Mean (Median;Std) Mean (Median;Std)
CPT 0.73
(0.95;0.39)
0.09
(0.05;0.11)
0.07
(0;0.10)
0.64
(0.79;0.38)
0.08
(0.04;0.11)
0.86
(>0.99;0.27)
0.13
(0.11;0.11)
0.97
(>0.99;0.1)
0.15
(0.13;0.11)
0.99
(>0.99;0.08)
0.16
(0.14;0.10)
FSPT                      
Span = 0.1 0.71
(0.84;0.33)
0.06
(0.06;0.04)
0.05
(0.05;0.03)
0.58
(0.67;0.32)
0.06
(0.05;0.03)
0.87
(0.95;0.2)
0.07
(0.07;0.04)
0.96
(>0.99;0.09)
0.08
(0.08;0.03)
0.98
(>0.99;0.06)
0.09
(0.09;0.03)
Span = 0.3 0.72
(0.88;0.36)
0.07
(0.06;0.07)
0.06
(0.04;0.06)
0.61
(0.79;0.39)
0.07
(0.05;0.06)
0.88
(>0.99;0.25)
0.10
(0.09;0.07)
0.97
(>0.99;0.11)
0.12
(0.11;0.06)
0.99
(>0.99;0.07)
0.14
(0.14;0.06)
Span = 0.5 0.70
(0.93;0.38)
0.08
(0.05;0.09)
0.06
(0.02;0.08)
0.65
(0.86;0.40)
0.08
(0.04;0.09)
0.80
(>0.99;0.33)
0.13
(0.12;0.11)
0.94
(>0.99;0.17)
0.17
(0.17;0.11)
0.96
(>0.99;0.16)
0.21
(0.22;0.11)
Span = 0.7 0.64
(0.98;0.43)
0.09
(0.03;0.11)
0.06
(0;0.09)
0.67
(0.95;0.41)
0.09
(0.03;0.11)
0.83
(>0.99;0.32)
0.16
(0.15;0.13)
0.92
(>0.99;0.2)
0.22
(0.23;0.13)
0.97
(>0.99;0.11)
0.27
(0.29;0.13)
Span = 0.9 0.68
(>0.99;0.43)
0.08
(0;0.11)
0.06
(0;0.10)
0.61
(0.79;0.43)
0.08
(0;0.11)
0.83
(>0.99;0.32)
0.14
(0.12;0.13)
0.90
(>0.99;0.24)
0.19
(0.20;0.13)
0.96
(>0.99;0.15)
0.24
(0.26;0.13)
UPT 0.86
(>0.99;0.26)
0.10
(0;0.15)
0.05
(0;0.10)
0.79
(0.91;0.29)
0.08
(0;0.13)
0.97
(>0.99;0.12)
0.15
(0.12;0.15)
0.99
(>0.99;0.03)
0.21
(0.23;0.15)
>0.99
(>0.99;0.04)
0.26
(0.28;0.14)
*Note that Sensitivity is not meaningful under the null hypothesis
Table 5: Scenario 2 Sensitivity and False Positive Rates of Permutation Test Methods under Alternative Hypotheses.