Odds Ratios

 

0.25

1.0*

2.0

3.0

4.0

5.0


 

Sensitivity

False Positive

False Positive

Sensitivity

False Positive

Sensitivity

False Positive

Sensitivity

False Positive

Sensitivity

False Positive

 

Mean (Median;Std)

Mean (Median;Std)

Mean (Median;Std)

Mean (Median;Std)

Mean (Median;Std)

Mean (Median;Std)

Mean (Median;Std)

Mean (Median;Std)

Mean (Median;Std)

Mean (Median;Std)

Mean (Median;Std)

CPT

0.73
(0.95;0.39)

0.09
(0.05;0.11)

0.07
(0;0.10)

0.64
(0.79;0.38)

0.08
(0.04;0.11)

0.86
(>0.99;0.27)

0.13
(0.11;0.11)

0.97
(>0.99;0.1)

0.15
(0.13;0.11)

0.99
(>0.99;0.08)

0.16
(0.14;0.10)

FSPT

 

 

 

 

 

 

 

 

 

 

 

Span = 0.1

0.71
(0.84;0.33)

0.06
(0.06;0.04)

0.05
(0.05;0.03)

0.58
(0.67;0.32)

0.06
(0.05;0.03)

0.87
(0.95;0.2)

0.07
(0.07;0.04)

0.96
(>0.99;0.09)

0.08
(0.08;0.03)

0.98
(>0.99;0.06)

0.09
(0.09;0.03)

Span = 0.3

0.72
(0.88;0.36)

0.07
(0.06;0.07)

0.06
(0.04;0.06)

0.61
(0.79;0.39)

0.07
(0.05;0.06)

0.88
(>0.99;0.25)

0.10
(0.09;0.07)

0.97
(>0.99;0.11)

0.12
(0.11;0.06)

0.99
(>0.99;0.07)

0.14
(0.14;0.06)

Span = 0.5

0.70
(0.93;0.38)

0.08
(0.05;0.09)

0.06
(0.02;0.08)

0.65
(0.86;0.40)

0.08
(0.04;0.09)

0.80
(>0.99;0.33)

0.13
(0.12;0.11)

0.94
(>0.99;0.17)

0.17
(0.17;0.11)

0.96
(>0.99;0.16)

0.21
(0.22;0.11)

Span = 0.7

0.64
(0.98;0.43)

0.09
(0.03;0.11)

0.06
(0;0.09)

0.67
(0.95;0.41)

0.09
(0.03;0.11)

0.83
(>0.99;0.32)

0.16
(0.15;0.13)

0.92
(>0.99;0.2)

0.22
(0.23;0.13)

0.97
(>0.99;0.11)

0.27
(0.29;0.13)

Span = 0.9

0.68
(>0.99;0.43)

0.08
(0;0.11)

0.06
(0;0.10)

0.61
(0.79;0.43)

0.08
(0;0.11)

0.83
(>0.99;0.32)

0.14
(0.12;0.13)

0.90
(>0.99;0.24)

0.19
(0.20;0.13)

0.96
(>0.99;0.15)

0.24
(0.26;0.13)

UPT

0.86
(>0.99;0.26)

0.10
(0;0.15)

0.05
(0;0.10)

0.79
(0.91;0.29)

0.08
(0;0.13)

0.97
(>0.99;0.12)

0.15
(0.12;0.15)

0.99
(>0.99;0.03)

0.21
(0.23;0.15)

>0.99
(>0.99;0.04)

0.26
(0.28;0.14)

*Note that Sensitivity is not meaningful under the null hypothesis
Table 5: Scenario 2 Sensitivity and False Positive Rates of Permutation Test Methods under Alternative Hypotheses.