Odds Ratios

 

0.5

1.0*

1.5

2.0

2.5

3.0

 

Sensitivity

False Positive

False Positive

Sensitivity

False Positive

Sensitivity

False Positive

Sensitivity

False Positive

Sensitivity

False Positive

 

Mean (Median;Std)

Mean (Median;Std)

Mean (Median;Std)

Mean (Median;Std)

Mean (Median;Std)

Mean (Median;Std)

Mean (Median;Std)

Mean (Median;Std)

Mean (Median;Std)

Mean (Median;Std)

Mean (Median;Std)

CPT

0.88
(>0.99;0.27)

0.14
(0.11;0.13)

0.06
(0;0.09)

0.65
(0.91;0.4)

0.11
(0.09;0.12)

0.93
(>0.99;0.21)

0.21
(0.21;0.13)

0.98
(>0.99;0.1)

0.28
(0.28;0.11)

0.99
(>0.99;0.08)

0.31
(0.3;0.11)

FSPT

 

 

 

 

 

 

 

 

 

 

 

Span = 0.1

0.55
(0.6;0.35)

0.08
(0.08;0.05)

0.05
(0.05;0.03)

0.38
(0.26;0.36)

0.07
(0.06;0.04)

0.64
(0.74;0.34)

0.10
(0.10;0.04)

0.78
(0.91;0.27)

0.14
(0.14;0.04)

0.89
(>0.99;0.21)

0.17
(0.17;0.04)

Span = 0.3

0.91
(>0.99;0.2)

0.11
(0.1;0.09)

0.05
(0.04;0.06)

0.66
(0.79;0.37)

0.08
(0.07;0.07)

0.96
(>0.99;0.12)

0.14
(0.14;0.08)

0.99
(>0.99;0.06)

0.20
(0.20;0.07)

>0.99 (>0.99;0.02)

0.24
(0.24;0.06)

Span = 0.5

0.89
(>0.99;0.27)

0.14
(0.12;0.12)

0.05
(0.01;0.07)

0.75
(0.98;0.34)

0.10
(0.09;0.10)

0.97
(>0.99;0.13)

0.20
(0.21;0.12)

0.99
(>0.99;0.06)

0.29
(0.30;0.09)

>0.99 (>0.99;0.01)

0.35
(0.36;0.08)

Span = 0.7

0.86
(>0.99;0.31)

0.15
(0.13;0.14)

0.05
(0;0.08)

0.77
(>0.99;0.36)

0.12
(0.09;0.12)

0.96
(>0.99;0.14)

0.24
(0.26;0.14)

0.99
(>0.99;0.07)

0.35
(0.37;0.1)

>0.99
(>0.99;0.01)

0.41
(0.42;0.08)

Span = 0.9

0.84
(>0.99;0.33)

0.13
(0.1;0.13)

0.05
(0;0.09)

0.78
(>0.99;0.36)

0.11
(0.07;0.12)

0.95
(>0.99;0.2)

0.22
(0.24;0.14)

0.99
(>0.99;0.07)

0.33
(0.35;0.11)

>0.99 (>0.99;0.01)

0.39
(0.39;0.08)

UPT

0.95
(>0.99;0.15)

0.13
(0.04;0.16)

0.05
(0;0.10)

0.76
(0.95;0.33)

0.10
(0.01;0.13)

0.97
(>0.99;0.1)

0.22
(0.24;0.16)

>0.99
(>0.99;0.03)

0.33
(0.35;0.12)

>0.99 (>0.99;0.03)

0.38
(0.39;0.09)

*Note that Sensitivity is not meaningful under the null hypothesis
Table 4: Scenario 1 Sensitivity and False Positive Rates of Permutation Test Methods under Alternative Hypotheses.