Hypothesis Testing Method |
Abbreviation |
Description |
Significance Cutoff |
Approximate Chi-Square Test |
ACST |
Compare the model deviance statistic to an approximate chi-square distribution. |
0.0125 |
Conditional Permutation Test |
CPT |
Select optimal span size for observed data by minimizing AIC statistic across range of spans. Compare difference in deviance statistic to conditional permutation distribution obtained by holding span size constant. |
0.025 |
Fixed Span Permutation Test |
FSPT |
Select span size a priori. Compare difference in deviance statistic to conditional permutation distribution obtained by holding span size constant. |
0.05 |
Fixed Multiple Span Permutation Test |
FMSPT |
Select 3-5 span sizes a priori. For each span size, compare the difference in deviance statistic to corresponding conditional permutation distribution obtained by holding the span size constant. Reject the null hypothesis if at least one p-value falls below the significance cutoff. |
 |
Unconditional Permutation Test |
UPT |
Select optimal span size for observed data as in CPT. Compare difference in deviance statistic to unconditional permutation distribution obtained by selecting optimal span size for each permuted dataset. |
0.05 |