Hypothesis Testing Method Abbreviation Description Significance Cutoff
Approximate Chi-Square Test ACST Compare the model deviance statistic to an approximate chi-square distribution. 0.0125
Conditional Permutation Test CPT Select optimal span size for observed data by minimizing AIC statistic across range of spans. Compare difference in deviance statistic to conditional permutation distribution obtained by holding span size constant. 0.025
Fixed Span Permutation Test FSPT Select span size a priori. Compare difference in deviance statistic to conditional permutation distribution obtained by holding span size constant. 0.05
Fixed Multiple Span Permutation Test FMSPT Select 3-5 span sizes a priori. For each span size, compare the difference in deviance statistic to corresponding conditional permutation distribution obtained by holding the span size constant. Reject the null hypothesis if at least one p-value falls below the significance cutoff.
Unconditional Permutation Test UPT Select optimal span size for observed data as in CPT. Compare difference in deviance statistic to unconditional permutation distribution obtained by selecting optimal span size for each permuted dataset. 0.05
Table 1: Description of Hypothesis Testing Methods and Significance Cutoffs.