Hypothesis Testing Method

Abbreviation

Description

Significance Cutoff

Approximate Chi-Square Test

ACST

Compare the model deviance statistic to an approximate chi-square distribution.

0.0125

Conditional Permutation Test

CPT

Select optimal span size for observed data by minimizing AIC statistic across range of spans. Compare difference in deviance statistic to conditional permutation distribution obtained by holding span size constant.

0.025

Fixed Span Permutation Test

FSPT

Select span size a priori. Compare difference in deviance statistic to conditional permutation distribution obtained by holding span size constant.

0.05

Fixed Multiple Span Permutation Test

FMSPT

Select 3-5 span sizes a priori. For each span size, compare the difference in deviance statistic to corresponding conditional permutation distribution obtained by holding the span size constant. Reject the null hypothesis if at least one p-value falls below the significance cutoff.

Unconditional Permutation Test

UPT

Select optimal span size for observed data as in CPT. Compare difference in deviance statistic to unconditional permutation distribution obtained by selecting optimal span size for each permuted dataset.

0.05

Table 1: Description of Hypothesis Testing Methods and Significance Cutoffs.