Primary analysis–Putting accuracy during post-tests
re_post.model.no.outliers <- aov_ez("id","re", at_no.outliers.putt.heart.long %>% filter(at_no.outliers.putt.heart.long$phase == "lp" | phase =="mp" | phase == "hp"), between = "group", within = "phase", anova_table = list(es = "pes"))
summary(re_post.model.no.outliers)
##
## Univariate Type III Repeated-Measures ANOVA Assuming Sphericity
##
## Sum Sq num Df Error SS den Df F value Pr(>F)
## (Intercept) 495513 1 28622 78 1350.3481 < 2e-16 ***
## group 428 1 28622 78 1.1652 0.28371
## phase 467 2 20892 156 1.7440 0.17821
## group:phase 2564 2 20892 156 9.5715 0.00012 ***
## ---
## Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
##
##
## Mauchly Tests for Sphericity
##
## Test statistic p-value
## phase 0.83307 0.00088375
## group:phase 0.83307 0.00088375
##
##
## Greenhouse-Geisser and Huynh-Feldt Corrections
## for Departure from Sphericity
##
## GG eps Pr(>F[GG])
## phase 0.85695 0.1833016
## group:phase 0.85695 0.0002921 ***
## ---
## Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
##
## HF eps Pr(>F[HF])
## phase 0.8743306 0.1827155275
## group:phase 0.8743306 0.0002621456
knitr::kable(nice(re_post.model.no.outliers), "pipe")
| Effect | df | MSE | F | pes | p.value |
|---|---|---|---|---|---|
| group | 1, 78 | 366.95 | 1.17 | .015 | .284 |
| phase | 1.71, 133.68 | 156.28 | 1.74 | .022 | .183 |
| group:phase | 1.71, 133.68 | 156.28 | 9.57 *** | .109 | <.001 |
The Group x Post-test interaction was significant, so separate ANOVAs (post-test) were conducted for each group.
AT group
re_post.model.no.outliers.at <- aov_ez("id", "re", at_no.outliers.putt.heart.long %>% filter(at_no.outliers.putt.heart.long$group == "at", at_no.outliers.putt.heart.long$phase == "lp" | phase =="mp" | phase == "hp"), within = "phase", anova_table = list(es = "pes"))
summary(re_post.model.no.outliers.at)
##
## Univariate Type III Repeated-Measures ANOVA Assuming Sphericity
##
## Sum Sq num Df Error SS den Df F value Pr(>F)
## (Intercept) 239400 1 12823 40 746.771 <2e-16 ***
## phase 436 2 12417 80 1.403 0.2518
## ---
## Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
##
##
## Mauchly Tests for Sphericity
##
## Test statistic p-value
## phase 0.83067 0.026846
##
##
## Greenhouse-Geisser and Huynh-Feldt Corrections
## for Departure from Sphericity
##
## GG eps Pr(>F[GG])
## phase 0.85519 0.252
##
## HF eps Pr(>F[HF])
## phase 0.8896116 0.2520897
knitr::kable(nice(re_post.model.no.outliers.at), "pipe")
| Effect | df | MSE | F | pes | p.value |
|---|---|---|---|---|---|
| phase | 1.71, 68.42 | 181.49 | 1.40 | .034 | .252 |
Control group
re_post.model.no.outliers.cg <- aov_ez("id", "re", at_no.outliers.putt.heart.long %>% filter(at_no.outliers.putt.heart.long$group == "cg", at_no.outliers.putt.heart.long$phase == "lp" | phase =="mp" | phase == "hp"), within = "phase", anova_table = list(es = "pes"))
summary(re_post.model.no.outliers.cg)
##
## Univariate Type III Repeated-Measures ANOVA Assuming Sphericity
##
## Sum Sq num Df Error SS den Df F value Pr(>F)
## (Intercept) 256123 1 15799.1 38 616.03 < 2.2e-16 ***
## phase 2543 2 8475.1 76 11.40 4.678e-05 ***
## ---
## Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
##
##
## Mauchly Tests for Sphericity
##
## Test statistic p-value
## phase 0.83653 0.036807
##
##
## Greenhouse-Geisser and Huynh-Feldt Corrections
## for Departure from Sphericity
##
## GG eps Pr(>F[GG])
## phase 0.8595 0.0001276 ***
## ---
## Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
##
## HF eps Pr(>F[HF])
## phase 0.8963505 9.805553e-05
knitr::kable(nice(re_post.model.no.outliers.cg), "pipe")
| Effect | df | MSE | F | pes | p.value |
|---|---|---|---|---|---|
| phase | 1.72, 65.32 | 129.74 | 11.40 *** | .231 | <.001 |
There was a significant effect of post-test for the control group, so paired t-tests were conducted between each pair of post-tests. A Bonferonni correction should be applied to the p-values below. The two-tailed (as opposed to one-tailed) t-tests and Bonferroni corrections (as opposed to no corrections) deviate from our analysis plan and were done at the recommendation of an anonymous reviewer.
t.test(re ~ phase, at_no.outliers.putt.heart.long %>%
filter(at_no.outliers.putt.heart.long$group == "cg", at_no.outliers.putt.heart.long$phase == "lp" | phase == "mp"), paired = TRUE)
##
## Paired t-test
##
## data: re by phase
## t = -3.135, df = 38, p-value = 0.003309
## alternative hypothesis: true difference in means is not equal to 0
## 95 percent confidence interval:
## -9.565998 -2.059131
## sample estimates:
## mean of the differences
## -5.812564
t.test(re ~ phase, at_no.outliers.putt.heart.long %>%
filter(at_no.outliers.putt.heart.long$group == "cg", at_no.outliers.putt.heart.long$phase == "lp" | phase == "hp"), paired = TRUE)
##
## Paired t-test
##
## data: re by phase
## t = 4.4678, df = 38, p-value = 6.891e-05
## alternative hypothesis: true difference in means is not equal to 0
## 95 percent confidence interval:
## 6.244472 16.591938
## sample estimates:
## mean of the differences
## 11.41821
t.test(re ~ phase, at_no.outliers.putt.heart.long %>%
filter(at_no.outliers.putt.heart.long$group == "cg", at_no.outliers.putt.heart.long$phase == "mp" | phase == "hp"), paired = TRUE)
##
## Paired t-test
##
## data: re by phase
## t = 2.091, df = 38, p-value = 0.04326
## alternative hypothesis: true difference in means is not equal to 0
## 95 percent confidence interval:
## 0.1786328 11.0326493
## sample estimates:
## mean of the differences
## 5.605641
Effect sizes were calculated for the paired-t-tests.
cohen.d(re ~ phase, at_no.outliers.putt.heart.long %>%
filter(at_no.outliers.putt.heart.long$group == "cg", at_no.outliers.putt.heart.long$phase == "lp" | phase == "mp"), paired=TRUE, hedges.correction=TRUE)
##
## Hedges's g
##
## g estimate: -0.3770054 (small)
## 95 percent confidence interval:
## lower upper
## -0.6248843 -0.1291264
cohen.d(re ~ phase, at_no.outliers.putt.heart.long %>%
filter(at_no.outliers.putt.heart.long$group == "cg", at_no.outliers.putt.heart.long$phase == "lp" | phase == "hp"), paired=TRUE, hedges.correction=TRUE)
##
## Hedges's g
##
## g estimate: 0.7958023 (medium)
## 95 percent confidence interval:
## lower upper
## 0.3887319 1.2028727
cohen.d(re ~ phase, at_no.outliers.putt.heart.long %>%
filter(at_no.outliers.putt.heart.long$group == "cg", at_no.outliers.putt.heart.long$phase == "mp" | phase == "hp"), paired=TRUE, hedges.correction=TRUE)
##
## Hedges's g
##
## g estimate: 0.3361817 (small)
## 95 percent confidence interval:
## lower upper
## 0.007050725 0.665312628
Because of the significant Group x Post-test interaction, t-tests were conducted between groups for each post-test. We deviated from our analysis plan at the recommendation of an anonymous reviewer to make all t-tests two-tailed. Additionally, a Bonferroni correction should be applied to p-values below, which is a deviation from our analysis plan and done at the recommendation of an anonymous reviewer.
t.test(re ~ group, at_no.outliers.putt.heart.long %>%
filter(at_no.outliers.putt.heart.long$phase == "lp"), paired = FALSE)
##
## Welch Two Sample t-test
##
## data: re by group
## t = 1.9018, df = 72.453, p-value = 0.06117
## alternative hypothesis: true difference in means between group at and group cg is not equal to 0
## 95 percent confidence interval:
## -0.2534498 10.8008545
## sample estimates:
## mean in group at mean in group cg
## 46.3178 41.0441
t.test(re ~ group, at_no.outliers.putt.heart.long %>%
filter(at_no.outliers.putt.heart.long$phase == "mp"), alternative = "less", paired = FALSE)
##
## Welch Two Sample t-test
##
## data: re by group
## t = -0.74771, df = 75.064, p-value = 0.2285
## alternative hypothesis: true difference in means between group at and group cg is less than 0
## 95 percent confidence interval:
## -Inf 3.121726
## sample estimates:
## mean in group at mean in group cg
## 44.31317 46.85667
t.test(re ~ group, at_no.outliers.putt.heart.long %>%
filter(at_no.outliers.putt.heart.long$phase == "hp"), alternative = "less", paired = FALSE)
##
## Welch Two Sample t-test
##
## data: re by group
## t = -3.037, df = 76.676, p-value = 0.001632
## alternative hypothesis: true difference in means between group at and group cg is less than 0
## 95 percent confidence interval:
## -Inf -4.852671
## sample estimates:
## mean in group at mean in group cg
## 41.72098 52.46231
Effect sizes were calculated for the t-tests.
cohen.d(re_lp ~ group, at_no.outliers, hedges.correction=TRUE)
##
## Hedges's g
##
## g estimate: 0.4178456 (small)
## 95 percent confidence interval:
## lower upper
## -0.02794838 0.86363962
cohen.d(re_mp ~ group, at_no.outliers, hedges.correction=TRUE)
##
## Hedges's g
##
## g estimate: -0.1662531 (negligible)
## 95 percent confidence interval:
## lower upper
## -0.6080244 0.2755181
cohen.d(re_hp ~ group, at_no.outliers, hedges.correction=TRUE)
##
## Hedges's g
##
## g estimate: -0.6741381 (medium)
## 95 percent confidence interval:
## lower upper
## -1.1274944 -0.2207817
Putting accuracy figure
Creating figure
re_plot.no.outliers<-aov_ez("id", "re", at_no.outliers.putt.heart.fig.long, between = "group", within = "phase")
afex_plot(re_plot.no.outliers, x = "phase", panel = "group", error = "within",
point_arg = list(size = 2),
error_arg = list(size = 1, width = 0),
factor_levels = list(phase = c("Pre-Test", "Prac 1 Early", "Prac 1 Mid", "Prac 1 Late", "Prac 2 Early", "Prac 2 Mid", "Prac 2 Late", "LP Post-Test", "MP Post-Test", "HP Post-Test"), group = (c("Anxiety Training", "Control")))) +
labs(y = "Radial Error (cm)", x = "Phase") +
theme_bw(base_size = 15) +
geom_line(aes(group = 10), size = 1) +
theme(axis.text.x = element_text(angle = 90))
ggsave(here("output", "re_phase.group.no.outliers.png"))