Study 1c Report
18 January, 2023
Test for Manipulation check Item #1
Descriptive statistics:
group1 mean sd se
X11 harsh 3.35 0.95 0.16
X12 mastery 3.72 0.92 0.17
X13 mild 3.26 1.11 0.19
ANOVA test:
Df Sum Sq Mean Sq F value Pr(>F)
cond1 2 3.67 1.8334 1.836 0.165
Residuals 97 96.84 0.9984
Post-hoc (Tukey test)
diff lwr upr p adj
mastery-harsh 0.373 -0.22 0.96 0.29
mild-harsh -0.087 -0.65 0.48 0.93
mild-mastery -0.459 -1.06 0.14 0.17
Test for Manipulation check Item #2
Descriptive statistics:
group1 mean sd se
X11 harsh 1.84 0.87 0.14
X12 mastery 1.38 0.68 0.13
X13 mild 1.53 0.61 0.11
ANOVA test:
Df Sum Sq Mean Sq F value Pr(>F)
cond1 2 3.67 1.8374 3.406 0.0372 *
Residuals 97 52.33 0.5394
---
Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
Post-hoc (Tukey test)
diff lwr upr p adj
mastery-harsh -0.46 -0.89 -0.025 0.036
mild-harsh -0.31 -0.72 0.107 0.186
mild-mastery 0.15 -0.29 0.592 0.699
DV: Perceived competence
Descriptive statistics:
group1 mean sd se
X11 harsh 1.77 0.69 0.11
X12 mastery 2.37 0.80 0.15
X13 mild 1.83 0.72 0.12
ANOVA test:
Df Sum Sq Mean Sq F value Pr(>F)
cond1 2 6.76 3.382 6.269 0.00275 **
Residuals 97 52.32 0.539
---
Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
Post-hoc (Tukey test)
diff lwr upr p adj
mastery-harsh 0.602 0.17 1.036 0.0038
mild-harsh 0.068 -0.35 0.483 0.9207
mild-mastery -0.534 -0.98 -0.093 0.0135
DV: Enjoyment
Descriptive statistics:
group1 mean sd se
X11 harsh 3.56 1.04 0.17
X12 mastery 3.91 0.75 0.14
X13 mild 3.40 1.10 0.19
ANOVA test:
Df Sum Sq Mean Sq F value Pr(>F)
cond1 2 4.14 2.0722 2.115 0.126
Residuals 97 95.05 0.9799
Post-hoc (Tukey test)
diff lwr upr p adj
mastery-harsh 0.35 -0.23 0.934 0.33
mild-harsh -0.16 -0.72 0.403 0.78
mild-mastery -0.51 -1.10 0.089 0.11
DV: Perceived Usefulness
Descriptive statistics:
group1 mean sd se
X11 harsh 3.71 0.92 0.15
X12 mastery 3.90 0.67 0.12
X13 mild 3.21 0.97 0.17
ANOVA test:
Df Sum Sq Mean Sq F value Pr(>F)
cond1 2 8.29 4.144 5.461 0.00566 **
Residuals 97 73.62 0.759
---
Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
Post-hoc (Tukey test)
diff lwr upr p adj
mastery-harsh 0.18 -0.33 0.699 0.6695
mild-harsh -0.51 -1.00 -0.013 0.0428
mild-mastery -0.69 -1.21 -0.167 0.0064
DV: Perceived Pressure
Descriptive statistics:
group1 mean sd se
X11 harsh 3.21 1.22 0.20
X12 mastery 2.55 1.00 0.19
X13 mild 2.58 1.39 0.24
ANOVA test:
Df Sum Sq Mean Sq F value Pr(>F)
cond1 2 9.59 4.795 3.201 0.0451 *
Residuals 97 145.32 1.498
---
Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
Post-hoc (Tukey test)
diff lwr upr p adj
mastery-harsh -0.655 -1.38 0.067 0.084
mild-harsh -0.629 -1.32 0.063 0.083
mild-mastery 0.027 -0.71 0.763 0.996
DV: Extra attempt
Descriptive statistics:
group1 mean sd se
X11 harsh 0.81 0.40 0.07
X12 mastery 0.86 0.35 0.07
X13 mild 0.76 0.43 0.07
ANOVA test:
Df Sum Sq Mean Sq F value Pr(>F)
cond1 2 0.148 0.0742 0.472 0.625
Residuals 97 15.242 0.1571
Post-hoc (Tukey test)
diff lwr upr p adj
mastery-harsh 0.051 -0.18 0.29 0.86
mild-harsh -0.046 -0.27 0.18 0.88
mild-mastery -0.097 -0.34 0.14 0.60
DV: Time Dedicated to Puzzles (in seconds)
$ANOVA
Effect DFn DFd SSn SSd F p p<.05 ges
1 (Intercept) 1 97 19264279 495291 3772.800 1.86e-79 * 0.95064
2 cond 2 97 4026 495291 0.394 6.75e-01 0.00401
3 time 2 194 353956 504893 68.002 4.17e-23 * 0.26139
4 cond:time 4 194 6175 504893 0.593 6.68e-01 0.00614
$`Mauchly's Test for Sphericity`
Effect W p p<.05
3 time 0.637 4.03e-10 *
4 cond:time 0.637 4.03e-10 *
$`Sphericity Corrections`
Effect GGe p[GG] p[GG]<.05 HFe p[HF] p[HF]<.05
3 time 0.734 1.23e-17 * 0.742 8.21e-18 *
4 cond:time 0.734 6.17e-01 0.742 6.19e-01
Changes in dedication (in seconds) across time:
Post-hoc comparisons:
Get the means per session, per condition:
time cond1 emmean SE df lower.CL upper.CL
1 harsh 208 9.64 291 189 227
2 harsh 273 9.64 291 254 292
3 harsh 282 9.64 291 263 301
1 mastery 213 10.89 291 191 234
2 mastery 280 10.89 291 259 302
3 mastery 281 10.89 291 259 302
1 mild 196 10.05 291 176 215
2 mild 264 10.05 291 244 283
3 mild 287 10.05 291 267 307
Confidence level used: 0.95
Comparisons per condition, collapsing for session:
time = 1:
contrast estimate SE df t.ratio p.value
harsh - mastery -4.28 14.5 291 -0.295 0.9533
harsh - mild 12.83 13.9 291 0.921 0.6273
mastery - mild 17.12 14.8 291 1.155 0.4811
time = 2:
contrast estimate SE df t.ratio p.value
harsh - mastery -7.54 14.5 291 -0.518 0.8624
harsh - mild 8.96 13.9 291 0.643 0.7962
mastery - mild 16.50 14.8 291 1.113 0.5066
time = 3:
contrast estimate SE df t.ratio p.value
harsh - mastery 1.07 14.5 291 0.073 0.9970
harsh - mild -5.20 13.9 291 -0.374 0.9260
mastery - mild -6.27 14.8 291 -0.423 0.9061
P value adjustment: tukey method for comparing a family of 3 estimates
Comparisons for consecutive measurements:
cond1 time contrast estimate SE df t.ratio p.value
harsh . time2 - time1 64.168 13.6 291 4.708 <.0001
harsh . time3 - time2 9.186 13.6 291 0.674 0.9959
mastery . time2 - time1 67.421 15.4 291 4.379 0.0002
mastery . time3 - time2 0.583 15.4 291 0.038 1.0000
mild . time2 - time1 68.038 14.2 291 4.785 <.0001
mild . time3 - time2 23.350 14.2 291 1.642 0.6050
. 1 mastery - harsh 4.284 14.5 291 0.295 1.0000
. 1 mild - mastery -17.116 14.8 291 -1.155 0.9031
. 2 mastery - harsh 7.537 14.5 291 0.518 0.9993
. 2 mild - mastery -16.499 14.8 291 -1.113 0.9191
. 3 mastery - harsh -1.066 14.5 291 -0.073 1.0000
. 3 mild - mastery 6.269 14.8 291 0.423 0.9998
P value adjustment: mvt method for 12 tests
Comparisons for consecutive interactions:
time_eff cond1_eff estimate SE df t.ratio p.value
1 effect harsh effect 2.201 6.62 291 0.333 0.9972
2 effect harsh effect -0.174 6.62 291 -0.026 1.0000
3 effect harsh effect -2.027 6.62 291 -0.306 0.9980
1 effect mastery effect 2.900 7.03 291 0.412 0.9937
2 effect mastery effect 3.779 7.03 291 0.537 0.9827
3 effect mastery effect -6.678 7.03 291 -0.949 0.8729
1 effect mild effect -5.101 6.75 291 -0.755 0.9409
2 effect mild effect -3.605 6.75 291 -0.534 0.9831
3 effect mild effect 8.706 6.75 291 1.289 0.6899
P value adjustment: mvt method for 9 tests
DV: Number of Movements
$ANOVA
Effect DFn DFd SSn SSd F p p<.05 ges
1 (Intercept) 1 97 3588539 203757 1708.354 2.16e-63 * 0.90974
2 cond 2 97 539 203757 0.128 8.80e-01 0.00151
3 time 2 194 66462 152284 42.334 5.54e-16 * 0.15730
4 cond:time 4 194 7452 152284 2.373 5.37e-02 0.02050
$`Mauchly's Test for Sphericity`
Effect W p p<.05
3 time 0.742 6.11e-07 *
4 cond:time 0.742 6.11e-07 *
$`Sphericity Corrections`
Effect GGe p[GG] p[GG]<.05 HFe p[HF] p[HF]<.05
3 time 0.795 3.30e-13 * 0.806 2.33e-13 *
4 cond:time 0.795 6.88e-02 0.806 6.79e-02
Changes in movements across time:
Post-hoc comparisons:
Get the means per session, per condition:
time cond1 emmean SE df lower.CL upper.CL
1 harsh 93.2 5.75 291 81.9 105
2 harsh 118.8 5.75 291 107.5 130
3 harsh 120.6 5.75 291 109.3 132
1 mastery 87.6 6.50 291 74.8 100
2 mastery 121.5 6.50 291 108.7 134
3 mastery 113.6 6.50 291 100.8 126
1 mild 84.2 6.00 291 72.4 96
2 mild 112.3 6.00 291 100.5 124
3 mild 131.4 6.00 291 119.5 143
Confidence level used: 0.95
Comparisons per condition, collapsing for session:
time = 1:
contrast estimate SE df t.ratio p.value
harsh - mastery 5.66 8.68 291 0.653 0.7908
harsh - mild 9.01 8.31 291 1.084 0.5246
mastery - mild 3.35 8.84 291 0.378 0.9241
time = 2:
contrast estimate SE df t.ratio p.value
harsh - mastery -2.70 8.68 291 -0.311 0.9481
harsh - mild 6.49 8.31 291 0.781 0.7150
mastery - mild 9.19 8.84 291 1.039 0.5527
time = 3:
contrast estimate SE df t.ratio p.value
harsh - mastery 7.00 8.68 291 0.807 0.6990
harsh - mild -10.73 8.31 291 -1.291 0.4012
mastery - mild -17.73 8.84 291 -2.006 0.1127
P value adjustment: tukey method for comparing a family of 3 estimates
Comparisons for consecutive measurements:
cond1 time contrast estimate SE df t.ratio p.value
harsh . time2 - time1 25.57 8.13 291 3.144 0.0196
harsh . time3 - time2 1.84 8.13 291 0.226 1.0000
mastery . time2 - time1 33.93 9.19 291 3.694 0.0030
mastery . time3 - time2 -7.86 9.19 291 -0.856 0.9811
mild . time2 - time1 28.09 8.48 291 3.311 0.0113
mild . time3 - time2 19.06 8.48 291 2.247 0.2189
. 1 mastery - harsh -5.66 8.68 291 -0.653 0.9967
. 1 mild - mastery -3.35 8.84 291 -0.378 0.9999
. 2 mastery - harsh 2.70 8.68 291 0.311 1.0000
. 2 mild - mastery -9.19 8.84 291 -1.039 0.9433
. 3 mastery - harsh -7.00 8.68 291 -0.807 0.9868
. 3 mild - mastery 17.73 8.84 291 2.006 0.3500
P value adjustment: mvt method for 12 tests
Comparisons for consecutive interactions:
time_eff cond1_eff estimate SE df t.ratio p.value
1 effect harsh effect 3.254 3.95 291 0.824 0.9201
2 effect harsh effect -0.374 3.95 291 -0.095 1.0000
3 effect harsh effect -2.881 3.95 291 -0.730 0.9475
1 effect mastery effect 0.912 4.20 291 0.217 0.9995
2 effect mastery effect 5.647 4.20 291 1.346 0.6543
3 effect mastery effect -6.559 4.20 291 -1.563 0.5123
1 effect mild effect -4.166 4.03 291 -1.034 0.8341
2 effect mild effect -5.274 4.03 291 -1.309 0.6777
3 effect mild effect 9.440 4.03 291 2.343 0.1281
P value adjustment: mvt method for 9 tests DV: Number of Assembled Pieces
$ANOVA
Effect DFn DFd SSn SSd F p p<.05 ges
1 (Intercept) 1 97 2028.00 296 664.987 3.31e-45 * 0.66517
2 cond 2 97 5.51 296 0.904 4.08e-01 0.00537
3 time 2 194 635.76 725 85.056 3.00e-27 * 0.38377
4 cond:time 4 194 21.87 725 1.463 2.15e-01 0.02098
$`Mauchly's Test for Sphericity`
Effect W p p<.05
3 time 0.597 1.81e-11 *
4 cond:time 0.597 1.81e-11 *
$`Sphericity Corrections`
Effect GGe p[GG] p[GG]<.05 HFe p[HF] p[HF]<.05
3 time 0.713 3.54e-20 * 0.721 2.29e-20 *
4 cond:time 0.713 2.29e-01 0.721 2.28e-01
Changes in assembled pieces across time:
Post-hoc comparisons:
Get the means per session, per condition:
time cond1 emmean SE df lower.CL upper.CL
1 harsh 4.65 0.308 291 4.043 5.25
2 harsh 1.43 0.308 291 0.826 2.04
3 harsh 1.97 0.308 291 1.367 2.58
1 mastery 5.31 0.348 291 4.626 5.99
2 mastery 1.17 0.348 291 0.488 1.86
3 mastery 1.66 0.348 291 0.971 2.34
1 mild 4.06 0.321 291 3.427 4.69
2 mild 1.38 0.321 291 0.750 2.01
3 mild 1.79 0.321 291 1.162 2.43
Confidence level used: 0.95
Comparisons per condition, collapsing for session:
time = 1:
contrast estimate SE df t.ratio p.value
harsh - mastery -0.6617 0.465 291 -1.424 0.3296
harsh - mild 0.5898 0.445 291 1.326 0.3821
mastery - mild 1.2515 0.473 291 2.643 0.0234
time = 2:
contrast estimate SE df t.ratio p.value
harsh - mastery 0.2600 0.465 291 0.560 0.8415
harsh - mild 0.0501 0.445 291 0.113 0.9930
mastery - mild -0.2099 0.473 291 -0.443 0.8973
time = 3:
contrast estimate SE df t.ratio p.value
harsh - mastery 0.3178 0.465 291 0.684 0.7729
harsh - mild 0.1789 0.445 291 0.402 0.9148
mastery - mild -0.1389 0.473 291 -0.293 0.9536
P value adjustment: tukey method for comparing a family of 3 estimates
Comparisons for consecutive measurements:
cond1 time contrast estimate SE df t.ratio p.value
harsh . time2 - time1 -3.216 0.435 291 -7.386 <.0001
harsh . time3 - time2 0.541 0.435 291 1.241 0.8641
mastery . time2 - time1 -4.138 0.492 291 -8.413 <.0001
mastery . time3 - time2 0.483 0.492 291 0.981 0.9584
mild . time2 - time1 -2.676 0.454 291 -5.892 <.0001
mild . time3 - time2 0.412 0.454 291 0.906 0.9735
. 1 mastery - harsh 0.662 0.465 291 1.424 0.7581
. 1 mild - mastery -1.252 0.473 291 -2.643 0.0845
. 2 mastery - harsh -0.260 0.465 291 -0.560 0.9988
. 2 mild - mastery 0.210 0.473 291 0.443 0.9998
. 3 mastery - harsh -0.318 0.465 291 -0.684 0.9954
. 3 mild - mastery 0.139 0.473 291 0.293 1.0000
P value adjustment: mvt method for 12 tests
Comparisons for consecutive interactions:
time_eff cond1_eff estimate SE df t.ratio p.value
1 effect harsh effect -0.1056 0.211 291 -0.500 0.9869
2 effect harsh effect 0.0217 0.211 291 0.103 1.0000
3 effect harsh effect 0.0839 0.211 291 0.397 0.9945
1 effect mastery effect 0.5281 0.225 291 2.350 0.1265
2 effect mastery effect -0.2663 0.225 291 -1.185 0.7532
3 effect mastery effect -0.2619 0.225 291 -1.165 0.7642
1 effect mild effect -0.4225 0.216 291 -1.958 0.2804
2 effect mild effect 0.2446 0.216 291 1.133 0.7821
3 effect mild effect 0.1780 0.216 291 0.825 0.9200
P value adjustment: mvt method for 9 tests