tg-matcher 2: Preliminary analysis
Experiment
Boring stuff
Read in data
Bonus
Timing
This is clock time over the whole experiment (paying attention or not)
How long are individual trials taking?
if we exclude the > than 1 minute ones (as plausible got distracted doing other things), mean rts:
So, 10ish seconds per trial generally.
Accuracy
Average accuracy is lower than in experiment 1 with moderate person-to-person variability.
And two people who guessed randomly sigh.
Key question is whether there are differences between the conditions. Here’s mean accuracy and bootstrapped 95% CIs in each condition.
And plot with per-participant small dots.
Tangrams vary a lot in guessability.
Models!
predict accuracy as a function of:
- group size x round
- nuisance variable of trial (might get better over time)
- size x round | tangram
- size x round + trial | participant
## Family: bernoulli
## Links: mu = logit
## Formula: correct ~ group_size * thickness * round + trial_order + (group_size * thickness * round | correct_tangram) + (group_size * thickness * round + trial_order | workerid)
## Data: good_stuff (Number of observations: 3840)
## Draws: 4 chains, each with iter = 2000; warmup = 1000; thin = 1;
## total post-warmup draws = 4000
##
## Group-Level Effects:
## ~correct_tangram (Number of levels: 12)
## Estimate
## sd(Intercept) 0.81
## sd(group_size6_player) 0.13
## sd(thicknessthin) 0.13
## sd(roundround_6) 0.17
## sd(group_size6_player:thicknessthin) 0.14
## sd(group_size6_player:roundround_6) 0.15
## sd(thicknessthin:roundround_6) 0.24
## sd(group_size6_player:thicknessthin:roundround_6) 0.28
## cor(Intercept,group_size6_player) 0.06
## cor(Intercept,thicknessthin) -0.02
## cor(group_size6_player,thicknessthin) 0.01
## cor(Intercept,roundround_6) -0.06
## cor(group_size6_player,roundround_6) 0.00
## cor(thicknessthin,roundround_6) -0.02
## cor(Intercept,group_size6_player:thicknessthin) -0.01
## cor(group_size6_player,group_size6_player:thicknessthin) -0.06
## cor(thicknessthin,group_size6_player:thicknessthin) -0.02
## cor(roundround_6,group_size6_player:thicknessthin) -0.01
## cor(Intercept,group_size6_player:roundround_6) 0.12
## cor(group_size6_player,group_size6_player:roundround_6) -0.04
## cor(thicknessthin,group_size6_player:roundround_6) 0.00
## cor(roundround_6,group_size6_player:roundround_6) -0.07
## cor(group_size6_player:thicknessthin,group_size6_player:roundround_6) -0.03
## cor(Intercept,thicknessthin:roundround_6) -0.11
## cor(group_size6_player,thicknessthin:roundround_6) -0.04
## cor(thicknessthin,thicknessthin:roundround_6) -0.03
## cor(roundround_6,thicknessthin:roundround_6) -0.06
## cor(group_size6_player:thicknessthin,thicknessthin:roundround_6) 0.03
## cor(group_size6_player:roundround_6,thicknessthin:roundround_6) -0.05
## cor(Intercept,group_size6_player:thicknessthin:roundround_6) 0.01
## cor(group_size6_player,group_size6_player:thicknessthin:roundround_6) -0.05
## cor(thicknessthin,group_size6_player:thicknessthin:roundround_6) 0.06
## cor(roundround_6,group_size6_player:thicknessthin:roundround_6) -0.08
## cor(group_size6_player:thicknessthin,group_size6_player:thicknessthin:roundround_6) -0.01
## cor(group_size6_player:roundround_6,group_size6_player:thicknessthin:roundround_6) -0.08
## cor(thicknessthin:roundround_6,group_size6_player:thicknessthin:roundround_6) -0.01
## Est.Error
## sd(Intercept) 0.20
## sd(group_size6_player) 0.10
## sd(thicknessthin) 0.10
## sd(roundround_6) 0.12
## sd(group_size6_player:thicknessthin) 0.11
## sd(group_size6_player:roundround_6) 0.11
## sd(thicknessthin:roundround_6) 0.16
## sd(group_size6_player:thicknessthin:roundround_6) 0.20
## cor(Intercept,group_size6_player) 0.33
## cor(Intercept,thicknessthin) 0.32
## cor(group_size6_player,thicknessthin) 0.34
## cor(Intercept,roundround_6) 0.31
## cor(group_size6_player,roundround_6) 0.33
## cor(thicknessthin,roundround_6) 0.33
## cor(Intercept,group_size6_player:thicknessthin) 0.32
## cor(group_size6_player,group_size6_player:thicknessthin) 0.34
## cor(thicknessthin,group_size6_player:thicknessthin) 0.34
## cor(roundround_6,group_size6_player:thicknessthin) 0.33
## cor(Intercept,group_size6_player:roundround_6) 0.33
## cor(group_size6_player,group_size6_player:roundround_6) 0.33
## cor(thicknessthin,group_size6_player:roundround_6) 0.33
## cor(roundround_6,group_size6_player:roundround_6) 0.33
## cor(group_size6_player:thicknessthin,group_size6_player:roundround_6) 0.33
## cor(Intercept,thicknessthin:roundround_6) 0.31
## cor(group_size6_player,thicknessthin:roundround_6) 0.33
## cor(thicknessthin,thicknessthin:roundround_6) 0.34
## cor(roundround_6,thicknessthin:roundround_6) 0.33
## cor(group_size6_player:thicknessthin,thicknessthin:roundround_6) 0.34
## cor(group_size6_player:roundround_6,thicknessthin:roundround_6) 0.33
## cor(Intercept,group_size6_player:thicknessthin:roundround_6) 0.31
## cor(group_size6_player,group_size6_player:thicknessthin:roundround_6) 0.34
## cor(thicknessthin,group_size6_player:thicknessthin:roundround_6) 0.34
## cor(roundround_6,group_size6_player:thicknessthin:roundround_6) 0.33
## cor(group_size6_player:thicknessthin,group_size6_player:thicknessthin:roundround_6) 0.33
## cor(group_size6_player:roundround_6,group_size6_player:thicknessthin:roundround_6) 0.34
## cor(thicknessthin:roundround_6,group_size6_player:thicknessthin:roundround_6) 0.33
## l-95% CI
## sd(Intercept) 0.51
## sd(group_size6_player) 0.00
## sd(thicknessthin) 0.00
## sd(roundround_6) 0.01
## sd(group_size6_player:thicknessthin) 0.01
## sd(group_size6_player:roundround_6) 0.01
## sd(thicknessthin:roundround_6) 0.01
## sd(group_size6_player:thicknessthin:roundround_6) 0.02
## cor(Intercept,group_size6_player) -0.57
## cor(Intercept,thicknessthin) -0.61
## cor(group_size6_player,thicknessthin) -0.62
## cor(Intercept,roundround_6) -0.62
## cor(group_size6_player,roundround_6) -0.62
## cor(thicknessthin,roundround_6) -0.63
## cor(Intercept,group_size6_player:thicknessthin) -0.62
## cor(group_size6_player,group_size6_player:thicknessthin) -0.70
## cor(thicknessthin,group_size6_player:thicknessthin) -0.65
## cor(roundround_6,group_size6_player:thicknessthin) -0.63
## cor(Intercept,group_size6_player:roundround_6) -0.54
## cor(group_size6_player,group_size6_player:roundround_6) -0.66
## cor(thicknessthin,group_size6_player:roundround_6) -0.62
## cor(roundround_6,group_size6_player:roundround_6) -0.69
## cor(group_size6_player:thicknessthin,group_size6_player:roundround_6) -0.64
## cor(Intercept,thicknessthin:roundround_6) -0.68
## cor(group_size6_player,thicknessthin:roundround_6) -0.65
## cor(thicknessthin,thicknessthin:roundround_6) -0.69
## cor(roundround_6,thicknessthin:roundround_6) -0.68
## cor(group_size6_player:thicknessthin,thicknessthin:roundround_6) -0.62
## cor(group_size6_player:roundround_6,thicknessthin:roundround_6) -0.66
## cor(Intercept,group_size6_player:thicknessthin:roundround_6) -0.59
## cor(group_size6_player,group_size6_player:thicknessthin:roundround_6) -0.69
## cor(thicknessthin,group_size6_player:thicknessthin:roundround_6) -0.60
## cor(roundround_6,group_size6_player:thicknessthin:roundround_6) -0.68
## cor(group_size6_player:thicknessthin,group_size6_player:thicknessthin:roundround_6) -0.64
## cor(group_size6_player:roundround_6,group_size6_player:thicknessthin:roundround_6) -0.70
## cor(thicknessthin:roundround_6,group_size6_player:thicknessthin:roundround_6) -0.62
## u-95% CI
## sd(Intercept) 1.28
## sd(group_size6_player) 0.37
## sd(thicknessthin) 0.38
## sd(roundround_6) 0.47
## sd(group_size6_player:thicknessthin) 0.42
## sd(group_size6_player:roundround_6) 0.42
## sd(thicknessthin:roundround_6) 0.61
## sd(group_size6_player:thicknessthin:roundround_6) 0.75
## cor(Intercept,group_size6_player) 0.67
## cor(Intercept,thicknessthin) 0.60
## cor(group_size6_player,thicknessthin) 0.66
## cor(Intercept,roundround_6) 0.55
## cor(group_size6_player,roundround_6) 0.63
## cor(thicknessthin,roundround_6) 0.62
## cor(Intercept,group_size6_player:thicknessthin) 0.61
## cor(group_size6_player,group_size6_player:thicknessthin) 0.59
## cor(thicknessthin,group_size6_player:thicknessthin) 0.63
## cor(roundround_6,group_size6_player:thicknessthin) 0.61
## cor(Intercept,group_size6_player:roundround_6) 0.69
## cor(group_size6_player,group_size6_player:roundround_6) 0.62
## cor(thicknessthin,group_size6_player:roundround_6) 0.63
## cor(roundround_6,group_size6_player:roundround_6) 0.56
## cor(group_size6_player:thicknessthin,group_size6_player:roundround_6) 0.60
## cor(Intercept,thicknessthin:roundround_6) 0.51
## cor(group_size6_player,thicknessthin:roundround_6) 0.62
## cor(thicknessthin,thicknessthin:roundround_6) 0.61
## cor(roundround_6,thicknessthin:roundround_6) 0.58
## cor(group_size6_player:thicknessthin,thicknessthin:roundround_6) 0.67
## cor(group_size6_player:roundround_6,thicknessthin:roundround_6) 0.60
## cor(Intercept,group_size6_player:thicknessthin:roundround_6) 0.60
## cor(group_size6_player,group_size6_player:thicknessthin:roundround_6) 0.60
## cor(thicknessthin,group_size6_player:thicknessthin:roundround_6) 0.68
## cor(roundround_6,group_size6_player:thicknessthin:roundround_6) 0.58
## cor(group_size6_player:thicknessthin,group_size6_player:thicknessthin:roundround_6) 0.62
## cor(group_size6_player:roundround_6,group_size6_player:thicknessthin:roundround_6) 0.57
## cor(thicknessthin:roundround_6,group_size6_player:thicknessthin:roundround_6) 0.62
## Rhat
## sd(Intercept) 1.00
## sd(group_size6_player) 1.00
## sd(thicknessthin) 1.00
## sd(roundround_6) 1.00
## sd(group_size6_player:thicknessthin) 1.00
## sd(group_size6_player:roundround_6) 1.00
## sd(thicknessthin:roundround_6) 1.00
## sd(group_size6_player:thicknessthin:roundround_6) 1.00
## cor(Intercept,group_size6_player) 1.00
## cor(Intercept,thicknessthin) 1.00
## cor(group_size6_player,thicknessthin) 1.00
## cor(Intercept,roundround_6) 1.00
## cor(group_size6_player,roundround_6) 1.00
## cor(thicknessthin,roundround_6) 1.00
## cor(Intercept,group_size6_player:thicknessthin) 1.00
## cor(group_size6_player,group_size6_player:thicknessthin) 1.00
## cor(thicknessthin,group_size6_player:thicknessthin) 1.00
## cor(roundround_6,group_size6_player:thicknessthin) 1.00
## cor(Intercept,group_size6_player:roundround_6) 1.00
## cor(group_size6_player,group_size6_player:roundround_6) 1.00
## cor(thicknessthin,group_size6_player:roundround_6) 1.00
## cor(roundround_6,group_size6_player:roundround_6) 1.00
## cor(group_size6_player:thicknessthin,group_size6_player:roundround_6) 1.00
## cor(Intercept,thicknessthin:roundround_6) 1.00
## cor(group_size6_player,thicknessthin:roundround_6) 1.00
## cor(thicknessthin,thicknessthin:roundround_6) 1.00
## cor(roundround_6,thicknessthin:roundround_6) 1.00
## cor(group_size6_player:thicknessthin,thicknessthin:roundround_6) 1.00
## cor(group_size6_player:roundround_6,thicknessthin:roundround_6) 1.00
## cor(Intercept,group_size6_player:thicknessthin:roundround_6) 1.00
## cor(group_size6_player,group_size6_player:thicknessthin:roundround_6) 1.00
## cor(thicknessthin,group_size6_player:thicknessthin:roundround_6) 1.00
## cor(roundround_6,group_size6_player:thicknessthin:roundround_6) 1.00
## cor(group_size6_player:thicknessthin,group_size6_player:thicknessthin:roundround_6) 1.00
## cor(group_size6_player:roundround_6,group_size6_player:thicknessthin:roundround_6) 1.00
## cor(thicknessthin:roundround_6,group_size6_player:thicknessthin:roundround_6) 1.00
## Bulk_ESS
## sd(Intercept) 1247
## sd(group_size6_player) 1982
## sd(thicknessthin) 1884
## sd(roundround_6) 1652
## sd(group_size6_player:thicknessthin) 2732
## sd(group_size6_player:roundround_6) 2795
## sd(thicknessthin:roundround_6) 1681
## sd(group_size6_player:thicknessthin:roundround_6) 1975
## cor(Intercept,group_size6_player) 6846
## cor(Intercept,thicknessthin) 6416
## cor(group_size6_player,thicknessthin) 3762
## cor(Intercept,roundround_6) 4871
## cor(group_size6_player,roundround_6) 3539
## cor(thicknessthin,roundround_6) 3438
## cor(Intercept,group_size6_player:thicknessthin) 4836
## cor(group_size6_player,group_size6_player:thicknessthin) 3924
## cor(thicknessthin,group_size6_player:thicknessthin) 3968
## cor(roundround_6,group_size6_player:thicknessthin) 4217
## cor(Intercept,group_size6_player:roundround_6) 5748
## cor(group_size6_player,group_size6_player:roundround_6) 3956
## cor(thicknessthin,group_size6_player:roundround_6) 4499
## cor(roundround_6,group_size6_player:roundround_6) 3628
## cor(group_size6_player:thicknessthin,group_size6_player:roundround_6) 3187
## cor(Intercept,thicknessthin:roundround_6) 4690
## cor(group_size6_player,thicknessthin:roundround_6) 3311
## cor(thicknessthin,thicknessthin:roundround_6) 3374
## cor(roundround_6,thicknessthin:roundround_6) 2890
## cor(group_size6_player:thicknessthin,thicknessthin:roundround_6) 2715
## cor(group_size6_player:roundround_6,thicknessthin:roundround_6) 2620
## cor(Intercept,group_size6_player:thicknessthin:roundround_6) 5196
## cor(group_size6_player,group_size6_player:thicknessthin:roundround_6) 3531
## cor(thicknessthin,group_size6_player:thicknessthin:roundround_6) 3362
## cor(roundround_6,group_size6_player:thicknessthin:roundround_6) 3358
## cor(group_size6_player:thicknessthin,group_size6_player:thicknessthin:roundround_6) 2872
## cor(group_size6_player:roundround_6,group_size6_player:thicknessthin:roundround_6) 2842
## cor(thicknessthin:roundround_6,group_size6_player:thicknessthin:roundround_6) 2933
## Tail_ESS
## sd(Intercept) 2350
## sd(group_size6_player) 1723
## sd(thicknessthin) 1675
## sd(roundround_6) 2133
## sd(group_size6_player:thicknessthin) 2153
## sd(group_size6_player:roundround_6) 2233
## sd(thicknessthin:roundround_6) 1683
## sd(group_size6_player:thicknessthin:roundround_6) 1980
## cor(Intercept,group_size6_player) 2761
## cor(Intercept,thicknessthin) 2929
## cor(group_size6_player,thicknessthin) 3038
## cor(Intercept,roundround_6) 2354
## cor(group_size6_player,roundround_6) 3297
## cor(thicknessthin,roundround_6) 3255
## cor(Intercept,group_size6_player:thicknessthin) 2882
## cor(group_size6_player,group_size6_player:thicknessthin) 2952
## cor(thicknessthin,group_size6_player:thicknessthin) 3313
## cor(roundround_6,group_size6_player:thicknessthin) 3448
## cor(Intercept,group_size6_player:roundround_6) 3043
## cor(group_size6_player,group_size6_player:roundround_6) 2706
## cor(thicknessthin,group_size6_player:roundround_6) 3412
## cor(roundround_6,group_size6_player:roundround_6) 2879
## cor(group_size6_player:thicknessthin,group_size6_player:roundround_6) 3211
## cor(Intercept,thicknessthin:roundround_6) 3037
## cor(group_size6_player,thicknessthin:roundround_6) 2779
## cor(thicknessthin,thicknessthin:roundround_6) 2651
## cor(roundround_6,thicknessthin:roundround_6) 3053
## cor(group_size6_player:thicknessthin,thicknessthin:roundround_6) 3046
## cor(group_size6_player:roundround_6,thicknessthin:roundround_6) 3407
## cor(Intercept,group_size6_player:thicknessthin:roundround_6) 2942
## cor(group_size6_player,group_size6_player:thicknessthin:roundround_6) 3151
## cor(thicknessthin,group_size6_player:thicknessthin:roundround_6) 3011
## cor(roundround_6,group_size6_player:thicknessthin:roundround_6) 3258
## cor(group_size6_player:thicknessthin,group_size6_player:thicknessthin:roundround_6) 3100
## cor(group_size6_player:roundround_6,group_size6_player:thicknessthin:roundround_6) 3395
## cor(thicknessthin:roundround_6,group_size6_player:thicknessthin:roundround_6) 3420
##
## ~workerid (Number of levels: 60)
## Estimate
## sd(Intercept) 0.62
## sd(group_size6_player) 0.20
## sd(thicknessthin) 0.17
## sd(roundround_6) 0.16
## sd(trial_order) 0.01
## sd(group_size6_player:thicknessthin) 0.19
## sd(group_size6_player:roundround_6) 0.20
## sd(thicknessthin:roundround_6) 0.18
## sd(group_size6_player:thicknessthin:roundround_6) 0.24
## cor(Intercept,group_size6_player) -0.00
## cor(Intercept,thicknessthin) -0.11
## cor(group_size6_player,thicknessthin) -0.08
## cor(Intercept,roundround_6) -0.15
## cor(group_size6_player,roundround_6) -0.01
## cor(thicknessthin,roundround_6) -0.04
## cor(Intercept,trial_order) 0.03
## cor(group_size6_player,trial_order) -0.04
## cor(thicknessthin,trial_order) -0.00
## cor(roundround_6,trial_order) 0.02
## cor(Intercept,group_size6_player:thicknessthin) 0.00
## cor(group_size6_player,group_size6_player:thicknessthin) -0.03
## cor(thicknessthin,group_size6_player:thicknessthin) -0.03
## cor(roundround_6,group_size6_player:thicknessthin) 0.00
## cor(trial_order,group_size6_player:thicknessthin) -0.00
## cor(Intercept,group_size6_player:roundround_6) -0.11
## cor(group_size6_player,group_size6_player:roundround_6) -0.05
## cor(thicknessthin,group_size6_player:roundround_6) -0.00
## cor(roundround_6,group_size6_player:roundround_6) -0.05
## cor(trial_order,group_size6_player:roundround_6) 0.03
## cor(group_size6_player:thicknessthin,group_size6_player:roundround_6) -0.01
## cor(Intercept,thicknessthin:roundround_6) -0.10
## cor(group_size6_player,thicknessthin:roundround_6) -0.03
## cor(thicknessthin,thicknessthin:roundround_6) -0.03
## cor(roundround_6,thicknessthin:roundround_6) -0.02
## cor(trial_order,thicknessthin:roundround_6) 0.01
## cor(group_size6_player:thicknessthin,thicknessthin:roundround_6) -0.01
## cor(group_size6_player:roundround_6,thicknessthin:roundround_6) -0.00
## cor(Intercept,group_size6_player:thicknessthin:roundround_6) -0.06
## cor(group_size6_player,group_size6_player:thicknessthin:roundround_6) -0.05
## cor(thicknessthin,group_size6_player:thicknessthin:roundround_6) 0.04
## cor(roundround_6,group_size6_player:thicknessthin:roundround_6) -0.04
## cor(trial_order,group_size6_player:thicknessthin:roundround_6) 0.04
## cor(group_size6_player:thicknessthin,group_size6_player:thicknessthin:roundround_6) -0.06
## cor(group_size6_player:roundround_6,group_size6_player:thicknessthin:roundround_6) -0.04
## cor(thicknessthin:roundround_6,group_size6_player:thicknessthin:roundround_6) -0.01
## Est.Error
## sd(Intercept) 0.10
## sd(group_size6_player) 0.12
## sd(thicknessthin) 0.12
## sd(roundround_6) 0.11
## sd(trial_order) 0.00
## sd(group_size6_player:thicknessthin) 0.13
## sd(group_size6_player:roundround_6) 0.14
## sd(thicknessthin:roundround_6) 0.13
## sd(group_size6_player:thicknessthin:roundround_6) 0.17
## cor(Intercept,group_size6_player) 0.28
## cor(Intercept,thicknessthin) 0.30
## cor(group_size6_player,thicknessthin) 0.31
## cor(Intercept,roundround_6) 0.30
## cor(group_size6_player,roundround_6) 0.31
## cor(thicknessthin,roundround_6) 0.32
## cor(Intercept,trial_order) 0.28
## cor(group_size6_player,trial_order) 0.31
## cor(thicknessthin,trial_order) 0.31
## cor(roundround_6,trial_order) 0.32
## cor(Intercept,group_size6_player:thicknessthin) 0.31
## cor(group_size6_player,group_size6_player:thicknessthin) 0.32
## cor(thicknessthin,group_size6_player:thicknessthin) 0.32
## cor(roundround_6,group_size6_player:thicknessthin) 0.31
## cor(trial_order,group_size6_player:thicknessthin) 0.31
## cor(Intercept,group_size6_player:roundround_6) 0.31
## cor(group_size6_player,group_size6_player:roundround_6) 0.32
## cor(thicknessthin,group_size6_player:roundround_6) 0.31
## cor(roundround_6,group_size6_player:roundround_6) 0.31
## cor(trial_order,group_size6_player:roundround_6) 0.32
## cor(group_size6_player:thicknessthin,group_size6_player:roundround_6) 0.32
## cor(Intercept,thicknessthin:roundround_6) 0.30
## cor(group_size6_player,thicknessthin:roundround_6) 0.32
## cor(thicknessthin,thicknessthin:roundround_6) 0.32
## cor(roundround_6,thicknessthin:roundround_6) 0.32
## cor(trial_order,thicknessthin:roundround_6) 0.32
## cor(group_size6_player:thicknessthin,thicknessthin:roundround_6) 0.31
## cor(group_size6_player:roundround_6,thicknessthin:roundround_6) 0.32
## cor(Intercept,group_size6_player:thicknessthin:roundround_6) 0.30
## cor(group_size6_player,group_size6_player:thicknessthin:roundround_6) 0.31
## cor(thicknessthin,group_size6_player:thicknessthin:roundround_6) 0.31
## cor(roundround_6,group_size6_player:thicknessthin:roundround_6) 0.31
## cor(trial_order,group_size6_player:thicknessthin:roundround_6) 0.32
## cor(group_size6_player:thicknessthin,group_size6_player:thicknessthin:roundround_6) 0.32
## cor(group_size6_player:roundround_6,group_size6_player:thicknessthin:roundround_6) 0.32
## cor(thicknessthin:roundround_6,group_size6_player:thicknessthin:roundround_6) 0.31
## l-95% CI
## sd(Intercept) 0.43
## sd(group_size6_player) 0.01
## sd(thicknessthin) 0.01
## sd(roundround_6) 0.01
## sd(trial_order) 0.00
## sd(group_size6_player:thicknessthin) 0.01
## sd(group_size6_player:roundround_6) 0.01
## sd(thicknessthin:roundround_6) 0.01
## sd(group_size6_player:thicknessthin:roundround_6) 0.01
## cor(Intercept,group_size6_player) -0.54
## cor(Intercept,thicknessthin) -0.64
## cor(group_size6_player,thicknessthin) -0.64
## cor(Intercept,roundround_6) -0.68
## cor(group_size6_player,roundround_6) -0.59
## cor(thicknessthin,roundround_6) -0.63
## cor(Intercept,trial_order) -0.51
## cor(group_size6_player,trial_order) -0.62
## cor(thicknessthin,trial_order) -0.60
## cor(roundround_6,trial_order) -0.58
## cor(Intercept,group_size6_player:thicknessthin) -0.58
## cor(group_size6_player,group_size6_player:thicknessthin) -0.63
## cor(thicknessthin,group_size6_player:thicknessthin) -0.62
## cor(roundround_6,group_size6_player:thicknessthin) -0.60
## cor(trial_order,group_size6_player:thicknessthin) -0.60
## cor(Intercept,group_size6_player:roundround_6) -0.66
## cor(group_size6_player,group_size6_player:roundround_6) -0.63
## cor(thicknessthin,group_size6_player:roundround_6) -0.61
## cor(roundround_6,group_size6_player:roundround_6) -0.63
## cor(trial_order,group_size6_player:roundround_6) -0.59
## cor(group_size6_player:thicknessthin,group_size6_player:roundround_6) -0.61
## cor(Intercept,thicknessthin:roundround_6) -0.63
## cor(group_size6_player,thicknessthin:roundround_6) -0.62
## cor(thicknessthin,thicknessthin:roundround_6) -0.62
## cor(roundround_6,thicknessthin:roundround_6) -0.61
## cor(trial_order,thicknessthin:roundround_6) -0.61
## cor(group_size6_player:thicknessthin,thicknessthin:roundround_6) -0.60
## cor(group_size6_player:roundround_6,thicknessthin:roundround_6) -0.60
## cor(Intercept,group_size6_player:thicknessthin:roundround_6) -0.60
## cor(group_size6_player,group_size6_player:thicknessthin:roundround_6) -0.63
## cor(thicknessthin,group_size6_player:thicknessthin:roundround_6) -0.56
## cor(roundround_6,group_size6_player:thicknessthin:roundround_6) -0.62
## cor(trial_order,group_size6_player:thicknessthin:roundround_6) -0.57
## cor(group_size6_player:thicknessthin,group_size6_player:thicknessthin:roundround_6) -0.64
## cor(group_size6_player:roundround_6,group_size6_player:thicknessthin:roundround_6) -0.63
## cor(thicknessthin:roundround_6,group_size6_player:thicknessthin:roundround_6) -0.58
## u-95% CI
## sd(Intercept) 0.83
## sd(group_size6_player) 0.45
## sd(thicknessthin) 0.42
## sd(roundround_6) 0.41
## sd(trial_order) 0.01
## sd(group_size6_player:thicknessthin) 0.48
## sd(group_size6_player:roundround_6) 0.53
## sd(thicknessthin:roundround_6) 0.47
## sd(group_size6_player:thicknessthin:roundround_6) 0.65
## cor(Intercept,group_size6_player) 0.55
## cor(Intercept,thicknessthin) 0.51
## cor(group_size6_player,thicknessthin) 0.53
## cor(Intercept,roundround_6) 0.48
## cor(group_size6_player,roundround_6) 0.60
## cor(thicknessthin,roundround_6) 0.57
## cor(Intercept,trial_order) 0.58
## cor(group_size6_player,trial_order) 0.57
## cor(thicknessthin,trial_order) 0.57
## cor(roundround_6,trial_order) 0.62
## cor(Intercept,group_size6_player:thicknessthin) 0.59
## cor(group_size6_player,group_size6_player:thicknessthin) 0.59
## cor(thicknessthin,group_size6_player:thicknessthin) 0.58
## cor(roundround_6,group_size6_player:thicknessthin) 0.61
## cor(trial_order,group_size6_player:thicknessthin) 0.59
## cor(Intercept,group_size6_player:roundround_6) 0.53
## cor(group_size6_player,group_size6_player:roundround_6) 0.56
## cor(thicknessthin,group_size6_player:roundround_6) 0.59
## cor(roundround_6,group_size6_player:roundround_6) 0.56
## cor(trial_order,group_size6_player:roundround_6) 0.64
## cor(group_size6_player:thicknessthin,group_size6_player:roundround_6) 0.61
## cor(Intercept,thicknessthin:roundround_6) 0.51
## cor(group_size6_player,thicknessthin:roundround_6) 0.60
## cor(thicknessthin,thicknessthin:roundround_6) 0.58
## cor(roundround_6,thicknessthin:roundround_6) 0.59
## cor(trial_order,thicknessthin:roundround_6) 0.62
## cor(group_size6_player:thicknessthin,thicknessthin:roundround_6) 0.61
## cor(group_size6_player:roundround_6,thicknessthin:roundround_6) 0.60
## cor(Intercept,group_size6_player:thicknessthin:roundround_6) 0.52
## cor(group_size6_player,group_size6_player:thicknessthin:roundround_6) 0.58
## cor(thicknessthin,group_size6_player:thicknessthin:roundround_6) 0.64
## cor(roundround_6,group_size6_player:thicknessthin:roundround_6) 0.57
## cor(trial_order,group_size6_player:thicknessthin:roundround_6) 0.64
## cor(group_size6_player:thicknessthin,group_size6_player:thicknessthin:roundround_6) 0.56
## cor(group_size6_player:roundround_6,group_size6_player:thicknessthin:roundround_6) 0.59
## cor(thicknessthin:roundround_6,group_size6_player:thicknessthin:roundround_6) 0.59
## Rhat
## sd(Intercept) 1.00
## sd(group_size6_player) 1.00
## sd(thicknessthin) 1.00
## sd(roundround_6) 1.00
## sd(trial_order) 1.00
## sd(group_size6_player:thicknessthin) 1.00
## sd(group_size6_player:roundround_6) 1.00
## sd(thicknessthin:roundround_6) 1.00
## sd(group_size6_player:thicknessthin:roundround_6) 1.00
## cor(Intercept,group_size6_player) 1.00
## cor(Intercept,thicknessthin) 1.00
## cor(group_size6_player,thicknessthin) 1.00
## cor(Intercept,roundround_6) 1.00
## cor(group_size6_player,roundround_6) 1.00
## cor(thicknessthin,roundround_6) 1.00
## cor(Intercept,trial_order) 1.00
## cor(group_size6_player,trial_order) 1.00
## cor(thicknessthin,trial_order) 1.00
## cor(roundround_6,trial_order) 1.00
## cor(Intercept,group_size6_player:thicknessthin) 1.00
## cor(group_size6_player,group_size6_player:thicknessthin) 1.00
## cor(thicknessthin,group_size6_player:thicknessthin) 1.00
## cor(roundround_6,group_size6_player:thicknessthin) 1.00
## cor(trial_order,group_size6_player:thicknessthin) 1.00
## cor(Intercept,group_size6_player:roundround_6) 1.00
## cor(group_size6_player,group_size6_player:roundround_6) 1.00
## cor(thicknessthin,group_size6_player:roundround_6) 1.00
## cor(roundround_6,group_size6_player:roundround_6) 1.00
## cor(trial_order,group_size6_player:roundround_6) 1.00
## cor(group_size6_player:thicknessthin,group_size6_player:roundround_6) 1.00
## cor(Intercept,thicknessthin:roundround_6) 1.00
## cor(group_size6_player,thicknessthin:roundround_6) 1.00
## cor(thicknessthin,thicknessthin:roundround_6) 1.00
## cor(roundround_6,thicknessthin:roundround_6) 1.00
## cor(trial_order,thicknessthin:roundround_6) 1.00
## cor(group_size6_player:thicknessthin,thicknessthin:roundround_6) 1.00
## cor(group_size6_player:roundround_6,thicknessthin:roundround_6) 1.00
## cor(Intercept,group_size6_player:thicknessthin:roundround_6) 1.00
## cor(group_size6_player,group_size6_player:thicknessthin:roundround_6) 1.00
## cor(thicknessthin,group_size6_player:thicknessthin:roundround_6) 1.00
## cor(roundround_6,group_size6_player:thicknessthin:roundround_6) 1.00
## cor(trial_order,group_size6_player:thicknessthin:roundround_6) 1.00
## cor(group_size6_player:thicknessthin,group_size6_player:thicknessthin:roundround_6) 1.00
## cor(group_size6_player:roundround_6,group_size6_player:thicknessthin:roundround_6) 1.00
## cor(thicknessthin:roundround_6,group_size6_player:thicknessthin:roundround_6) 1.00
## Bulk_ESS
## sd(Intercept) 1635
## sd(group_size6_player) 877
## sd(thicknessthin) 1074
## sd(roundround_6) 1325
## sd(trial_order) 455
## sd(group_size6_player:thicknessthin) 1438
## sd(group_size6_player:roundround_6) 1232
## sd(thicknessthin:roundround_6) 1361
## sd(group_size6_player:thicknessthin:roundround_6) 1484
## cor(Intercept,group_size6_player) 4898
## cor(Intercept,thicknessthin) 3828
## cor(group_size6_player,thicknessthin) 2999
## cor(Intercept,roundround_6) 4453
## cor(group_size6_player,roundround_6) 3212
## cor(thicknessthin,roundround_6) 3614
## cor(Intercept,trial_order) 3516
## cor(group_size6_player,trial_order) 1700
## cor(thicknessthin,trial_order) 1849
## cor(roundround_6,trial_order) 1432
## cor(Intercept,group_size6_player:thicknessthin) 5342
## cor(group_size6_player,group_size6_player:thicknessthin) 3472
## cor(thicknessthin,group_size6_player:thicknessthin) 3216
## cor(roundround_6,group_size6_player:thicknessthin) 3273
## cor(trial_order,group_size6_player:thicknessthin) 3366
## cor(Intercept,group_size6_player:roundround_6) 4659
## cor(group_size6_player,group_size6_player:roundround_6) 4017
## cor(thicknessthin,group_size6_player:roundround_6) 3198
## cor(roundround_6,group_size6_player:roundround_6) 3312
## cor(trial_order,group_size6_player:roundround_6) 3221
## cor(group_size6_player:thicknessthin,group_size6_player:roundround_6) 3066
## cor(Intercept,thicknessthin:roundround_6) 4848
## cor(group_size6_player,thicknessthin:roundround_6) 3700
## cor(thicknessthin,thicknessthin:roundround_6) 3765
## cor(roundround_6,thicknessthin:roundround_6) 3256
## cor(trial_order,thicknessthin:roundround_6) 3341
## cor(group_size6_player:thicknessthin,thicknessthin:roundround_6) 2958
## cor(group_size6_player:roundround_6,thicknessthin:roundround_6) 2930
## cor(Intercept,group_size6_player:thicknessthin:roundround_6) 4887
## cor(group_size6_player,group_size6_player:thicknessthin:roundround_6) 4022
## cor(thicknessthin,group_size6_player:thicknessthin:roundround_6) 3640
## cor(roundround_6,group_size6_player:thicknessthin:roundround_6) 3108
## cor(trial_order,group_size6_player:thicknessthin:roundround_6) 3322
## cor(group_size6_player:thicknessthin,group_size6_player:thicknessthin:roundround_6) 3197
## cor(group_size6_player:roundround_6,group_size6_player:thicknessthin:roundround_6) 3131
## cor(thicknessthin:roundround_6,group_size6_player:thicknessthin:roundround_6) 2745
## Tail_ESS
## sd(Intercept) 2326
## sd(group_size6_player) 1443
## sd(thicknessthin) 1768
## sd(roundround_6) 2106
## sd(trial_order) 1081
## sd(group_size6_player:thicknessthin) 1580
## sd(group_size6_player:roundround_6) 1720
## sd(thicknessthin:roundround_6) 1936
## sd(group_size6_player:thicknessthin:roundround_6) 1937
## cor(Intercept,group_size6_player) 2792
## cor(Intercept,thicknessthin) 2724
## cor(group_size6_player,thicknessthin) 2639
## cor(Intercept,roundround_6) 3138
## cor(group_size6_player,roundround_6) 3060
## cor(thicknessthin,roundround_6) 3437
## cor(Intercept,trial_order) 2766
## cor(group_size6_player,trial_order) 2578
## cor(thicknessthin,trial_order) 2825
## cor(roundround_6,trial_order) 2460
## cor(Intercept,group_size6_player:thicknessthin) 2802
## cor(group_size6_player,group_size6_player:thicknessthin) 3061
## cor(thicknessthin,group_size6_player:thicknessthin) 3212
## cor(roundround_6,group_size6_player:thicknessthin) 3240
## cor(trial_order,group_size6_player:thicknessthin) 3159
## cor(Intercept,group_size6_player:roundround_6) 2847
## cor(group_size6_player,group_size6_player:roundround_6) 2838
## cor(thicknessthin,group_size6_player:roundround_6) 3056
## cor(roundround_6,group_size6_player:roundround_6) 3356
## cor(trial_order,group_size6_player:roundround_6) 3158
## cor(group_size6_player:thicknessthin,group_size6_player:roundround_6) 3205
## cor(Intercept,thicknessthin:roundround_6) 2602
## cor(group_size6_player,thicknessthin:roundround_6) 2645
## cor(thicknessthin,thicknessthin:roundround_6) 2838
## cor(roundround_6,thicknessthin:roundround_6) 3241
## cor(trial_order,thicknessthin:roundround_6) 2866
## cor(group_size6_player:thicknessthin,thicknessthin:roundround_6) 3207
## cor(group_size6_player:roundround_6,thicknessthin:roundround_6) 3191
## cor(Intercept,group_size6_player:thicknessthin:roundround_6) 2873
## cor(group_size6_player,group_size6_player:thicknessthin:roundround_6) 2997
## cor(thicknessthin,group_size6_player:thicknessthin:roundround_6) 2902
## cor(roundround_6,group_size6_player:thicknessthin:roundround_6) 3367
## cor(trial_order,group_size6_player:thicknessthin:roundround_6) 3127
## cor(group_size6_player:thicknessthin,group_size6_player:thicknessthin:roundround_6) 3448
## cor(group_size6_player:roundround_6,group_size6_player:thicknessthin:roundround_6) 3645
## cor(thicknessthin:roundround_6,group_size6_player:thicknessthin:roundround_6) 3223
##
## Population-Level Effects:
## Estimate Est.Error l-95% CI
## Intercept 0.59 0.27 0.06
## group_size6_player -0.16 0.15 -0.45
## thicknessthin -0.13 0.15 -0.42
## roundround_6 -0.45 0.15 -0.75
## trial_order -0.00 0.00 -0.01
## group_size6_player:thicknessthin 0.06 0.20 -0.34
## group_size6_player:roundround_6 0.15 0.20 -0.26
## thicknessthin:roundround_6 0.44 0.21 0.02
## group_size6_player:thicknessthin:roundround_6 -0.01 0.29 -0.59
## u-95% CI Rhat Bulk_ESS Tail_ESS
## Intercept 1.13 1.00 813 1317
## group_size6_player 0.13 1.00 2226 2525
## thicknessthin 0.16 1.00 2218 2765
## roundround_6 -0.16 1.00 2291 2943
## trial_order 0.00 1.00 5299 3164
## group_size6_player:thicknessthin 0.46 1.00 2188 2891
## group_size6_player:roundround_6 0.54 1.00 2091 2556
## thicknessthin:roundround_6 0.85 1.00 2237 2637
## group_size6_player:thicknessthin:roundround_6 0.56 1.00 2139 3035
##
## Draws were sampled using sampling(NUTS). For each parameter, Bulk_ESS
## and Tail_ESS are effective sample size measures, and Rhat is the potential
## scale reduction factor on split chains (at convergence, Rhat = 1).So basically this confirms what we see above: the percentages aren’t that different across conditions, but there is an interaction – 2-player games end up less transparent than 6-player games, even if they start in (roughly) the same place and don’t change that much from start to end.
Logistic models are annoying to think about, so we can look at predictions:
Dotted lines are 95% posterior predictions from the model (no random effects), solid lines are mean and 95% CI from bootstrapping that category.
check what’s up with predictions via simpler models
seems a bit odd that model preds are all larger than the bootstrap, so we check out what’s causing it. Seems to be that adding mixed effects leads to pulling up the lower outliers more (b/c there’s further out low ones??), although maybe this is partly due to that x logit stuff
compare accuracy as function of original accuracy & length
how does RT vary based on transcript length?
how does accuracy vary based on transcript length?
Note there’s some join or exclusion issue happening where we don’t have round results for some of these – I thought it might be an NA issue, but it looks like not – looks like results v chat mismatch thing which I will deal with later. Grrr.
What’s the relationship between original listener accuracy and accuracy?
Definitely positive correlation here, which makes sense.
just to check correlation issues, original accuracy v length. some correlation, but not huge.
# by tangram
# confusion matrix might be real interesting!
#Joint with expt 1
