MHA data 2024/01/26


Read in the data:

library(tidyverse)
── Attaching packages ─────────────────────────────────────── tidyverse 1.3.2 ──
✔ ggplot2 3.4.0     ✔ purrr   0.3.4
✔ tibble  3.1.7     ✔ dplyr   1.1.0
✔ tidyr   1.2.0     ✔ stringr 1.4.0
✔ readr   2.1.4     ✔ forcats 0.5.1
── Conflicts ────────────────────────────────────────── tidyverse_conflicts() ──
✖ dplyr::filter() masks stats::filter()
✖ dplyr::lag()    masks stats::lag()
library(VGAM)
Loading required package: stats4
Loading required package: splines
df <- read.csv('r-34 data downloader/output_data_.csv')
# df <- df |> filter(is.na(reward) == FALSE)
#head(df)

Calculate Missing Values:

df |> 
  filter(mooclet_id %in% c(583,584,585,586,587,588,590)) |>
  group_by(mooclet_id) |>
  summarise(total_arm_assignments = length(reward),
            total_missing_value = sum(is.na(reward)),
            missing_ratio = sum(is.na(reward))/length(reward))
# A tibble: 7 × 4
  mooclet_id total_arm_assignments total_missing_value missing_ratio
       <int>                 <int>               <int>         <dbl>
1        583                   169                 112        0.663 
2        584                   169                 112        0.663 
3        585                   166                 111        0.669 
4        586                   343                  21        0.0612
5        587                   344                   8        0.0233
6        588                   391                   8        0.0205
7        590                   343                   9        0.0262

Summarized into:

Model 1: Modular bandits data are fitting on LM since the reward is multi-class,

could use multi-nomial logistic model, too

B1 model: fitted

df |> 
  filter(mooclet_id == 583) |>
  lm(formula = reward ~ as.factor(arm) +
       context_is_weekday*as.factor(arm) + 
       context_is_preferred_time*as.factor(arm) + 
       context_time_of_day_period*as.factor(arm) + 
       context_active_last_48*as.factor(arm) + 
       context_study_period*as.factor(arm) + 
       context_k10_response_sum_class*as.factor(arm)) |>
  summary()

Call:
lm(formula = reward ~ as.factor(arm) + context_is_weekday * as.factor(arm) + 
    context_is_preferred_time * as.factor(arm) + context_time_of_day_period * 
    as.factor(arm) + context_active_last_48 * as.factor(arm) + 
    context_study_period * as.factor(arm) + context_k10_response_sum_class * 
    as.factor(arm), data = filter(df, mooclet_id == 583))

Residuals:
     Min       1Q   Median       3Q      Max 
-0.44517 -0.12367 -0.00743  0.14893  0.48907 

Coefficients:
                                                                                         Estimate
(Intercept)                                                                              -1.23148
as.factor(arm)B1 Modular Link Clinical TrialZzgot_no_link                                 2.56104
context_is_weekday                                                                        0.21858
context_is_preferred_time                                                                 0.09476
context_time_of_day_period                                                                0.47768
context_active_last_48                                                                    0.11422
context_study_period                                                                      1.04078
context_k10_response_sum_class                                                            0.59594
as.factor(arm)B1 Modular Link Clinical TrialZzgot_no_link:context_is_weekday             -0.13574
as.factor(arm)B1 Modular Link Clinical TrialZzgot_no_link:context_is_preferred_time       0.12645
as.factor(arm)B1 Modular Link Clinical TrialZzgot_no_link:context_time_of_day_period     -0.62578
as.factor(arm)B1 Modular Link Clinical TrialZzgot_no_link:context_active_last_48         -0.85371
as.factor(arm)B1 Modular Link Clinical TrialZzgot_no_link:context_study_period           -1.36356
as.factor(arm)B1 Modular Link Clinical TrialZzgot_no_link:context_k10_response_sum_class -0.66095
                                                                                         Std. Error
(Intercept)                                                                                 0.50509
as.factor(arm)B1 Modular Link Clinical TrialZzgot_no_link                                   0.69571
context_is_weekday                                                                          0.12521
context_is_preferred_time                                                                   0.12581
context_time_of_day_period                                                                  0.18935
context_active_last_48                                                                      0.25202
context_study_period                                                                        0.39654
context_k10_response_sum_class                                                              0.43557
as.factor(arm)B1 Modular Link Clinical TrialZzgot_no_link:context_is_weekday                0.15915
as.factor(arm)B1 Modular Link Clinical TrialZzgot_no_link:context_is_preferred_time         0.16455
as.factor(arm)B1 Modular Link Clinical TrialZzgot_no_link:context_time_of_day_period        0.22881
as.factor(arm)B1 Modular Link Clinical TrialZzgot_no_link:context_active_last_48            0.36027
as.factor(arm)B1 Modular Link Clinical TrialZzgot_no_link:context_study_period              0.50683
as.factor(arm)B1 Modular Link Clinical TrialZzgot_no_link:context_k10_response_sum_class    0.52017
                                                                                         t value
(Intercept)                                                                               -2.438
as.factor(arm)B1 Modular Link Clinical TrialZzgot_no_link                                  3.681
context_is_weekday                                                                         1.746
context_is_preferred_time                                                                  0.753
context_time_of_day_period                                                                 2.523
context_active_last_48                                                                     0.453
context_study_period                                                                       2.625
context_k10_response_sum_class                                                             1.368
as.factor(arm)B1 Modular Link Clinical TrialZzgot_no_link:context_is_weekday              -0.853
as.factor(arm)B1 Modular Link Clinical TrialZzgot_no_link:context_is_preferred_time        0.768
as.factor(arm)B1 Modular Link Clinical TrialZzgot_no_link:context_time_of_day_period      -2.735
as.factor(arm)B1 Modular Link Clinical TrialZzgot_no_link:context_active_last_48          -2.370
as.factor(arm)B1 Modular Link Clinical TrialZzgot_no_link:context_study_period            -2.690
as.factor(arm)B1 Modular Link Clinical TrialZzgot_no_link:context_k10_response_sum_class  -1.271
                                                                                         Pr(>|t|)
(Intercept)                                                                               0.01918
as.factor(arm)B1 Modular Link Clinical TrialZzgot_no_link                                 0.00067
context_is_weekday                                                                        0.08834
context_is_preferred_time                                                                 0.45564
context_time_of_day_period                                                                0.01562
context_active_last_48                                                                    0.65277
context_study_period                                                                      0.01213
context_k10_response_sum_class                                                            0.17871
as.factor(arm)B1 Modular Link Clinical TrialZzgot_no_link:context_is_weekday              0.39866
as.factor(arm)B1 Modular Link Clinical TrialZzgot_no_link:context_is_preferred_time       0.44662
as.factor(arm)B1 Modular Link Clinical TrialZzgot_no_link:context_time_of_day_period      0.00917
as.factor(arm)B1 Modular Link Clinical TrialZzgot_no_link:context_active_last_48          0.02259
as.factor(arm)B1 Modular Link Clinical TrialZzgot_no_link:context_study_period            0.01028
as.factor(arm)B1 Modular Link Clinical TrialZzgot_no_link:context_k10_response_sum_class  0.21102
                                                                                            
(Intercept)                                                                              *  
as.factor(arm)B1 Modular Link Clinical TrialZzgot_no_link                                ***
context_is_weekday                                                                       .  
context_is_preferred_time                                                                   
context_time_of_day_period                                                               *  
context_active_last_48                                                                      
context_study_period                                                                     *  
context_k10_response_sum_class                                                              
as.factor(arm)B1 Modular Link Clinical TrialZzgot_no_link:context_is_weekday                
as.factor(arm)B1 Modular Link Clinical TrialZzgot_no_link:context_is_preferred_time         
as.factor(arm)B1 Modular Link Clinical TrialZzgot_no_link:context_time_of_day_period     ** 
as.factor(arm)B1 Modular Link Clinical TrialZzgot_no_link:context_active_last_48         *  
as.factor(arm)B1 Modular Link Clinical TrialZzgot_no_link:context_study_period           *  
as.factor(arm)B1 Modular Link Clinical TrialZzgot_no_link:context_k10_response_sum_class    
---
Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1

Residual standard error: 0.2367 on 41 degrees of freedom
  (114 observations deleted due to missingness)
Multiple R-squared:  0.563, Adjusted R-squared:  0.4245 
F-statistic: 4.064 on 13 and 41 DF,  p-value: 0.0002818

B2 model: fitted:

df |> 
  filter(mooclet_id == 584) |>
  lm(formula = reward ~ as.factor(arm) +
       context_is_weekday*as.factor(arm) + 
       context_is_preferred_time*as.factor(arm) + 
       context_time_of_day_period*as.factor(arm) + 
       context_active_last_48*as.factor(arm) + 
       context_study_period*as.factor(arm) + 
       context_k10_response_sum_class*as.factor(arm)) |>
  summary()

Call:
lm(formula = reward ~ as.factor(arm) + context_is_weekday * as.factor(arm) + 
    context_is_preferred_time * as.factor(arm) + context_time_of_day_period * 
    as.factor(arm) + context_active_last_48 * as.factor(arm) + 
    context_study_period * as.factor(arm) + context_k10_response_sum_class * 
    as.factor(arm), data = filter(df, mooclet_id == 584))

Residuals:
     Min       1Q   Median       3Q      Max 
-0.49966 -0.14715 -0.00388  0.14601  0.63927 

Coefficients:
                                                                                                    Estimate
(Intercept)                                                                                          1.07903
as.factor(arm)B2 Modular Rationale Clinical TrialZzmodular_rationale                                -2.05988
context_is_weekday                                                                                   0.08475
context_is_preferred_time                                                                            0.33256
context_time_of_day_period                                                                          -0.03803
context_active_last_48                                                                              -0.84136
context_study_period                                                                                -0.07251
context_k10_response_sum_class                                                                      -0.01802
as.factor(arm)B2 Modular Rationale Clinical TrialZzmodular_rationale:context_is_weekday              0.04888
as.factor(arm)B2 Modular Rationale Clinical TrialZzmodular_rationale:context_is_preferred_time      -0.21519
as.factor(arm)B2 Modular Rationale Clinical TrialZzmodular_rationale:context_time_of_day_period      0.27303
as.factor(arm)B2 Modular Rationale Clinical TrialZzmodular_rationale:context_active_last_48          0.98366
as.factor(arm)B2 Modular Rationale Clinical TrialZzmodular_rationale:context_study_period            0.65517
as.factor(arm)B2 Modular Rationale Clinical TrialZzmodular_rationale:context_k10_response_sum_class  0.79883
                                                                                                    Std. Error
(Intercept)                                                                                            0.50361
as.factor(arm)B2 Modular Rationale Clinical TrialZzmodular_rationale                                   0.79209
context_is_weekday                                                                                     0.12758
context_is_preferred_time                                                                              0.12835
context_time_of_day_period                                                                             0.16631
context_active_last_48                                                                                 0.28703
context_study_period                                                                                   0.34849
context_k10_response_sum_class                                                                         0.37286
as.factor(arm)B2 Modular Rationale Clinical TrialZzmodular_rationale:context_is_weekday                0.18171
as.factor(arm)B2 Modular Rationale Clinical TrialZzmodular_rationale:context_is_preferred_time         0.17821
as.factor(arm)B2 Modular Rationale Clinical TrialZzmodular_rationale:context_time_of_day_period        0.23932
as.factor(arm)B2 Modular Rationale Clinical TrialZzmodular_rationale:context_active_last_48            0.39935
as.factor(arm)B2 Modular Rationale Clinical TrialZzmodular_rationale:context_study_period              0.51600
as.factor(arm)B2 Modular Rationale Clinical TrialZzmodular_rationale:context_k10_response_sum_class    0.49004
                                                                                                    t value
(Intercept)                                                                                           2.143
as.factor(arm)B2 Modular Rationale Clinical TrialZzmodular_rationale                                 -2.601
context_is_weekday                                                                                    0.664
context_is_preferred_time                                                                             2.591
context_time_of_day_period                                                                           -0.229
context_active_last_48                                                                               -2.931
context_study_period                                                                                 -0.208
context_k10_response_sum_class                                                                       -0.048
as.factor(arm)B2 Modular Rationale Clinical TrialZzmodular_rationale:context_is_weekday               0.269
as.factor(arm)B2 Modular Rationale Clinical TrialZzmodular_rationale:context_is_preferred_time       -1.207
as.factor(arm)B2 Modular Rationale Clinical TrialZzmodular_rationale:context_time_of_day_period       1.141
as.factor(arm)B2 Modular Rationale Clinical TrialZzmodular_rationale:context_active_last_48           2.463
as.factor(arm)B2 Modular Rationale Clinical TrialZzmodular_rationale:context_study_period             1.270
as.factor(arm)B2 Modular Rationale Clinical TrialZzmodular_rationale:context_k10_response_sum_class   1.630
                                                                                                    Pr(>|t|)
(Intercept)                                                                                           0.0381
as.factor(arm)B2 Modular Rationale Clinical TrialZzmodular_rationale                                  0.0129
context_is_weekday                                                                                    0.5102
context_is_preferred_time                                                                             0.0132
context_time_of_day_period                                                                            0.8203
context_active_last_48                                                                                0.0055
context_study_period                                                                                  0.8362
context_k10_response_sum_class                                                                        0.9617
as.factor(arm)B2 Modular Rationale Clinical TrialZzmodular_rationale:context_is_weekday               0.7893
as.factor(arm)B2 Modular Rationale Clinical TrialZzmodular_rationale:context_is_preferred_time        0.2342
as.factor(arm)B2 Modular Rationale Clinical TrialZzmodular_rationale:context_time_of_day_period       0.2606
as.factor(arm)B2 Modular Rationale Clinical TrialZzmodular_rationale:context_active_last_48           0.0181
as.factor(arm)B2 Modular Rationale Clinical TrialZzmodular_rationale:context_study_period             0.2113
as.factor(arm)B2 Modular Rationale Clinical TrialZzmodular_rationale:context_k10_response_sum_class   0.1107
                                                                                                      
(Intercept)                                                                                         * 
as.factor(arm)B2 Modular Rationale Clinical TrialZzmodular_rationale                                * 
context_is_weekday                                                                                    
context_is_preferred_time                                                                           * 
context_time_of_day_period                                                                            
context_active_last_48                                                                              **
context_study_period                                                                                  
context_k10_response_sum_class                                                                        
as.factor(arm)B2 Modular Rationale Clinical TrialZzmodular_rationale:context_is_weekday               
as.factor(arm)B2 Modular Rationale Clinical TrialZzmodular_rationale:context_is_preferred_time        
as.factor(arm)B2 Modular Rationale Clinical TrialZzmodular_rationale:context_time_of_day_period       
as.factor(arm)B2 Modular Rationale Clinical TrialZzmodular_rationale:context_active_last_48         * 
as.factor(arm)B2 Modular Rationale Clinical TrialZzmodular_rationale:context_study_period             
as.factor(arm)B2 Modular Rationale Clinical TrialZzmodular_rationale:context_k10_response_sum_class   
---
Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1

Residual standard error: 0.2633 on 41 degrees of freedom
  (114 observations deleted due to missingness)
Multiple R-squared:  0.4594,    Adjusted R-squared:  0.2879 
F-statistic:  2.68 on 13 and 41 DF,  p-value: 0.008127

For B3:

df |> 
  filter(mooclet_id == 585) |>
  lm(formula = reward ~ as.factor(arm) +
       context_is_weekday*as.factor(arm) + 
       context_is_preferred_time*as.factor(arm) + 
       context_time_of_day_period*as.factor(arm) + 
       context_active_last_48*as.factor(arm) + 
       context_study_period*as.factor(arm) + 
       context_k10_response_sum_class*as.factor(arm)) |>
  summary()

Call:
lm(formula = reward ~ as.factor(arm) + context_is_weekday * as.factor(arm) + 
    context_is_preferred_time * as.factor(arm) + context_time_of_day_period * 
    as.factor(arm) + context_active_last_48 * as.factor(arm) + 
    context_study_period * as.factor(arm) + context_k10_response_sum_class * 
    as.factor(arm), data = filter(df, mooclet_id == 585))

Residuals:
    Min      1Q  Median      3Q     Max 
-0.5343 -0.1485  0.0000  0.1379  0.5887 

Coefficients: (4 not defined because of singularities)
                                                                                                         Estimate
(Intercept)                                                                                             -0.116253
as.factor(arm)B3 Modular Interaction Clinical TrialZzreflection_question                                 0.595850
as.factor(arm)B3 Modular Interaction Clinical TrialZzshort_prompt                                        0.019883
as.factor(arm)B3 Modular Interaction Clinical TrialZzstories                                            -0.345957
context_is_weekday                                                                                       0.292219
context_is_preferred_time                                                                                0.328541
context_time_of_day_period                                                                               0.004742
context_active_last_48                                                                                  -0.288246
context_study_period                                                                                    -0.109970
context_k10_response_sum_class                                                                           0.750456
as.factor(arm)B3 Modular Interaction Clinical TrialZzreflection_question:context_is_weekday             -0.363218
as.factor(arm)B3 Modular Interaction Clinical TrialZzshort_prompt:context_is_weekday                    -0.072027
as.factor(arm)B3 Modular Interaction Clinical TrialZzstories:context_is_weekday                         -0.542523
as.factor(arm)B3 Modular Interaction Clinical TrialZzreflection_question:context_is_preferred_time      -0.355754
as.factor(arm)B3 Modular Interaction Clinical TrialZzshort_prompt:context_is_preferred_time              0.035882
as.factor(arm)B3 Modular Interaction Clinical TrialZzstories:context_is_preferred_time                  -0.078541
as.factor(arm)B3 Modular Interaction Clinical TrialZzreflection_question:context_time_of_day_period      0.282836
as.factor(arm)B3 Modular Interaction Clinical TrialZzshort_prompt:context_time_of_day_period            -0.164117
as.factor(arm)B3 Modular Interaction Clinical TrialZzstories:context_time_of_day_period                 -0.755198
as.factor(arm)B3 Modular Interaction Clinical TrialZzreflection_question:context_active_last_48                NA
as.factor(arm)B3 Modular Interaction Clinical TrialZzshort_prompt:context_active_last_48                       NA
as.factor(arm)B3 Modular Interaction Clinical TrialZzstories:context_active_last_48                            NA
as.factor(arm)B3 Modular Interaction Clinical TrialZzreflection_question:context_study_period            0.176158
as.factor(arm)B3 Modular Interaction Clinical TrialZzshort_prompt:context_study_period                   0.630643
as.factor(arm)B3 Modular Interaction Clinical TrialZzstories:context_study_period                        0.860426
as.factor(arm)B3 Modular Interaction Clinical TrialZzreflection_question:context_k10_response_sum_class -0.569533
as.factor(arm)B3 Modular Interaction Clinical TrialZzshort_prompt:context_k10_response_sum_class        -0.606946
as.factor(arm)B3 Modular Interaction Clinical TrialZzstories:context_k10_response_sum_class                    NA
                                                                                                        Std. Error
(Intercept)                                                                                               0.884507
as.factor(arm)B3 Modular Interaction Clinical TrialZzreflection_question                                  1.022531
as.factor(arm)B3 Modular Interaction Clinical TrialZzshort_prompt                                         1.258732
as.factor(arm)B3 Modular Interaction Clinical TrialZzstories                                              1.164421
context_is_weekday                                                                                        0.241466
context_is_preferred_time                                                                                 0.187181
context_time_of_day_period                                                                                0.247130
context_active_last_48                                                                                    0.225372
context_study_period                                                                                      0.539763
context_k10_response_sum_class                                                                            0.543341
as.factor(arm)B3 Modular Interaction Clinical TrialZzreflection_question:context_is_weekday               0.279447
as.factor(arm)B3 Modular Interaction Clinical TrialZzshort_prompt:context_is_weekday                      0.349090
as.factor(arm)B3 Modular Interaction Clinical TrialZzstories:context_is_weekday                           1.379424
as.factor(arm)B3 Modular Interaction Clinical TrialZzreflection_question:context_is_preferred_time        0.236743
as.factor(arm)B3 Modular Interaction Clinical TrialZzshort_prompt:context_is_preferred_time               0.275491
as.factor(arm)B3 Modular Interaction Clinical TrialZzstories:context_is_preferred_time                    0.842336
as.factor(arm)B3 Modular Interaction Clinical TrialZzreflection_question:context_time_of_day_period       0.321471
as.factor(arm)B3 Modular Interaction Clinical TrialZzshort_prompt:context_time_of_day_period              0.429394
as.factor(arm)B3 Modular Interaction Clinical TrialZzstories:context_time_of_day_period                   1.394281
as.factor(arm)B3 Modular Interaction Clinical TrialZzreflection_question:context_active_last_48                 NA
as.factor(arm)B3 Modular Interaction Clinical TrialZzshort_prompt:context_active_last_48                        NA
as.factor(arm)B3 Modular Interaction Clinical TrialZzstories:context_active_last_48                             NA
as.factor(arm)B3 Modular Interaction Clinical TrialZzreflection_question:context_study_period             0.693336
as.factor(arm)B3 Modular Interaction Clinical TrialZzshort_prompt:context_study_period                    0.949372
as.factor(arm)B3 Modular Interaction Clinical TrialZzstories:context_study_period                         2.213072
as.factor(arm)B3 Modular Interaction Clinical TrialZzreflection_question:context_k10_response_sum_class   0.699594
as.factor(arm)B3 Modular Interaction Clinical TrialZzshort_prompt:context_k10_response_sum_class          0.825342
as.factor(arm)B3 Modular Interaction Clinical TrialZzstories:context_k10_response_sum_class                     NA
                                                                                                        t value
(Intercept)                                                                                              -0.131
as.factor(arm)B3 Modular Interaction Clinical TrialZzreflection_question                                  0.583
as.factor(arm)B3 Modular Interaction Clinical TrialZzshort_prompt                                         0.016
as.factor(arm)B3 Modular Interaction Clinical TrialZzstories                                             -0.297
context_is_weekday                                                                                        1.210
context_is_preferred_time                                                                                 1.755
context_time_of_day_period                                                                                0.019
context_active_last_48                                                                                   -1.279
context_study_period                                                                                     -0.204
context_k10_response_sum_class                                                                            1.381
as.factor(arm)B3 Modular Interaction Clinical TrialZzreflection_question:context_is_weekday              -1.300
as.factor(arm)B3 Modular Interaction Clinical TrialZzshort_prompt:context_is_weekday                     -0.206
as.factor(arm)B3 Modular Interaction Clinical TrialZzstories:context_is_weekday                          -0.393
as.factor(arm)B3 Modular Interaction Clinical TrialZzreflection_question:context_is_preferred_time       -1.503
as.factor(arm)B3 Modular Interaction Clinical TrialZzshort_prompt:context_is_preferred_time               0.130
as.factor(arm)B3 Modular Interaction Clinical TrialZzstories:context_is_preferred_time                   -0.093
as.factor(arm)B3 Modular Interaction Clinical TrialZzreflection_question:context_time_of_day_period       0.880
as.factor(arm)B3 Modular Interaction Clinical TrialZzshort_prompt:context_time_of_day_period             -0.382
as.factor(arm)B3 Modular Interaction Clinical TrialZzstories:context_time_of_day_period                  -0.542
as.factor(arm)B3 Modular Interaction Clinical TrialZzreflection_question:context_active_last_48              NA
as.factor(arm)B3 Modular Interaction Clinical TrialZzshort_prompt:context_active_last_48                     NA
as.factor(arm)B3 Modular Interaction Clinical TrialZzstories:context_active_last_48                          NA
as.factor(arm)B3 Modular Interaction Clinical TrialZzreflection_question:context_study_period             0.254
as.factor(arm)B3 Modular Interaction Clinical TrialZzshort_prompt:context_study_period                    0.664
as.factor(arm)B3 Modular Interaction Clinical TrialZzstories:context_study_period                         0.389
as.factor(arm)B3 Modular Interaction Clinical TrialZzreflection_question:context_k10_response_sum_class  -0.814
as.factor(arm)B3 Modular Interaction Clinical TrialZzshort_prompt:context_k10_response_sum_class         -0.735
as.factor(arm)B3 Modular Interaction Clinical TrialZzstories:context_k10_response_sum_class                  NA
                                                                                                        Pr(>|t|)
(Intercept)                                                                                               0.8963
as.factor(arm)B3 Modular Interaction Clinical TrialZzreflection_question                                  0.5643
as.factor(arm)B3 Modular Interaction Clinical TrialZzshort_prompt                                         0.9875
as.factor(arm)B3 Modular Interaction Clinical TrialZzstories                                              0.7684
context_is_weekday                                                                                        0.2354
context_is_preferred_time                                                                                 0.0891
context_time_of_day_period                                                                                0.9848
context_active_last_48                                                                                    0.2104
context_study_period                                                                                      0.8399
context_k10_response_sum_class                                                                            0.1771
as.factor(arm)B3 Modular Interaction Clinical TrialZzreflection_question:context_is_weekday               0.2033
as.factor(arm)B3 Modular Interaction Clinical TrialZzshort_prompt:context_is_weekday                      0.8379
as.factor(arm)B3 Modular Interaction Clinical TrialZzstories:context_is_weekday                           0.6968
as.factor(arm)B3 Modular Interaction Clinical TrialZzreflection_question:context_is_preferred_time        0.1430
as.factor(arm)B3 Modular Interaction Clinical TrialZzshort_prompt:context_is_preferred_time               0.8972
as.factor(arm)B3 Modular Interaction Clinical TrialZzstories:context_is_preferred_time                    0.9263
as.factor(arm)B3 Modular Interaction Clinical TrialZzreflection_question:context_time_of_day_period       0.3857
as.factor(arm)B3 Modular Interaction Clinical TrialZzshort_prompt:context_time_of_day_period              0.7049
as.factor(arm)B3 Modular Interaction Clinical TrialZzstories:context_time_of_day_period                   0.5919
as.factor(arm)B3 Modular Interaction Clinical TrialZzreflection_question:context_active_last_48               NA
as.factor(arm)B3 Modular Interaction Clinical TrialZzshort_prompt:context_active_last_48                      NA
as.factor(arm)B3 Modular Interaction Clinical TrialZzstories:context_active_last_48                           NA
as.factor(arm)B3 Modular Interaction Clinical TrialZzreflection_question:context_study_period             0.8011
as.factor(arm)B3 Modular Interaction Clinical TrialZzshort_prompt:context_study_period                    0.5114
as.factor(arm)B3 Modular Interaction Clinical TrialZzstories:context_study_period                         0.7001
as.factor(arm)B3 Modular Interaction Clinical TrialZzreflection_question:context_k10_response_sum_class   0.4218
as.factor(arm)B3 Modular Interaction Clinical TrialZzshort_prompt:context_k10_response_sum_class          0.4676
as.factor(arm)B3 Modular Interaction Clinical TrialZzstories:context_k10_response_sum_class                   NA
                                                                                                         
(Intercept)                                                                                              
as.factor(arm)B3 Modular Interaction Clinical TrialZzreflection_question                                 
as.factor(arm)B3 Modular Interaction Clinical TrialZzshort_prompt                                        
as.factor(arm)B3 Modular Interaction Clinical TrialZzstories                                             
context_is_weekday                                                                                       
context_is_preferred_time                                                                               .
context_time_of_day_period                                                                               
context_active_last_48                                                                                   
context_study_period                                                                                     
context_k10_response_sum_class                                                                           
as.factor(arm)B3 Modular Interaction Clinical TrialZzreflection_question:context_is_weekday              
as.factor(arm)B3 Modular Interaction Clinical TrialZzshort_prompt:context_is_weekday                     
as.factor(arm)B3 Modular Interaction Clinical TrialZzstories:context_is_weekday                          
as.factor(arm)B3 Modular Interaction Clinical TrialZzreflection_question:context_is_preferred_time       
as.factor(arm)B3 Modular Interaction Clinical TrialZzshort_prompt:context_is_preferred_time              
as.factor(arm)B3 Modular Interaction Clinical TrialZzstories:context_is_preferred_time                   
as.factor(arm)B3 Modular Interaction Clinical TrialZzreflection_question:context_time_of_day_period      
as.factor(arm)B3 Modular Interaction Clinical TrialZzshort_prompt:context_time_of_day_period             
as.factor(arm)B3 Modular Interaction Clinical TrialZzstories:context_time_of_day_period                  
as.factor(arm)B3 Modular Interaction Clinical TrialZzreflection_question:context_active_last_48          
as.factor(arm)B3 Modular Interaction Clinical TrialZzshort_prompt:context_active_last_48                 
as.factor(arm)B3 Modular Interaction Clinical TrialZzstories:context_active_last_48                      
as.factor(arm)B3 Modular Interaction Clinical TrialZzreflection_question:context_study_period            
as.factor(arm)B3 Modular Interaction Clinical TrialZzshort_prompt:context_study_period                   
as.factor(arm)B3 Modular Interaction Clinical TrialZzstories:context_study_period                        
as.factor(arm)B3 Modular Interaction Clinical TrialZzreflection_question:context_k10_response_sum_class  
as.factor(arm)B3 Modular Interaction Clinical TrialZzshort_prompt:context_k10_response_sum_class         
as.factor(arm)B3 Modular Interaction Clinical TrialZzstories:context_k10_response_sum_class              
---
Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1

Residual standard error: 0.2904 on 31 degrees of freedom
  (111 observations deleted due to missingness)
Multiple R-squared:  0.5028,    Adjusted R-squared:  0.1339 
F-statistic: 1.363 on 23 and 31 DF,  p-value: 0.2083

For C1:

df |> 
  filter(mooclet_id == 586) |>
  glm(formula = as.factor(reward) ~ as.factor(arm)+
        context_is_weekday*as.factor(arm) + 
        context_is_preferred_time*as.factor(arm) + 
        context_time_of_day_period*as.factor(arm) + 
        context_active_last_48*as.factor(arm) + 
        context_study_period*as.factor(arm) + 
        context_k10_response_sum_class*as.factor(arm), family = binomial) |>
  summary()

Call:
glm(formula = as.factor(reward) ~ as.factor(arm) + context_is_weekday * 
    as.factor(arm) + context_is_preferred_time * as.factor(arm) + 
    context_time_of_day_period * as.factor(arm) + context_active_last_48 * 
    as.factor(arm) + context_study_period * as.factor(arm) + 
    context_k10_response_sum_class * as.factor(arm), family = binomial, 
    data = filter(df, mooclet_id == 586))

Deviance Residuals: 
     Min        1Q    Median        3Q       Max  
-2.12308  -0.58694  -0.26130  -0.08099   2.60552  

Coefficients:
                                                                                                    Estimate
(Intercept)                                                                                           2.8945
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzis_loss                                       -0.8518
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzno_rationale                                 -19.0214
context_is_weekday                                                                                    1.2751
context_is_preferred_time                                                                             0.4491
context_time_of_day_period                                                                            0.6230
context_active_last_48                                                                                0.1557
context_study_period                                                                                 -4.0436
context_k10_response_sum_class                                                                       -3.8511
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzis_loss:context_is_weekday                    -1.1239
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzno_rationale:context_is_weekday               -0.4535
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzis_loss:context_is_preferred_time              0.6183
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzno_rationale:context_is_preferred_time         0.7447
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzis_loss:context_time_of_day_period            -0.2888
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzno_rationale:context_time_of_day_period        0.3152
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzis_loss:context_active_last_48                 2.0196
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzno_rationale:context_active_last_48           16.0240
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzis_loss:context_study_period                   1.3746
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzno_rationale:context_study_period              4.4163
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzis_loss:context_k10_response_sum_class        -1.3923
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzno_rationale:context_k10_response_sum_class    0.8089
                                                                                                   Std. Error
(Intercept)                                                                                            3.0175
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzis_loss                                         3.5857
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzno_rationale                                 1028.0813
context_is_weekday                                                                                     1.9334
context_is_preferred_time                                                                              1.2120
context_time_of_day_period                                                                             2.0261
context_active_last_48                                                                                 1.3046
context_study_period                                                                                   1.8871
context_k10_response_sum_class                                                                         2.0417
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzis_loss:context_is_weekday                      2.1365
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzno_rationale:context_is_weekday                 2.4296
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzis_loss:context_is_preferred_time               1.3650
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzno_rationale:context_is_preferred_time          2.0182
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzis_loss:context_time_of_day_period              2.2673
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzno_rationale:context_time_of_day_period         2.5178
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzis_loss:context_active_last_48                  1.7641
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzno_rationale:context_active_last_48          1028.0692
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzis_loss:context_study_period                    2.0470
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzno_rationale:context_study_period               3.0651
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzis_loss:context_k10_response_sum_class          2.3255
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzno_rationale:context_k10_response_sum_class     3.2940
                                                                                                   z value
(Intercept)                                                                                          0.959
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzis_loss                                      -0.238
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzno_rationale                                 -0.019
context_is_weekday                                                                                   0.660
context_is_preferred_time                                                                            0.371
context_time_of_day_period                                                                           0.307
context_active_last_48                                                                               0.119
context_study_period                                                                                -2.143
context_k10_response_sum_class                                                                      -1.886
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzis_loss:context_is_weekday                   -0.526
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzno_rationale:context_is_weekday              -0.187
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzis_loss:context_is_preferred_time             0.453
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzno_rationale:context_is_preferred_time        0.369
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzis_loss:context_time_of_day_period           -0.127
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzno_rationale:context_time_of_day_period       0.125
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzis_loss:context_active_last_48                1.145
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzno_rationale:context_active_last_48           0.016
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzis_loss:context_study_period                  0.672
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzno_rationale:context_study_period             1.441
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzis_loss:context_k10_response_sum_class       -0.599
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzno_rationale:context_k10_response_sum_class   0.246
                                                                                                   Pr(>|z|)
(Intercept)                                                                                          0.3374
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzis_loss                                       0.8122
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzno_rationale                                  0.9852
context_is_weekday                                                                                   0.5096
context_is_preferred_time                                                                            0.7110
context_time_of_day_period                                                                           0.7585
context_active_last_48                                                                               0.9050
context_study_period                                                                                 0.0321
context_k10_response_sum_class                                                                       0.0593
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzis_loss:context_is_weekday                    0.5989
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzno_rationale:context_is_weekday               0.8519
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzis_loss:context_is_preferred_time             0.6506
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzno_rationale:context_is_preferred_time        0.7121
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzis_loss:context_time_of_day_period            0.8986
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzno_rationale:context_time_of_day_period       0.9004
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzis_loss:context_active_last_48                0.2523
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzno_rationale:context_active_last_48           0.9876
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzis_loss:context_study_period                  0.5019
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzno_rationale:context_study_period             0.1496
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzis_loss:context_k10_response_sum_class        0.5494
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzno_rationale:context_k10_response_sum_class   0.8060
                                                                                                    
(Intercept)                                                                                         
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzis_loss                                      
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzno_rationale                                 
context_is_weekday                                                                                  
context_is_preferred_time                                                                           
context_time_of_day_period                                                                          
context_active_last_48                                                                              
context_study_period                                                                               *
context_k10_response_sum_class                                                                     .
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzis_loss:context_is_weekday                   
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzno_rationale:context_is_weekday              
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzis_loss:context_is_preferred_time            
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzno_rationale:context_is_preferred_time       
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzis_loss:context_time_of_day_period           
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzno_rationale:context_time_of_day_period      
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzis_loss:context_active_last_48               
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzno_rationale:context_active_last_48          
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzis_loss:context_study_period                 
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzno_rationale:context_study_period            
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzis_loss:context_k10_response_sum_class       
as.factor(arm)C1 Long Prompt Rationale Clinical TrialZzno_rationale:context_k10_response_sum_class  
---
Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1

(Dispersion parameter for binomial family taken to be 1)

    Null deviance: 307.02  on 308  degrees of freedom
Residual deviance: 205.77  on 288  degrees of freedom
  (34 observations deleted due to missingness)
AIC: 247.77

Number of Fisher Scoring iterations: 16

For C2:

df |> 
  filter(mooclet_id == 587) |>
  glm(formula = as.factor(reward) ~ as.factor(arm)+
        context_is_weekday*as.factor(arm) + 
        context_is_preferred_time*as.factor(arm) + 
        context_time_of_day_period*as.factor(arm) + 
        context_active_last_48*as.factor(arm) + 
        context_study_period*as.factor(arm) + 
        context_k10_response_sum_class*as.factor(arm), family = binomial) |>
  summary()
Warning: glm.fit: fitted probabilities numerically 0 or 1 occurred

Call:
glm(formula = as.factor(reward) ~ as.factor(arm) + context_is_weekday * 
    as.factor(arm) + context_is_preferred_time * as.factor(arm) + 
    context_time_of_day_period * as.factor(arm) + context_active_last_48 * 
    as.factor(arm) + context_study_period * as.factor(arm) + 
    context_k10_response_sum_class * as.factor(arm), family = binomial, 
    data = filter(df, mooclet_id == 587))

Deviance Residuals: 
    Min       1Q   Median       3Q      Max  
-1.9088  -0.7745  -0.2533   0.7817   2.2704  

Coefficients:
                                                                                                       Estimate
(Intercept)                                                                                            -1.11809
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzinspiration                                   -23.65890
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzno_motivation                                  -0.33943
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzperspective                                   -56.85812
context_is_weekday                                                                                      1.09356
context_is_preferred_time                                                                               0.19319
context_time_of_day_period                                                                             -0.98858
context_active_last_48                                                                                  1.15727
context_study_period                                                                                   -3.29951
context_k10_response_sum_class                                                                          1.20187
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzinspiration:context_is_weekday                 -3.59813
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzno_motivation:context_is_weekday               -1.04260
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzperspective:context_is_weekday                -16.55645
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzinspiration:context_is_preferred_time           0.96561
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzno_motivation:context_is_preferred_time        -0.14258
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzperspective:context_is_preferred_time           0.00260
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzinspiration:context_time_of_day_period          6.17870
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzno_motivation:context_time_of_day_period        0.34733
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzperspective:context_time_of_day_period         41.35400
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzinspiration:context_active_last_48             19.71465
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzno_motivation:context_active_last_48            0.04079
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzperspective:context_active_last_48             56.76101
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzinspiration:context_study_period                1.22581
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzno_motivation:context_study_period              0.82817
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzperspective:context_study_period                1.45095
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzinspiration:context_k10_response_sum_class      3.43411
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzno_motivation:context_k10_response_sum_class    1.10347
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzperspective:context_k10_response_sum_class      0.92178
                                                                                                     Std. Error
(Intercept)                                                                                             2.41712
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzinspiration                                  4667.37479
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzno_motivation                                   3.02574
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzperspective                                  4110.19180
context_is_weekday                                                                                      1.24113
context_is_preferred_time                                                                               0.81465
context_time_of_day_period                                                                              2.19812
context_active_last_48                                                                                  0.92781
context_study_period                                                                                    1.31827
context_k10_response_sum_class                                                                          1.88242
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzinspiration:context_is_weekday                  2.37248
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzno_motivation:context_is_weekday                1.44975
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzperspective:context_is_weekday               1124.21367
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzinspiration:context_is_preferred_time           1.32404
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzno_motivation:context_is_preferred_time         1.02704
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzperspective:context_is_preferred_time           0.99537
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzinspiration:context_time_of_day_period          5.61222
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzno_motivation:context_time_of_day_period        2.81953
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzperspective:context_time_of_day_period       3372.64010
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzinspiration:context_active_last_48           4667.37280
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzno_motivation:context_active_last_48            1.14728
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzperspective:context_active_last_48           4110.19035
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzinspiration:context_study_period                1.96087
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzno_motivation:context_study_period              1.66359
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzperspective:context_study_period                1.61939
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzinspiration:context_k10_response_sum_class      3.84365
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzno_motivation:context_k10_response_sum_class    2.36492
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzperspective:context_k10_response_sum_class      2.27453
                                                                                                     z value
(Intercept)                                                                                           -0.463
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzinspiration                                   -0.005
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzno_motivation                                 -0.112
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzperspective                                   -0.014
context_is_weekday                                                                                     0.881
context_is_preferred_time                                                                              0.237
context_time_of_day_period                                                                            -0.450
context_active_last_48                                                                                 1.247
context_study_period                                                                                  -2.503
context_k10_response_sum_class                                                                         0.638
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzinspiration:context_is_weekday                -1.517
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzno_motivation:context_is_weekday              -0.719
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzperspective:context_is_weekday                -0.015
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzinspiration:context_is_preferred_time          0.729
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzno_motivation:context_is_preferred_time       -0.139
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzperspective:context_is_preferred_time          0.003
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzinspiration:context_time_of_day_period         1.101
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzno_motivation:context_time_of_day_period       0.123
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzperspective:context_time_of_day_period         0.012
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzinspiration:context_active_last_48             0.004
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzno_motivation:context_active_last_48           0.036
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzperspective:context_active_last_48             0.014
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzinspiration:context_study_period               0.625
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzno_motivation:context_study_period             0.498
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzperspective:context_study_period               0.896
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzinspiration:context_k10_response_sum_class     0.893
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzno_motivation:context_k10_response_sum_class   0.467
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzperspective:context_k10_response_sum_class     0.405
                                                                                                     Pr(>|z|)
(Intercept)                                                                                            0.6437
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzinspiration                                    0.9960
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzno_motivation                                  0.9107
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzperspective                                    0.9890
context_is_weekday                                                                                     0.3783
context_is_preferred_time                                                                              0.8125
context_time_of_day_period                                                                             0.6529
context_active_last_48                                                                                 0.2123
context_study_period                                                                                   0.0123
context_k10_response_sum_class                                                                         0.5232
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzinspiration:context_is_weekday                 0.1294
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzno_motivation:context_is_weekday               0.4720
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzperspective:context_is_weekday                 0.9882
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzinspiration:context_is_preferred_time          0.4658
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzno_motivation:context_is_preferred_time        0.8896
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzperspective:context_is_preferred_time          0.9979
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzinspiration:context_time_of_day_period         0.2709
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzno_motivation:context_time_of_day_period       0.9020
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzperspective:context_time_of_day_period         0.9902
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzinspiration:context_active_last_48             0.9966
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzno_motivation:context_active_last_48           0.9716
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzperspective:context_active_last_48             0.9890
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzinspiration:context_study_period               0.5319
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzno_motivation:context_study_period             0.6186
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzperspective:context_study_period               0.3703
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzinspiration:context_k10_response_sum_class     0.3716
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzno_motivation:context_k10_response_sum_class   0.6408
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzperspective:context_k10_response_sum_class     0.6853
                                                                                                      
(Intercept)                                                                                           
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzinspiration                                   
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzno_motivation                                 
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzperspective                                   
context_is_weekday                                                                                    
context_is_preferred_time                                                                             
context_time_of_day_period                                                                            
context_active_last_48                                                                                
context_study_period                                                                                 *
context_k10_response_sum_class                                                                        
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzinspiration:context_is_weekday                
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzno_motivation:context_is_weekday              
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzperspective:context_is_weekday                
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzinspiration:context_is_preferred_time         
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzno_motivation:context_is_preferred_time       
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzperspective:context_is_preferred_time         
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzinspiration:context_time_of_day_period        
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzno_motivation:context_time_of_day_period      
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzperspective:context_time_of_day_period        
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzinspiration:context_active_last_48            
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzno_motivation:context_active_last_48          
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzperspective:context_active_last_48            
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzinspiration:context_study_period              
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzno_motivation:context_study_period            
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzperspective:context_study_period              
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzinspiration:context_k10_response_sum_class    
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzno_motivation:context_k10_response_sum_class  
as.factor(arm)C2 Long Prompt Motivation Clinical TrialZzperspective:context_k10_response_sum_class    
---
Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1

(Dispersion parameter for binomial family taken to be 1)

    Null deviance: 418.54  on 321  degrees of freedom
Residual deviance: 296.93  on 294  degrees of freedom
  (22 observations deleted due to missingness)
AIC: 352.93

Number of Fisher Scoring iterations: 19

For C3:

df |> 
  filter(mooclet_id == 588) |>
  glm(formula = as.factor(reward) ~ as.factor(arm)+
        context_is_weekday*as.factor(arm) + 
        context_is_preferred_time*as.factor(arm) + 
        context_time_of_day_period*as.factor(arm) + 
        context_active_last_48*as.factor(arm) + 
        context_study_period*as.factor(arm) + 
        context_k10_response_sum_class*as.factor(arm), family = binomial) |>
  summary()

Call:
glm(formula = as.factor(reward) ~ as.factor(arm) + context_is_weekday * 
    as.factor(arm) + context_is_preferred_time * as.factor(arm) + 
    context_time_of_day_period * as.factor(arm) + context_active_last_48 * 
    as.factor(arm) + context_study_period * as.factor(arm) + 
    context_k10_response_sum_class * as.factor(arm), family = binomial, 
    data = filter(df, mooclet_id == 588))

Deviance Residuals: 
    Min       1Q   Median       3Q      Max  
-2.0142  -0.8705  -0.2739   0.9049   2.4721  

Coefficients:
                                                                                                  Estimate
(Intercept)                                                                                        -2.6540
as.factor(arm)C3 Long Prompt Reminder Clinical TrialZzno_reminder                                 -14.9251
context_is_weekday                                                                                 -0.5605
context_is_preferred_time                                                                           0.2568
context_time_of_day_period                                                                          0.2610
context_active_last_48                                                                              2.6830
context_study_period                                                                               -1.8939
context_k10_response_sum_class                                                                      1.2837
as.factor(arm)C3 Long Prompt Reminder Clinical TrialZzno_reminder:context_is_weekday                6.9597
as.factor(arm)C3 Long Prompt Reminder Clinical TrialZzno_reminder:context_is_preferred_time        -0.4678
as.factor(arm)C3 Long Prompt Reminder Clinical TrialZzno_reminder:context_time_of_day_period      -23.8701
as.factor(arm)C3 Long Prompt Reminder Clinical TrialZzno_reminder:context_active_last_48           14.8003
as.factor(arm)C3 Long Prompt Reminder Clinical TrialZzno_reminder:context_study_period             -2.2122
as.factor(arm)C3 Long Prompt Reminder Clinical TrialZzno_reminder:context_k10_response_sum_class    2.2792
                                                                                                 Std. Error
(Intercept)                                                                                          1.1663
as.factor(arm)C3 Long Prompt Reminder Clinical TrialZzno_reminder                                  978.2451
context_is_weekday                                                                                   0.5781
context_is_preferred_time                                                                            0.3376
context_time_of_day_period                                                                           1.1965
context_active_last_48                                                                               0.4665
context_study_period                                                                                 0.5458
context_k10_response_sum_class                                                                       0.9712
as.factor(arm)C3 Long Prompt Reminder Clinical TrialZzno_reminder:context_is_weekday              1978.0905
as.factor(arm)C3 Long Prompt Reminder Clinical TrialZzno_reminder:context_is_preferred_time          0.9573
as.factor(arm)C3 Long Prompt Reminder Clinical TrialZzno_reminder:context_time_of_day_period      5934.2709
as.factor(arm)C3 Long Prompt Reminder Clinical TrialZzno_reminder:context_active_last_48           978.2422
as.factor(arm)C3 Long Prompt Reminder Clinical TrialZzno_reminder:context_study_period               1.9079
as.factor(arm)C3 Long Prompt Reminder Clinical TrialZzno_reminder:context_k10_response_sum_class     1.9250
                                                                                                 z value
(Intercept)                                                                                       -2.275
as.factor(arm)C3 Long Prompt Reminder Clinical TrialZzno_reminder                                 -0.015
context_is_weekday                                                                                -0.969
context_is_preferred_time                                                                          0.761
context_time_of_day_period                                                                         0.218
context_active_last_48                                                                             5.752
context_study_period                                                                              -3.470
context_k10_response_sum_class                                                                     1.322
as.factor(arm)C3 Long Prompt Reminder Clinical TrialZzno_reminder:context_is_weekday               0.004
as.factor(arm)C3 Long Prompt Reminder Clinical TrialZzno_reminder:context_is_preferred_time       -0.489
as.factor(arm)C3 Long Prompt Reminder Clinical TrialZzno_reminder:context_time_of_day_period      -0.004
as.factor(arm)C3 Long Prompt Reminder Clinical TrialZzno_reminder:context_active_last_48           0.015
as.factor(arm)C3 Long Prompt Reminder Clinical TrialZzno_reminder:context_study_period            -1.159
as.factor(arm)C3 Long Prompt Reminder Clinical TrialZzno_reminder:context_k10_response_sum_class   1.184
                                                                                                 Pr(>|z|)
(Intercept)                                                                                      0.022878
as.factor(arm)C3 Long Prompt Reminder Clinical TrialZzno_reminder                                0.987827
context_is_weekday                                                                               0.332309
context_is_preferred_time                                                                        0.446814
context_time_of_day_period                                                                       0.827346
context_active_last_48                                                                           8.84e-09
context_study_period                                                                             0.000521
context_k10_response_sum_class                                                                   0.186231
as.factor(arm)C3 Long Prompt Reminder Clinical TrialZzno_reminder:context_is_weekday             0.997193
as.factor(arm)C3 Long Prompt Reminder Clinical TrialZzno_reminder:context_is_preferred_time      0.625092
as.factor(arm)C3 Long Prompt Reminder Clinical TrialZzno_reminder:context_time_of_day_period     0.996791
as.factor(arm)C3 Long Prompt Reminder Clinical TrialZzno_reminder:context_active_last_48         0.987929
as.factor(arm)C3 Long Prompt Reminder Clinical TrialZzno_reminder:context_study_period           0.246255
as.factor(arm)C3 Long Prompt Reminder Clinical TrialZzno_reminder:context_k10_response_sum_class 0.236409
                                                                                                    
(Intercept)                                                                                      *  
as.factor(arm)C3 Long Prompt Reminder Clinical TrialZzno_reminder                                   
context_is_weekday                                                                                  
context_is_preferred_time                                                                           
context_time_of_day_period                                                                          
context_active_last_48                                                                           ***
context_study_period                                                                             ***
context_k10_response_sum_class                                                                      
as.factor(arm)C3 Long Prompt Reminder Clinical TrialZzno_reminder:context_is_weekday                
as.factor(arm)C3 Long Prompt Reminder Clinical TrialZzno_reminder:context_is_preferred_time         
as.factor(arm)C3 Long Prompt Reminder Clinical TrialZzno_reminder:context_time_of_day_period        
as.factor(arm)C3 Long Prompt Reminder Clinical TrialZzno_reminder:context_active_last_48            
as.factor(arm)C3 Long Prompt Reminder Clinical TrialZzno_reminder:context_study_period              
as.factor(arm)C3 Long Prompt Reminder Clinical TrialZzno_reminder:context_k10_response_sum_class    
---
Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1

(Dispersion parameter for binomial family taken to be 1)

    Null deviance: 459.36  on 370  degrees of freedom
Residual deviance: 333.46  on 357  degrees of freedom
  (20 observations deleted due to missingness)
AIC: 361.46

Number of Fisher Scoring iterations: 16

For C4:

df |> 
  filter(mooclet_id == 590) |>
  glm(formula = as.factor(reward) ~ as.factor(arm)+
        context_is_weekday*as.factor(arm) + 
        context_is_preferred_time*as.factor(arm) + 
        context_time_of_day_period*as.factor(arm) + 
        context_active_last_48*as.factor(arm) + 
        context_study_period*as.factor(arm) + 
        context_k10_response_sum_class*as.factor(arm), family = binomial) |>
  summary()

Call:
glm(formula = as.factor(reward) ~ as.factor(arm) + context_is_weekday * 
    as.factor(arm) + context_is_preferred_time * as.factor(arm) + 
    context_time_of_day_period * as.factor(arm) + context_active_last_48 * 
    as.factor(arm) + context_study_period * as.factor(arm) + 
    context_k10_response_sum_class * as.factor(arm), family = binomial, 
    data = filter(df, mooclet_id == 590))

Deviance Residuals: 
    Min       1Q   Median       3Q      Max  
-1.8628  -0.8073  -0.3007   0.8685   2.4604  

Coefficients:
                                                                                                                Estimate
(Intercept)                                                                                                     -1.61449
as.factor(arm)C4 Long Prompt Reflection Commitment Clinical TrialZzno_commitment                                -0.85897
context_is_weekday                                                                                              -0.40318
context_is_preferred_time                                                                                       -1.24103
context_time_of_day_period                                                                                      -0.05877
context_active_last_48                                                                                           2.21807
context_study_period                                                                                            -2.84620
context_k10_response_sum_class                                                                                   1.34749
as.factor(arm)C4 Long Prompt Reflection Commitment Clinical TrialZzno_commitment:context_is_weekday              0.63139
as.factor(arm)C4 Long Prompt Reflection Commitment Clinical TrialZzno_commitment:context_is_preferred_time      -1.34831
as.factor(arm)C4 Long Prompt Reflection Commitment Clinical TrialZzno_commitment:context_time_of_day_period      0.89230
as.factor(arm)C4 Long Prompt Reflection Commitment Clinical TrialZzno_commitment:context_active_last_48          0.77908
as.factor(arm)C4 Long Prompt Reflection Commitment Clinical TrialZzno_commitment:context_study_period            0.56476
as.factor(arm)C4 Long Prompt Reflection Commitment Clinical TrialZzno_commitment:context_k10_response_sum_class -0.40318
                                                                                                                Std. Error
(Intercept)                                                                                                        1.45125
as.factor(arm)C4 Long Prompt Reflection Commitment Clinical TrialZzno_commitment                                   2.11234
context_is_weekday                                                                                                 0.67181
context_is_preferred_time                                                                                          0.68688
context_time_of_day_period                                                                                         0.67287
context_active_last_48                                                                                             0.78760
context_study_period                                                                                               0.73859
context_k10_response_sum_class                                                                                     1.14329
as.factor(arm)C4 Long Prompt Reflection Commitment Clinical TrialZzno_commitment:context_is_weekday                0.93820
as.factor(arm)C4 Long Prompt Reflection Commitment Clinical TrialZzno_commitment:context_is_preferred_time         1.07870
as.factor(arm)C4 Long Prompt Reflection Commitment Clinical TrialZzno_commitment:context_time_of_day_period        0.93607
as.factor(arm)C4 Long Prompt Reflection Commitment Clinical TrialZzno_commitment:context_active_last_48            1.11055
as.factor(arm)C4 Long Prompt Reflection Commitment Clinical TrialZzno_commitment:context_study_period              1.07964
as.factor(arm)C4 Long Prompt Reflection Commitment Clinical TrialZzno_commitment:context_k10_response_sum_class    1.63025
                                                                                                                z value
(Intercept)                                                                                                      -1.112
as.factor(arm)C4 Long Prompt Reflection Commitment Clinical TrialZzno_commitment                                 -0.407
context_is_weekday                                                                                               -0.600
context_is_preferred_time                                                                                        -1.807
context_time_of_day_period                                                                                       -0.087
context_active_last_48                                                                                            2.816
context_study_period                                                                                             -3.854
context_k10_response_sum_class                                                                                    1.179
as.factor(arm)C4 Long Prompt Reflection Commitment Clinical TrialZzno_commitment:context_is_weekday               0.673
as.factor(arm)C4 Long Prompt Reflection Commitment Clinical TrialZzno_commitment:context_is_preferred_time       -1.250
as.factor(arm)C4 Long Prompt Reflection Commitment Clinical TrialZzno_commitment:context_time_of_day_period       0.953
as.factor(arm)C4 Long Prompt Reflection Commitment Clinical TrialZzno_commitment:context_active_last_48           0.702
as.factor(arm)C4 Long Prompt Reflection Commitment Clinical TrialZzno_commitment:context_study_period             0.523
as.factor(arm)C4 Long Prompt Reflection Commitment Clinical TrialZzno_commitment:context_k10_response_sum_class  -0.247
                                                                                                                Pr(>|z|)
(Intercept)                                                                                                     0.265931
as.factor(arm)C4 Long Prompt Reflection Commitment Clinical TrialZzno_commitment                                0.684268
context_is_weekday                                                                                              0.548418
context_is_preferred_time                                                                                       0.070800
context_time_of_day_period                                                                                      0.930402
context_active_last_48                                                                                          0.004859
context_study_period                                                                                            0.000116
context_k10_response_sum_class                                                                                  0.238557
as.factor(arm)C4 Long Prompt Reflection Commitment Clinical TrialZzno_commitment:context_is_weekday             0.500963
as.factor(arm)C4 Long Prompt Reflection Commitment Clinical TrialZzno_commitment:context_is_preferred_time      0.211320
as.factor(arm)C4 Long Prompt Reflection Commitment Clinical TrialZzno_commitment:context_time_of_day_period     0.340467
as.factor(arm)C4 Long Prompt Reflection Commitment Clinical TrialZzno_commitment:context_active_last_48         0.482975
as.factor(arm)C4 Long Prompt Reflection Commitment Clinical TrialZzno_commitment:context_study_period           0.600902
as.factor(arm)C4 Long Prompt Reflection Commitment Clinical TrialZzno_commitment:context_k10_response_sum_class 0.804668
                                                                                                                   
(Intercept)                                                                                                        
as.factor(arm)C4 Long Prompt Reflection Commitment Clinical TrialZzno_commitment                                   
context_is_weekday                                                                                                 
context_is_preferred_time                                                                                       .  
context_time_of_day_period                                                                                         
context_active_last_48                                                                                          ** 
context_study_period                                                                                            ***
context_k10_response_sum_class                                                                                     
as.factor(arm)C4 Long Prompt Reflection Commitment Clinical TrialZzno_commitment:context_is_weekday                
as.factor(arm)C4 Long Prompt Reflection Commitment Clinical TrialZzno_commitment:context_is_preferred_time         
as.factor(arm)C4 Long Prompt Reflection Commitment Clinical TrialZzno_commitment:context_time_of_day_period        
as.factor(arm)C4 Long Prompt Reflection Commitment Clinical TrialZzno_commitment:context_active_last_48            
as.factor(arm)C4 Long Prompt Reflection Commitment Clinical TrialZzno_commitment:context_study_period              
as.factor(arm)C4 Long Prompt Reflection Commitment Clinical TrialZzno_commitment:context_k10_response_sum_class    
---
Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1

(Dispersion parameter for binomial family taken to be 1)

    Null deviance: 417.67  on 320  degrees of freedom
Residual deviance: 306.26  on 307  degrees of freedom
  (22 observations deleted due to missingness)
AIC: 334.26

Number of Fisher Scoring iterations: 6