## 
## =========================================
## WAVE: wave_1 
## =========================================
## 
## CS Pedagogical Confidence
##  raw_alpha std.alpha   G6(smc) average_r      S/N         ase     mean       sd
##  0.9567964 0.9569212 0.9625136 0.7603827 22.21325 0.005001831 5.008189 1.392798
##   median_r
##  0.7739784
## 
## AI Pedagogical Confidence
##  raw_alpha std.alpha   G6(smc) average_r      S/N         ase     mean       sd
##  0.9726098 0.9730536 0.9762898 0.8376271 36.11065 0.003138384 4.621474 1.499072
##   median_r
##  0.8385561
## 
## CS Motivation
##  raw_alpha std.alpha   G6(smc) average_r      S/N       ase     mean       sd
##  0.9219957 0.9232799 0.8996528 0.8004575 12.03439 0.0103578 5.840764 0.965639
##   median_r
##  0.7703318
## 
## AI Motivation
##  raw_alpha std.alpha   G6(smc) average_r      S/N         ase    mean       sd
##  0.9528511 0.9532827 0.9326265 0.8718241 20.40534 0.006082256 5.26327 1.262562
##   median_r
##  0.8643612
## 
## CS Knowledge (Full Scale)
## Warning in psych::alpha(df_combined[, cs_full_items_w]): Some items were negatively correlated with the first principal component and probably 
## should be reversed.  
## To do this, run the function again with the 'check.keys=TRUE' option
## Some items ( functions_iops_wave_1_scored ) were negatively correlated with the first principal component and 
## probably should be reversed.  
## To do this, run the function again with the 'check.keys=TRUE' option raw_alpha std.alpha   G6(smc) average_r      S/N       ase      mean        sd
##  0.7190917 0.7303487 0.8071951 0.1096179 2.708493 0.0295791 0.2940809 0.3363301
##   median_r
##  0.1179663
## 
## GLAT (AI Knowledge)
##  raw_alpha std.alpha  G6(smc) average_r      S/N        ase      mean        sd
##  0.6898871 0.7023206 0.725774 0.1536083 2.359318 0.03346053 0.6479638 0.2050285
##   median_r
##  0.1256165
## 
## =========================================
## WAVE: wave_2 
## =========================================
## 
## CS Pedagogical Confidence
##  raw_alpha std.alpha  G6(smc) average_r      S/N        ase     mean       sd
##  0.9741151 0.9743243 0.975767  0.844262 37.94728 0.00297366 5.446788 1.372881
##   median_r
##  0.8397277
## 
## AI Pedagogical Confidence
##  raw_alpha std.alpha   G6(smc) average_r      S/N         ase     mean       sd
##   0.974664 0.9750834 0.9781129  0.848268 39.13396 0.002913629 5.238734 1.411133
##   median_r
##  0.8553585
## 
## CS Motivation
##  raw_alpha std.alpha   G6(smc) average_r      S/N         ase     mean      sd
##  0.9403299 0.9420358 0.9225483 0.8441722 16.25203 0.007895271 6.069351 1.05215
##   median_r
##  0.8178961
## 
## AI Motivation
##  raw_alpha std.alpha   G6(smc) average_r      S/N         ase     mean       sd
##  0.9485013 0.9500573 0.9314852 0.8637785 19.02295 0.006711123 5.841163 1.117419
##   median_r
##  0.8620702
## 
## CS Knowledge (Full Scale)
## Warning in psych::alpha(df_combined[, cs_full_items_w]): Some items were negatively correlated with the first principal component and probably 
## should be reversed.  
## To do this, run the function again with the 'check.keys=TRUE' option
## Some items ( functions_iops_wave_2_scored ) were negatively correlated with the first principal component and 
## probably should be reversed.  
## To do this, run the function again with the 'check.keys=TRUE' option raw_alpha std.alpha   G6(smc) average_r      S/N        ase      mean
##   0.787119 0.8001152 0.8640451   0.15394 4.002883 0.02229093 0.3297712
##         sd  median_r
##  0.3427513 0.1427243
## 
## GLAT (AI Knowledge)
##  raw_alpha std.alpha   G6(smc) average_r      S/N        ase      mean
##  0.7360064 0.7300801 0.7738311 0.1722277 2.704802 0.02806752 0.6767283
##         sd  median_r
##  0.2177037 0.1751255
## Warning in psych::alpha(df_combined[, scales[[s]]]): Some items were negatively correlated with the first principal component and probably 
## should be reversed.  
## To do this, run the function again with the 'check.keys=TRUE' option
## Some items ( functions_iops_wave_1_scored ) were negatively correlated with the first principal component and 
## probably should be reversed.  
## To do this, run the function again with the 'check.keys=TRUE' option
## Warning in psych::alpha(df_combined[, scales[[s]]]): Some items were negatively correlated with the first principal component and probably 
## should be reversed.  
## To do this, run the function again with the 'check.keys=TRUE' option
## Some items ( functions_iops_wave_2_scored ) were negatively correlated with the first principal component and 
## probably should be reversed.  
## To do this, run the function again with the 'check.keys=TRUE' option
##      Wave          Scale Alpha N_Items
## 1  wave_1 CS_Pedagogical 0.957       7
## 2  wave_1 AI_Pedagogical 0.973       7
## 3  wave_1  CS_Motivation 0.922       3
## 4  wave_1  AI_Motivation 0.953       3
## 5  wave_1   CS_Knowledge 0.719      22
## 6  wave_1           GLAT 0.690      13
## 7  wave_2 CS_Pedagogical 0.974       7
## 8  wave_2 AI_Pedagogical 0.975       7
## 9  wave_2  CS_Motivation 0.940       3
## 10 wave_2  AI_Motivation 0.949       3
## 11 wave_2   CS_Knowledge 0.787      22
## 12 wave_2           GLAT 0.736      13
## # A tibble: 104 × 1
## # Groups:   record_id [104]
##    record_id
##        <dbl>
##  1         8
##  2        11
##  3        12
##  4        13
##  5        16
##  6        24
##  7        26
##  8        27
##  9        28
## 10        31
## # ℹ 94 more rows
## ANOVA Table (type III tests)
## 
##                 Effect DFn DFd     F     p p<.05   ges
## 1      condition_label   1  76 2.536 0.115       0.026
## 2                 wave   1  76 1.874 0.175       0.005
## 3 condition_label:wave   1  76 4.339 0.041     * 0.012
Descriptive Statistics for GLAT
Condition wave N M SD
Control Wave 1 36 8.44 2.72
Control Wave 2 30 7.80 3.02
Treatment Wave 1 49 8.41 2.65
Treatment Wave 2 49 9.41 2.55
## # A tibble: 2 × 11
##   condition_label .y.   group1 group2    n1    n2 statistic    df       p
## * <fct>           <chr> <chr>  <chr>  <int> <int>     <dbl> <dbl>   <dbl>
## 1 Control         sGLAT Wave 1 Wave 2    29    29     0.493    28 0.626  
## 2 Treatment       sGLAT Wave 1 Wave 2    49    49    -2.70     48 0.00948
## # ℹ 2 more variables: p.adj <dbl>, p.adj.signif <chr>
## # A tibble: 2 × 10
##   wave   .y.   group1  group2       n1    n2      p p.signif  p.adj p.adj.signif
## * <chr>  <chr> <chr>   <chr>     <int> <int>  <dbl> <chr>     <dbl> <chr>       
## 1 Wave 1 sGLAT Control Treatment    29    49 0.635  ns       0.635  ns          
## 2 Wave 2 sGLAT Control Treatment    29    49 0.0209 *        0.0209 *

## # A tibble: 103 × 1
## # Groups:   record_id [103]
##    record_id
##        <dbl>
##  1         8
##  2        11
##  3        12
##  4        13
##  5        16
##  6        24
##  7        26
##  8        27
##  9        28
## 10        31
## # ℹ 93 more rows
## ANOVA Table (type III tests)
## 
##                 Effect DFn DFd     F     p p<.05      ges
## 1      condition_label   1  77 5.990 0.017     * 0.063000
## 2                 wave   1  77 0.063 0.802       0.000115
## 3 condition_label:wave   1  77 1.237 0.269       0.002000
Descriptive Statistics for CS Knowledge
Condition wave N M SD
Control Wave 1 87 5.47 7.24
Control Wave 2 30 12.40 4.93
Treatment Wave 1 93 7.54 7.46
Treatment Wave 2 49 14.77 3.15
## # A tibble: 2 × 11
##   condition_label .y.      group1 group2    n1    n2 statistic    df     p p.adj
## * <fct>           <chr>    <chr>  <chr>  <int> <int>     <dbl> <dbl> <dbl> <dbl>
## 1 Control         sCS_kno… Wave 1 Wave 2    30    30     0.422    29 0.676 0.676
## 2 Treatment       sCS_kno… Wave 1 Wave 2    49    49    -1.44     48 0.157 0.157
## # ℹ 1 more variable: p.adj.signif <chr>
## # A tibble: 2 × 10
##   wave   .y.       group1 group2    n1    n2      p p.signif  p.adj p.adj.signif
## * <chr>  <chr>     <chr>  <chr>  <int> <int>  <dbl> <chr>     <dbl> <chr>       
## 1 Wave 1 sCS_know… Contr… Treat…    30    49 0.0591 ns       0.0591 ns          
## 2 Wave 2 sCS_know… Contr… Treat…    30    49 0.0110 *        0.0110 *

## ANOVA Table (type III tests)
## 
##                 Effect DFn DFd      F        p p<.05   ges
## 1      condition_label   1 146 36.107 1.42e-08     * 0.163
## 2                 wave   1 146 11.086 1.00e-03     * 0.016
## 3 condition_label:wave   1 146 12.898 4.49e-04     * 0.018
Descriptive Statistics for CS Pedagogical Confidence
Condition wave N M SD
Control Wave 1 64 4.55 1.64
Control Wave 2 56 4.51 1.60
Treatment Wave 1 93 5.32 1.10
Treatment Wave 2 93 6.01 0.80
## # A tibble: 2 × 11
##   condition_label .y.         group1 group2    n1    n2 statistic    df        p
## * <fct>           <chr>       <chr>  <chr>  <int> <int>     <dbl> <dbl>    <dbl>
## 1 Control         cs_ped_conf Wave 1 Wave 2    55    55     0.138    54  8.90e-1
## 2 Treatment       cs_ped_conf Wave 1 Wave 2    93    93    -6.55     92  3.30e-9
## # ℹ 2 more variables: p.adj <dbl>, p.adj.signif <chr>
## # A tibble: 2 × 10
##   wave   .y.   group1 group2    n1    n2        p p.signif    p.adj p.adj.signif
## * <chr>  <chr> <chr>  <chr>  <int> <int>    <dbl> <chr>       <dbl> <chr>       
## 1 Wave 1 cs_p… Contr… Treat…    55    93 7.58e- 4 ***      7.58e- 4 ***         
## 2 Wave 2 cs_p… Contr… Treat…    55    93 4.28e-12 ****     4.28e-12 ****

## ANOVA Table (type III tests)
## 
##                 Effect DFn DFd      F        p p<.05   ges
## 1      condition_label   1 146 23.802 2.76e-06     * 0.111
## 2                 wave   1 146 20.858 1.04e-05     * 0.032
## 3 condition_label:wave   1 146 15.792 1.11e-04     * 0.025
Descriptive Statistics for AI Pedagogical Confidence
Condition wave N M SD
Control Wave 1 64 4.34 1.72
Control Wave 2 56 4.33 1.55
Treatment Wave 1 93 4.82 1.30
Treatment Wave 2 93 5.79 0.98
## # A tibble: 2 × 11
##   condition_label .y.         group1 group2    n1    n2 statistic    df        p
## * <fct>           <chr>       <chr>  <chr>  <int> <int>     <dbl> <dbl>    <dbl>
## 1 Control         ai_ped_conf Wave 1 Wave 2    55    55    -0.340    54 7.35e- 1
## 2 Treatment       ai_ped_conf Wave 1 Wave 2    93    93    -7.49     92 4.05e-11
## # ℹ 2 more variables: p.adj <dbl>, p.adj.signif <chr>
## # A tibble: 2 × 10
##   wave   .y.   group1 group2    n1    n2        p p.signif    p.adj p.adj.signif
## * <chr>  <chr> <chr>  <chr>  <int> <int>    <dbl> <chr>       <dbl> <chr>       
## 1 Wave 1 ai_p… Contr… Treat…    55    93 3.49e- 2 *        3.49e- 2 *           
## 2 Wave 2 ai_p… Contr… Treat…    55    93 1.00e-10 ****     1.00e-10 ****

## ANOVA Table (type III tests)
## 
##                 Effect DFn DFd      F        p p<.05   ges
## 1      condition_label   1 146 34.548 2.71e-08     * 0.154
## 2                 wave   1 146  5.166 2.40e-02     * 0.008
## 3 condition_label:wave   1 146 12.635 5.11e-04     * 0.019
Descriptive Statistics for CS Motivation
Condition wave N M SD
Control Wave 1 64 5.55 1.04
Control Wave 2 56 5.39 1.23
Treatment Wave 1 93 6.04 0.86
Treatment Wave 2 93 6.48 0.65
## # A tibble: 2 × 11
##   condition_label .y.         group1 group2    n1    n2 statistic    df        p
## * <fct>           <chr>       <chr>  <chr>  <int> <int>     <dbl> <dbl>    <dbl>
## 1 Control         cs_mot_conf Wave 1 Wave 2    55    55     0.674    54  5.03e-1
## 2 Treatment       cs_mot_conf Wave 1 Wave 2    93    93    -5.55     92  2.77e-7
## # ℹ 2 more variables: p.adj <dbl>, p.adj.signif <chr>
## # A tibble: 2 × 10
##   wave   .y.   group1 group2    n1    n2        p p.signif    p.adj p.adj.signif
## * <chr>  <chr> <chr>  <chr>  <int> <int>    <dbl> <chr>       <dbl> <chr>       
## 1 Wave 1 cs_m… Contr… Treat…    55    93 8.58e- 4 ***      8.58e- 4 ***         
## 2 Wave 2 cs_m… Contr… Treat…    55    93 9.13e-11 ****     9.13e-11 ****

## ANOVA Table (type III tests)
## 
##                 Effect DFn DFd      F        p p<.05   ges
## 1      condition_label   1 146 12.546 5.33e-04     * 0.057
## 2                 wave   1 146 22.519 4.91e-06     * 0.043
## 3 condition_label:wave   1 146 11.049 1.00e-03     * 0.022
Descriptive Statistics for AI Motivation
Condition wave N M SD
Control Wave 1 64 5.16 1.36
Control Wave 2 56 5.25 1.11
Treatment Wave 1 93 5.34 1.19
Treatment Wave 2 93 6.20 0.96
## # A tibble: 2 × 11
##   condition_label .y.         group1 group2    n1    n2 statistic    df        p
## * <fct>           <chr>       <chr>  <chr>  <int> <int>     <dbl> <dbl>    <dbl>
## 1 Control         ai_mot_conf Wave 1 Wave 2    55    55    -0.947    54  3.48e-1
## 2 Treatment       ai_mot_conf Wave 1 Wave 2    93    93    -6.42     92  5.76e-9
## # ℹ 2 more variables: p.adj <dbl>, p.adj.signif <chr>
## # A tibble: 2 × 10
##   wave   .y.     group1 group2    n1    n2       p p.signif   p.adj p.adj.signif
## * <chr>  <chr>   <chr>  <chr>  <int> <int>   <dbl> <chr>      <dbl> <chr>       
## 1 Wave 1 ai_mot… Contr… Treat…    55    93 2.85e-1 ns       2.85e-1 ns          
## 2 Wave 2 ai_mot… Contr… Treat…    55    93 2.56e-7 ****     2.56e-7 ****

## # A tibble: 34 × 1
## # Groups:   record_id [34]
##    record_id
##        <dbl>
##  1       968
##  2       973
##  3       974
##  4       975
##  5       981
##  6       982
##  7       985
##  8       986
##  9       995
## 10       996
## # ℹ 24 more rows
## ANOVA Table (type III tests)
## 
##                 Effect DFn DFd      F        p p<.05   ges
## 1      condition_label   1 146 26.525 8.28e-07     * 0.122
## 2                 wave   1 146 55.833 6.67e-12     * 0.081
## 3 condition_label:wave   1 146 55.833 6.67e-12     * 0.081
Descriptive Statistics for AI Pedagogical Content Knowledge
Condition wave N M SD
Control Wave 1 64 1.00 1.08
Control Wave 2 56 0.91 1.08
Treatment Wave 1 93 1.10 1.13
Treatment Wave 2 93 2.43 1.07
## # A tibble: 2 × 11
##   condition_label .y.        group1 group2    n1    n2 statistic    df        p
## * <fct>           <chr>      <chr>  <chr>  <int> <int>     <dbl> <dbl>    <dbl>
## 1 Control         pck_ai_now Wave 1 Wave 2    55    55       0      54 1   e+ 0
## 2 Treatment       pck_ai_now Wave 1 Wave 2    93    93     -10.8    92 5.08e-18
## # ℹ 2 more variables: p.adj <dbl>, p.adj.signif <chr>
## # A tibble: 2 × 10
##   wave   .y.   group1 group2    n1    n2        p p.signif    p.adj p.adj.signif
## * <chr>  <chr> <chr>  <chr>  <int> <int>    <dbl> <chr>       <dbl> <chr>       
## 1 Wave 1 pck_… Contr… Treat…    55    93 3.68e- 1 ns       3.68e- 1 ns          
## 2 Wave 2 pck_… Contr… Treat…    55    93 9.88e-14 ****     9.88e-14 ****

Descriptive Statistics for CS Pedagogical Content Knowledge
Condition wave N M SD
Control Wave 1 64 1.28 1.36
Control Wave 2 56 1.23 1.26
Treatment Wave 1 93 1.82 1.35
Treatment Wave 2 93 2.74 1.02
## # A tibble: 34 × 1
## # Groups:   record_id [34]
##    record_id
##        <dbl>
##  1       968
##  2       973
##  3       974
##  4       975
##  5       981
##  6       982
##  7       985
##  8       986
##  9       995
## 10       996
## # ℹ 24 more rows
## ANOVA Table (type III tests)
## 
##                 Effect DFn DFd      F        p p<.05   ges
## 1      condition_label   1 146 29.063 2.75e-07     * 0.142
## 2                 wave   1 146 29.235 2.56e-07     * 0.033
## 3 condition_label:wave   1 146 27.023 6.66e-07     * 0.031
## # A tibble: 2 × 11
##   condition_label .y.         group1 group2    n1    n2 statistic    df        p
## * <fct>           <chr>       <chr>  <chr>  <int> <int>     <dbl> <dbl>    <dbl>
## 1 Control         pck_cs_aft… Wave 1 Wave 2    55    55    -0.173    54 8.64e- 1
## 2 Treatment       pck_cs_aft… Wave 1 Wave 2    93    93    -7.79     92 9.68e-12
## # ℹ 2 more variables: p.adj <dbl>, p.adj.signif <chr>
## # A tibble: 2 × 10
##   wave   .y.   group1 group2    n1    n2        p p.signif    p.adj p.adj.signif
## * <chr>  <chr> <chr>  <chr>  <int> <int>    <dbl> <chr>       <dbl> <chr>       
## 1 Wave 1 pck_… Contr… Treat…    55    93 1.24e- 2 *        1.24e- 2 *           
## 2 Wave 2 pck_… Contr… Treat…    55    93 9.33e-13 ****     9.33e-13 ****

## 
## 
## ### Condition
Condition
Category N Percent
Control 89 48.9
Treatment 93 51.1
## 
## 
## ### Geographic Locale
Geographic Locale
Category N Percent
City 45 27.8
Multiple 4 2.5
Rural 24 14.8
Suburb 27 16.7
Town 62 38.3
## 
## 
## ### Title I School
Title I School
Category N Percent
Missing 11 6.8
No 17 10.5
Yes 134 82.7
## 
## 
## ### Grade Band
Grade Band
Category N Percent
6-8 45 27.3
9-12 43 26.1
PreK-5 77 46.7
## 
## 
## ### Primary Grade Taught
Primary Grade Taught
Category N Percent
PreK 5 3.0
Kindergarten 7 4.2
1 9 5.5
2 11 6.7
3 15 9.1
4 13 7.9
5 17 10.3
6 14 8.5
7 9 5.5
8 22 13.3
9 8 4.8
10 12 7.3
11 14 8.5
12 9 5.5
## 
## 
## ### Disability Status
Disability Status
Category N Percent
No 158 99.4
Unsure 1 0.6
## 
## 
## ### Age
Age
Category N Percent
30–39 years old 28 17.6
40–49 years old 63 39.6
50–59 years old 46 28.9
60–69 years old 9 5.7
999 2 1.3
Under 30 11 6.9
## 
## 
## ### How Often Teach Computer Science
How Often Teach Computer Science
Category N Percent
2–3 times a month 8 8.6
2–3 times a week 15 16.1
4–5 times a week 36 38.7
Less than every other month 6 6.5
Never 1 1.1
Once a month or every other month 9 9.7
Once a week 10 10.8
Other 8 8.6
## 
## 
## ### How Often Teach AI
How Often Teach AI
Category N Percent
2–3 times a month 9 17.3
2–3 times a week 4 7.7
4–5 times a week 1 1.9
Less than every other month 13 25.0
Never 2 3.8
Once a month or every other month 9 17.3
Once a week 10 19.2
Other 4 7.7
## [1] 148
## # A tibble: 2 × 2
##   condition_label     n
##   <chr>           <int>
## 1 Control            55
## 2 Treatment          93
Table 1 Participant Demographics by Condition

Characteristic

Treatment

Control

Geographic Locale

City

35 (37.6%)

7 (12.7%)

Suburb

12 (12.9%)

12 (21.8%)

Town

30 (32.3%)

26 (47.3%)

Rural

13 (14%)

10 (18.2%)

Multiple

3 (3.2%)

Fisher's exact test, p = 0.006

Title I School

No

9 (9.7%)

5 (9.1%)

Yes

76 (81.7%)

47 (85.5%)

Missing

8 (8.6%)

3 (5.5%)

Fisher's exact test, p = 0.844

Grade Band

PreK-5

44 (47.3%)

26 (47.3%)

6-8

30 (32.3%)

11 (20%)

9-12

19 (20.4%)

18 (32.7%)

χ²(2, N = 148) = 3.97, p = 0.138

Disability Status

No

92 (98.9%)

55 (100%)

Not sure

1 (1.1%)

Fisher's exact test, p = 1

Age

<30 years

7 (7.5%)

4 (7.3%)

30-39 years

15 (16.1%)

12 (21.8%)

40-49 years

32 (34.4%)

24 (43.6%)

50-59 years

31 (33.3%)

12 (21.8%)

>59 years

6 (6.5%)

3 (5.5%)

Missing

2 (2.2%)

Fisher's exact test, p = 0.577

How Often Teach Computer Science

Never taught before

1 (1.5%)

Less than every other month

3 (4.5%)

Once a month or every other month

6 (9.1%)

2 (10.5%)

Two to three times a month

4 (6.1%)

2 (10.5%)

Once a week

9 (13.6%)

1 (5.3%)

Two to three times a week

10 (15.2%)

5 (26.3%)

Four to five times a week

25 (37.9%)

9 (47.4%)

Other

8 (12.1%)

Fisher's exact test, p = 0.564

How Often Teach AI

Never taught before

1 (3.2%)

1 (6.7%)

Less than every other month

9 (29%)

3 (20%)

Once a month or every other month

2 (6.5%)

4 (26.7%)

Two to three times a month

6 (19.4%)

2 (13.3%)

Once a week

7 (22.6%)

2 (13.3%)

Two to three times a week

2 (6.5%)

2 (13.3%)

Four to five times a week

1 (6.7%)

Other

4 (12.9%)

Fisher's exact test, p = 0.248

Gender

Woman

72 (77.4%)

43 (78.2%)

Man

20 (21.5%)

11 (20%)

Another designation

1 (1.1%)

1 (1.8%)

Fisher's exact test, p = 1

Race/Ethnicity

African-American/Black

20 (21.5%)

Asian - East

1 (1.1%)

1 (1.8%)

Asian - Southeast

1 (1.8%)

Hispanic/Latino(a)

15 (16.1%)

Middle Eastern/North African

1 (1.1%)

1 (1.8%)

White

53 (57%)

48 (87.3%)

Multiracial

2 (2.2%)

4 (7.3%)

Prefer not to say

1 (1.1%)

Fisher's exact test, p < .001

Primary Grade Taught

Primary Grade Taught

5.58 (3.52)

6.31 (3.72)

t(108.7) = 1.17, p = 0.243

Teaching Experience

n_Control

n_Treatment

M (SD)_Control

M (SD)_Treatment

55

93

16.75 (8.06)

16.59 (9.05)

t(124.0) = 0.12, p = 0.907, d = 0.02 (negligible)

Teaching Experience in CS

n_Control

n_Treatment

M (SD)_Control

M (SD)_Treatment

55

93

3.4 (6.67)

4.02 (5.29)

t(94.0) = -0.58, p = 0.560, d = -0.10 (negligible)

Table X Reasons for Not Attending PD, Control Condition (Select All That Apply)

Reason for Not Attending PD

n

I don't know what CSTA is

9

No interest in CS PD

4

No interest in AI PD

1

Content not relevant to current role

5

Scheduling conflict (professional)

6

Scheduling conflict (personal/family)

19

Date/time not convenient

10

Travel/location not convenient

8

Insufficient advance notice

4

Didn't know about PD opportunities

16

Other

2

Table X Primary Reason for Not Attending PD, Control Condition

Primary Reason

n

Multiple

16

Didn't know about PD opportunities

11

Scheduling conflict (personal/family)

8

Don't know what CSTA is

5

Content not relevant to current role

3

Date/time not convenient

3

No interest in CS PD

3

Other

2

Scheduling conflict (professional)

2

Travel/location not convenient

2

## # A tibble: 2 × 2
##   record_id why_no_pd_other  
##       <dbl> <chr>            
## 1       964 Lack of childcare
## 2       979 on vacation
## ANOVA Table (type III tests)
## 
##                 Effect DFn DFd     F     p p<.05   ges
## 1      condition_label   1  76 2.536 0.115       0.026
## 2                 wave   1  76 1.874 0.175       0.005
## 3 condition_label:wave   1  76 4.339 0.041     * 0.012
Descriptive Statistics for GLAT
Condition wave N M SD
Control Wave 1 29 8.10 2.85
Control Wave 2 29 7.90 3.03
Treatment Wave 1 49 8.41 2.65
Treatment Wave 2 49 9.41 2.55
## # A tibble: 2 × 11
##   condition_label .y.   group1 group2    n1    n2 statistic    df       p
## * <chr>           <chr> <chr>  <chr>  <int> <int>     <dbl> <dbl>   <dbl>
## 1 Control         sGLAT Wave 1 Wave 2    29    29     0.493    28 0.626  
## 2 Treatment       sGLAT Wave 1 Wave 2    49    49    -2.70     48 0.00948
## # ℹ 2 more variables: p.adj <dbl>, p.adj.signif <chr>
## # A tibble: 2 × 10
##   wave   .y.   group1  group2       n1    n2      p p.signif  p.adj p.adj.signif
## * <chr>  <chr> <chr>   <chr>     <int> <int>  <dbl> <chr>     <dbl> <chr>       
## 1 Wave 1 sGLAT Control Treatment    29    49 0.635  ns       0.635  ns          
## 2 Wave 2 sGLAT Control Treatment    29    49 0.0209 *        0.0209 *
## # A tibble: 2 × 10
##   .y.   group1 group2 effsize condition_label    n1    n2 conf.low conf.high
## * <chr> <chr>  <chr>    <dbl> <chr>           <int> <int>    <dbl>     <dbl>
## 1 sGLAT Wave 1 Wave 2  0.0916 Control            29    29    -0.3       0.49
## 2 sGLAT Wave 1 Wave 2 -0.386  Treatment          49    49    -0.66     -0.12
## # ℹ 1 more variable: magnitude <ord>
## # A tibble: 2 × 10
##   .y.   group1  group2    effsize wave     n1    n2 conf.low conf.high magnitude
## * <chr> <chr>   <chr>       <dbl> <chr> <int> <int>    <dbl>     <dbl> <ord>    
## 1 sGLAT Control Treatment  -0.111 Wave…    29    49    -0.58      0.33 negligib…
## 2 sGLAT Control Treatment  -0.540 Wave…    29    49    -1.07     -0.05 moderate

## ANOVA Table (type III tests)
## 
##                 Effect DFn DFd     F     p p<.05      ges
## 1      condition_label   1  76 4.668 0.034     * 0.051000
## 2                 wave   1  76 0.097 0.757       0.000159
## 3 condition_label:wave   1  76 3.197 0.078       0.005000
Descriptive Statistics for CS Knowledge
Condition wave N M SD
Control Wave 1 29 13.12 4.25
Control Wave 2 29 12.48 4.99
Treatment Wave 1 49 14.32 2.77
Treatment Wave 2 49 14.77 3.15
## # A tibble: 2 × 11
##   condition_label .y.      group1 group2    n1    n2 statistic    df     p p.adj
## * <chr>           <chr>    <chr>  <chr>  <int> <int>     <dbl> <dbl> <dbl> <dbl>
## 1 Control         sCS_kno… Wave 1 Wave 2    29    29      1.08    28 0.289 0.289
## 2 Treatment       sCS_kno… Wave 1 Wave 2    49    49     -1.44    48 0.157 0.157
## # ℹ 1 more variable: p.adj.signif <chr>
## # A tibble: 2 × 10
##   wave   .y.       group1 group2    n1    n2      p p.signif  p.adj p.adj.signif
## * <chr>  <chr>     <chr>  <chr>  <int> <int>  <dbl> <chr>     <dbl> <chr>       
## 1 Wave 1 sCS_know… Contr… Treat…    29    49 0.137  ns       0.137  ns          
## 2 Wave 2 sCS_know… Contr… Treat…    29    49 0.0155 *        0.0155 *
## # A tibble: 2 × 10
##   .y.       group1 group2 effsize condition_label    n1    n2 conf.low conf.high
## * <chr>     <chr>  <chr>    <dbl> <chr>           <int> <int>    <dbl>     <dbl>
## 1 sCS_know… Wave 1 Wave 2   0.201 Control            29    29    -0.19      0.56
## 2 sCS_know… Wave 1 Wave 2  -0.206 Treatment          49    49    -0.47      0.05
## # ℹ 1 more variable: magnitude <ord>
## # A tibble: 2 × 10
##   .y.       group1 group2 effsize wave     n1    n2 conf.low conf.high magnitude
## * <chr>     <chr>  <chr>    <dbl> <chr> <int> <int>    <dbl>     <dbl> <ord>    
## 1 sCS_know… Contr… Treat…  -0.333 Wave…    29    49    -0.81      0.16 small    
## 2 sCS_know… Contr… Treat…  -0.547 Wave…    29    49    -1.1      -0.04 moderate

## ANOVA Table (type III tests)
## 
##                 Effect DFn DFd      F        p p<.05   ges
## 1      condition_label   1 146 36.107 1.42e-08     * 0.163
## 2                 wave   1 146 11.086 1.00e-03     * 0.016
## 3 condition_label:wave   1 146 12.898 4.49e-04     * 0.018
Descriptive Statistics for CS Pedagogical Confidence
Condition wave N M SD
Control Wave 1 55 4.53 1.70
Control Wave 2 55 4.50 1.62
Treatment Wave 1 93 5.32 1.10
Treatment Wave 2 93 6.01 0.80
## # A tibble: 2 × 11
##   condition_label .y.         group1 group2    n1    n2 statistic    df        p
## * <chr>           <chr>       <chr>  <chr>  <int> <int>     <dbl> <dbl>    <dbl>
## 1 Control         cs_ped_conf Wave 1 Wave 2    55    55     0.138    54  8.90e-1
## 2 Treatment       cs_ped_conf Wave 1 Wave 2    93    93    -6.55     92  3.30e-9
## # ℹ 2 more variables: p.adj <dbl>, p.adj.signif <chr>
## # A tibble: 2 × 10
##   wave   .y.   group1 group2    n1    n2        p p.signif    p.adj p.adj.signif
## * <chr>  <chr> <chr>  <chr>  <int> <int>    <dbl> <chr>       <dbl> <chr>       
## 1 Wave 1 cs_p… Contr… Treat…    55    93 7.58e- 4 ***      7.58e- 4 ***         
## 2 Wave 2 cs_p… Contr… Treat…    55    93 4.28e-12 ****     4.28e-12 ****
## # A tibble: 2 × 10
##   .y.       group1 group2 effsize condition_label    n1    n2 conf.low conf.high
## * <chr>     <chr>  <chr>    <dbl> <chr>           <int> <int>    <dbl>     <dbl>
## 1 cs_ped_c… Wave 1 Wave 2  0.0187 Control            55    55    -0.2       0.38
## 2 cs_ped_c… Wave 1 Wave 2 -0.679  Treatment          93    93    -0.94     -0.49
## # ℹ 1 more variable: magnitude <ord>
## # A tibble: 2 × 10
##   .y.       group1 group2 effsize wave     n1    n2 conf.low conf.high magnitude
## * <chr>     <chr>  <chr>    <dbl> <chr> <int> <int>    <dbl>     <dbl> <ord>    
## 1 cs_ped_c… Contr… Treat…  -0.553 Wave…    55    93    -0.89     -0.21 moderate 
## 2 cs_ped_c… Contr… Treat…  -1.18  Wave…    55    93    -1.54     -0.87 large

## ANOVA Table (type III tests)
## 
##                 Effect DFn DFd      F        p p<.05   ges
## 1      condition_label   1 146 23.802 2.76e-06     * 0.111
## 2                 wave   1 146 20.858 1.04e-05     * 0.032
## 3 condition_label:wave   1 146 15.792 1.11e-04     * 0.025
Descriptive Statistics for AI Pedagogical Confidence
Condition wave N M SD
Control Wave 1 55 4.26 1.84
Control Wave 2 55 4.33 1.56
Treatment Wave 1 93 4.82 1.30
Treatment Wave 2 93 5.79 0.98
## # A tibble: 2 × 11
##   condition_label .y.         group1 group2    n1    n2 statistic    df        p
## * <chr>           <chr>       <chr>  <chr>  <int> <int>     <dbl> <dbl>    <dbl>
## 1 Control         ai_ped_conf Wave 1 Wave 2    55    55    -0.340    54 7.35e- 1
## 2 Treatment       ai_ped_conf Wave 1 Wave 2    93    93    -7.49     92 4.05e-11
## # ℹ 2 more variables: p.adj <dbl>, p.adj.signif <chr>
## # A tibble: 2 × 10
##   wave   .y.   group1 group2    n1    n2        p p.signif    p.adj p.adj.signif
## * <chr>  <chr> <chr>  <chr>  <int> <int>    <dbl> <chr>       <dbl> <chr>       
## 1 Wave 1 ai_p… Contr… Treat…    55    93 3.49e- 2 *        3.49e- 2 *           
## 2 Wave 2 ai_p… Contr… Treat…    55    93 1.00e-10 ****     1.00e-10 ****
## # A tibble: 2 × 10
##   .y.       group1 group2 effsize condition_label    n1    n2 conf.low conf.high
## * <chr>     <chr>  <chr>    <dbl> <chr>           <int> <int>    <dbl>     <dbl>
## 1 ai_ped_c… Wave 1 Wave 2 -0.0458 Control            55    55     -0.3      0.23
## 2 ai_ped_c… Wave 1 Wave 2 -0.777  Treatment          93    93     -1       -0.58
## # ℹ 1 more variable: magnitude <ord>
## # A tibble: 2 × 10
##   .y.       group1 group2 effsize wave     n1    n2 conf.low conf.high magnitude
## * <chr>     <chr>  <chr>    <dbl> <chr> <int> <int>    <dbl>     <dbl> <ord>    
## 1 ai_ped_c… Contr… Treat…  -0.346 Wave…    55    93    -0.7       0.02 small    
## 2 ai_ped_c… Contr… Treat…  -1.12  Wave…    55    93    -1.52     -0.76 large

## ANOVA Table (type III tests)
## 
##                 Effect DFn DFd      F        p p<.05   ges
## 1      condition_label   1 146 34.548 2.71e-08     * 0.154
## 2                 wave   1 146  5.166 2.40e-02     * 0.008
## 3 condition_label:wave   1 146 12.635 5.11e-04     * 0.019
Descriptive Statistics for CS Motivation
Condition wave N M SD
Control Wave 1 55 5.49 1.08
Control Wave 2 55 5.39 1.24
Treatment Wave 1 93 6.04 0.86
Treatment Wave 2 93 6.48 0.65
## # A tibble: 2 × 11
##   condition_label .y.         group1 group2    n1    n2 statistic    df        p
## * <chr>           <chr>       <chr>  <chr>  <int> <int>     <dbl> <dbl>    <dbl>
## 1 Control         cs_mot_conf Wave 1 Wave 2    55    55     0.674    54  5.03e-1
## 2 Treatment       cs_mot_conf Wave 1 Wave 2    93    93    -5.55     92  2.77e-7
## # ℹ 2 more variables: p.adj <dbl>, p.adj.signif <chr>
## # A tibble: 2 × 10
##   wave   .y.   group1 group2    n1    n2        p p.signif    p.adj p.adj.signif
## * <chr>  <chr> <chr>  <chr>  <int> <int>    <dbl> <chr>       <dbl> <chr>       
## 1 Wave 1 cs_m… Contr… Treat…    55    93 8.58e- 4 ***      8.58e- 4 ***         
## 2 Wave 2 cs_m… Contr… Treat…    55    93 9.13e-11 ****     9.13e-11 ****
## # A tibble: 2 × 10
##   .y.       group1 group2 effsize condition_label    n1    n2 conf.low conf.high
## * <chr>     <chr>  <chr>    <dbl> <chr>           <int> <int>    <dbl>     <dbl>
## 1 cs_mot_c… Wave 1 Wave 2  0.0909 Control            55    55    -0.19      0.34
## 2 cs_mot_c… Wave 1 Wave 2 -0.575  Treatment          93    93    -0.78     -0.38
## # ℹ 1 more variable: magnitude <ord>
## # A tibble: 2 × 10
##   .y.       group1 group2 effsize wave     n1    n2 conf.low conf.high magnitude
## * <chr>     <chr>  <chr>    <dbl> <chr> <int> <int>    <dbl>     <dbl> <ord>    
## 1 cs_mot_c… Contr… Treat…  -0.562 Wave…    55    93    -0.92     -0.24 moderate 
## 2 cs_mot_c… Contr… Treat…  -1.10  Wave…    55    93    -1.46     -0.77 large

## ANOVA Table (type III tests)
## 
##                 Effect DFn DFd      F        p p<.05   ges
## 1      condition_label   1 146 12.546 5.33e-04     * 0.057
## 2                 wave   1 146 22.519 4.91e-06     * 0.043
## 3 condition_label:wave   1 146 11.049 1.00e-03     * 0.022
Descriptive Statistics for AI Motivation
Condition wave N M SD
Control Wave 1 55 5.10 1.42
Control Wave 2 55 5.25 1.12
Treatment Wave 1 93 5.34 1.19
Treatment Wave 2 93 6.20 0.96
## # A tibble: 2 × 11
##   condition_label .y.         group1 group2    n1    n2 statistic    df        p
## * <chr>           <chr>       <chr>  <chr>  <int> <int>     <dbl> <dbl>    <dbl>
## 1 Control         ai_mot_conf Wave 1 Wave 2    55    55    -0.947    54  3.48e-1
## 2 Treatment       ai_mot_conf Wave 1 Wave 2    93    93    -6.42     92  5.76e-9
## # ℹ 2 more variables: p.adj <dbl>, p.adj.signif <chr>
## # A tibble: 2 × 10
##   wave   .y.     group1 group2    n1    n2       p p.signif   p.adj p.adj.signif
## * <chr>  <chr>   <chr>  <chr>  <int> <int>   <dbl> <chr>      <dbl> <chr>       
## 1 Wave 1 ai_mot… Contr… Treat…    55    93 2.85e-1 ns       2.85e-1 ns          
## 2 Wave 2 ai_mot… Contr… Treat…    55    93 2.56e-7 ****     2.56e-7 ****
## # A tibble: 2 × 10
##   .y.       group1 group2 effsize condition_label    n1    n2 conf.low conf.high
## * <chr>     <chr>  <chr>    <dbl> <chr>           <int> <int>    <dbl>     <dbl>
## 1 ai_mot_c… Wave 1 Wave 2  -0.128 Control            55    55    -0.39      0.14
## 2 ai_mot_c… Wave 1 Wave 2  -0.666 Treatment          93    93    -0.89     -0.47
## # ℹ 1 more variable: magnitude <ord>
## # A tibble: 2 × 10
##   .y.       group1 group2 effsize wave     n1    n2 conf.low conf.high magnitude
## * <chr>     <chr>  <chr>    <dbl> <chr> <int> <int>    <dbl>     <dbl> <ord>    
## 1 ai_mot_c… Contr… Treat…  -0.178 Wave…    55    93    -0.52      0.17 negligib…
## 2 ai_mot_c… Contr… Treat…  -0.901 Wave…    55    93    -1.35     -0.53 large

## ANOVA Table (type III tests)
## 
##                 Effect DFn DFd      F        p p<.05   ges
## 1      condition_label   1 146 26.525 8.28e-07     * 0.122
## 2                 wave   1 146 55.833 6.67e-12     * 0.081
## 3 condition_label:wave   1 146 55.833 6.67e-12     * 0.081
Descriptive Statistics for AI Pedagogical Content Knowledge
Condition wave N M SD
Control Wave 1 55 0.93 1.05
Control Wave 2 55 0.93 1.09
Treatment Wave 1 93 1.10 1.13
Treatment Wave 2 93 2.43 1.07
## # A tibble: 2 × 11
##   condition_label .y.        group1 group2    n1    n2 statistic    df        p
## * <chr>           <chr>      <chr>  <chr>  <int> <int>     <dbl> <dbl>    <dbl>
## 1 Control         pck_ai_now Wave 1 Wave 2    55    55       0      54 1   e+ 0
## 2 Treatment       pck_ai_now Wave 1 Wave 2    93    93     -10.8    92 5.08e-18
## # ℹ 2 more variables: p.adj <dbl>, p.adj.signif <chr>
## # A tibble: 2 × 10
##   wave   .y.   group1 group2    n1    n2        p p.signif    p.adj p.adj.signif
## * <chr>  <chr> <chr>  <chr>  <int> <int>    <dbl> <chr>       <dbl> <chr>       
## 1 Wave 1 pck_… Contr… Treat…    55    93 3.68e- 1 ns       3.68e- 1 ns          
## 2 Wave 2 pck_… Contr… Treat…    55    93 9.88e-14 ****     9.88e-14 ****
## # A tibble: 2 × 10
##   .y.       group1 group2 effsize condition_label    n1    n2 conf.low conf.high
## * <chr>     <chr>  <chr>    <dbl> <chr>           <int> <int>    <dbl>     <dbl>
## 1 pck_ai_n… Wave 1 Wave 2    0    Control            55    55    -0.3       0.24
## 2 pck_ai_n… Wave 1 Wave 2   -1.12 Treatment          93    93    -1.43     -0.87
## # ℹ 1 more variable: magnitude <ord>
## # A tibble: 2 × 10
##   .y.       group1 group2 effsize wave     n1    n2 conf.low conf.high magnitude
## * <chr>     <chr>  <chr>    <dbl> <chr> <int> <int>    <dbl>     <dbl> <ord>    
## 1 pck_ai_n… Contr… Treat…  -0.155 Wave…    55    93    -0.5       0.2  negligib…
## 2 pck_ai_n… Contr… Treat…  -1.40  Wave…    55    93    -1.86     -0.98 large

Descriptive Statistics for CS Pedagogical Content Knowledge
Condition wave N M SD
Control Wave 1 55 1.24 1.35
Control Wave 2 55 1.25 1.27
Treatment Wave 1 93 1.82 1.35
Treatment Wave 2 93 2.74 1.02
## ANOVA Table (type III tests)
## 
##                 Effect DFn DFd      F        p p<.05   ges
## 1      condition_label   1 146 29.063 2.75e-07     * 0.142
## 2                 wave   1 146 29.235 2.56e-07     * 0.033
## 3 condition_label:wave   1 146 27.023 6.66e-07     * 0.031
## # A tibble: 2 × 11
##   condition_label .y.         group1 group2    n1    n2 statistic    df        p
## * <chr>           <chr>       <chr>  <chr>  <int> <int>     <dbl> <dbl>    <dbl>
## 1 Control         pck_cs_aft… Wave 1 Wave 2    55    55    -0.173    54 8.64e- 1
## 2 Treatment       pck_cs_aft… Wave 1 Wave 2    93    93    -7.79     92 9.68e-12
## # ℹ 2 more variables: p.adj <dbl>, p.adj.signif <chr>
## # A tibble: 2 × 10
##   wave   .y.   group1 group2    n1    n2        p p.signif    p.adj p.adj.signif
## * <chr>  <chr> <chr>  <chr>  <int> <int>    <dbl> <chr>       <dbl> <chr>       
## 1 Wave 1 pck_… Contr… Treat…    55    93 1.24e- 2 *        1.24e- 2 *           
## 2 Wave 2 pck_… Contr… Treat…    55    93 9.33e-13 ****     9.33e-13 ****
## # A tibble: 2 × 10
##   .y.       group1 group2 effsize condition_label    n1    n2 conf.low conf.high
## * <chr>     <chr>  <chr>    <dbl> <chr>           <int> <int>    <dbl>     <dbl>
## 1 pck_cs_a… Wave 1 Wave 2 -0.0233 Control            55    55    -0.3       0.24
## 2 pck_cs_a… Wave 1 Wave 2 -0.808  Treatment          93    93    -1.03     -0.62
## # ℹ 1 more variable: magnitude <ord>
## # A tibble: 2 × 10
##   .y.       group1 group2 effsize wave     n1    n2 conf.low conf.high magnitude
## * <chr>     <chr>  <chr>    <dbl> <chr> <int> <int>    <dbl>     <dbl> <ord>    
## 1 pck_cs_a… Contr… Treat…  -0.431 Wave…    55    93    -0.82     -0.08 small    
## 2 pck_cs_a… Contr… Treat…  -1.29  Wave…    55    93    -1.77     -0.91 large

GLAT

GLAT - Mixed ANOVA

Effect

DFn

DFd

F

p

η²G

condition_label

1.00

76.00

2.54

= 0.115

0.03

wave

1.00

76.00

1.87

= 0.175

0.01

condition_label:wave

1.00

76.00

4.34

= 0.041

0.01

GLAT - Within-Condition Comparisons (Wave 1 vs Wave 2)

Comparison

n1

n2

t

df

p

Cohen's d

Control : Wave 1 vs Wave 2

29

29

0.49

28.00

= 0.626

0.09 (negligible)

Treatment : Wave 1 vs Wave 2

49

49

-2.70

48.00

= 0.009

-0.39 (small)

GLAT - Between-Condition Comparisons (Control vs Treatment)

Comparison

n1

n2

t

df

p

Cohen's d

Wave 1 : Control vs Treatment

29

49

-0.47

55.63

= 0.641

-0.11 (negligible)

Wave 2 : Control vs Treatment

29

49

-2.26

51.16

= 0.028

-0.54 (moderate)

CS Knowledge

CS Knowledge - Mixed ANOVA

Effect

DFn

DFd

F

p

η²G

condition_label

1.00

76.00

4.67

= 0.034

0.05

wave

1.00

76.00

0.10

= 0.757

0.00

condition_label:wave

1.00

76.00

3.20

= 0.078

0.01

CS Knowledge - Within-Condition Comparisons (Wave 1 vs Wave 2)

Comparison

n1

n2

t

df

p

Cohen's d

Control : Wave 1 vs Wave 2

29

29

1.08

28.00

= 0.289

0.2 (small)

Treatment : Wave 1 vs Wave 2

49

49

-1.44

48.00

= 0.157

-0.21 (small)

CS Knowledge - Between-Condition Comparisons (Control vs Treatment)

Comparison

n1

n2

t

df

p

Cohen's d

Wave 1 : Control vs Treatment

29

49

-1.35

42.34

= 0.183

-0.33 (small)

Wave 2 : Control vs Treatment

29

49

-2.21

41.42

= 0.032

-0.55 (moderate)

CS Pedagogical Confidence

CS Pedagogical Confidence - Mixed ANOVA

Effect

DFn

DFd

F

p

η²G

condition_label

1.00

146.00

36.11

< .001

0.16

wave

1.00

146.00

11.09

= 0.001

0.02

condition_label:wave

1.00

146.00

12.90

< .001

0.02

CS Pedagogical Confidence - Within-Condition Comparisons (Wave 1 vs Wave 2)

Comparison

n1

n2

t

df

p

Cohen's d

Control : Wave 1 vs Wave 2

55

55

0.14

54.00

= 0.890

0.02 (negligible)

Treatment : Wave 1 vs Wave 2

93

93

-6.55

92.00

< .001

-0.68 (moderate)

CS Pedagogical Confidence - Between-Condition Comparisons (Control vs Treatment)

Comparison

n1

n2

t

df

p

Cohen's d

Wave 1 : Control vs Treatment

55

93

-3.09

80.95

= 0.003

-0.55 (moderate)

Wave 2 : Control vs Treatment

55

93

-6.45

70.04

< .001

-1.18 (large)

AI Pedagogical Confidence

AI Pedagogical Confidence - Mixed ANOVA

Effect

DFn

DFd

F

p

η²G

condition_label

1.00

146.00

23.80

< .001

0.11

wave

1.00

146.00

20.86

< .001

0.03

condition_label:wave

1.00

146.00

15.79

< .001

0.03

AI Pedagogical Confidence - Within-Condition Comparisons (Wave 1 vs Wave 2)

Comparison

n1

n2

t

df

p

Cohen's d

Control : Wave 1 vs Wave 2

55

55

-0.34

54.00

= 0.735

-0.05 (negligible)

Treatment : Wave 1 vs Wave 2

93

93

-7.49

92.00

< .001

-0.78 (moderate)

AI Pedagogical Confidence - Between-Condition Comparisons (Control vs Treatment)

Comparison

n1

n2

t

df

p

Cohen's d

Wave 1 : Control vs Treatment

55

93

-1.95

86.29

= 0.054

-0.35 (small)

Wave 2 : Control vs Treatment

55

93

-6.22

79.37

< .001

-1.12 (large)

CS Motivation

CS Motivation - Mixed ANOVA

Effect

DFn

DFd

F

p

η²G

condition_label

1.00

146.00

34.55

< .001

0.15

wave

1.00

146.00

5.17

= 0.024

0.01

condition_label:wave

1.00

146.00

12.63

< .001

0.02

CS Motivation - Within-Condition Comparisons (Wave 1 vs Wave 2)

Comparison

n1

n2

t

df

p

Cohen's d

Control : Wave 1 vs Wave 2

55

55

0.67

54.00

= 0.503

0.09 (negligible)

Treatment : Wave 1 vs Wave 2

93

93

-5.55

92.00

< .001

-0.58 (moderate)

CS Motivation - Between-Condition Comparisons (Control vs Treatment)

Comparison

n1

n2

t

df

p

Cohen's d

Wave 1 : Control vs Treatment

55

93

-3.21

94.46

= 0.002

-0.56 (moderate)

Wave 2 : Control vs Treatment

55

93

-6.03

71.94

< .001

-1.1 (large)

AI Motivation

AI Motivation - Mixed ANOVA

Effect

DFn

DFd

F

p

η²G

condition_label

1.00

146.00

12.55

< .001

0.06

wave

1.00

146.00

22.52

< .001

0.04

condition_label:wave

1.00

146.00

11.05

= 0.001

0.02

AI Motivation - Within-Condition Comparisons (Wave 1 vs Wave 2)

Comparison

n1

n2

t

df

p

Cohen's d

Control : Wave 1 vs Wave 2

55

55

-0.95

54.00

= 0.348

-0.13 (negligible)

Treatment : Wave 1 vs Wave 2

93

93

-6.42

92.00

< .001

-0.67 (moderate)

AI Motivation - Between-Condition Comparisons (Control vs Treatment)

Comparison

n1

n2

t

df

p

Cohen's d

Wave 1 : Control vs Treatment

55

93

-1.03

98.39

= 0.307

-0.18 (negligible)

Wave 2 : Control vs Treatment

55

93

-5.20

100.17

< .001

-0.9 (large)

AI Pedagogical Content Knowledge

AI Pedagogical Content Knowledge - Mixed ANOVA

Effect

DFn

DFd

F

p

η²G

condition_label

1.00

146.00

26.52

< .001

0.12

wave

1.00

146.00

55.83

< .001

0.08

condition_label:wave

1.00

146.00

55.83

< .001

0.08

AI Pedagogical Content Knowledge - Within-Condition Comparisons (Wave 1 vs Wave 2)

Comparison

n1

n2

t

df

p

Cohen's d

Control : Wave 1 vs Wave 2

55

55

0.00

54.00

= 1.000

0 (negligible)

Treatment : Wave 1 vs Wave 2

93

93

-10.79

92.00

< .001

-1.12 (large)

AI Pedagogical Content Knowledge - Between-Condition Comparisons (Control vs Treatment)

Comparison

n1

n2

t

df

p

Cohen's d

Wave 1 : Control vs Treatment

55

93

-0.92

120.33

= 0.359

-0.16 (negligible)

Wave 2 : Control vs Treatment

55

93

-8.19

111.87

< .001

-1.4 (large)

CS Pedagogical Content Knowledge

CS Pedagogical Content Knowledge - Mixed ANOVA

Effect

DFn

DFd

F

p

η²G

condition_label

1.00

146.00

29.06

< .001

0.14

wave

1.00

146.00

29.23

< .001

0.03

condition_label:wave

1.00

146.00

27.02

< .001

0.03

CS Pedagogical Content Knowledge - Within-Condition Comparisons (Wave 1 vs Wave 2)

Comparison

n1

n2

t

df

p

Cohen's d

Control : Wave 1 vs Wave 2

55

55

-0.17

54.00

= 0.864

-0.02 (negligible)

Treatment : Wave 1 vs Wave 2

93

93

-7.79

92.00

< .001

-0.81 (large)

CS Pedagogical Content Knowledge - Between-Condition Comparisons (Control vs Treatment)

Comparison

n1

n2

t

df

p

Cohen's d

Wave 1 : Control vs Treatment

55

93

-2.53

113.75

= 0.013

-0.43 (small)

Wave 2 : Control vs Treatment

55

93

-7.41

95.27

< .001

-1.29 (large)