Libraries

Include libraries needed to read (readr), manipulate (dplyr), represent (knitr, tidyverse), and analyze (ltm) data.

library(readr)
library(dplyr)
library(knitr)
library(boot)
library(tidyverse)
library(ltm)

Functions file

source('ExtendedTimeFunctions.R')

Data

Create list of data. 20 objects in list. 4 are the Winter 2018 exam files, 14 are the past exam files. 2 are gender and time cluster information for Winter 2018.

allData <- read.alldata()

for (i in 1:length(allData)) {
  allData[[i]] <- filter(allData[[i]], student_id != 0)
}
allData_Elements Name
1 WN2018_E4
2 WN2018_E3
3 WN2018_E2
4 WN2018_E1
5 WN2016_E1
6 WN2015_E4
7 WN2015_E3
8 WN2015_E2
9 WN2015_E1
10 WN2014_E4
11 WN2014_E3
12 WN2014_E2
13 WN2014_E1
14 WN2013_E4
15 WN2013_E3
16 WN2013_E2
17 WN2013_E1
18 FA2004_E3
19 WN2018_gender_3cluster
20 WN2018_gender_2cluster

41 Repeated Questions - matched to WN2018 term and original term

Number WN2018_Info OriginalTerm_Info
1 WN2018_E4_Q1 WN2013_E4_Q6
2 WN2018_E4_Q5 WN2013_E4_Q4
3 WN2018_E4_Q7 WN2015_E4_Q3
4 WN2018_E4_Q13 WN2013_E4_Q7
5 WN2018_E4_Q14 WN2013_E4_Q10
6 WN2018_E4_Q16 WN2015_E4_Q17
7 WN2018_E4_Q17 WN2015_E4_Q14
8 WN2018_E4_Q18 WN2015_E4_Q15
9 WN2018_E4_Q19 WN2014_E4_Q12
10 WN2018_E4_Q20 WN2013_E4_Q19
11 WN2018_E4_Q21 WN2013_E4_Q24
12 WN2018_E4_Q22 WN2015_E4_Q19
13 WN2018_E3_Q4 WN2015_E3_Q4
14 WN2018_E3_Q5 WN2013_E3_Q5
15 WN2018_E3_Q6 FA2004_E3_Q5
16 WN2018_E3_Q7 WN2014_E3_Q7
17 WN2018_E3_Q9 WN2015_E3_Q9
18 WN2018_E3_Q12 FA2004_E3_Q12
19 WN2018_E3_Q13 WN2013_E3_Q13
20 WN2018_E3_Q17 FA2004_E3_Q17
21 WN2018_E3_Q18 WN2013_E3_Q18
22 WN2018_E2_Q1 WN2013_E2_Q1
23 WN2018_E2_Q2 WN2015_E2_Q2
24 WN2018_E2_Q4 WN2014_E2_Q4
25 WN2018_E2_Q7 WN2014_E2_Q7
26 WN2018_E2_Q8 WN2013_E2_Q8
27 WN2018_E2_Q11 WN2013_E2_Q11
28 WN2018_E2_Q12 WN2013_E2_Q13
29 WN2018_E2_Q13 WN2014_E2_Q13
30 WN2018_E2_Q14 WN2013_E2_Q14
31 WN2018_E2_Q19 WN2015_E2_Q19
32 WN2018_E1_Q2 WN2016_E1_Q2
33 WN2018_E1_Q3 WN2014_E4_Q4
34 WN2018_E1_Q4 WN2013_E1_Q4
35 WN2018_E1_Q5 WN2014_E1_Q5
36 WN2018_E1_Q6 WN2014_E4_Q6
37 WN2018_E1_Q8 WN2013_E1_Q8
38 WN2018_E1_Q9 WN2016_E1_Q8
39 WN2018_E1_Q12 WN2015_E1_Q12
40 WN2018_E1_Q16 WN2013_E1_Q16
41 WN2018_E1_Q19 WN2014_E1_Q19

Percent correct for 41 repeated questions

Number Percent Correct WN2018 Term Standard Error WN2018 Term Percent Correct Original Term Standard Error Original Term Percent Correct Difference (WN2018 - Original)
1 0.7536232 0.0171243 0.6293605 0.0186000 0.1242627
2 0.6988728 0.0184609 0.6540698 0.0182442 0.0448030
3 0.8599034 0.0138691 0.7593496 0.0172430 0.1005538
4 0.7777778 0.0168828 0.8430233 0.0140093 -0.0652455
5 0.7842190 0.0164885 0.7863372 0.0156943 -0.0021182
6 0.7262480 0.0179398 0.6325203 0.0196955 0.0937277
7 0.8421900 0.0147303 0.7593496 0.0171803 0.0828404
8 0.8792271 0.0130793 0.8016260 0.0160488 0.0776010
9 0.8325282 0.0149615 0.8629032 0.0137637 -0.0303750
10 0.6537842 0.0192233 0.7281977 0.0170903 -0.0744135
11 0.5169082 0.0199741 0.6191860 0.0188291 -0.1022778
12 0.5362319 0.0201077 0.6243902 0.0195440 -0.0881584
13 0.7929374 0.0160646 0.7777778 0.0168885 0.0151596
14 0.8170144 0.0155682 0.7503650 0.0164774 0.0666495
15 0.5345104 0.0201393 0.4850575 0.0240177 0.0494530
16 0.6869984 0.0187672 0.7335474 0.0177471 -0.0465490
17 0.7415730 0.0174971 0.6094771 0.0196256 0.1320959
18 0.7174960 0.0177565 0.6091954 0.0233761 0.1083006
19 0.6099518 0.0195465 0.7007299 0.0174779 -0.0907781
20 0.3772071 0.0194858 0.2896552 0.0216771 0.0875519
21 0.4991974 0.0202219 0.4656934 0.0192747 0.0335040
22 0.7445483 0.0169896 0.6847978 0.0172964 0.0597505
23 0.9065421 0.0113965 0.7622821 0.0169352 0.1442600
24 0.8068536 0.0154632 0.7291982 0.0172048 0.0776554
25 0.8333333 0.0149380 0.6717095 0.0182523 0.1616238
26 0.9065421 0.0115973 0.8284519 0.0141431 0.0780902
27 0.7274143 0.0173825 0.6652720 0.0178052 0.0621424
28 0.7056075 0.0179077 0.8730823 0.0125201 -0.1674748
29 0.5342679 0.0199217 0.5975794 0.0190089 -0.0633115
30 0.6417445 0.0189987 0.7726639 0.0156988 -0.1309193
31 0.6137072 0.0190786 0.5198098 0.0198827 0.0938973
32 0.7939394 0.0159276 0.7756410 0.0167879 0.0182984
33 0.8060606 0.0152242 0.8451613 0.0146346 -0.0391007
34 0.8000000 0.0155988 0.5076709 0.0184866 0.2923291
35 0.6863636 0.0180191 0.7319277 0.0170155 -0.0455641
36 0.7833333 0.0160115 0.7790323 0.0166566 0.0043011
37 0.7863636 0.0160711 0.8019526 0.0149556 -0.0155889
38 0.7287879 0.0174774 0.6971154 0.0185086 0.0316725
39 0.9015152 0.0116544 0.6069731 0.0193901 0.2945421
40 0.6000000 0.0191431 0.6080893 0.0180758 -0.0080893
41 0.8000000 0.0154432 0.7515060 0.0166827 0.0484940

Percent correct by gender for 41 repeated questions in Winter 2018

Number Percent Correct Female Percent Correct Female Standard Error Male Percent Correct Male Standard Error Percent Correct Difference (F-M)
1 0.7536232 0.7021277 0.0300905 0.7853403 0.0209029 -0.0832127
2 0.6988728 0.6851064 0.0304853 0.7094241 0.0233200 -0.0243177
3 0.8599034 0.8170213 0.0252527 0.8848168 0.0164303 -0.0677955
4 0.7777778 0.7234043 0.0290553 0.8115183 0.0199522 -0.0881141
5 0.7842190 0.6893617 0.0303091 0.8455497 0.0182662 -0.1561880
6 0.7262480 0.7234043 0.0289145 0.7277487 0.0229024 -0.0043444
7 0.8421900 0.8468085 0.0233848 0.8376963 0.0188368 0.0091122
8 0.8792271 0.8553191 0.0228940 0.8952880 0.0155544 -0.0399688
9 0.8325282 0.7276596 0.0290129 0.8979058 0.0155589 -0.1702462
10 0.6537842 0.6000000 0.0319909 0.6858639 0.0238577 -0.0858639
11 0.5169082 0.4255319 0.0318490 0.5759162 0.0250488 -0.1503843
12 0.5362319 0.4723404 0.0325579 0.5732984 0.0253296 -0.1009580
13 0.7929374 0.7805907 0.0266044 0.8036649 0.0203565 -0.0230742
14 0.8170144 0.7594937 0.0274465 0.8507853 0.0186267 -0.0912917
15 0.5345104 0.3924051 0.0322837 0.6204188 0.0247397 -0.2280138
16 0.6869984 0.6666667 0.0308267 0.7041885 0.0231548 -0.0375218
17 0.7415730 0.6877637 0.0298666 0.7748691 0.0211898 -0.0871054
18 0.7174960 0.6582278 0.0308342 0.7513089 0.0218275 -0.0930811
19 0.6099518 0.5907173 0.0314776 0.6178010 0.0248280 -0.0270837
20 0.3772071 0.3248945 0.0304390 0.4083770 0.0252974 -0.0834824
21 0.4991974 0.4641350 0.0323597 0.5235602 0.0252781 -0.0594252
22 0.7445483 0.7581967 0.0273620 0.7328244 0.0225780 0.0253723
23 0.9065421 0.8934426 0.0197510 0.9134860 0.0142087 -0.0200434
24 0.8068536 0.7745902 0.0196421 0.8320611 0.0189945 -0.0574709
25 0.8333333 0.8606557 0.0222396 0.8193384 0.0193752 0.0413173
26 0.9065421 0.9098361 0.0182095 0.9083969 0.0146364 0.0014391
27 0.7274143 0.7418033 0.0276498 0.7201018 0.0227287 0.0217015
28 0.7056075 0.6639344 0.0303572 0.7353690 0.0223357 -0.0714345
29 0.5342679 0.4672131 0.0320815 0.5776081 0.0249241 -0.1103950
30 0.6417445 0.6311475 0.0308928 0.6513995 0.0240732 -0.0202520
31 0.6137072 0.6188525 0.0309371 0.6106870 0.0244995 0.0081654
32 0.7939394 0.7800000 0.0261024 0.8019802 0.0196422 -0.0219802
33 0.8060606 0.7880000 0.0258636 0.8193069 0.0191893 -0.0313069
34 0.8000000 0.7760000 0.0262383 0.8168317 0.0195064 -0.0408317
35 0.6863636 0.5680000 0.0317452 0.7574257 0.0212018 -0.1894257
36 0.7833333 0.8040000 0.0250388 0.7722772 0.0210121 0.0317228
37 0.7863636 0.7240000 0.0284524 0.8242574 0.0187933 -0.1002574
38 0.7287879 0.7360000 0.0277103 0.7252475 0.0224375 0.0107525
39 0.9015152 0.8520000 0.0225273 0.9306931 0.0126850 -0.0786931
40 0.6000000 0.6280000 0.0306813 0.5841584 0.0246918 0.0438416
41 0.8000000 0.7960000 0.0256553 0.8044554 0.0197168 -0.0084554