CoT unidim
CoT Construct (Fall 2021 and Spring 2022)
Design Computational Solutions:
Identify a problem and develop (creative) solutions by identifying input, output, and algorithms
BASS page:
1 Datasets (raw files)
There are n=933 respondents at Pretest and n=295 at Posttest. Raw data file is available here:
2 Calibration
## Item parameters
## |**********|
## |----------|
## Regression parameters
## |**|
## ||
## |--|## est.Dim1 se.Dim1
## 1 0.0000000 0.00000000
## 2 0.2615813 0.07329702Please see this link below for the calibration of the same dataset in ConQuest:
https://www.dropbox.com/sh/4we25w0pvnccabf/AAADpWgPYv3vB_TwRP1hnUuIa?dl=0
2.1 Model specification
## [1] "item+item*step"2.2 Latent regression coefficient (gain from pre to post)
## hs
## Main dimension 0.266
## S. errors 0.070—> ## Reliability
## EAP/PV RELIABILITY: 0.772.3 Variance
## errors
## [1,] 1.004 0.0412.4 Item parameters
The parameter difficulty parameters may be thought of as a kind of “average” item difficulty for a partial credit item. This may be useful, if one wishes to have one indicative difficulty parameter for a partial credit item as a whole. Otherwise, to describe the difficulty of a partial credit item, one needs to describe the difficulties of individual score categories within the item, such as using the Thurstonian thresholds (Wu et al., 2016).
## n_item item est error
## 1 1 Delivery.03.. 3.205 0.217
## 2 2 Elevator.04.. 1.116 0.067
## 3 3 Park.01b_MC.. 1.651 0.133
## 4 4 Shipping.03.. 0.455 0.055
## 5 5 Sorting.03b.. 1.065 0.088
## 6 6 Sorting.03c.. -0.312 0.070
## 7 7 TicTac.01ab.. -0.750 0.051
## 8 8 Delivery.03.. 1.161 0.110
## 9 9 SignUp.01ab.. -0.654 0.105
## 10 10 Travel.01_N.. -0.703 0.074
## 11 11 Delivery.01.. -0.822 0.174
## 12 12 Delivery.01.. 0.490 0.242
## 13 13 Shipping.03.. 0.543 0.135
## 14 14 Delivery.00.. 0.081 0.061
## 15 15 Elevator.00.. 0.549 0.068
## 16 16 Ticket.02_O.. 0.308 0.045
## 17 17 Travel.00ab.. -0.140 0.052
## 18 18 Elevator.02.. 0.538 0.050
## 19 19 Market.01ab.. 0.373 0.038
## 20 20 Delivery.00.. 1.029 0.151
## 21 21 Elevator.00.. 0.779 0.150
## 22 22 Market.00ab.. 0.491 0.101
## 23 23 Market.01ab.. -0.187 0.158
## 24 24 Travel.00ab.. 0.647 0.147
## 25 25 Delivery.01.. -1.231 0.090
## 26 26 Delivery.02.. -0.897 0.120
## 27 27 Delivery.02.. 0.803 0.116
## 28 28 Elevator.01.. -0.569 0.079
## 29 29 Elevator.03.. 0.866 0.058
## 30 30 Elevator.04.. 0.051 0.115
## 31 31 LunchList.0.. 0.969 0.084
## 32 32 Market.01d_.. -0.131 0.080
## 33 33 Market.02b_.. 0.377 0.041
## 34 34 Park.01c_NU.. -0.445 0.075
## 35 35 Pizza.01a_F.. -1.782 0.143
## 36 36 Pizza.01a_F.. -2.355 0.169
## 37 37 Pizza.01a_F.. -1.606 0.137
## 38 38 Pizza.01a_F.. -2.287 0.166
## 39 39 Pizza.01a_F.. -1.059 0.122
## 40 40 Pizza.01a_F.. -1.479 0.133
## 41 41 Pizza.01a_F.. -0.340 0.112
## 42 42 Pizza.02b_F.. 0.483 0.113
## 43 43 Pizza.02b_F.. 0.473 0.113
## 44 44 Pizza.02b_F.. -1.828 0.146
## 45 45 SignUp.01c_.. 0.614 0.063
## 46 46 SignUp.01d_.. -0.031 0.113
## 47 47 Sorting.03a.. -0.122 0.112
## 48 48 TicTac.03_O.. -0.448 0.042
## 49 49 Delivery.03.. 2.575 0.155
## 50 50 Shipping.01.. -1.101 0.078
## 51 51 Video.01_MC.. 1.146 0.075
## 52 52 LunchList.0.. 0.461 0.161
## 53 53 Market.02b_.. 0.479 0.261## W.fit: Weighted fit (Infit)## [,1] [,2]
## [1,] "item1" "Delivery.03d_NU_F"
## [2,] "item2" "Elevator.04c_OE_F"
## [3,] "item3" "Park.01b_MC_F"
## [4,] "item4" "Shipping.03abc_MCOE2_F"
## [5,] "item5" "Sorting.03b_MC_F"
## [6,] "item6" "Sorting.03c_MC_F"
## [7,] "item7" "TicTac.01ab_MCOE_F"
## [8,] "item8" "Delivery.03ab_MCMC_C"
## [9,] "item9" "SignUp.01ab_MCRO_C"
## [10,] "item10" "Travel.01_NU_C"
## [11,] "item11" "Delivery.01b_MC_S"
## [12,] "item12" "Delivery.01c_MC_S"
## [13,] "item13" "Shipping.03abc_MCMCOE_S"2.5 Step parameters
Delta is the point at which the probability of being in category k − 1 and category k is equals. This mathematical fact provides an interpretation for the delta (d) parameters (Wu et al., 2016)
## n_item item step est error
## 1 2 Elevator.04.. 0 NA NA
## 2 2 Elevator.04.. 1 -2.126 0.148
## 3 2 Elevator.04.. 2 -1.029 0.122
## 4 2 Elevator.04.. 3 0.485 0.170
## 5 2 Elevator.04.. 4 2.671 NA
## 6 4 Shipping.03.. 0 NA NA
## 7 4 Shipping.03.. 1 1.824 0.118
## 8 4 Shipping.03.. 2 -2.193 0.123
## 9 4 Shipping.03.. 3 0.369 NA
## 10 5 Sorting.03b.. 0 NA NA
## 11 5 Sorting.03b.. 1 -0.937 0.108
## 12 5 Sorting.03b.. 2 0.937 NA
## 13 6 Sorting.03c.. 0 NA NA
## 14 6 Sorting.03c.. 1 0.849 0.151
## 15 6 Sorting.03c.. 2 -0.849 NA
## 16 7 TicTac.01ab.. 0 NA NA
## 17 7 TicTac.01ab.. 1 0.430 0.076
## 18 7 TicTac.01ab.. 2 -1.901 0.075
## 19 7 TicTac.01ab.. 3 1.471 NA
## 20 9 SignUp.01ab.. 0 NA NA
## 21 9 SignUp.01ab.. 1 -2.687 0.108
## 22 9 SignUp.01ab.. 2 2.687 NA
## 23 11 Delivery.01.. 0 NA NA
## 24 11 Delivery.01.. 1 0.728 0.342
## 25 11 Delivery.01.. 2 -0.728 NA
## 26 13 Shipping.03.. 0 NA NA
## 27 13 Shipping.03.. 1 0.337 0.245
## 28 13 Shipping.03.. 2 -0.891 0.269
## 29 13 Shipping.03.. 3 0.554 NA
## 30 14 Delivery.00.. 0 NA NA
## 31 14 Delivery.00.. 1 -2.487 0.151
## 32 14 Delivery.00.. 2 -0.175 0.110
## 33 14 Delivery.00.. 3 0.650 0.129
## 34 14 Delivery.00.. 4 2.012 NA
## 35 15 Elevator.00.. 0 NA NA
## 36 15 Elevator.00.. 1 -1.423 0.151
## 37 15 Elevator.00.. 2 -1.904 0.121
## 38 15 Elevator.00.. 3 1.685 0.177
## 39 15 Elevator.00.. 4 1.642 NA
## 40 16 Ticket.02_O.. 0 NA NA
## 41 16 Ticket.02_O.. 1 -1.934 0.117
## 42 16 Ticket.02_O.. 2 -0.987 0.087
## 43 16 Ticket.02_O.. 3 0.081 0.086
## 44 16 Ticket.02_O.. 4 2.839 NA
## 45 17 Travel.00ab.. 0 NA NA
## 46 17 Travel.00ab.. 1 -2.068 0.091
## 47 17 Travel.00ab.. 2 0.282 0.078
## 48 17 Travel.00ab.. 3 1.786 NA
## 49 18 Elevator.02.. 0 NA NA
## 50 18 Elevator.02.. 1 -1.823 0.109
## 51 18 Elevator.02.. 2 -0.013 0.099
## 52 18 Elevator.02.. 3 0.564 0.130
## 53 18 Elevator.02.. 4 1.273 NA
## 54 19 Market.01ab.. 0 NA NA
## 55 19 Market.01ab.. 1 -1.984 0.084
## 56 19 Market.01ab.. 2 0.359 0.077
## 57 19 Market.01ab.. 3 0.624 0.105
## 58 19 Market.01ab.. 4 1.001 NA
## 59 20 Delivery.00.. 0 NA NA
## 60 20 Delivery.00.. 1 -2.693 0.368
## 61 20 Delivery.00.. 2 -1.033 0.251
## 62 20 Delivery.00.. 3 0.851 0.338
## 63 20 Delivery.00.. 4 2.876 NA
## 64 21 Elevator.00.. 0 NA NA
## 65 21 Elevator.00.. 1 -1.287 0.330
## 66 21 Elevator.00.. 2 -1.693 0.289
## 67 21 Elevator.00.. 3 0.949 0.330
## 68 21 Elevator.00.. 4 2.031 NA
## 69 22 Market.00ab.. 0 NA NA
## 70 22 Market.00ab.. 1 -2.126 0.218
## 71 22 Market.00ab.. 2 -0.697 0.179
## 72 22 Market.00ab.. 3 1.490 0.252
## 73 22 Market.00ab.. 4 1.333 NA
## 74 23 Market.01ab.. 0 NA NA
## 75 23 Market.01ab.. 1 -4.100 0.415
## 76 23 Market.01ab.. 2 0.205 0.255
## 77 23 Market.01ab.. 3 2.562 0.440
## 78 23 Market.01ab.. 4 1.334 NA
## 79 24 Travel.00ab.. 0 NA NA
## 80 24 Travel.00ab.. 1 -2.034 0.368
## 81 24 Travel.00ab.. 2 -1.594 0.267
## 82 24 Travel.00ab.. 3 0.826 0.288
## 83 24 Travel.00ab.. 4 2.803 NA
## 84 25 Delivery.01.. 0 NA NA
## 85 25 Delivery.01.. 1 -0.843 0.111
## 86 25 Delivery.01.. 2 0.843 NA
## 87 28 Elevator.01.. 0 NA NA
## 88 28 Elevator.01.. 1 -0.553 0.107
## 89 28 Elevator.01.. 2 0.553 NA
## 90 29 Elevator.03.. 0 NA NA
## 91 29 Elevator.03.. 1 -0.951 0.131
## 92 29 Elevator.03.. 2 -1.365 0.122
## 93 29 Elevator.03.. 3 0.091 0.140
## 94 29 Elevator.03.. 4 2.225 NA
## 95 33 Market.02b_.. 0 NA NA
## 96 33 Market.02b_.. 1 -1.016 0.089
## 97 33 Market.02b_.. 2 -1.207 0.080
## 98 33 Market.02b_.. 3 1.245 0.112
## 99 33 Market.02b_.. 4 0.978 NA
## 100 34 Park.01c_NU.. 0 NA NA
## 101 34 Park.01c_NU.. 1 0.072 0.121
## 102 34 Park.01c_NU.. 2 -0.072 NA
## 103 45 SignUp.01c_.. 0 NA NA
## 104 45 SignUp.01c_.. 1 -0.231 0.112
## 105 45 SignUp.01c_.. 2 -1.303 0.114
## 106 45 SignUp.01c_.. 3 1.534 NA
## 107 48 TicTac.03_O.. 0 NA NA
## 108 48 TicTac.03_O.. 1 -0.255 0.079
## 109 48 TicTac.03_O.. 2 0.363 0.096
## 110 48 TicTac.03_O.. 3 -0.108 NA2.6 Thurstonian thresholds
For partial credit items, to achieve a score of 2, students would generally need to accomplish more tasks than for achieving a score of 1. To reflect this “cumulative achievement”, the Thurstonian thresholds are sometimes used as indicators of “score difficulties”. The Thurstonian threshold for a score category is defined as the ability at which the probability of achieving that score or higher reaches 0.50.
## [,1] [,2] [,3] [,4]
## Delivery.03d_NU_F 3.205 NA NA NA
## Elevator.04c_OE_F -1.254 0.146 1.682 3.887
## Park.01b_MC_F 1.651 NA NA NA
## Shipping.03abc_MCOE2_F 0.029 0.124 1.061 NA
## Sorting.03b_MC_F 0.002 2.129 NA NA
## Sorting.03c_MC_F -0.524 -0.100 NA NA
## TicTac.01ab_MCOE_F -1.677 -1.395 0.765 NA
## Delivery.03ab_MCMC_C 1.161 NA NA NA
## SignUp.01ab_MCRO_C -3.346 2.037 NA NA
## Travel.01_NU_C -0.703 NA NA NA
## Delivery.01b_MC_S -1.061 -0.583 NA NA
## Delivery.01c_MC_S 0.489 NA NA NA
## Shipping.03abc_MCMCOE_S -0.102 0.302 1.355 NA
## Delivery.00ab_OEOE_F -2.497 -0.306 0.828 2.298
## Elevator.00ab_OE2_F -1.506 -0.766 1.773 2.689
## Ticket.02_OE_F -1.905 -0.661 0.587 3.207
## Travel.00ab_OEOE_F -2.293 0.056 1.820 NA
## Elevator.02abc_OE3_C -1.428 0.284 1.147 2.160
## Market.01abc_OE_C -1.700 0.336 1.039 1.833
## Delivery.00abc_OEOEOE_S -1.819 0.019 1.896 4.018
## Elevator.00abc_OEOEOE_S -1.126 -0.394 1.565 3.051
## Market.00abc_OEOEOE_S -1.820 -0.133 1.570 2.372
## Market.01abc_MCOEOE_S -4.300 -0.074 1.609 2.073
## Travel.00abc_OEOEOE_S -1.765 -0.665 1.439 3.567
## Delivery.01a_MC_F -2.223 -0.240 NA NA
## Delivery.02a_MC_F -0.897 NA NA NA
## Delivery.02b_NU_F 0.803 NA NA NA
## Elevator.01a_NU_F -1.354 0.217 NA NA
## Elevator.03_OE_F -0.742 -0.104 1.073 3.195
## Elevator.04a_MC_F 0.051 NA NA NA
## LunchList.01_MC_drag.v2_F 0.969 NA NA NA
## Market.01d_MC_F -0.131 NA NA NA
## Market.02b_OE_F -1.194 -0.396 1.165 1.933
## Park.01c_NU_F -0.895 0.005 NA NA
## Pizza.01a_FB.1_F -1.782 NA NA NA
## Pizza.01a_FB.2_F -2.355 NA NA NA
## Pizza.01a_FB.3_F -1.606 NA NA NA
## Pizza.01a_FB.4_F -2.287 NA NA NA
## Pizza.01a_FB.5_F -1.060 NA NA NA
## Pizza.01a_FB.6_F -1.479 NA NA NA
## Pizza.01a_FB.7_F -0.340 NA NA NA
## Pizza.02b_FB.1_F 0.482 NA NA NA
## Pizza.02b_FB.2_F 0.473 NA NA NA
## Pizza.02b_FB.3_F -1.828 NA NA NA
## SignUp.01c_MC_F -0.467 0.061 2.210 NA
## SignUp.01d_MC_F -0.031 NA NA NA
## Sorting.03a_NU_F -0.122 NA NA NA
## TicTac.03_OE_F -1.137 -0.352 0.180 NA
## Delivery.03c_FB_C 2.575 NA NA NA
## Shipping.01_NU_C -1.102 NA NA NA
## Video.01_MC_drag.v2_C 1.146 NA NA NA
## LunchList.01_MC_S 0.461 NA NA NA
## Market.02b_FB_S 0.479 NA NA NA## CoT1 CoT2 CoT3 CoT4
## Delivery.03d_NU_F 3.205 NA NA NA
## Elevator.04c_OE_F -1.254 0.146 1.682 3.887
## Park.01b_MC_F 1.651 NA NA NA
## Shipping.03abc_MCOE2_F 0.029 0.124 1.061 NA
## Sorting.03b_MC_F 0.002 2.129 NA NA
## Sorting.03c_MC_F -0.524 -0.100 NA NA
## TicTac.01ab_MCOE_F -1.677 -1.395 0.765 NA
## Delivery.03ab_MCMC_C 1.161 NA NA NA
## SignUp.01ab_MCRO_C -3.346 2.037 NA NA
## Travel.01_NU_C -0.703 NA NA NA
## Delivery.01b_MC_S -1.061 -0.583 NA NA
## Delivery.01c_MC_S 0.489 NA NA NA
## Shipping.03abc_MCMCOE_S -0.102 0.302 1.355 NA
## Delivery.00ab_OEOE_F -2.497 -0.306 0.828 2.298
## Elevator.00ab_OE2_F -1.506 -0.766 1.773 2.689
## Ticket.02_OE_F -1.905 -0.661 0.587 3.207
## Travel.00ab_OEOE_F -2.293 0.056 1.820 NA
## Elevator.02abc_OE3_C -1.428 0.284 1.147 2.160
## Market.01abc_OE_C -1.700 0.336 1.039 1.833
## Delivery.00abc_OEOEOE_S -1.819 0.019 1.896 4.018
## Elevator.00abc_OEOEOE_S -1.126 -0.394 1.565 3.051
## Market.00abc_OEOEOE_S -1.820 -0.133 1.570 2.372
## Market.01abc_MCOEOE_S -4.300 -0.074 1.609 2.073
## Travel.00abc_OEOEOE_S -1.765 -0.665 1.439 3.567
## Delivery.01a_MC_F -2.223 -0.240 NA NA
## Delivery.02a_MC_F -0.897 NA NA NA
## Delivery.02b_NU_F 0.803 NA NA NA
## Elevator.01a_NU_F -1.354 0.217 NA NA
## Elevator.03_OE_F -0.742 -0.104 1.073 3.195
## Elevator.04a_MC_F 0.051 NA NA NA
## LunchList.01_MC_drag.v2_F 0.969 NA NA NA
## Market.01d_MC_F -0.131 NA NA NA
## Market.02b_OE_F -1.194 -0.396 1.165 1.933
## Park.01c_NU_F -0.895 0.005 NA NA
## Pizza.01a_FB.1_F -1.782 NA NA NA
## Pizza.01a_FB.2_F -2.355 NA NA NA
## Pizza.01a_FB.3_F -1.606 NA NA NA
## Pizza.01a_FB.4_F -2.287 NA NA NA
## Pizza.01a_FB.5_F -1.060 NA NA NA
## Pizza.01a_FB.6_F -1.479 NA NA NA
## Pizza.01a_FB.7_F -0.340 NA NA NA
## Pizza.02b_FB.1_F 0.482 NA NA NA
## Pizza.02b_FB.2_F 0.473 NA NA NA
## Pizza.02b_FB.3_F -1.828 NA NA NA
## SignUp.01c_MC_F -0.467 0.061 2.210 NA
## SignUp.01d_MC_F -0.031 NA NA NA
## Sorting.03a_NU_F -0.122 NA NA NA
## TicTac.03_OE_F -1.137 -0.352 0.180 NA
## Delivery.03c_FB_C 2.575 NA NA NA
## Shipping.01_NU_C -1.102 NA NA NA
## Video.01_MC_drag.v2_C 1.146 NA NA NA
## LunchList.01_MC_S 0.461 NA NA NA
## Market.02b_FB_S 0.479 NA NA NA## CoT1 CoT2 CoT3 CoT4
## Min. :-4.3000 Min. :-1.39500 Min. :0.180 Min. :1.833
## 1st Qu.:-1.7000 1st Qu.:-0.38350 1st Qu.:1.050 1st Qu.:2.160
## Median :-1.0600 Median :-0.08700 Median :1.355 Median :2.689
## Mean :-0.7525 Mean :-0.01742 Mean :1.303 Mean :2.791
## 3rd Qu.: 0.0290 3rd Qu.: 0.14050 3rd Qu.:1.645 3rd Qu.:3.207
## Max. : 3.2050 Max. : 2.12900 Max. :2.210 Max. :4.018
## NA's :27 NA's :34 NA's :40## X CoT1 CoT2 CoT3 CoT4
## 1 Delivery.03d_NU_F NA NA NA 3.205
## 2 Elevator.04c_OE_F -1.254 0.146 1.682 3.887
## 3 Park.01b_MC_F NA NA NA 1.651
## 4 Shipping.03abc_MCOE2_F 0.029 0.124 1.061 NA
## 5 Sorting.03b_MC_F NA 0.002 2.129 NA
## 6 Sorting.03c_MC_F NA -0.524 -0.100 NA
## 7 TicTac.01ab_MCOE_F -1.677 -1.395 0.765 NA
## 8 Delivery.03ab_MCMC_C NA NA 1.161 NA
## 9 SignUp.01ab_MCRO_C -3.346 NA 2.037 NA
## 10 Travel.01_NU_C NA -0.703 NA NA
## 11 Delivery.01b_MC_S -1.061 -0.583 NA NA
## 12 Delivery.01c_MC_S NA 0.489 NA NA
## 13 Shipping.03abc_MCMCOE_S -0.102 0.302 1.355 NA
## 14 Delivery.00ab_OEOE_F -2.497 -0.306 0.828 2.298
## 15 Elevator.00ab_OE2_F -1.506 -0.766 1.773 2.689
## 16 Ticket.02_OE_F -1.905 -0.661 0.587 3.207
## 17 Travel.00ab_OEOE_F -2.293 0.056 1.820 NA
## 18 Elevator.02abc_OE3_C -1.428 0.284 1.147 2.160
## 19 Market.01abc_OE_C -1.700 0.336 1.039 1.833
## 20 Delivery.00abc_OEOEOE_S -1.819 0.019 1.896 4.018
## 21 Elevator.00abc_OEOEOE_S -1.126 -0.394 1.565 3.051
## 22 Market.00abc_OEOEOE_S -1.820 -0.133 1.570 2.372
## 23 Market.01abc_MCOEOE_S -4.300 -0.074 1.609 2.073
## 24 Travel.00abc_OEOEOE_S -1.765 -0.665 1.439 3.567
## 25 Delivery.01a_MC_F -2.223 -0.240 NA NA
## 26 Delivery.02a_MC_F NA -0.897 NA NA
## 27 Delivery.02b_NU_F NA NA 0.803 NA
## 28 Elevator.01a_NU_F -1.354 0.217 NA NA
## 29 Elevator.03_OE_F -0.742 -0.104 1.073 3.195
## 30 Elevator.04a_MC_F NA 0.051 NA NA
## 31 LunchList.01_MC_drag.v2_F NA NA 0.969 NA
## 32 Market.01d_MC_F NA -0.131 NA NA
## 33 Market.02b_OE_F -1.194 -0.396 1.165 1.933
## 34 Park.01c_NU_F -0.895 NA 0.005 NA
## 35 Pizza.01a_FB.1_F NA -1.782 NA NA
## 36 Pizza.01a_FB.2_F NA -2.355 NA NA
## 37 Pizza.01a_FB.3_F NA -1.606 NA NA
## 38 Pizza.01a_FB.4_F NA -2.287 NA NA
## 39 Pizza.01a_FB.5_F NA -1.060 NA NA
## 40 Pizza.01a_FB.6_F NA -1.479 NA NA
## 41 Pizza.01a_FB.7_F NA -0.340 NA NA
## 42 Pizza.02b_FB.1_F NA NA 0.482 NA
## 43 Pizza.02b_FB.2_F NA NA 0.473 NA
## 44 Pizza.02b_FB.3_F NA NA -1.828 NA
## 45 SignUp.01c_MC_F -0.467 0.061 2.210 NA
## 46 SignUp.01d_MC_F NA -0.031 NA NA
## 47 Sorting.03a_NU_F NA -0.122 NA NA
## 48 TicTac.03_OE_F -1.137 -0.352 0.180 NA
## 49 Delivery.03c_FB_C NA NA NA 2.575
## 50 Shipping.01_NU_C NA -1.102 NA NA
## 51 Video.01_MC_drag.v2_C NA NA NA 1.146
## 52 LunchList.01_MC_S NA NA 0.461 NA
## 53 Market.02b_FB_S NA NA NA 0.4793 Links to CQ files (please copy/paste these links)
https://www.dropbox.com/sh/vr3f9anqhy5im7c/AADIvwaK5vPUPdw1BZBepbQSa?dl=0
4 Item fit graph
5 Wright Map
6 Category Characteristic Curves (CCC)
7 Calibration summary from TAM
## ------------------------------------------------------------
## TAM 4.1-4 (2022-08-28 16:03:54)
## R version 4.2.2 (2022-10-31) x86_64, darwin17.0 | nodename=Permans-MacBook-Pro-4.local | login=root
##
## Date of Analysis: 2023-02-24 02:27:06
## Time difference of 0.4756649 secs
## Computation time: 0.4756649
##
## Multidimensional Item Response Model in TAM
##
## IRT Model: PCM2
## Call:
## TAM::tam.mml(resp = cot[, c(6:58)], Y = cot[, 5], irtmodel = "PCM2",
## verbose = FALSE)
##
## ------------------------------------------------------------
## Number of iterations = 73
## Numeric integration with 21 integration points
##
## Deviance = 36002.01
## Log likelihood = -18001.01
## Number of persons = 1228
## Number of persons used = 1148
## Number of items = 53
## Number of estimated parameters = 113
## Item threshold parameters = 111
## Item slope parameters = 0
## Regression parameters = 1
## Variance/covariance parameters = 1
##
## AIC = 36228 | penalty=226 | AIC=-2*LL + 2*p
## AIC3 = 36341 | penalty=339 | AIC3=-2*LL + 3*p
## BIC = 36798 | penalty=796.17 | BIC=-2*LL + log(n)*p
## aBIC = 36439 | penalty=436.86 | aBIC=-2*LL + log((n-2)/24)*p (adjusted BIC)
## CAIC = 36911 | penalty=909.17 | CAIC=-2*LL + [log(n)+1]*p (consistent AIC)
## AICc = 36253 | penalty=250.92 | AICc=-2*LL + 2*p + 2*p*(p+1)/(n-p-1) (bias corrected AIC)
## GHP = 0.79069 | GHP=( -LL + p ) / (#Persons * #Items) (Gilula-Haberman log penalty)
##
## ------------------------------------------------------------
## EAP Reliability
## [1] 0.779
## ------------------------------------------------------------
## Covariances and Variances
## [,1]
## [1,] 1.006
## ------------------------------------------------------------
## Correlations and Standard Deviations (in the diagonal)
## [,1]
## [1,] 1.003
## ------------------------------------------------------------
## Regression Coefficients
## [,1]
## [1,] 0.00000
## [2,] 0.26158
## ------------------------------------------------------------
## Standardized Coefficients
## parm dim est StdYX StdX StdY
## 1 Intercept 1 0.0000 NA NA NA
## 2 Y1 1 0.2616 0.1108 0.1118 0.2592
##
## ** Explained Variance R^2
## [1] 0.0123
## ** SD Theta
## [1] 1.0092
## ** SD Predictors
## Intercept Y1
## 0.0000 0.4274
## ------------------------------------------------------------
## Item Parameters -A*Xsi
## item N M xsi.item AXsi_.Cat1 AXsi_.Cat2
## 1 Delivery.03d_NU_F 387 0.062 3.209 3.209 NA
## 2 Elevator.04c_OE_F 357 1.431 1.121 -1.005 -0.912
## 3 Park.01b_MC_F 388 0.211 1.656 1.656 NA
## 4 Shipping.03abc_MCOE2_F 376 1.218 0.461 2.284 0.553
## 5 Sorting.03b_MC_F 379 0.615 1.071 0.134 2.141
## 6 Sorting.03c_MC_F 379 1.201 -0.306 0.543 -0.612
## 7 TicTac.01ab_MCOE_F 772 2.097 -0.746 -0.319 -2.964
## 8 Delivery.03ab_MCMC_C 474 0.295 1.164 1.164 NA
## 9 SignUp.01ab_MCRO_C 548 1.124 -0.652 -3.340 -1.304
## 10 Travel.01_NU_C 998 0.663 -0.699 -0.699 NA
## 11 Delivery.01b_MC_S 84 1.524 -0.823 -0.096 -1.647
## 12 Delivery.01c_MC_S 84 0.452 0.488 0.488 NA
## 13 Shipping.03abc_MCMCOE_S 80 1.425 0.544 0.880 0.533
## 14 Delivery.00ab_OEOE_F 399 1.912 0.085 -2.405 -2.496
## 15 Elevator.00ab_OE2_F 389 1.715 0.554 -0.870 -2.220
## 16 Ticket.02_OE_F 755 2.001 0.313 -1.622 -2.297
## 17 Travel.00ab_OEOE_F 764 1.558 -0.136 -2.204 -2.057
## 18 Elevator.02abc_OE3_C 522 1.594 0.542 -1.281 -0.752
## 19 Market.01abc_OE_C 865 1.625 0.378 -1.607 -0.870
## 20 Delivery.00abc_OEOEOE_S 84 1.619 1.028 -1.666 -1.672
## 21 Elevator.00abc_OEOEOE_S 72 1.750 0.779 -0.509 -1.423
## 22 Market.00abc_OEOEOE_S 155 1.787 0.492 -1.636 -1.840
## 23 Market.01abc_MCOEOE_S 71 1.859 -0.187 -4.289 -4.271
## 24 Travel.00abc_OEOEOE_S 85 1.882 0.645 -1.390 -2.339
## 25 Delivery.01a_MC_F 392 1.477 -1.228 -2.072 -2.456
## 26 Delivery.02a_MC_F 392 0.691 -0.894 -0.894 NA
## 27 Delivery.02b_NU_F 392 0.355 0.807 0.807 NA
## 28 Elevator.01a_NU_F 389 1.254 -0.563 -1.117 -1.127
## 29 Elevator.03_OE_F 374 1.532 0.872 -0.079 -0.572
## 30 Elevator.04a_MC_F 359 0.501 0.057 0.057 NA
## 31 LunchList.01_MC_drag.v2_F 761 0.319 0.974 0.974 NA
## 32 Market.01d_MC_F 759 0.540 -0.126 -0.126 NA
## 33 Market.02b_OE_F 759 1.746 0.381 -0.636 -1.462
## 34 Park.01c_NU_F 385 1.262 -0.442 -0.371 -0.883
## 35 Pizza.01a_FB.1_F 384 0.823 -1.777 -1.777 NA
## 36 Pizza.01a_FB.2_F 384 0.885 -2.351 -2.351 NA
## 37 Pizza.01a_FB.3_F 384 0.799 -1.602 -1.602 NA
## 38 Pizza.01a_FB.4_F 383 0.880 -2.283 -2.283 NA
## 39 Pizza.01a_FB.5_F 384 0.714 -1.054 -1.054 NA
## 40 Pizza.01a_FB.6_F 384 0.781 -1.474 -1.474 NA
## 41 Pizza.01a_FB.7_F 384 0.576 -0.335 -0.335 NA
## 42 Pizza.02b_FB.1_F 379 0.406 0.488 0.488 NA
## 43 Pizza.02b_FB.2_F 380 0.408 0.478 0.478 NA
## 44 Pizza.02b_FB.3_F 379 0.831 -1.823 -1.823 NA
## 45 SignUp.01c_MC_F 382 1.280 0.618 0.385 -0.299
## 46 SignUp.01d_MC_F 381 0.528 -0.027 -0.027 NA
## 47 Sorting.03a_NU_F 379 0.533 -0.116 -0.116 NA
## 48 TicTac.03_OE_F 758 1.894 -0.443 -0.699 -0.778
## 49 Delivery.03c_FB_C 471 0.108 2.579 2.579 NA
## 50 Shipping.01_NU_C 1008 0.731 -1.098 -1.098 NA
## 51 Video.01_MC_drag.v2_C 1004 0.299 1.150 1.150 NA
## 52 LunchList.01_MC_S 195 0.456 0.461 0.461 NA
## 53 Market.02b_FB_S 77 0.481 0.480 0.480 NA
## AXsi_.Cat3 AXsi_.Cat4 B.Cat1.Dim1 B.Cat2.Dim1 B.Cat3.Dim1 B.Cat4.Dim1
## 1 NA NA 1 0 0 0
## 2 0.694 4.486 1 2 3 4
## 3 NA NA 1 0 0 0
## 4 1.382 NA 1 2 3 0
## 5 NA NA 1 2 0 0
## 6 NA NA 1 2 0 0
## 7 -2.238 NA 1 2 3 0
## 8 NA NA 1 0 0 0
## 9 NA NA 1 2 0 0
## 10 NA NA 1 0 0 0
## 11 NA NA 1 2 0 0
## 12 NA NA 1 0 0 0
## 13 1.631 NA 1 2 3 0
## 14 -1.760 0.338 1 2 3 4
## 15 0.019 2.215 1 2 3 4
## 16 -1.902 1.250 1 2 3 4
## 17 -0.407 NA 1 2 3 0
## 18 0.354 2.170 1 2 3 4
## 19 0.132 1.511 1 2 3 4
## 20 0.207 4.111 1 2 3 4
## 21 0.306 3.118 1 2 3 4
## 22 0.142 1.968 1 2 3 4
## 23 -1.896 -0.749 1 2 3 4
## 24 -0.868 2.582 1 2 3 4
## 25 NA NA 1 2 0 0
## 26 NA NA 1 0 0 0
## 27 NA NA 1 0 0 0
## 28 NA NA 1 2 0 0
## 29 0.391 3.487 1 2 3 4
## 30 NA NA 1 0 0 0
## 31 NA NA 1 0 0 0
## 32 NA NA 1 0 0 0
## 33 0.165 1.524 1 2 3 4
## 34 NA NA 1 2 0 0
## 35 NA NA 1 0 0 0
## 36 NA NA 1 0 0 0
## 37 NA NA 1 0 0 0
## 38 NA NA 1 0 0 0
## 39 NA NA 1 0 0 0
## 40 NA NA 1 0 0 0
## 41 NA NA 1 0 0 0
## 42 NA NA 1 0 0 0
## 43 NA NA 1 0 0 0
## 44 NA NA 1 0 0 0
## 45 1.854 NA 1 2 3 0
## 46 NA NA 1 0 0 0
## 47 NA NA 1 0 0 0
## 48 -1.329 NA 1 2 3 0
## 49 NA NA 1 0 0 0
## 50 NA NA 1 0 0 0
## 51 NA NA 1 0 0 0
## 52 NA NA 1 0 0 0
## 53 NA NA 1 0 0 0
##
## Item Parameters Xsi
## xsi se.xsi
## Delivery.03d_NU_F 3.209 0.218
## Elevator.04c_OE_F 1.121 0.067
## Park.01b_MC_F 1.656 0.133
## Shipping.03abc_MCOE2_F 0.461 0.055
## Sorting.03b_MC_F 1.071 0.088
## Sorting.03c_MC_F -0.306 0.070
## TicTac.01ab_MCOE_F -0.746 0.051
## Delivery.03ab_MCMC_C 1.164 0.110
## SignUp.01ab_MCRO_C -0.652 0.105
## Travel.01_NU_C -0.699 0.074
## Delivery.01b_MC_S -0.823 0.174
## Delivery.01c_MC_S 0.488 0.242
## Shipping.03abc_MCMCOE_S 0.544 0.135
## Delivery.00ab_OEOE_F 0.085 0.062
## Elevator.00ab_OE2_F 0.554 0.068
## Ticket.02_OE_F 0.313 0.045
## Travel.00ab_OEOE_F -0.136 0.052
## Elevator.02abc_OE3_C 0.542 0.050
## Market.01abc_OE_C 0.378 0.038
## Delivery.00abc_OEOEOE_S 1.028 0.151
## Elevator.00abc_OEOEOE_S 0.779 0.150
## Market.00abc_OEOEOE_S 0.492 0.101
## Market.01abc_MCOEOE_S -0.187 0.158
## Travel.00abc_OEOEOE_S 0.645 0.147
## Delivery.01a_MC_F -1.228 0.090
## Delivery.02a_MC_F -0.894 0.120
## Delivery.02b_NU_F 0.807 0.116
## Elevator.01a_NU_F -0.563 0.079
## Elevator.03_OE_F 0.872 0.058
## Elevator.04a_MC_F 0.057 0.115
## LunchList.01_MC_drag.v2_F 0.974 0.084
## Market.01d_MC_F -0.126 0.080
## Market.02b_OE_F 0.381 0.041
## Park.01c_NU_F -0.442 0.075
## Pizza.01a_FB.1_F -1.777 0.143
## Pizza.01a_FB.2_F -2.351 0.169
## Pizza.01a_FB.3_F -1.602 0.137
## Pizza.01a_FB.4_F -2.283 0.166
## Pizza.01a_FB.5_F -1.054 0.122
## Pizza.01a_FB.6_F -1.474 0.133
## Pizza.01a_FB.7_F -0.335 0.113
## Pizza.02b_FB.1_F 0.488 0.113
## Pizza.02b_FB.2_F 0.478 0.113
## Pizza.02b_FB.3_F -1.823 0.146
## SignUp.01c_MC_F 0.618 0.063
## SignUp.01d_MC_F -0.027 0.113
## Sorting.03a_NU_F -0.116 0.112
## TicTac.03_OE_F -0.443 0.042
## Delivery.03c_FB_C 2.579 0.155
## Shipping.01_NU_C -1.098 0.078
## Video.01_MC_drag.v2_C 1.150 0.075
## LunchList.01_MC_S 0.461 0.161
## Market.02b_FB_S 0.480 0.261
## Elevator.04c_OE_F_step1 -2.126 0.148
## Elevator.04c_OE_F_step2 -1.028 0.122
## Elevator.04c_OE_F_step3 0.485 0.170
## Shipping.03abc_MCOE2_F_step1 1.823 0.118
## Shipping.03abc_MCOE2_F_step2 -2.192 0.123
## Sorting.03b_MC_F_step1 -0.937 0.108
## Sorting.03c_MC_F_step1 0.850 0.151
## TicTac.01ab_MCOE_F_step1 0.427 0.076
## TicTac.01ab_MCOE_F_step2 -1.899 0.075
## SignUp.01ab_MCRO_C_step1 -2.688 0.108
## Delivery.01b_MC_S_step1 0.728 0.342
## Shipping.03abc_MCMCOE_S_step1 0.336 0.245
## Shipping.03abc_MCMCOE_S_step2 -0.891 0.269
## Delivery.00ab_OEOE_F_step1 -2.489 0.151
## Delivery.00ab_OEOE_F_step2 -0.176 0.110
## Delivery.00ab_OEOE_F_step3 0.651 0.129
## Elevator.00ab_OE2_F_step1 -1.424 0.151
## Elevator.00ab_OE2_F_step2 -1.903 0.121
## Elevator.00ab_OE2_F_step3 1.685 0.177
## Ticket.02_OE_F_step1 -1.935 0.117
## Ticket.02_OE_F_step2 -0.987 0.087
## Ticket.02_OE_F_step3 0.082 0.086
## Travel.00ab_OEOE_F_step1 -2.069 0.091
## Travel.00ab_OEOE_F_step2 0.283 0.078
## Elevator.02abc_OE3_C_step1 -1.824 0.109
## Elevator.02abc_OE3_C_step2 -0.013 0.099
## Elevator.02abc_OE3_C_step3 0.564 0.130
## Market.01abc_OE_C_step1 -1.985 0.084
## Market.01abc_OE_C_step2 0.360 0.077
## Market.01abc_OE_C_step3 0.625 0.105
## Delivery.00abc_OEOEOE_S_step1 -2.694 0.368
## Delivery.00abc_OEOEOE_S_step2 -1.033 0.251
## Delivery.00abc_OEOEOE_S_step3 0.851 0.338
## Elevator.00abc_OEOEOE_S_step1 -1.288 0.330
## Elevator.00abc_OEOEOE_S_step2 -1.693 0.289
## Elevator.00abc_OEOEOE_S_step3 0.949 0.330
## Market.00abc_OEOEOE_S_step1 -2.128 0.218
## Market.00abc_OEOEOE_S_step2 -0.697 0.179
## Market.00abc_OEOEOE_S_step3 1.490 0.252
## Market.01abc_MCOEOE_S_step1 -4.102 0.415
## Market.01abc_MCOEOE_S_step2 0.205 0.255
## Market.01abc_MCOEOE_S_step3 2.562 0.440
## Travel.00abc_OEOEOE_S_step1 -2.035 0.368
## Travel.00abc_OEOEOE_S_step2 -1.595 0.267
## Travel.00abc_OEOEOE_S_step3 0.826 0.288
## Delivery.01a_MC_F_step1 -0.844 0.111
## Elevator.01a_NU_F_step1 -0.553 0.107
## Elevator.03_OE_F_step1 -0.950 0.131
## Elevator.03_OE_F_step2 -1.365 0.122
## Elevator.03_OE_F_step3 0.091 0.140
## Market.02b_OE_F_step1 -1.018 0.089
## Market.02b_OE_F_step2 -1.206 0.080
## Market.02b_OE_F_step3 1.245 0.112
## Park.01c_NU_F_step1 0.071 0.121
## SignUp.01c_MC_F_step1 -0.233 0.112
## SignUp.01c_MC_F_step2 -1.302 0.114
## TicTac.03_OE_F_step1 -0.256 0.079
## TicTac.03_OE_F_step2 0.364 0.096
##
## Item Parameters in IRT parameterization
## item alpha beta tau.Cat1 tau.Cat2 tau.Cat3 tau.Cat4
## 1 Delivery.03d_NU_F 1 3.209 NA NA NA NA
## 2 Elevator.04c_OE_F 1 1.121 -2.126 -1.028 0.485 2.670
## 3 Park.01b_MC_F 1 1.656 NA NA NA NA
## 4 Shipping.03abc_MCOE2_F 1 0.461 1.823 -2.192 0.369 NA
## 5 Sorting.03b_MC_F 1 1.071 -0.937 0.937 NA NA
## 6 Sorting.03c_MC_F 1 -0.306 0.850 -0.850 NA NA
## 7 TicTac.01ab_MCOE_F 1 -0.746 0.427 -1.899 1.472 NA
## 8 Delivery.03ab_MCMC_C 1 1.164 NA NA NA NA
## 9 SignUp.01ab_MCRO_C 1 -0.652 -2.688 2.688 NA NA
## 10 Travel.01_NU_C 1 -0.699 NA NA NA NA
## 11 Delivery.01b_MC_S 1 -0.823 0.728 -0.728 NA NA
## 12 Delivery.01c_MC_S 1 0.488 NA NA NA NA
## 13 Shipping.03abc_MCMCOE_S 1 0.544 0.336 -0.891 0.555 NA
## 14 Delivery.00ab_OEOE_F 1 0.085 -2.489 -0.176 0.651 2.013
## 15 Elevator.00ab_OE2_F 1 0.554 -1.424 -1.903 1.685 1.642
## 16 Ticket.02_OE_F 1 0.313 -1.935 -0.987 0.082 2.840
## 17 Travel.00ab_OEOE_F 1 -0.136 -2.069 0.283 1.786 NA
## 18 Elevator.02abc_OE3_C 1 0.542 -1.824 -0.013 0.564 1.273
## 19 Market.01abc_OE_C 1 0.378 -1.985 0.360 0.625 1.001
## 20 Delivery.00abc_OEOEOE_S 1 1.028 -2.694 -1.033 0.851 2.877
## 21 Elevator.00abc_OEOEOE_S 1 0.779 -1.288 -1.693 0.949 2.032
## 22 Market.00abc_OEOEOE_S 1 0.492 -2.128 -0.697 1.490 1.334
## 23 Market.01abc_MCOEOE_S 1 -0.187 -4.102 0.205 2.562 1.335
## 24 Travel.00abc_OEOEOE_S 1 0.645 -2.035 -1.595 0.826 2.804
## 25 Delivery.01a_MC_F 1 -1.228 -0.844 0.844 NA NA
## 26 Delivery.02a_MC_F 1 -0.894 NA NA NA NA
## 27 Delivery.02b_NU_F 1 0.807 NA NA NA NA
## 28 Elevator.01a_NU_F 1 -0.563 -0.553 0.553 NA NA
## 29 Elevator.03_OE_F 1 0.872 -0.950 -1.365 0.091 2.225
## 30 Elevator.04a_MC_F 1 0.057 NA NA NA NA
## 31 LunchList.01_MC_drag.v2_F 1 0.974 NA NA NA NA
## 32 Market.01d_MC_F 1 -0.126 NA NA NA NA
## 33 Market.02b_OE_F 1 0.381 -1.018 -1.206 1.245 0.979
## 34 Park.01c_NU_F 1 -0.442 0.071 -0.071 NA NA
## 35 Pizza.01a_FB.1_F 1 -1.777 NA NA NA NA
## 36 Pizza.01a_FB.2_F 1 -2.351 NA NA NA NA
## 37 Pizza.01a_FB.3_F 1 -1.602 NA NA NA NA
## 38 Pizza.01a_FB.4_F 1 -2.283 NA NA NA NA
## 39 Pizza.01a_FB.5_F 1 -1.054 NA NA NA NA
## 40 Pizza.01a_FB.6_F 1 -1.474 NA NA NA NA
## 41 Pizza.01a_FB.7_F 1 -0.335 NA NA NA NA
## 42 Pizza.02b_FB.1_F 1 0.488 NA NA NA NA
## 43 Pizza.02b_FB.2_F 1 0.478 NA NA NA NA
## 44 Pizza.02b_FB.3_F 1 -1.823 NA NA NA NA
## 45 SignUp.01c_MC_F 1 0.618 -0.233 -1.302 1.535 NA
## 46 SignUp.01d_MC_F 1 -0.027 NA NA NA NA
## 47 Sorting.03a_NU_F 1 -0.116 NA NA NA NA
## 48 TicTac.03_OE_F 1 -0.443 -0.256 0.364 -0.107 NA
## 49 Delivery.03c_FB_C 1 2.579 NA NA NA NA
## 50 Shipping.01_NU_C 1 -1.098 NA NA NA NA
## 51 Video.01_MC_drag.v2_C 1 1.150 NA NA NA NA
## 52 LunchList.01_MC_S 1 0.461 NA NA NA NA
## 53 Market.02b_FB_S 1 0.480 NA NA NA NA