Overview about sample compositions
Look at devices using different classifications. For the first table “NA” are people that do not submit the first page.
Main_1 Main_2 Main_3 Main_4 pilot_2.1 pilot_3 pilot_4
false 451 479 836 265 163 32 106
true 430 581 39 419 196 50 123
<NA> 79 174 211 115 51 6 230
Main_1 Main_2 Main_3 Main_4 pilot_2.1 pilot_3 pilot_4
Android 10 16 3 13 6 1 5
Chrome OS 7 5 8 5 1 1 0
Linux 346 432 106 278 144 34 95
Mac 174 221 106 185 77 18 50
Other 79 174 211 115 51 6 230
Windows 344 386 652 203 131 28 79
Main_1 Main_2 Main_3 Main_4 pilot_2.1 pilot_3 pilot_4
Laptop/Desktop 525 612 766 393 209 47 129
Mobile Phone 293 391 4 258 129 33 78
Other/Unknown 124 204 286 138 66 7 242
Tablet 18 27 30 10 6 1 10
Main_1 Main_2 Main_3 Main_4 pilot_2.1 pilot_3 pilot_4
Android 310 418 34 268 135 34 88
iPad 6 6 5 7 0 0 0
iPhone 113 157 0 144 61 16 35
Laptop/Other 531 653 1047 380 214 38 336
We only look at timeouts, but not at screen outs/over quota etc.
Here we can see the drop-outs for the first DCE page by survey round:
Main_1 Main_2 Main_3 Main_4 pilot_2.1 pilot_3 pilot_4
0 563 591 549 410 214 48 162
1 61 147 23 75 36 5 16
Main_1 Main_2 Main_3 Main_4 pilot_2.1 pilot_3
0 0.90224359 0.80081301 0.95979021 0.84536082 0.85600000 0.90566038
1 0.09775641 0.19918699 0.04020979 0.15463918 0.14400000 0.09433962
pilot_4
0 0.91011236
1 0.08988764
Here by device:
Android iPad iPhone Laptop/Other
0 754 16 139 1628
1 160 1 176 26
Android iPad iPhone Laptop/Other
0 0.297201419 0.006306661 0.054789121 0.641702799
1 0.440771350 0.002754821 0.484848485 0.071625344
Android iPad iPhone Laptop/Other
0 0.82494530 0.94117647 0.44126984 0.98428053
1 0.17505470 0.05882353 0.55873016 0.01571947
Drop outs on the first dce page by device for all survey rounds (within and between device drop-outs):
Survey Round: Main_1
device
Drop_out Android iPad iPhone Laptop/Other
0 0.355239787 0.008880995 0.046181172 0.589698046
1 0.491803279 0.000000000 0.475409836 0.032786885
----------------------
Survey Round: Main_2
device
Drop_out Android iPad iPhone Laptop/Other
0 0.345177665 0.005076142 0.065989848 0.583756345
1 0.578231293 0.006802721 0.401360544 0.013605442
----------------------
Survey Round: Main_3
device
Drop_out Android iPad Laptop/Other
0 0.030965392 0.005464481 0.963570128
1 0.217391304 0.000000000 0.782608696
----------------------
Survey Round: Main_4
device
Drop_out Android iPad iPhone Laptop/Other
0 0.42926829 0.01219512 0.08536585 0.47317073
1 0.16000000 0.00000000 0.78666667 0.05333333
----------------------
Survey Round: pilot_2.1
device
Drop_out Android iPhone Laptop/Other
0 0.34112150 0.09345794 0.56542056
1 0.44444444 0.55555556 0.00000000
----------------------
Survey Round: pilot_3
device
Drop_out Android iPhone Laptop/Other
0 0.4583333 0.1666667 0.3750000
1 0.8000000 0.2000000 0.0000000
----------------------
Survey Round: pilot_4
device
Drop_out Android iPhone Laptop/Other
0 0.38271605 0.06790123 0.54938272
1 0.50000000 0.50000000 0.00000000
----------------------
Survey Round: Main_1
device
Drop_out Android iPad iPhone Laptop/Other
0 0.869565217 1.000000000 0.472727273 0.994011976
1 0.130434783 0.000000000 0.527272727 0.005988024
----------------------
Survey Round: Main_2
device
Drop_out Android iPad iPhone Laptop/Other
0 0.705882353 0.750000000 0.397959184 0.994236311
1 0.294117647 0.250000000 0.602040816 0.005763689
----------------------
Survey Round: Main_3
device
Drop_out Android iPad Laptop/Other
0 0.77272727 1.00000000 0.96709324
1 0.22727273 0.00000000 0.03290676
----------------------
Survey Round: Main_4
device
Drop_out Android iPad iPhone Laptop/Other
0 0.93617021 1.00000000 0.37234043 0.97979798
1 0.06382979 0.00000000 0.62765957 0.02020202
----------------------
Survey Round: pilot_2.1
device
Drop_out Android iPhone Laptop/Other
0 0.8202247 0.5000000 1.0000000
1 0.1797753 0.5000000 0.0000000
----------------------
Survey Round: pilot_3
device
Drop_out Android iPhone Laptop/Other
0 0.8461538 0.8888889 1.0000000
1 0.1538462 0.1111111 0.0000000
----------------------
Survey Round: pilot_4
device
Drop_out Android iPhone Laptop/Other
0 0.8857143 0.5789474 1.0000000
1 0.1142857 0.4210526 0.0000000
----------------------
Dropout trends
Cumulative drop-out rates plotted by survey page. Device: all includes all observations, Device: false only Laptops and Device: true only mobile phones. The dashed vertical line is the start of the discrete choice experiment. Device: true and Device:false do not include persons not submitting the first page, as the variable is only defined if you submit the first page, device: all includes all observations (we only use timeouts and completes for the analysis).
We only look at the data after the pretest as the survey page structure was changed between pretest and main. Under pretest check below you also find plots for the pretests.
Compare Main Survey rounds
