1 Project Overview

Problem

COVID-19 vaccine hesitancy has been recognized as a problem across nations. A resistance to getting vaccinated is emerging as a major hurdle, especially in the developing world, where vaccine access issues are still being gradually resolved. Persistent pools of unvaccinated people around the world could present a greater risk for the emergence of new variants of concern. Addressing people’s vaccine hesitancy is hence crucial to curb the spread of COVID-19, and to consequently avert hospitalizations and death.

Objectives

We intend to understand why people are hesitant about getting the COVID-19 vaccine. Hesitancy could not only occur within the unvaccinated population but also in a subset of people who already got vaccinated. Therefore, phase 1 of the project has the following objectives:

  1. Understand why people are hesitant to get the COVID-19 vaccines
  2. Understand ways to best elicit vaccine impediments from respondents
  3. Pinpoint what treatments will help people get vaccinated

Approach

We intend to use chatbot as a medium (on Facebook) to conduct conversations with people to understand how we can best achieve the above three objectives. We have run six pilots as of April 18, 2022, – 2 in the United States using Qualtrics on Lucid, and 4 in South Africa on Facebook. The eventual goal will be running this using multiple chatbots that enable the conversation to flow more naturally than in a survey format. We hypothesize that respondents are more likely to respond to our sensitive questions around vaccine hesitancy if the questions are asked more casually in an open stress-free setting. Therefore, in all version of the pilots, we make our tone as causal as possible (using emojis, GIFs, emphatic prompts) and include delays in the appearance of questions (and empathetic responses after each question) to make the conversation more authentic.


2 Current Pilot

Analysis script used is linked here. Relevant GitHub issue is linked here.

This analysis is based on 1835 respondents who completed the current pilot survey wave.

We have split the detailed analyses into core and appendix sections:

  • Core Analysis
    • Chatbot Covariate Analysis
    • Chatbot Descriptive Analysis
  • Appendix Analysis
    • Ad Recruitment-Cost Analysis
    • Chatbot Engagement Analysis

3 Core Analysis

3.1 Chatbot Covariate Analysis

Goal: Analyze if there are any significant relationships between covariates and outcomes of interest (impediments, treatments, vaccination receptiveness).

3.1.1 Predictors of Impediments

Key Questions: What chatbot covariates predict impediments? Which of these are Facebook ad covariates that can be used for targeting? How significant are these results?

The correlation plots and multinomial logits here aim to understand what demographic variables and impediments are associated with each other. We would want to filter out the demographic variables that are highly correlated with other demographic variables and the demographic variables that are not related to the motivation/ability impediment to minimize the number of questions respondents have to answer.

Since the correlation matrices provided by ggcorrplot() shows the correlation coefficients between continuous variables, we mapped binary and ordinal variables to continuous variables. Details on this mapping:

  • female: 1 if female, 0 if male
  • income: 0 if the participant is unemployed, 1 if household income < R5,000, 2 if household income in R5,000 – R9,999, …, 6 if household income > R100,000
  • education: 1 if the participant’s education < high school, 2 if education is high school, …, 6 if education is a graduate degree
  • religiosity: 1 if the participant is not very religious, 2 if somewhat religious, 3 if very religious
  • politics: 1 if the participant is conservative, 2 if moderate, 3 if liberal
  • location: 1 if the participant lives in rural, 2 if suburban, 3 if urban,
  • white: 1 if the participant is a white or caucasian, 0 if not
  • no_motive: 1 if the participant does not have the motive to get vax, 0 otherwise
    • no_benefits: 1 if participant believes vaccine has no benefits, 0 otherwise
    • against_beliefs:: 1 if participant believes vaccine is against their beliefs, 0 otherwise
    • risky:: 1 if participant believes vaccine is risky, 0 otherwise
  • no_ability: 1 if the participant does not have the ability to get vax, 0 otherwise
    • no_time: 1 if participant has no time to get vaxxed, 0 otherwise
    • no_money: 1 if participant has no money to get vaxxed, 0 otherwise
    • no_availability: 1 if participant faces vax availability issues, 0 otherwise

3.1.1.1 Motivation Impediments

3.1.1.1.1 Correlation plot

Crossed out correlations are not statistically significant.

3.1.1.1.2 Multinomial logit
  Baseline With Interactions
Risky: (Intercept) -1.647*** -1.142
  (0.565) (1.806)
Risky: female -0.270 -0.247
  (0.206) (1.091)
Risky: education 0.021 -0.282
  (0.083) (2.162)
Risky: income 0.057 -1.047
  (0.079) (2.305)
Risky: religiosity 0.024 -0.967
  (0.136) (1.668)
Risky: politics 0.251* 0.008
  (0.150) (1.879)
Risky: location 0.105 1.580
  (0.116) (1.693)
Risky: white -0.641 0.120
  (0.574) (0.139)
No benefits: (Intercept) -1.038* -0.880
  (0.617) (1.756)
No benefits: female -0.188 -1.064
  (0.236) (1.239)
No benefits: education 0.013 0.414
  (0.093) (2.235)
No benefits: income 0.301*** -0.731
  (0.077) (1.884)
No benefits: religiosity -0.320** -0.225
  (0.146) (1.843)
No benefits: politics -0.115 -2.219
  (0.175) (1.999)
No benefits: location 0.112 0.614
  (0.134) (1.733)
No benefits: white -0.613 -0.105
  (0.590) (0.299)
Against beliefs: (Intercept) -3.112*** -1.509
  (0.983) (1.696)
Against beliefs: female -0.273 -0.113
  (0.354) (1.308)
Against beliefs: education 0.171 1.327
  (0.130) (1.178)
Against beliefs: income 0.099 -0.816
  (0.127) (1.466)
Against beliefs: religiosity 0.120 -0.658
  (0.243) (2.098)
Against beliefs: politics -0.148 -0.854
  (0.262) (1.215)
Against beliefs: location 0.194 -0.381
  (0.203) (1.165)
Against beliefs: white -0.823 0.039
  (1.057) (0.084)
Risky: female:education   -1.021
    (1.434)
Risky: female:income   -0.257
    (1.753)
Risky: education:income   -0.290
    (1.381)
Risky: female:religiosity   0.789
    (2.583)
Risky: education:religiosity   1.212
    (1.030)
Risky: income:religiosity   0.966
    (1.256)
Risky: female:politics   0.020
    (1.320)
Risky: education:politics   0.781
    (1.151)
Risky: income:politics   -0.164
    (1.456)
Risky: religiosity:politics   -0.161
    (0.972)
Risky: female:location   -0.397
    (1.312)
Risky: education:location   -0.096
    (1.368)
Risky: income:location   -1.162
    (1.429)
Risky: religiosity:location   -0.187
    (0.922)
Risky: politics:location   0.190
    (1.165)
Risky: female:white   0.114
    (0.134)
Risky: education:white   -0.130
    (0.299)
Risky: income:white   -0.136
    (0.255)
Risky: religiosity:white   0.253
    (0.251)
Risky: politics:white   0.036
    (0.208)
Risky: location:white   0.444
    (0.399)
Risky: female:education:income   0.769
    (1.339)
Risky: female:education:religiosity   -0.926
    (0.929)
Risky: female:income:religiosity   -1.160
    (1.673)
Risky: education:income:religiosity   -0.371
    (0.673)
Risky: female:education:politics   -1.000
    (1.005)
Risky: female:income:politics   0.690
    (1.225)
Risky: education:income:politics   0.015
    (0.707)
Risky: female:religiosity:politics   -0.170
    (1.188)
Risky: education:religiosity:politics   -0.646
    (0.545)
Risky: income:religiosity:politics   0.019
    (0.709)
Risky: female:education:location   -0.503
    (1.028)
Risky: female:income:location   1.020
    (1.222)
Risky: education:income:location   0.581
    (0.759)
Risky: female:religiosity:location   -0.313
    (1.317)
Risky: education:religiosity:location   -0.421
    (0.547)
Risky: income:religiosity:location   0.179
    (0.642)
Risky: female:politics:location   -0.360
    (0.992)
Risky: education:politics:location   -0.558
    (0.684)
Risky: income:politics:location   0.343
    (0.815)
Risky: religiosity:politics:location   0.092
    (0.522)
Risky: female:education:white   -0.028
    (0.333)
Risky: female:income:white   -0.145
    (0.191)
Risky: education:income:white   -0.491*
    (0.253)
Risky: female:religiosity:white   0.171
    (0.197)
Risky: education:religiosity:white   -0.191
    (0.635)
Risky: income:religiosity:white   0.126
    (0.535)
Risky: female:politics:white   0.053
    (0.191)
Risky: education:politics:white   -0.053
    (0.830)
Risky: income:politics:white   0.021
    (0.483)
Risky: religiosity:politics:white   -0.084
    (0.548)
Risky: female:location:white   0.404
    (0.422)
Risky: education:location:white   -0.045
    (0.402)
Risky: income:location:white   -0.374
    (0.692)
Risky: religiosity:location:white   0.894
    (0.797)
Risky: politics:location:white   0.165
    (0.263)
Risky: female:education:income:religiosity   0.530
    (0.722)
Risky: female:education:income:politics   0.052
    (0.739)
Risky: female:education:religiosity:politics   1.004*
    (0.540)
Risky: female:income:religiosity:politics   0.168
    (0.844)
Risky: education:income:religiosity:politics   0.170
    (0.352)
Risky: female:education:income:location   -0.283
    (0.786)
Risky: female:education:religiosity:location   0.742
    (0.550)
Risky: female:income:religiosity:location   0.146
    (0.864)
Risky: education:income:religiosity:location   -0.016
    (0.307)
Risky: female:education:politics:location   1.105
    (0.686)
Risky: female:income:politics:location   -0.498
    (1.013)
Risky: education:income:politics:location   -0.032
    (0.365)
Risky: female:religiosity:politics:location   0.306
    (0.643)
Risky: education:religiosity:politics:location   0.331
    (0.272)
Risky: income:religiosity:politics:location   -0.104
    (0.344)
Risky: female:education:income:white   -0.326
    (0.268)
Risky: female:education:religiosity:white   -0.013
    (0.518)
Risky: female:income:religiosity:white   -0.052
    (0.257)
Risky: education:income:religiosity:white   -0.143
    (0.400)
Risky: female:education:politics:white   -0.009
    (0.672)
Risky: female:income:politics:white   0.101
    (0.262)
Risky: education:income:politics:white   -0.024
    (0.439)
Risky: female:religiosity:politics:white   -0.158
    (0.221)
Risky: education:religiosity:politics:white   -0.203
    (1.161)
Risky: income:religiosity:politics:white   0.099
    (0.677)
Risky: female:education:location:white   0.218
    (0.505)
Risky: female:income:location:white   -0.457
    (0.384)
Risky: education:income:location:white   -0.886
    (0.739)
Risky: female:religiosity:location:white   0.622
    (0.973)
Risky: education:religiosity:location:white   -0.010
    (1.123)
Risky: income:religiosity:location:white   0.315
    (1.325)
Risky: female:politics:location:white   0.173
    (0.192)
Risky: education:politics:location:white   0.149
    (1.424)
Risky: income:politics:location:white   -0.192
    (1.572)
Risky: religiosity:politics:location:white   -0.105
    (1.047)
Risky: female:education:income:religiosity:politics   -0.354
    (0.368)
Risky: female:education:income:religiosity:location   -0.221
    (0.361)
Risky: female:education:income:politics:location   -0.163
    (0.516)
Risky: female:education:religiosity:politics:location   -0.699**
    (0.311)
Risky: female:income:religiosity:politics:location   -0.051
    (0.486)
Risky: education:income:religiosity:politics:location   -0.064
    (0.158)
Risky: female:education:income:religiosity:white   0.043
    (0.746)
Risky: female:education:income:politics:white   0.220
    (0.449)
Risky: female:education:religiosity:politics:white   -0.343
    (1.109)
Risky: female:income:religiosity:politics:white   0.035
    (0.438)
Risky: education:income:religiosity:politics:white   0.019
    (1.402)
Risky: female:education:income:location:white   -0.512
    (0.478)
Risky: female:education:religiosity:location:white   0.456
    (0.606)
Risky: female:income:religiosity:location:white   -0.291
    (0.556)
Risky: education:income:religiosity:location:white   0.154
    (0.689)
Risky: female:education:politics:location:white   0.180
    (0.876)
Risky: female:income:politics:location:white   -0.071
    (0.364)
Risky: education:income:politics:location:white   -0.023
    (0.564)
Risky: female:religiosity:politics:location:white   -0.393
    (1.183)
Risky: education:religiosity:politics:location:white   0.051
    (0.908)
Risky: income:religiosity:politics:location:white   -0.156
    (0.729)
Risky: female:education:income:religiosity:politics:location   0.216
    (0.207)
Risky: female:education:income:religiosity:politics:white   0.123
    (1.502)
Risky: female:education:income:religiosity:location:white   0.545
    (0.566)
Risky: female:education:income:politics:location:white   0.448
    (0.674)
Risky: female:education:religiosity:politics:location:white   -0.538
    (1.043)
Risky: female:income:religiosity:politics:location:white   -0.513
    (1.047)
Risky: education:income:religiosity:politics:location:white   0.043
    (0.673)
Risky: female:education:income:religiosity:politics:location:white   -0.046
    (0.721)
No benefits: female:education   -0.218
    (1.291)
No benefits: female:income   0.562
    (1.467)
No benefits: education:income   -1.443
    (1.405)
No benefits: female:religiosity   -1.443
    (3.128)
No benefits: education:religiosity   -0.261
    (1.185)
No benefits: income:religiosity   0.574
    (1.147)
No benefits: female:politics   -0.537
    (1.537)
No benefits: education:politics   0.928
    (1.179)
No benefits: income:politics   1.806
    (1.269)
No benefits: religiosity:politics   0.461
    (1.160)
No benefits: female:location   1.492
    (1.375)
No benefits: education:location   -0.473
    (1.329)
No benefits: income:location   -2.062
    (1.345)
No benefits: religiosity:location   -0.522
    (1.027)
No benefits: politics:location   1.259
    (1.182)
No benefits: female:white   -0.170
    (0.305)
No benefits: education:white   -0.175
    (0.602)
No benefits: income:white   -0.097
    (0.437)
No benefits: religiosity:white   -0.110
    (0.569)
No benefits: politics:white   -0.149
    (0.534)
No benefits: location:white   -0.210
    (0.409)
No benefits: female:education:income   1.018
    (1.369)
No benefits: female:education:religiosity   0.580
    (1.348)
No benefits: female:income:religiosity   -0.488
    (1.660)
No benefits: education:income:religiosity   0.532
    (0.629)
No benefits: female:education:politics   1.145
    (0.952)
No benefits: female:income:politics   -0.588
    (1.192)
No benefits: education:income:politics   0.101
    (0.696)
No benefits: female:religiosity:politics   1.610
    (1.465)
No benefits: education:religiosity:politics   -0.213
    (0.630)
No benefits: income:religiosity:politics   -0.697
    (0.719)
No benefits: female:education:location   0.216
    (1.051)
No benefits: female:income:location   0.277
    (1.213)
No benefits: education:income:location   1.712*
    (0.875)
No benefits: female:religiosity:location   -0.379
    (1.463)
No benefits: education:religiosity:location   0.296
    (0.570)
No benefits: income:religiosity:location   0.809
    (0.672)
No benefits: female:politics:location   -0.201
    (1.039)
No benefits: education:politics:location   -0.450
    (0.691)
No benefits: income:politics:location   0.212
    (0.788)
No benefits: religiosity:politics:location   -0.156
    (0.611)
No benefits: female:education:white   -0.268
    (0.584)
No benefits: female:income:white   -0.219
    (0.445)
No benefits: education:income:white   -0.214
    (0.596)
No benefits: female:religiosity:white   -0.250
    (0.599)
No benefits: education:religiosity:white   -0.216
    (1.374)
No benefits: income:religiosity:white   0.147
    (1.062)
No benefits: female:politics:white   -0.158
    (0.532)
No benefits: education:politics:white   -0.191
    (0.674)
No benefits: income:politics:white   -0.110
    (1.028)
No benefits: religiosity:politics:white   -0.199
    (0.882)
No benefits: female:location:white   -0.393
    (0.409)
No benefits: education:location:white   -0.012
    (0.507)
No benefits: income:location:white   -0.251
    (0.706)
No benefits: religiosity:location:white   -0.113
    (0.585)
No benefits: politics:location:white   -0.248
    (0.892)
No benefits: female:education:income:religiosity   -0.039
    (0.799)
No benefits: female:education:income:politics   -0.711
    (0.817)
No benefits: female:education:religiosity:politics   -0.949
    (0.694)
No benefits: female:income:religiosity:politics   -0.070
    (0.977)
No benefits: education:income:religiosity:politics   -0.037
    (0.317)
No benefits: female:education:income:location   -1.231
    (0.852)
No benefits: female:education:religiosity:location   -0.011
    (0.656)
No benefits: female:income:religiosity:location   0.286
    (0.903)
No benefits: education:income:religiosity:location   -0.662*
    (0.352)
No benefits: female:education:politics:location   -0.980
    (0.742)
No benefits: female:income:politics:location   0.076
    (0.882)
No benefits: education:income:politics:location   -0.477
    (0.434)
No benefits: female:religiosity:politics:location   -0.130
    (0.726)
No benefits: education:religiosity:politics:location   0.073
    (0.292)
No benefits: income:religiosity:politics:location   -0.151
    (0.375)
No benefits: female:education:income:white   -0.447
    (0.605)
No benefits: female:education:religiosity:white   -0.413
    (1.311)
No benefits: female:income:religiosity:white   -0.024
    (1.193)
No benefits: education:income:religiosity:white   0.330
    (0.386)
No benefits: female:education:politics:white   -0.000
    (0.686)
No benefits: female:income:politics:white   -0.201
    (1.008)
No benefits: education:income:politics:white   -0.178
    (0.375)
No benefits: female:religiosity:politics:white   -0.130
    (0.911)
No benefits: education:religiosity:politics:white   -0.517
    (1.518)
No benefits: income:religiosity:politics:white   0.122
    (1.833)
No benefits: female:education:location:white   -0.287
    (0.369)
No benefits: female:income:location:white   -0.556
    (0.586)
No benefits: education:income:location:white   0.100
    (0.912)
No benefits: female:religiosity:location:white   -0.567
    (0.568)
No benefits: education:religiosity:location:white   0.292
    (1.295)
No benefits: income:religiosity:location:white   0.359
    (0.827)
No benefits: female:politics:location:white   -0.272
    (0.858)
No benefits: education:politics:location:white   0.080
    (0.841)
No benefits: income:politics:location:white   -0.185
    (2.016)
No benefits: religiosity:politics:location:white   -0.224
    (0.955)
No benefits: female:education:income:religiosity:politics   0.250
    (0.389)
No benefits: female:education:income:religiosity:location   0.204
    (0.429)
No benefits: female:education:income:politics:location   0.821
    (0.511)
No benefits: female:education:religiosity:politics:location   0.403
    (0.341)
No benefits: female:income:religiosity:politics:location   -0.110
    (0.524)
No benefits: education:income:religiosity:politics:location   0.190
    (0.165)
No benefits: female:education:income:religiosity:white   -0.008
    (0.403)
No benefits: female:education:income:politics:white   -0.133
    (0.365)
No benefits: female:education:religiosity:politics:white   0.160
    (1.522)
No benefits: female:income:religiosity:politics:white   0.228
    (1.953)
No benefits: education:income:religiosity:politics:white   -0.273
    (0.816)
No benefits: female:education:income:location:white   -0.523
    (0.942)
No benefits: female:education:religiosity:location:white   -0.429
    (0.898)
No benefits: female:income:religiosity:location:white   -0.181
    (1.029)
No benefits: education:income:religiosity:location:white   1.177***
    (0.383)
No benefits: female:education:politics:location:white   0.591
    (0.889)
No benefits: female:income:politics:location:white   -0.379
    (1.858)
No benefits: education:income:politics:location:white   0.266
    (0.496)
No benefits: female:religiosity:politics:location:white   -0.147
    (0.887)
No benefits: education:religiosity:politics:location:white   -0.376
    (1.068)
No benefits: income:religiosity:politics:location:white   0.268
    (1.313)
No benefits: female:education:income:religiosity:politics:location   -0.222
    (0.206)
No benefits: female:education:income:religiosity:politics:white   0.529
    (0.819)
No benefits: female:education:income:religiosity:location:white   -0.029
    (0.309)
No benefits: female:education:income:politics:location:white   0.421
    (0.471)
No benefits: female:education:religiosity:politics:location:white   1.192
    (1.170)
No benefits: female:income:religiosity:politics:location:white   0.393
    (1.376)
No benefits: education:income:religiosity:politics:location:white   -1.326***
    (0.400)
No benefits: female:education:income:religiosity:politics:location:white   0.294
    (0.407)
Against beliefs: female:education   -0.635
    (1.471)
Against beliefs: female:income   0.925
    (1.694)
Against beliefs: education:income   -0.126
    (1.805)
Against beliefs: female:religiosity   -0.455
    (1.365)
Against beliefs: education:religiosity   0.165
    (1.093)
Against beliefs: income:religiosity   0.958
    (1.671)
Against beliefs: female:politics   0.466
    (1.269)
Against beliefs: education:politics   -0.291
    (1.324)
Against beliefs: income:politics   -0.727
    (1.384)
Against beliefs: religiosity:politics   -0.046
    (1.373)
Against beliefs: female:location   -0.361
    (1.096)
Against beliefs: education:location   0.955
    (1.136)
Against beliefs: income:location   -0.510
    (1.591)
Against beliefs: religiosity:location   0.607
    (0.885)
Against beliefs: politics:location   1.006
    (1.520)
Against beliefs: female:white   0.046
    (0.142)
Against beliefs: education:white   0.044
    (0.146)
Against beliefs: income:white   0.012
    (0.352)
Against beliefs: religiosity:white   0.064
    (0.269)
Against beliefs: politics:white   0.129
    (0.219)
Against beliefs: location:white   -0.023
    (0.235)
Against beliefs: female:education:income   0.632
    (2.223)
Against beliefs: female:education:religiosity   0.240
    (1.031)
Against beliefs: female:income:religiosity   -0.836
    (1.618)
Against beliefs: education:income:religiosity   -0.272
    (0.856)
Against beliefs: female:education:politics   -0.451
    (1.990)
Against beliefs: female:income:politics   0.529
    (2.146)
Against beliefs: education:income:politics   -0.197
    (0.926)
Against beliefs: female:religiosity:politics   1.263
    (1.094)
Against beliefs: education:religiosity:politics   -0.007
    (0.689)
Against beliefs: income:religiosity:politics   -0.035
    (1.026)
Against beliefs: female:education:location   -1.578
    (1.544)
Against beliefs: female:income:location   1.233
    (2.016)
Against beliefs: education:income:location   0.383
    (1.000)
Against beliefs: female:religiosity:location   -0.852
    (1.077)
Against beliefs: education:religiosity:location   -0.639
    (0.541)
Against beliefs: income:religiosity:location   -0.270
    (0.843)
Against beliefs: female:politics:location   0.076
    (1.372)
Against beliefs: education:politics:location   -0.869
    (0.604)
Against beliefs: income:politics:location   -0.103
    (0.850)
Against beliefs: religiosity:politics:location   -0.281
    (0.726)
Against beliefs: female:education:white   0.090
    (0.250)
Against beliefs: female:income:white   0.022
    (0.154)
Against beliefs: education:income:white   -0.033
    (0.775)
Against beliefs: female:religiosity:white   0.051
    (0.189)
Against beliefs: education:religiosity:white   -0.001
    (0.338)
Against beliefs: income:religiosity:white   0.127
    (0.820)
Against beliefs: female:politics:white   0.128
    (0.352)
Against beliefs: education:politics:white   0.183
    (0.447)
Against beliefs: income:politics:white   0.020
    (0.539)
Against beliefs: religiosity:politics:white   0.193
    (0.431)
Against beliefs: female:location:white   -0.009
    (0.264)
Against beliefs: education:location:white   -0.019
    (0.579)
Against beliefs: income:location:white   -0.048
    (0.520)
Against beliefs: religiosity:location:white   -0.112
    (0.587)
Against beliefs: politics:location:white   0.126
    (0.476)
Against beliefs: female:education:income:religiosity   0.107
    (1.123)
Against beliefs: female:education:income:politics   0.011
    (1.290)
Against beliefs: female:education:religiosity:politics   -0.180
    (0.910)
Against beliefs: female:income:religiosity:politics   -0.385
    (1.191)
Against beliefs: education:income:religiosity:politics   0.159
    (0.445)
Against beliefs: female:education:income:location   -0.813
    (1.135)
Against beliefs: female:education:religiosity:location   1.041
    (0.771)
Against beliefs: female:income:religiosity:location   0.113
    (1.098)
Against beliefs: education:income:religiosity:location   0.016
    (0.389)
Against beliefs: female:education:politics:location   1.022
    (1.097)
Against beliefs: female:income:politics:location   -0.707
    (1.332)
Against beliefs: education:income:politics:location   0.183
    (0.409)
Against beliefs: female:religiosity:politics:location   -0.187
    (0.767)
Against beliefs: education:religiosity:politics:location   0.337
    (0.279)
Against beliefs: income:religiosity:politics:location   0.208
    (0.432)
Against beliefs: female:education:income:white   0.006
    (0.563)
Against beliefs: female:education:religiosity:white   0.153
    (0.452)
Against beliefs: female:income:religiosity:white   0.022
    (0.389)
Against beliefs: education:income:religiosity:white   0.105
    (0.587)
Against beliefs: female:education:politics:white   0.110
    (0.291)
Against beliefs: female:income:politics:white   0.093
    (0.737)
Against beliefs: education:income:politics:white   -0.072
    (1.174)
Against beliefs: female:religiosity:politics:white   0.166
    (0.354)
Against beliefs: education:religiosity:politics:white   0.154
    (0.769)
Against beliefs: income:religiosity:politics:white   0.127
    (0.566)
Against beliefs: female:education:location:white   0.103
    (0.346)
Against beliefs: female:income:location:white   -0.046
    (0.508)
Against beliefs: education:income:location:white   -0.071
    (0.907)
Against beliefs: female:religiosity:location:white   -0.151
    (0.557)
Against beliefs: education:religiosity:location:white   -0.366
    (1.279)
Against beliefs: income:religiosity:location:white   0.144
    (1.813)
Against beliefs: female:politics:location:white   0.110
    (0.440)
Against beliefs: education:politics:location:white   0.361
    (0.634)
Against beliefs: income:politics:location:white   -0.105
    (0.763)
Against beliefs: religiosity:politics:location:white   0.017
    (0.963)
Against beliefs: female:education:income:religiosity:politics   -0.033
    (0.617)
Against beliefs: female:education:income:religiosity:location   0.012
    (0.484)
Against beliefs: female:education:income:politics:location   0.197
    (0.620)
Against beliefs: female:education:religiosity:politics:location   -0.413
    (0.480)
Against beliefs: female:income:religiosity:politics:location   0.233
    (0.639)
Against beliefs: education:income:religiosity:politics:location   -0.101
    (0.172)
Against beliefs: female:education:income:religiosity:white   0.038
    (0.851)
Against beliefs: female:education:income:politics:white   -0.016
    (0.800)
Against beliefs: female:education:religiosity:politics:white   0.146
    (0.458)
Against beliefs: female:income:religiosity:politics:white   0.118
    (0.567)
Against beliefs: education:income:religiosity:politics:white   -0.024
    (1.114)
Against beliefs: female:education:income:location:white   -0.005
    (0.827)
Against beliefs: female:education:religiosity:location:white   0.104
    (0.659)
Against beliefs: female:income:religiosity:location:white   -0.185
    (1.336)
Against beliefs: education:income:religiosity:location:white   0.201
    (0.444)
Against beliefs: female:education:politics:location:white   0.125
    (0.408)
Against beliefs: female:income:politics:location:white   0.064
    (1.323)
Against beliefs: education:income:politics:location:white   -0.096
    (0.846)
Against beliefs: female:religiosity:politics:location:white   -0.060
    (0.934)
Against beliefs: education:religiosity:politics:location:white   -0.020
    (0.709)
Against beliefs: income:religiosity:politics:location:white   -0.073
    (0.827)
Against beliefs: female:education:income:religiosity:politics:location   -0.009
    (0.237)
Against beliefs: female:education:income:religiosity:politics:white   -0.050
    (0.943)
Against beliefs: female:education:income:religiosity:location:white   -0.010
    (1.160)
Against beliefs: female:education:income:politics:location:white   -0.009
    (1.805)
Against beliefs: female:education:religiosity:politics:location:white   0.001
    (0.879)
Against beliefs: female:income:religiosity:politics:location:white   -0.108
    (0.901)
Against beliefs: education:income:religiosity:politics:location:white   -0.132
    (1.260)
Against beliefs: female:education:income:religiosity:politics:location:white   -0.171
    (0.513)
AIC 1390.660 1661.037
BIC 1496.740 2827.916
Log Likelihood -671.330 -566.519
Deviance 1342.660 1133.037
Num. obs. 614 614
K 4 4
***p < 0.01; **p < 0.05; *p < 0.1

3.1.1.2 Ability Impediments

3.1.1.2.1 Correlation plot

Crossed out correlations are not statistically significant.

3.1.1.2.2 Multinomial logit
  Baseline With Interactions
No Money: (Intercept) -8.963*** -1.016
  (2.668) (1.573)
No Money: female 0.492 0.385
  (0.637) (1.801)
No Money: education -0.332 -0.557
  (0.308) (2.482)
No Money: income 0.139 -0.778
  (0.205) (2.897)
No Money: religiosity 0.892 -0.563
  (0.564) (4.328)
No Money: politics -0.434 -1.037
  (0.496) (2.047)
No Money: location 1.466** -0.043
  (0.634) (1.660)
No Money: white 0.920 -0.310
  (0.897) (0.302)
No Time: (Intercept) -3.712*** 0.312
  (0.857) (2.562)
No Time: female 0.502 -0.204
  (0.312) (1.640)
No Time: education -0.152 -0.389
  (0.130) (3.713)
No Time: income 0.096 -0.025
  (0.105) (1.574)
No Time: religiosity 0.086 -0.325
  (0.194) (2.183)
No Time: politics 0.057 1.723
  (0.219) (2.767)
No Time: location 0.455** -0.522
  (0.178) (2.257)
No Time: white -14.532*** -0.006
  (0.000) (0.140)
No Availability: (Intercept) -2.505** -1.879
  (1.106) (2.828)
No Availability: female 0.173 -0.133
  (0.392) (2.111)
No Availability: education 0.037 -0.776
  (0.158) (2.810)
No Availability: income -0.123 -0.601
  (0.170) (1.773)
No Availability: religiosity 0.196 -0.369
  (0.273) (3.042)
No Availability: politics -0.568* -1.527
  (0.306) (4.298)
No Availability: location 0.093 -0.210
  (0.215) (4.155)
No Availability: white -15.535*** -0.042
  (0.000) (0.079)
No Money: female:education   -0.325
    (2.759)
No Money: female:income   0.056
    (2.062)
No Money: education:income   -0.375
    (2.792)
No Money: female:religiosity   1.432
    (3.210)
No Money: education:religiosity   -0.298
    (3.475)
No Money: income:religiosity   -0.113
    (3.536)
No Money: female:politics   -0.332
    (2.913)
No Money: education:politics   0.060
    (2.692)
No Money: income:politics   -0.279
    (2.503)
No Money: religiosity:politics   -0.123
    (2.957)
No Money: female:location   1.254
    (2.191)
No Money: education:location   0.734
    (2.598)
No Money: income:location   0.338
    (2.388)
No Money: religiosity:location   -0.815
    (1.900)
No Money: politics:location   -0.558
    (2.128)
No Money: female:white   -0.261
    (0.328)
No Money: education:white   -0.191
    (0.487)
No Money: income:white   -0.212
    (0.390)
No Money: religiosity:white   -0.312
    (0.358)
No Money: politics:white   -0.269
    (0.508)
No Money: location:white   -0.774
    (0.776)
No Money: female:education:income   -0.334
    (2.496)
No Money: female:education:religiosity   -0.229
    (3.758)
No Money: female:income:religiosity   0.745
    (4.068)
No Money: education:income:religiosity   0.071
    (2.585)
No Money: female:education:politics   0.221
    (2.736)
No Money: female:income:politics   -0.188
    (2.228)
No Money: education:income:politics   0.357
    (2.016)
No Money: female:religiosity:politics   -0.102
    (3.568)
No Money: education:religiosity:politics   0.192
    (1.786)
No Money: income:religiosity:politics   0.167
    (2.651)
No Money: female:education:location   -0.167
    (3.638)
No Money: female:income:location   0.064
    (3.620)
No Money: education:income:location   -0.030
    (1.141)
No Money: female:religiosity:location   0.498
    (2.026)
No Money: education:religiosity:location   0.020
    (1.381)
No Money: income:religiosity:location   0.574
    (1.397)
No Money: female:politics:location   -0.108
    (3.646)
No Money: education:politics:location   -0.257
    (1.562)
No Money: income:politics:location   -0.055
    (2.261)
No Money: religiosity:politics:location   0.625
    (1.289)
No Money: female:education:white   -0.105
    (0.491)
No Money: female:income:white   -0.189
    (0.423)
No Money: education:income:white   -0.073
    (1.087)
No Money: female:religiosity:white   -0.147
    (0.352)
No Money: education:religiosity:white   0.120
    (0.751)
No Money: income:religiosity:white   -0.328
    (0.528)
No Money: female:politics:white   -0.252
    (0.493)
No Money: education:politics:white   -0.371
    (0.701)
No Money: income:politics:white   0.178
    (0.800)
No Money: religiosity:politics:white   -0.316
    (0.590)
No Money: female:location:white   -0.646
    (0.879)
No Money: education:location:white   -0.297
    (0.498)
No Money: income:location:white   -0.594
    (0.642)
No Money: religiosity:location:white   -0.525
    (1.022)
No Money: politics:location:white   -0.532
    (0.990)
No Money: female:education:income:religiosity   -0.013
    (2.363)
No Money: female:education:income:politics   0.409
    (2.079)
No Money: female:education:religiosity:politics   -0.257
    (2.441)
No Money: female:income:religiosity:politics   -0.336
    (2.932)
No Money: education:income:religiosity:politics   -0.123
    (1.174)
No Money: female:education:income:location   -0.436
    (2.769)
No Money: female:education:religiosity:location   -0.207
    (1.765)
No Money: female:income:religiosity:location   -1.224
    (2.272)
No Money: education:income:religiosity:location   -0.067
    (0.891)
No Money: female:education:politics:location   -0.257
    (2.589)
No Money: female:income:politics:location   0.200
    (3.042)
No Money: education:income:politics:location   -0.031
    (0.869)
No Money: female:religiosity:politics:location   -0.439
    (1.739)
No Money: education:religiosity:politics:location   -0.013
    (0.716)
No Money: income:religiosity:politics:location   -0.235
    (1.088)
No Money: female:education:income:white   -0.005
    (1.098)
No Money: female:education:religiosity:white   0.447
    (0.832)
No Money: female:income:religiosity:white   -0.257
    (0.529)
No Money: education:income:religiosity:white   0.049
    (0.350)
No Money: female:education:politics:white   -0.398
    (0.711)
No Money: female:income:politics:white   0.179
    (0.722)
No Money: education:income:politics:white   0.255
    (1.193)
No Money: female:religiosity:politics:white   -0.214
    (0.468)
No Money: education:religiosity:politics:white   -0.485
    (1.252)
No Money: income:religiosity:politics:white   0.026
    (1.089)
No Money: female:education:location:white   -0.081
    (0.492)
No Money: female:income:location:white   -0.573
    (0.798)
No Money: education:income:location:white   -0.305
    (0.911)
No Money: female:religiosity:location:white   -0.062
    (1.223)
No Money: education:religiosity:location:white   1.072
    (1.508)
No Money: income:religiosity:location:white   -0.663
    (0.611)
No Money: female:politics:location:white   -0.527
    (0.971)
No Money: education:politics:location:white   -0.507
    (1.192)
No Money: income:politics:location:white   0.444
    (1.283)
No Money: religiosity:politics:location:white   -0.116
    (1.086)
No Money: female:education:income:religiosity:politics   0.003
    (1.278)
No Money: female:education:income:religiosity:location   0.435
    (1.229)
No Money: female:education:income:politics:location   0.006
    (1.370)
No Money: female:education:religiosity:politics:location   0.298
    (1.125)
No Money: female:income:religiosity:politics:location   0.438
    (1.473)
No Money: education:income:religiosity:politics:location   0.043
    (0.437)
No Money: female:education:income:religiosity:white   0.285
    (0.394)
No Money: female:education:income:politics:white   0.243
    (1.209)
No Money: female:education:religiosity:politics:white   -0.377
    (1.166)
No Money: female:income:religiosity:politics:white   0.043
    (1.098)
No Money: education:income:religiosity:politics:white   -0.046
    (0.838)
No Money: female:education:income:location:white   -0.211
    (0.926)
No Money: female:education:religiosity:location:white   1.965
    (2.071)
No Money: female:income:religiosity:location:white   -0.528
    (0.662)
No Money: education:income:religiosity:location:white   0.048
    (1.185)
No Money: female:education:politics:location:white   -0.698
    (1.248)
No Money: female:income:politics:location:white   0.334
    (1.031)
No Money: education:income:politics:location:white   0.417
    (1.667)
No Money: female:religiosity:politics:location:white   0.104
    (0.853)
No Money: education:religiosity:politics:location:white   0.212
    (0.840)
No Money: income:religiosity:politics:location:white   0.603
    (1.286)
No Money: female:education:income:religiosity:politics:location   -0.143
    (0.627)
No Money: female:education:income:religiosity:politics:white   0.035
    (0.849)
No Money: female:education:income:religiosity:location:white   0.560
    (1.245)
No Money: female:education:income:politics:location:white   0.115
    (1.607)
No Money: female:education:religiosity:politics:location:white   0.299
    (1.206)
No Money: female:income:religiosity:politics:location:white   0.458
    (1.231)
No Money: education:income:religiosity:politics:location:white   -0.275
    (1.089)
No Money: female:education:income:religiosity:politics:location:white   -0.557
    (0.998)
No Time: female:education   0.094
    (2.528)
No Time: female:income   0.329
    (1.774)
No Time: education:income   0.542
    (2.895)
No Time: female:religiosity   -0.420
    (1.769)
No Time: education:religiosity   0.453
    (1.847)
No Time: income:religiosity   -0.661
    (1.908)
No Time: female:politics   -0.218
    (2.213)
No Time: education:politics   -0.241
    (2.036)
No Time: income:politics   -0.284
    (2.288)
No Time: religiosity:politics   -0.822
    (1.794)
No Time: female:location   0.361
    (1.645)
No Time: education:location   -0.623
    (2.077)
No Time: income:location   0.410
    (1.382)
No Time: religiosity:location   0.124
    (1.111)
No Time: politics:location   -0.543
    (1.606)
No Time: female:white   0.011
    (0.258)
No Time: education:white   0.043
    (0.516)
No Time: income:white   -0.021
    (0.374)
No Time: religiosity:white   -0.013
    (0.439)
No Time: politics:white   0.031
    (0.513)
No Time: location:white   -0.055
    (0.845)
No Time: female:education:income   0.389
    (2.893)
No Time: female:education:religiosity   0.092
    (1.270)
No Time: female:income:religiosity   -0.007
    (1.844)
No Time: education:income:religiosity   -0.543
    (1.384)
No Time: female:education:politics   -1.028
    (1.565)
No Time: female:income:politics   -0.377
    (2.640)
No Time: education:income:politics   -0.605
    (1.747)
No Time: female:religiosity:politics   0.203
    (1.575)
No Time: education:religiosity:politics   -0.318
    (1.169)
No Time: income:religiosity:politics   0.293
    (1.177)
No Time: female:education:location   0.963
    (1.592)
No Time: female:income:location   1.417
    (1.575)
No Time: education:income:location   -0.312
    (1.198)
No Time: female:religiosity:location   0.449
    (1.126)
No Time: education:religiosity:location   0.112
    (0.818)
No Time: income:religiosity:location   0.008
    (0.809)
No Time: female:politics:location   -1.486
    (1.507)
No Time: education:politics:location   0.232
    (1.030)
No Time: income:politics:location   0.011
    (1.025)
No Time: religiosity:politics:location   0.187
    (0.784)
No Time: female:education:white   0.062
    (0.576)
No Time: female:income:white   0.035
    (0.430)
No Time: education:income:white   0.013
    (0.605)
No Time: female:religiosity:white   -0.010
    (0.647)
No Time: education:religiosity:white   0.090
    (0.993)
No Time: income:religiosity:white   -0.053
    (1.168)
No Time: female:politics:white   0.052
    (0.185)
No Time: education:politics:white   0.054
    (0.883)
No Time: income:politics:white   0.046
    (0.824)
No Time: religiosity:politics:white   0.037
    (0.602)
No Time: female:location:white   -0.025
    (1.099)
No Time: education:location:white   -0.020
    (1.062)
No Time: income:location:white   -0.104
    (1.084)
No Time: religiosity:location:white   -0.108
    (1.742)
No Time: politics:location:white   0.007
    (1.547)
No Time: female:education:income:religiosity   -0.055
    (1.415)
No Time: female:education:income:politics   0.244
    (1.724)
No Time: female:education:religiosity:politics   0.707
    (1.003)
No Time: female:income:religiosity:politics   0.252
    (1.412)
No Time: education:income:religiosity:politics   0.414
    (0.645)
No Time: female:education:income:location   -1.232
    (1.503)
No Time: female:education:religiosity:location   -0.646
    (0.729)
No Time: female:income:religiosity:location   -0.798
    (1.010)
No Time: education:income:religiosity:location   0.229
    (0.516)
No Time: female:education:politics:location   0.731
    (0.961)
No Time: female:income:politics:location   -0.331
    (1.303)
No Time: education:income:politics:location   0.234
    (0.643)
No Time: female:religiosity:politics:location   0.355
    (0.857)
No Time: education:religiosity:politics:location   0.060
    (0.462)
No Time: income:religiosity:politics:location   -0.021
    (0.463)
No Time: female:education:income:white   0.127
    (1.077)
No Time: female:education:religiosity:white   0.074
    (0.453)
No Time: female:income:religiosity:white   -0.048
    (0.992)
No Time: education:income:religiosity:white   -0.022
    (0.920)
No Time: female:education:politics:white   0.056
    (0.787)
No Time: female:income:politics:white   0.153
    (0.674)
No Time: education:income:politics:white   -0.075
    (2.389)
No Time: female:religiosity:politics:white   0.016
    (0.408)
No Time: education:religiosity:politics:white   0.102
    (1.763)
No Time: income:religiosity:politics:white   0.030
    (1.103)
No Time: female:education:location:white   0.001
    (1.125)
No Time: female:income:location:white   -0.007
    (1.106)
No Time: education:income:location:white   -0.110
    (1.773)
No Time: female:religiosity:location:white   -0.109
    (2.521)
No Time: education:religiosity:location:white   0.008
    (1.562)
No Time: income:religiosity:location:white   -0.180
    (2.604)
No Time: female:politics:location:white   0.034
    (0.475)
No Time: education:politics:location:white   -0.060
    (2.434)
No Time: income:politics:location:white   0.003
    (2.087)
No Time: religiosity:politics:location:white   -0.032
    (1.096)
No Time: female:education:income:religiosity:politics   -0.260
    (0.757)
No Time: female:education:income:religiosity:location   0.579
    (0.687)
No Time: female:education:income:politics:location   0.283
    (0.828)
No Time: female:education:religiosity:politics:location   -0.306
    (0.493)
No Time: female:income:religiosity:politics:location   0.196
    (0.674)
No Time: education:income:religiosity:politics:location   -0.154
    (0.234)
No Time: female:education:income:religiosity:white   0.015
    (1.014)
No Time: female:education:income:politics:white   0.102
    (2.200)
No Time: female:education:religiosity:politics:white   0.004
    (1.579)
No Time: female:income:religiosity:politics:white   0.037
    (1.221)
No Time: education:income:religiosity:politics:white   -0.074
    (1.318)
No Time: female:education:income:location:white   0.102
    (2.985)
No Time: female:education:religiosity:location:white   -0.040
    (0.966)
No Time: female:income:religiosity:location:white   -0.208
    (1.796)
No Time: education:income:religiosity:location:white   0.030
    (1.071)
No Time: female:education:politics:location:white   -0.107
    (1.229)
No Time: female:income:politics:location:white   0.196
    (1.372)
No Time: education:income:politics:location:white   -0.340
    (3.213)
No Time: female:religiosity:politics:location:white   -0.094
    (1.007)
No Time: education:religiosity:politics:location:white   -0.071
    (1.278)
No Time: income:religiosity:politics:location:white   -0.006
    (1.883)
No Time: female:education:income:religiosity:politics:location   -0.106
    (0.366)
No Time: female:education:income:religiosity:politics:white   -0.106
    (1.434)
No Time: female:education:income:religiosity:location:white   0.089
    (1.681)
No Time: female:education:income:politics:location:white   -0.028
    (2.005)
No Time: female:education:religiosity:politics:location:white   -0.302
    (1.852)
No Time: female:income:religiosity:politics:location:white   -0.037
    (1.490)
No Time: education:income:religiosity:politics:location:white   0.188
    (1.219)
No Time: female:education:income:religiosity:politics:location:white   0.104
    (0.828)
No Availability: female:education   1.620
    (2.890)
No Availability: female:income   -0.182
    (2.084)
No Availability: education:income   -0.102
    (2.750)
No Availability: female:religiosity   -1.225
    (3.688)
No Availability: education:religiosity   0.145
    (1.322)
No Availability: income:religiosity   0.989
    (1.718)
No Availability: female:politics   1.130
    (2.372)
No Availability: education:politics   1.048
    (2.051)
No Availability: income:politics   0.093
    (2.927)
No Availability: religiosity:politics   -0.425
    (2.528)
No Availability: female:location   0.294
    (1.885)
No Availability: education:location   0.844
    (1.607)
No Availability: income:location   -0.864
    (3.104)
No Availability: religiosity:location   0.484
    (1.689)
No Availability: politics:location   0.609
    (2.269)
No Availability: female:white   -0.039
    (0.085)
No Availability: education:white   -0.089
    (0.211)
No Availability: income:white   0.080
    (0.397)
No Availability: religiosity:white   -0.143
    (0.242)
No Availability: politics:white   -0.055
    (0.151)
No Availability: location:white   -0.090
    (0.189)
No Availability: female:education:income   -0.354
    (2.730)
No Availability: female:education:religiosity   1.033
    (1.567)
No Availability: female:income:religiosity   0.043
    (2.400)
No Availability: education:income:religiosity   -0.164
    (1.178)
No Availability: female:education:politics   0.741
    (2.282)
No Availability: female:income:politics   0.068
    (3.256)
No Availability: education:income:politics   0.047
    (1.562)
No Availability: female:religiosity:politics   0.450
    (2.795)
No Availability: education:religiosity:politics   0.165
    (0.989)
No Availability: income:religiosity:politics   -0.141
    (1.482)
No Availability: female:education:location   -0.274
    (2.149)
No Availability: female:income:location   -1.172
    (2.791)
No Availability: education:income:location   0.142
    (0.845)
No Availability: female:religiosity:location   1.011
    (1.654)
No Availability: education:religiosity:location   -0.258
    (0.502)
No Availability: income:religiosity:location   -0.217
    (1.348)
No Availability: female:politics:location   0.351
    (1.935)
No Availability: education:politics:location   -0.700
    (0.858)
No Availability: income:politics:location   0.393
    (1.575)
No Availability: religiosity:politics:location   -0.004
    (1.105)
No Availability: female:education:white   -0.034
    (0.151)
No Availability: female:income:white   0.034
    (0.183)
No Availability: education:income:white   0.104
    (0.421)
No Availability: female:religiosity:white   -0.120
    (0.246)
No Availability: education:religiosity:white   -0.212
    (0.521)
No Availability: income:religiosity:white   -0.117
    (0.895)
No Availability: female:politics:white   0.009
    (0.180)
No Availability: education:politics:white   -0.294
    (0.262)
No Availability: income:politics:white   0.033
    (0.487)
No Availability: religiosity:politics:white   -0.159
    (0.206)
No Availability: female:location:white   -0.100
    (0.234)
No Availability: education:location:white   -0.081
    (0.853)
No Availability: income:location:white   0.310
    (0.672)
No Availability: religiosity:location:white   -0.259
    (0.641)
No Availability: politics:location:white   -0.033
    (0.564)
No Availability: female:education:income:religiosity   -0.242
    (1.305)
No Availability: female:education:income:politics   -2.398
    (1.779)
No Availability: female:education:religiosity:politics   -1.068
    (1.358)
No Availability: female:income:religiosity:politics   -0.198
    (1.492)
No Availability: education:income:religiosity:politics   -0.066
    (0.709)
No Availability: female:education:income:location   0.243
    (1.193)
No Availability: female:education:religiosity:location   -1.033
    (1.083)
No Availability: female:income:religiosity:location   0.387
    (1.562)
No Availability: education:income:religiosity:location   0.049
    (0.340)
No Availability: female:education:politics:location   -0.517
    (1.584)
No Availability: female:income:politics:location   -0.952
    (1.550)
No Availability: education:income:politics:location   -0.049
    (0.485)
No Availability: female:religiosity:politics:location   -0.597
    (1.339)
No Availability: education:religiosity:politics:location   0.024
    (0.392)
No Availability: income:religiosity:politics:location   -0.012
    (0.660)
No Availability: female:education:income:white   0.094
    (0.325)
No Availability: female:education:religiosity:white   -0.164
    (0.173)
No Availability: female:income:religiosity:white   -0.138
    (0.144)
No Availability: education:income:religiosity:white   0.062
    (0.361)
No Availability: female:education:politics:white   -0.059
    (0.379)
No Availability: female:income:politics:white   0.027
    (0.604)
No Availability: education:income:politics:white   -0.358
    (0.951)
No Availability: female:religiosity:politics:white   -0.012
    (0.311)
No Availability: education:religiosity:politics:white   -0.304
    (0.561)
No Availability: income:religiosity:politics:white   -0.278
    (0.312)
No Availability: female:education:location:white   0.010
    (0.247)
No Availability: female:income:location:white   0.143
    (0.290)
No Availability: education:income:location:white   0.441
    (0.430)
No Availability: female:religiosity:location:white   -0.272
    (0.776)
No Availability: education:religiosity:location:white   -0.157
    (1.709)
No Availability: income:religiosity:location:white   -0.080
    (2.244)
No Availability: female:politics:location:white   0.088
    (0.308)
No Availability: education:politics:location:white   -0.294
    (0.507)
No Availability: income:politics:location:white   0.412
    (0.729)
No Availability: religiosity:politics:location:white   -0.024
    (0.897)
No Availability: female:education:income:religiosity:politics   1.055
    (0.759)
No Availability: female:education:income:religiosity:location   0.171
    (0.589)
No Availability: female:education:income:politics:location   1.344
    (1.065)
No Availability: female:education:religiosity:politics:location   0.621
    (0.768)
No Availability: female:income:religiosity:politics:location   0.381
    (0.806)
No Availability: education:income:religiosity:politics:location   0.028
    (0.210)
No Availability: female:education:income:religiosity:white   0.126
    (0.292)
No Availability: female:education:income:politics:white   -0.165
    (0.334)
No Availability: female:education:religiosity:politics:white   -0.106
    (0.312)
No Availability: female:income:religiosity:politics:white   -0.130
    (0.391)
No Availability: education:income:religiosity:politics:white   -0.156
    (0.575)
No Availability: female:education:income:location:white   0.289
    (0.597)
No Availability: female:education:religiosity:location:white   -0.271
    (0.487)
No Availability: female:income:religiosity:location:white   -0.297
    (0.507)
No Availability: education:income:religiosity:location:white   -0.082
    (0.598)
No Availability: female:education:politics:location:white   0.175
    (0.559)
No Availability: female:income:politics:location:white   0.275
    (1.056)
No Availability: education:income:politics:location:white   -0.098
    (0.691)
No Availability: female:religiosity:politics:location:white   0.158
    (1.146)
No Availability: education:religiosity:politics:location:white   0.414
    (1.080)
No Availability: income:religiosity:politics:location:white   -0.001
    (0.924)
No Availability: female:education:income:religiosity:politics:location   -0.573
    (0.403)
No Availability: female:education:income:religiosity:politics:white   0.334
    (0.214)
No Availability: female:education:income:religiosity:location:white   -0.385
    (0.639)
No Availability: female:education:income:politics:location:white   0.052
    (0.523)
No Availability: female:education:religiosity:politics:location:white   0.208
    (0.341)
No Availability: female:income:religiosity:politics:location:white   -0.053
    (0.814)
No Availability: education:income:religiosity:politics:location:white   0.050
    (0.976)
No Availability: female:education:income:religiosity:politics:location:white   -0.033
    (0.410)
AIC 702.719 1074.508
BIC 808.798 2241.387
Log Likelihood -327.359 -273.254
Deviance 654.719 546.508
Num. obs. 614 614
K 4 4
***p < 0.01; **p < 0.05; *p < 0.1

3.1.2 Predictors of Treatments

Key Questions: What chatbot covariates predict treatments? Which of these are Facebook ad covariates that can be used for targeting? How significant are these results?

3.1.2.1 Correlaton plots

Crossed out correlations are not statistically significant.

3.1.2.2 Multinomial logit

  Baseline With Interactions
family supports it: (Intercept) 2.054** -0.331
  (0.849) (1.477)
family supports it: female 0.216 0.528
  (0.303) (0.943)
family supports it: education -0.129 -1.013
  (0.121) (1.762)
family supports it: income -0.172 0.970
  (0.106) (1.469)
family supports it: religiosity -0.417** 0.910
  (0.208) (1.874)
family supports it: politics -0.111 -0.069
  (0.221) (1.698)
family supports it: location 0.197 -0.771
  (0.174) (1.644)
family supports it: white 0.015 -0.157
  (0.592) (0.133)
job/school required: (Intercept) 2.573*** -0.772
  (0.777) (1.460)
job/school required: female -0.081 -0.934
  (0.275) (1.021)
job/school required: education 0.031 0.458
  (0.106) (1.488)
job/school required: income -0.154 0.294
  (0.094) (1.903)
job/school required: religiosity -0.241 -0.144
  (0.194) (1.710)
job/school required: politics -0.411** -1.672
  (0.201) (1.588)
job/school required: location 0.282* 0.108
  (0.159) (1.608)
job/school required: white -1.819*** -0.102
  (0.700) (0.196)
rewards for vaxxing: (Intercept) 0.891 0.313
  (1.272) (1.475)
rewards for vaxxing: female 0.308 0.507
  (0.500) (0.885)
rewards for vaxxing: education 0.015 -0.303
  (0.184) (1.370)
rewards for vaxxing: income 0.283** -0.396
  (0.144) (1.051)
rewards for vaxxing: religiosity -0.860*** 0.082
  (0.308) (1.726)
rewards for vaxxing: politics -0.580 -0.107
  (0.368) (1.978)
rewards for vaxxing: location 0.110 -0.489
  (0.285) (1.133)
rewards for vaxxing: white -1.115 -0.186
  (1.158) (0.259)
trusted info source: (Intercept) 1.207 0.648
  (0.968) (1.342)
trusted info source: female 0.333 0.120
  (0.351) (1.097)
trusted info source: education -0.066 -0.351
  (0.137) (1.781)
trusted info source: income -0.061 0.053
  (0.119) (1.053)
trusted info source: religiosity -0.291 1.432
  (0.238) (1.293)
trusted info source: politics -0.099 0.542
  (0.254) (1.605)
trusted info source: location -0.091 -1.349
  (0.200) (1.819)
trusted info source: white -0.477 -0.010
  (0.770) (0.063)
family supports it: female:education   1.442
    (1.234)
family supports it: female:income   -0.271
    (1.102)
family supports it: education:income   0.404
    (1.351)
family supports it: female:religiosity   -0.644
    (1.424)
family supports it: education:religiosity   -0.565
    (1.017)
family supports it: income:religiosity   0.195
    (1.358)
family supports it: female:politics   1.235
    (1.122)
family supports it: education:politics   -0.169
    (0.969)
family supports it: income:politics   0.175
    (1.331)
family supports it: religiosity:politics   0.582
    (1.114)
family supports it: female:location   -0.943
    (1.266)
family supports it: education:location   0.192
    (1.221)
family supports it: income:location   0.052
    (1.286)
family supports it: religiosity:location   0.020
    (1.028)
family supports it: politics:location   -0.247
    (1.188)
family supports it: female:white   -0.191
    (0.143)
family supports it: education:white   0.173
    (0.133)
family supports it: income:white   -0.059
    (0.181)
family supports it: religiosity:white   -0.146
    (0.221)
family supports it: politics:white   0.024
    (0.273)
family supports it: location:white   -0.450
    (0.395)
family supports it: female:education:income   -1.425
    (1.542)
family supports it: female:education:religiosity   0.655
    (0.963)
family supports it: female:income:religiosity   -0.718
    (1.362)
family supports it: education:income:religiosity   -0.045
    (0.612)
family supports it: female:education:politics   0.335
    (0.971)
family supports it: female:income:politics   1.348
    (1.393)
family supports it: education:income:politics   -0.178
    (0.693)
family supports it: female:religiosity:politics   -1.744*
    (0.941)
family supports it: education:religiosity:politics   0.363
    (0.615)
family supports it: income:religiosity:politics   -0.928
    (0.775)
family supports it: female:education:location   0.253
    (1.149)
family supports it: female:income:location   1.099
    (1.196)
family supports it: education:income:location   -0.376
    (0.686)
family supports it: female:religiosity:location   0.980
    (0.908)
family supports it: education:religiosity:location   0.293
    (0.547)
family supports it: income:religiosity:location   -0.230
    (0.646)
family supports it: female:politics:location   -0.526
    (1.139)
family supports it: education:politics:location   0.571
    (0.685)
family supports it: income:politics:location   0.399
    (0.854)
family supports it: religiosity:politics:location   -0.152
    (0.665)
family supports it: female:education:white   -0.045
    (0.215)
family supports it: female:income:white   0.226
    (0.186)
family supports it: education:income:white   0.118
    (0.363)
family supports it: female:religiosity:white   -0.331*
    (0.178)
family supports it: education:religiosity:white   0.714**
    (0.289)
family supports it: income:religiosity:white   -0.423
    (0.290)
family supports it: female:politics:white   -0.063
    (0.252)
family supports it: education:politics:white   -0.025
    (0.191)
family supports it: income:politics:white   -0.683
    (0.426)
family supports it: religiosity:politics:white   0.514
    (0.504)
family supports it: female:location:white   -0.620
    (0.422)
family supports it: education:location:white   0.249
    (0.331)
family supports it: income:location:white   0.830**
    (0.361)
family supports it: religiosity:location:white   -0.632
    (0.681)
family supports it: politics:location:white   0.123
    (0.338)
family supports it: female:education:income:religiosity   0.124
    (0.802)
family supports it: female:education:income:politics   -0.551
    (0.862)
family supports it: female:education:religiosity:politics   -0.415
    (0.664)
family supports it: female:income:religiosity:politics   0.625
    (0.859)
family supports it: education:income:religiosity:politics   0.169
    (0.357)
family supports it: female:education:income:location   0.968
    (0.965)
family supports it: female:education:religiosity:location   -0.843
    (0.589)
family supports it: female:income:religiosity:location   -0.175
    (0.783)
family supports it: education:income:religiosity:location   0.119
    (0.277)
family supports it: female:education:politics:location   -0.522
    (0.792)
family supports it: female:income:politics:location   -0.580
    (1.171)
family supports it: education:income:politics:location   -0.010
    (0.311)
family supports it: female:religiosity:politics:location   0.631
    (0.691)
family supports it: education:religiosity:politics:location   -0.314
    (0.346)
family supports it: income:religiosity:politics:location   0.222
    (0.368)
family supports it: female:education:income:white   0.314
    (0.436)
family supports it: female:education:religiosity:white   -0.043
    (0.323)
family supports it: female:income:religiosity:white   -0.025
    (0.248)
family supports it: education:income:religiosity:white   0.231
    (0.419)
family supports it: female:education:politics:white   0.019
    (0.180)
family supports it: female:income:politics:white   -0.466
    (0.404)
family supports it: education:income:politics:white   -0.436
    (0.827)
family supports it: female:religiosity:politics:white   0.120
    (0.431)
family supports it: education:religiosity:politics:white   0.418
    (0.302)
family supports it: income:religiosity:politics:white   -0.832*
    (0.436)
family supports it: female:education:location:white   -0.476
    (0.386)
family supports it: female:income:location:white   1.421***
    (0.374)
family supports it: education:income:location:white   0.602
    (0.487)
family supports it: female:religiosity:location:white   -1.126
    (0.693)
family supports it: education:religiosity:location:white   0.965
    (0.806)
family supports it: income:religiosity:location:white   0.059
    (0.920)
family supports it: female:politics:location:white   -0.208
    (0.257)
family supports it: education:politics:location:white   -0.379
    (0.264)
family supports it: income:politics:location:white   -0.062
    (0.513)
family supports it: religiosity:politics:location:white   1.111*
    (0.642)
family supports it: female:education:income:religiosity:politics   0.240
    (0.482)
family supports it: female:education:income:religiosity:location   -0.075
    (0.432)
family supports it: female:education:income:politics:location   -0.129
    (0.590)
family supports it: female:education:religiosity:politics:location   0.423
    (0.387)
family supports it: female:income:religiosity:politics:location   -0.236
    (0.558)
family supports it: education:income:religiosity:politics:location   -0.067
    (0.158)
family supports it: female:education:income:religiosity:white   -0.032
    (0.561)
family supports it: female:education:income:politics:white   -0.135
    (0.411)
family supports it: female:education:religiosity:politics:white   0.470
    (0.354)
family supports it: female:income:religiosity:politics:white   -1.062*
    (0.570)
family supports it: education:income:religiosity:politics:white   1.045**
    (0.436)
family supports it: female:education:income:location:white   0.790
    (0.700)
family supports it: female:education:religiosity:location:white   -0.994**
    (0.389)
family supports it: female:income:religiosity:location:white   1.244
    (0.878)
family supports it: education:income:religiosity:location:white   -0.757
    (0.799)
family supports it: female:education:politics:location:white   -0.193
    (0.328)
family supports it: female:income:politics:location:white   0.189
    (0.569)
family supports it: education:income:politics:location:white   -0.448
    (1.004)
family supports it: female:religiosity:politics:location:white   0.242
    (0.632)
family supports it: education:religiosity:politics:location:white   -0.862
    (0.944)
family supports it: income:religiosity:politics:location:white   -0.044
    (0.741)
family supports it: female:education:income:religiosity:politics:location   -0.008
    (0.261)
family supports it: female:education:income:religiosity:politics:white   0.369
    (0.358)
family supports it: female:education:income:religiosity:location:white   -1.181
    (0.991)
family supports it: female:education:income:politics:location:white   0.037
    (0.661)
family supports it: female:education:religiosity:politics:location:white   0.497
    (0.865)
family supports it: female:income:religiosity:politics:location:white   -0.369
    (0.834)
family supports it: education:income:religiosity:politics:location:white   0.211
    (0.640)
family supports it: female:education:income:religiosity:politics:location:white   0.065
    (0.548)
job/school required: female:education   0.156
    (1.617)
job/school required: female:income   0.856
    (1.347)
job/school required: education:income   -0.334
    (1.155)
job/school required: female:religiosity   -0.154
    (1.743)
job/school required: education:religiosity   0.006
    (0.927)
job/school required: income:religiosity   1.963
    (1.438)
job/school required: female:politics   -1.271
    (1.265)
job/school required: education:politics   -0.255
    (1.011)
job/school required: income:politics   0.294
    (1.420)
job/school required: religiosity:politics   0.508
    (1.042)
job/school required: female:location   0.931
    (1.886)
job/school required: education:location   -0.237
    (1.099)
job/school required: income:location   0.324
    (1.333)
job/school required: religiosity:location   0.345
    (0.864)
job/school required: politics:location   0.134
    (1.129)
job/school required: female:white   -0.154
    (0.245)
job/school required: education:white   -0.123
    (0.294)
job/school required: income:white   0.019
    (0.359)
job/school required: religiosity:white   -0.035
    (0.316)
job/school required: politics:white   -0.133
    (0.313)
job/school required: location:white   -0.235
    (0.305)
job/school required: female:education:income   0.585
    (1.079)
job/school required: female:education:religiosity   0.082
    (0.950)
job/school required: female:income:religiosity   -1.013
    (1.318)
job/school required: education:income:religiosity   -0.573
    (0.599)
job/school required: female:education:politics   1.717*
    (0.880)
job/school required: female:income:politics   1.021
    (1.053)
job/school required: education:income:politics   0.239
    (0.581)
job/school required: female:religiosity:politics   0.888
    (1.041)
job/school required: education:religiosity:politics   0.318
    (0.597)
job/school required: income:religiosity:politics   -0.784
    (0.766)
job/school required: female:education:location   0.212
    (1.005)
job/school required: female:income:location   -0.013
    (1.045)
job/school required: education:income:location   0.107
    (0.575)
job/school required: female:religiosity:location   0.452
    (1.153)
job/school required: education:religiosity:location   0.143
    (0.468)
job/school required: income:religiosity:location   -1.023
    (0.650)
job/school required: female:politics:location   -0.218
    (1.230)
job/school required: education:politics:location   0.538
    (0.650)
job/school required: income:politics:location   0.310
    (0.879)
job/school required: religiosity:politics:location   -0.052
    (0.523)
job/school required: female:education:white   -0.205
    (0.367)
job/school required: female:income:white   -0.147
    (0.261)
job/school required: education:income:white   0.067
    (0.612)
job/school required: female:religiosity:white   -0.199
    (0.301)
job/school required: education:religiosity:white   -0.184
    (0.583)
job/school required: income:religiosity:white   0.251
    (0.446)
job/school required: female:politics:white   -0.194
    (0.384)
job/school required: education:politics:white   0.159
    (0.225)
job/school required: income:politics:white   -0.023
    (0.580)
job/school required: religiosity:politics:white   -0.057
    (0.448)
job/school required: female:location:white   -0.279
    (0.395)
job/school required: education:location:white   -0.377
    (0.588)
job/school required: income:location:white   -0.045
    (0.536)
job/school required: religiosity:location:white   0.092
    (0.550)
job/school required: politics:location:white   -0.335
    (0.506)
job/school required: female:education:income:religiosity   0.242
    (0.609)
job/school required: female:education:income:politics   -1.142*
    (0.675)
job/school required: female:education:religiosity:politics   -0.935
    (0.590)
job/school required: female:income:religiosity:politics   -0.510
    (0.751)
job/school required: education:income:religiosity:politics   0.085
    (0.300)
job/school required: female:education:income:location   0.216
    (0.937)
job/school required: female:education:religiosity:location   -0.482
    (0.508)
job/school required: female:income:religiosity:location   0.156
    (0.747)
job/school required: education:income:religiosity:location   0.215
    (0.239)
job/school required: female:education:politics:location   -0.824
    (0.736)
job/school required: female:income:politics:location   -0.174
    (0.802)
job/school required: education:income:politics:location   -0.257
    (0.283)
job/school required: female:religiosity:politics:location   -0.183
    (0.698)
job/school required: education:religiosity:politics:location   -0.328
    (0.276)
job/school required: income:religiosity:politics:location   0.237
    (0.349)
job/school required: female:education:income:white   -0.169
    (0.320)
job/school required: female:education:religiosity:white   -0.318
    (0.537)
job/school required: female:income:religiosity:white   -0.160
    (0.288)
job/school required: education:income:religiosity:white   0.114
    (0.663)
job/school required: female:education:politics:white   -0.129
    (0.386)
job/school required: female:income:politics:white   -0.193
    (0.575)
job/school required: education:income:politics:white   0.473
    (1.000)
job/school required: female:religiosity:politics:white   -0.189
    (0.454)
job/school required: education:religiosity:politics:white   0.265
    (0.408)
job/school required: income:religiosity:politics:white   0.064
    (0.630)
job/school required: female:education:location:white   -0.363
    (0.599)
job/school required: female:income:location:white   -0.238
    (0.504)
job/school required: education:income:location:white   -0.182
    (0.467)
job/school required: female:religiosity:location:white   -0.221
    (0.426)
job/school required: education:religiosity:location:white   -0.453
    (0.937)
job/school required: income:religiosity:location:white   0.767
    (1.164)
job/school required: female:politics:location:white   -0.258
    (0.434)
job/school required: education:politics:location:white   0.141
    (0.811)
job/school required: income:politics:location:white   -0.397
    (0.459)
job/school required: religiosity:politics:location:white   0.046
    (0.587)
job/school required: female:education:income:religiosity:politics   0.436
    (0.345)
job/school required: female:education:income:religiosity:location   -0.131
    (0.349)
job/school required: female:education:income:politics:location   0.132
    (0.541)
job/school required: female:education:religiosity:politics:location   0.546*
    (0.327)
job/school required: female:income:religiosity:politics:location   0.081
    (0.438)
job/school required: education:income:religiosity:politics:location   0.021
    (0.115)
job/school required: female:education:income:religiosity:white   -0.292
    (0.422)
job/school required: female:education:income:politics:white   -0.025
    (0.549)
job/school required: female:education:religiosity:politics:white   -0.134
    (0.396)
job/school required: female:income:religiosity:politics:white   -0.209
    (0.769)
job/school required: education:income:religiosity:politics:white   0.402
    (0.856)
job/school required: female:education:income:location:white   -0.211
    (0.443)
job/school required: female:education:religiosity:location:white   -0.407
    (0.642)
job/school required: female:income:religiosity:location:white   -0.032
    (1.079)
job/school required: education:income:religiosity:location:white   0.076
    (0.417)
job/school required: female:education:politics:location:white   -0.112
    (0.497)
job/school required: female:income:politics:location:white   -0.231
    (0.643)
job/school required: education:income:politics:location:white   0.121
    (0.672)
job/school required: female:religiosity:politics:location:white   0.099
    (0.682)
job/school required: education:religiosity:politics:location:white   0.274
    (0.723)
job/school required: income:religiosity:politics:location:white   -0.073
    (0.734)
job/school required: female:education:income:religiosity:politics:location   -0.092
    (0.190)
job/school required: female:education:income:religiosity:politics:white   -0.245
    (0.762)
job/school required: female:education:income:religiosity:location:white   -0.084
    (0.972)
job/school required: female:education:income:politics:location:white   0.174
    (0.713)
job/school required: female:education:religiosity:politics:location:white   0.260
    (0.646)
job/school required: female:income:religiosity:politics:location:white   0.168
    (0.579)
job/school required: education:income:religiosity:politics:location:white   -0.445
    (0.999)
job/school required: female:education:income:religiosity:politics:location:white   0.303
    (0.872)
rewards for vaxxing: female:education   0.296
    (1.317)
rewards for vaxxing: female:income   -0.298
    (1.298)
rewards for vaxxing: education:income   0.068
    (1.267)
rewards for vaxxing: female:religiosity   0.828
    (1.628)
rewards for vaxxing: education:religiosity   -0.301
    (1.139)
rewards for vaxxing: income:religiosity   -0.341
    (1.620)
rewards for vaxxing: female:politics   0.012
    (1.349)
rewards for vaxxing: education:politics   0.104
    (0.893)
rewards for vaxxing: income:politics   0.237
    (1.241)
rewards for vaxxing: religiosity:politics   0.110
    (1.529)
rewards for vaxxing: female:location   0.015
    (1.126)
rewards for vaxxing: education:location   -0.817
    (1.175)
rewards for vaxxing: income:location   0.516
    (1.081)
rewards for vaxxing: religiosity:location   -1.172
    (1.136)
rewards for vaxxing: politics:location   -1.473
    (1.392)
rewards for vaxxing: female:white   -0.166
    (0.239)
rewards for vaxxing: education:white   -0.096
    (0.446)
rewards for vaxxing: income:white   -0.230
    (0.395)
rewards for vaxxing: religiosity:white   -0.073
    (0.206)
rewards for vaxxing: politics:white   -0.251
    (0.360)
rewards for vaxxing: location:white   -0.359
    (0.678)
rewards for vaxxing: female:education:income   0.383
    (1.521)
rewards for vaxxing: female:education:religiosity   0.114
    (1.323)
rewards for vaxxing: female:income:religiosity   -0.348
    (1.778)
rewards for vaxxing: education:income:religiosity   0.276
    (0.721)
rewards for vaxxing: female:education:politics   0.494
    (1.213)
rewards for vaxxing: female:income:politics   0.493
    (1.764)
rewards for vaxxing: education:income:politics   0.134
    (0.682)
rewards for vaxxing: female:religiosity:politics   -0.639
    (1.430)
rewards for vaxxing: education:religiosity:politics   -0.283
    (1.053)
rewards for vaxxing: income:religiosity:politics   -0.063
    (0.800)
rewards for vaxxing: female:education:location   -1.039
    (1.511)
rewards for vaxxing: female:income:location   -0.600
    (1.353)
rewards for vaxxing: education:income:location   0.041
    (0.742)
rewards for vaxxing: female:religiosity:location   0.783
    (1.282)
rewards for vaxxing: education:religiosity:location   0.827
    (0.535)
rewards for vaxxing: income:religiosity:location   0.420
    (0.778)
rewards for vaxxing: female:politics:location   -0.746
    (1.462)
rewards for vaxxing: education:politics:location   1.000
    (0.730)
rewards for vaxxing: income:politics:location   0.600
    (0.909)
rewards for vaxxing: religiosity:politics:location   0.778
    (0.763)
rewards for vaxxing: female:education:white   -0.112
    (0.305)
rewards for vaxxing: female:income:white   -0.072
    (0.363)
rewards for vaxxing: education:income:white   -0.241
    (0.280)
rewards for vaxxing: female:religiosity:white   -0.095
    (0.168)
rewards for vaxxing: education:religiosity:white   0.240
    (0.434)
rewards for vaxxing: income:religiosity:white   -0.017
    (0.365)
rewards for vaxxing: female:politics:white   -0.296
    (0.270)
rewards for vaxxing: education:politics:white   -0.117
    (0.813)
rewards for vaxxing: income:politics:white   -0.066
    (0.412)
rewards for vaxxing: religiosity:politics:white   -0.151
    (0.446)
rewards for vaxxing: female:location:white   -0.335
    (0.628)
rewards for vaxxing: education:location:white   0.058
    (1.174)
rewards for vaxxing: income:location:white   -0.677
    (1.342)
rewards for vaxxing: religiosity:location:white   0.073
    (0.663)
rewards for vaxxing: politics:location:white   -0.449
    (0.908)
rewards for vaxxing: female:education:income:religiosity   -0.335
    (0.869)
rewards for vaxxing: female:education:income:politics   -1.074
    (1.146)
rewards for vaxxing: female:education:religiosity:politics   -0.057
    (1.206)
rewards for vaxxing: female:income:religiosity:politics   0.068
    (1.187)
rewards for vaxxing: education:income:religiosity:politics   -0.050
    (0.389)
rewards for vaxxing: female:education:income:location   0.974
    (1.110)
rewards for vaxxing: female:education:religiosity:location   -0.187
    (0.799)
rewards for vaxxing: female:income:religiosity:location   0.115
    (0.950)
rewards for vaxxing: education:income:religiosity:location   -0.296
    (0.513)
rewards for vaxxing: female:education:politics:location   0.195
    (1.001)
rewards for vaxxing: female:income:politics:location   0.619
    (1.308)
rewards for vaxxing: education:income:politics:location   -0.295
    (0.407)
rewards for vaxxing: female:religiosity:politics:location   0.082
    (1.064)
rewards for vaxxing: education:religiosity:politics:location   -0.348
    (0.370)
rewards for vaxxing: income:religiosity:politics:location   -0.287
    (0.418)
rewards for vaxxing: female:education:income:white   -0.009
    (0.275)
rewards for vaxxing: female:education:religiosity:white   0.161
    (0.524)
rewards for vaxxing: female:income:religiosity:white   0.060
    (0.290)
rewards for vaxxing: education:income:religiosity:white   -0.040
    (0.467)
rewards for vaxxing: female:education:politics:white   -0.230
    (0.473)
rewards for vaxxing: female:income:politics:white   0.081
    (0.376)
rewards for vaxxing: education:income:politics:white   0.304
    (0.604)
rewards for vaxxing: female:religiosity:politics:white   -0.384
    (0.485)
rewards for vaxxing: education:religiosity:politics:white   -0.154
    (0.647)
rewards for vaxxing: income:religiosity:politics:white   0.478
    (0.568)
rewards for vaxxing: female:education:location:white   -0.014
    (0.611)
rewards for vaxxing: female:income:location:white   -0.357
    (1.175)
rewards for vaxxing: education:income:location:white   -0.607
    (0.844)
rewards for vaxxing: female:religiosity:location:white   0.065
    (0.618)
rewards for vaxxing: education:religiosity:location:white   1.233
    (1.267)
rewards for vaxxing: income:religiosity:location:white   -0.258
    (1.586)
rewards for vaxxing: female:politics:location:white   -0.608
    (0.665)
rewards for vaxxing: education:politics:location:white   -0.060
    (2.368)
rewards for vaxxing: income:politics:location:white   -0.372
    (0.886)
rewards for vaxxing: religiosity:politics:location:white   -0.096
    (1.563)
rewards for vaxxing: female:education:income:religiosity:politics   0.459
    (0.568)
rewards for vaxxing: female:education:income:religiosity:location   -0.044
    (0.607)
rewards for vaxxing: female:education:income:politics:location   -0.163
    (0.681)
rewards for vaxxing: female:education:religiosity:politics:location   0.057
    (0.521)
rewards for vaxxing: female:income:religiosity:politics:location   -0.313
    (0.751)
rewards for vaxxing: education:income:religiosity:politics:location   0.125
    (0.248)
rewards for vaxxing: female:education:income:religiosity:white   -0.008
    (0.340)
rewards for vaxxing: female:education:income:politics:white   0.449
    (0.784)
rewards for vaxxing: female:education:religiosity:politics:white   -0.288
    (0.658)
rewards for vaxxing: female:income:religiosity:politics:white   0.189
    (0.868)
rewards for vaxxing: education:income:religiosity:politics:white   0.436
    (0.576)
rewards for vaxxing: female:education:income:location:white   -0.126
    (0.768)
rewards for vaxxing: female:education:religiosity:location:white   1.258
    (1.633)
rewards for vaxxing: female:income:religiosity:location:white   0.010
    (0.728)
rewards for vaxxing: education:income:religiosity:location:white   -0.062
    (1.305)
rewards for vaxxing: female:education:politics:location:white   -0.303
    (0.749)
rewards for vaxxing: female:income:politics:location:white   -0.146
    (0.681)
rewards for vaxxing: education:income:politics:location:white   0.198
    (1.223)
rewards for vaxxing: female:religiosity:politics:location:white   -0.530
    (1.727)
rewards for vaxxing: education:religiosity:politics:location:white   -0.294
    (1.140)
rewards for vaxxing: income:religiosity:politics:location:white   0.596
    (1.016)
rewards for vaxxing: female:education:income:religiosity:politics:location   -0.028
    (0.341)
rewards for vaxxing: female:education:income:religiosity:politics:white   -0.188
    (0.508)
rewards for vaxxing: female:education:income:religiosity:location:white   0.394
    (0.900)
rewards for vaxxing: female:education:income:politics:location:white   0.493
    (1.211)
rewards for vaxxing: female:education:religiosity:politics:location:white   0.261
    (0.834)
rewards for vaxxing: female:income:religiosity:politics:location:white   0.087
    (1.331)
rewards for vaxxing: education:income:religiosity:politics:location:white   -0.265
    (1.249)
rewards for vaxxing: female:education:income:religiosity:politics:location:white   -0.553
    (0.970)
trusted info source: female:education   0.171
    (1.231)
trusted info source: female:income   -0.420
    (1.299)
trusted info source: education:income   -0.723
    (1.439)
trusted info source: female:religiosity   -0.462
    (1.388)
trusted info source: education:religiosity   -0.068
    (0.953)
trusted info source: income:religiosity   0.296
    (1.145)
trusted info source: female:politics   0.424
    (1.508)
trusted info source: education:politics   -0.358
    (1.006)
trusted info source: income:politics   0.909
    (1.488)
trusted info source: religiosity:politics   -0.523
    (1.059)
trusted info source: female:location   0.170
    (1.386)
trusted info source: education:location   -0.041
    (1.282)
trusted info source: income:location   -1.136
    (1.384)
trusted info source: religiosity:location   0.151
    (0.993)
trusted info source: politics:location   -0.938
    (1.290)
trusted info source: female:white   -0.056
    (0.094)
trusted info source: education:white   -0.109
    (0.089)
trusted info source: income:white   0.262
    (0.254)
trusted info source: religiosity:white   -0.073
    (0.211)
trusted info source: politics:white   -0.115
    (0.109)
trusted info source: location:white   -0.047
    (0.238)
trusted info source: female:education:income   0.804
    (1.463)
trusted info source: female:education:religiosity   -0.028
    (1.005)
trusted info source: female:income:religiosity   -0.905
    (1.331)
trusted info source: education:income:religiosity   -0.116
    (0.778)
trusted info source: female:education:politics   -0.449
    (1.241)
trusted info source: female:income:politics   -0.978
    (1.259)
trusted info source: education:income:politics   0.084
    (0.748)
trusted info source: female:religiosity:politics   0.325
    (1.055)
trusted info source: education:religiosity:politics   0.165
    (0.622)
trusted info source: income:religiosity:politics   -0.762
    (0.828)
trusted info source: female:education:location   0.494
    (1.335)
trusted info source: female:income:location   0.633
    (1.438)
trusted info source: education:income:location   0.702
    (0.635)
trusted info source: female:religiosity:location   0.040
    (1.081)
trusted info source: education:religiosity:location   -0.091
    (0.584)
trusted info source: income:religiosity:location   0.012
    (0.785)
trusted info source: female:politics:location   0.046
    (1.423)
trusted info source: education:politics:location   0.710
    (0.791)
trusted info source: income:politics:location   0.850
    (0.954)
trusted info source: religiosity:politics:location   0.273
    (0.592)
trusted info source: female:education:white   -0.046
    (0.067)
trusted info source: female:income:white   -0.053
    (0.205)
trusted info source: education:income:white   0.416**
    (0.185)
trusted info source: female:religiosity:white   -0.042
    (0.247)
trusted info source: education:religiosity:white   -0.224
    (0.138)
trusted info source: income:religiosity:white   0.180
    (0.305)
trusted info source: female:politics:white   -0.051
    (0.139)
trusted info source: education:politics:white   -0.329
    (0.352)
trusted info source: income:politics:white   0.330
    (0.288)
trusted info source: religiosity:politics:white   -0.354
    (0.267)
trusted info source: female:location:white   -0.143
    (0.309)
trusted info source: education:location:white   -0.334
    (0.348)
trusted info source: income:location:white   0.444
    (1.087)
trusted info source: religiosity:location:white   -0.022
    (0.710)
trusted info source: politics:location:white   -0.291
    (0.380)
trusted info source: female:education:income:religiosity   0.182
    (0.903)
trusted info source: female:education:income:politics   0.061
    (0.862)
trusted info source: female:education:religiosity:politics   -0.062
    (0.733)
trusted info source: female:income:religiosity:politics   0.630
    (0.926)
trusted info source: education:income:religiosity:politics   0.183
    (0.397)
trusted info source: female:education:income:location   0.246
    (1.036)
trusted info source: female:education:religiosity:location   -0.147
    (0.702)
trusted info source: female:income:religiosity:location   0.337
    (0.860)
trusted info source: education:income:religiosity:location   -0.047
    (0.344)
trusted info source: female:education:politics:location   -0.392
    (0.952)
trusted info source: female:income:politics:location   0.166
    (1.146)
trusted info source: education:income:politics:location   -0.401
    (0.370)
trusted info source: female:religiosity:politics:location   -0.094
    (0.788)
trusted info source: education:religiosity:politics:location   -0.161
    (0.311)
trusted info source: income:religiosity:politics:location   0.005
    (0.416)
trusted info source: female:education:income:white   0.105
    (0.280)
trusted info source: female:education:religiosity:white   -0.011
    (0.136)
trusted info source: female:income:religiosity:white   -0.009
    (0.176)
trusted info source: education:income:religiosity:white   0.059
    (0.242)
trusted info source: female:education:politics:white   -0.024
    (0.291)
trusted info source: female:income:politics:white   -0.014
    (0.258)
trusted info source: education:income:politics:white   0.433
    (0.486)
trusted info source: female:religiosity:politics:white   0.017
    (0.336)
trusted info source: education:religiosity:politics:white   -0.266
    (0.498)
trusted info source: income:religiosity:politics:white   -0.210
    (0.524)
trusted info source: female:education:location:white   -0.158
    (0.158)
trusted info source: female:income:location:white   -0.289
    (0.988)
trusted info source: education:income:location:white   0.496
    (0.448)
trusted info source: female:religiosity:location:white   -0.072
    (0.787)
trusted info source: education:religiosity:location:white   -0.128
    (0.549)
trusted info source: income:religiosity:location:white   0.455
    (1.337)
trusted info source: female:politics:location:white   -0.111
    (0.340)
trusted info source: education:politics:location:white   -0.762
    (1.127)
trusted info source: income:politics:location:white   0.491
    (0.487)
trusted info source: religiosity:politics:location:white   -0.404
    (0.888)
trusted info source: female:education:income:religiosity:politics   -0.108
    (0.476)
trusted info source: female:education:income:religiosity:location   -0.248
    (0.461)
trusted info source: female:education:income:politics:location   -0.287
    (0.611)
trusted info source: female:education:religiosity:politics:location   0.170
    (0.405)
trusted info source: female:income:religiosity:politics:location   -0.218
    (0.567)
trusted info source: education:income:religiosity:politics:location   0.017
    (0.175)
trusted info source: female:education:income:religiosity:white   0.325
    (0.341)
trusted info source: female:education:income:politics:white   0.271
    (0.482)
trusted info source: female:education:religiosity:politics:white   0.075
    (0.658)
trusted info source: female:income:religiosity:politics:white   0.113
    (0.621)
trusted info source: education:income:religiosity:politics:white   -0.631
    (0.481)
trusted info source: female:education:income:location:white   -0.198
    (0.537)
trusted info source: female:education:religiosity:location:white   -0.057
    (0.452)
trusted info source: female:income:religiosity:location:white   -0.271
    (1.037)
trusted info source: education:income:religiosity:location:white   0.078
    (0.930)
trusted info source: female:education:politics:location:white   -0.148
    (0.451)
trusted info source: female:income:politics:location:white   -0.302
    (0.299)
trusted info source: education:income:politics:location:white   0.316
    (0.598)
trusted info source: female:religiosity:politics:location:white   0.144
    (0.934)
trusted info source: education:religiosity:politics:location:white   1.039
    (0.725)
trusted info source: income:religiosity:politics:location:white   -0.257
    (0.587)
trusted info source: female:education:income:religiosity:politics:location   0.137
    (0.242)
trusted info source: female:education:income:religiosity:politics:white   0.663
    (0.597)
trusted info source: female:education:income:religiosity:location:white   0.008
    (0.851)
trusted info source: female:education:income:politics:location:white   -0.242
    (0.639)
trusted info source: female:education:religiosity:politics:location:white   0.099
    (0.920)
trusted info source: female:income:religiosity:politics:location:white   -0.157
    (0.626)
trusted info source: education:income:religiosity:politics:location:white   -0.500
    (0.732)
trusted info source: female:education:income:religiosity:politics:location:white   -0.019
    (0.721)
AIC 1567.170 1947.670
BIC 1707.497 3438.636
Log Likelihood -751.585 -633.835
Deviance 1503.170 1267.670
Num. obs. 593 593
K 5 5
***p < 0.01; **p < 0.05; *p < 0.1


3.2 Chatbot Descriptive Analysis

Goals: Capture new ideas for covariates, impediments, and treatments using descriptive / keyword analysis.

3.2.1 Covariate Variation

Key Questions: Do all multiple choice covariates collected have sufficient variation in answers? If not, which multiple choice options should we break out further and test in our next pilot?

3.2.1.1 Demographic variables

Here’s a summary of relevant demographic variables:

Here’s a distribution of respondent age:

##       age       
##  Min.   : 0.00  
##  1st Qu.:19.00  
##  Median :23.00  
##  Mean   :26.12  
##  3rd Qu.:30.00  
##  Max.   :70.00  
##  NA's   :28

Let’s move ahead to look at vaccination impediment related variables.


3.2.1.2 Vaccination status

We start off with a plot demonstrating the split among vaccinated and unvaccinated participants in this pilot:

3.2.1.3 Impediments

3.2.1.3.1 Overview

We asked participants about whether they have the motivation to get the COVID-19 vaccine and whether they have the ability to get the vaccine for both vaccinated and unvaccinated people. We then fork them into 8 different segments based on the vaccination status, motivation to get the vaccine, and ability to get the vaccine. We obtain the distribution below:

Distribution of forking segments of participants’ impediments
Vaccination status Able to get vaccine Have motivation to get vaccine Count Percentage of total participants
unvax yes no 420 23%
unvax no no 178 10%
unvax yes yes 88 5%
unvax no yes 13 1%
vax yes yes 562 31%
vax yes no 367 20%
vax no yes 117 6%
vax no no 90 5%


3.2.1.3.2 Analysis for each impediment

Let’s investigate each impediment (motivation & ability) in detail, and see the distributions of the reasons why they have such impediments.

  • Main Level: demonstrates the distribution of the reasons that chosen from the options we provided to them to explain why participants have motivation/ability impediments
  • Sub-level: analyze the explanations why participants choose the specific reason in the Main level
3.2.1.3.2.1 Motivational (Main Level)

We asked: What’s the main reason you don’t want to be vaccinated?

Provided options:

  • there’s no clear benefit (benefit)
  • it’s too risky (risk)
  • against my beliefs (belief)

The distribution of the answers demonstrates below:

3.2.1.3.2.2 Motivational (Sub-Level)

No Benefit

We asked: is there a main reason why you think there isn’t a benefit?

Provided options:

  • covid not dangerous
  • unlikely to get sick
  • had covid already
  • i can recover
  • other reason(s)

The distribution of the answers demonstrates below:

Risky

We asked: is there a main reason why you think there is risk?

Provided options:

  • don’t trust pharma
  • vaccines don’t work
  • bad side effects
  • needles/pain
  • other reason(s)

The distribution of the answers demonstrates below:

Against Beliefs

We asked: is there a main reason why against your belief?

Provided options:

  • don’t trust gov
  • religious reasons
  • freedom to choose
  • other reason(s)

The distribution of the answers demonstrates below:

3.2.1.3.2.3 Ability (Main Level)

We asked: What’s the main difficulty of getting vaccinated?

Provided options:

  • no vax available (availability)
  • lack of time (time)
  • lack of money (money)

The distribution of the answers demonstrates below:

3.2.1.3.2.4 Ability (Sub-Level)

No Availability

We asked: is there a main reason why there isn’t availability?

Provided options:

  • too far away
  • no vaccines left
  • other reason(s)

No Time

We asked: is there a main reason why there isn’t time?

Provided options:

  • no time to research
  • getting off work
  • childcare
  • other reason(s)

No Money

We asked: is there a main reason why there isn’t money?

Provided options:

  • travel costs
  • no insurance
  • no cost


3.2.2 New Treatments

What new treatments were mentioned (e.g., in “other reason(s)”) that we should potentially add to our next iteration of our pilot?

Free text treatments suggested by participants:

3.2.3 New impediments

What new impediments were mentioned (e.g., in “other reason(s)”) that we should potentially add to our next iteration of our pilot?

Free text motivation impediments suggested by participants:


Free text ability impediments suggested by participants:

3.2.4 New forking

Which fork path has the highest amount of false positives, and warrants a reevaluation of how we edit/rephrase the forking question?

Misforking proxy checks: This proxy gives us the proportion of respondents who felt our provided options within the fork were not exhaustive. The misforked respondents could be a subset of this (and hence this can be considered an upper bound). The cleanest way would be to flag free text responses as misforked (0/1) and then re-calculate these proportions).

Motive fork has 32% other responses.

flag n percent
FALSE 721 0.6834123
TRUE 334 0.3165877

Ability fork has 26% other responses.

flag n percent
FALSE 294 0.7386935
TRUE 104 0.2613065


4 Appendix Analysis

4.1 Ad-recruitment analysis

Goals: Analyze which ad creative approaches result in the lowest-cost responses for unvax & open to treatment participants (while maintaining response quality), and propose changes to ad creative & targeting to improve this metric.

Details on each of the 15 ads used can be found here.

Setup:

  • 1 campaign
  • 5 ad sets, 3 ads in each ad set
  • 15 ads split into:
    • 3 impediment themes (3 inaccessible, 6 risky, 6 unnecessary)
    • 2 different prompts (6 control and 9 airtime)
    • 9 different images (Images 1-6 used twice, images 7-9 used once)

Metrics explanation:

  • Impressions (Total Count) = the total number of times our ad has been viewed
  • Clickthrough (%) = #clicks / #impressions
  • Messages Sent (%) = #conversations / #clicks
  • Consent Obtained (%) = #consents / #conversations
  • Core Survey Complete (%) = #forking section completed / #consents
  • Treatment Complete (%) = #treatment section completed / #forking section completed
  • Demo Questions Complete (%) = #demog section completed / #treatment section completed
  • Full Survey Complete (%) = #full chat completed / #demog section completed
  • Total characters elicited per completed survey (treatment) = average #character in best treatment explanation per full chat completed
  • Avg characters elicited per completed survey (impediment explanations) = average #character in impediment explanations per full chat completed
  • Cost per Impression = amount spent / #impressions (in USD)
  • Cost per Link Click = amount spent / #clicks (in USD)
  • Cost per Survey Complete (All participants) = amount spent / #full chat completed (in USD)
  • Cost per Survey Complete (Unvax) = amount spent / #full chat completed with unvaccinated participants (in USD)
  • Cost per Survey Complete (Unvax, Open to Treatment) = amount spent / #full chat completed with unvaccinated and open to treatment participants (in USD)

Let’s first look at overall costs.

4.1.1 Costs - Overall


Let’s now break things down by ad type. The following analyses show 3 tables using different combinations of 15 distinct ads:

  1. split by 3 ad impediment themes
  2. split by 2 ad body text approaches
  3. split by 9 ad images

4.1.2 Costs: By Ad-type

4.1.2.1 Unnecessary vs Risky vs Inaccessible ads

This table compared three Ad impediment sources (vaccine is unnecessary vs vaccine is risky vs vaccine is inaccessible) in terms of the metrics described above.


4.1.2.2 Control vs Airtime

This table compared two Ad body text approaches - control (share your opinion) vs (take a short survey and earn airtime) - in terms of the metrics described above.


4.1.2.3 Image-wise Split

This table compared nine images in terms of the metrics described above.



Let’s narrow our focus and now look at the costs per completed survey for every ad for only unvaccinated respondents.

4.1.3 Costs per completion: By Ad and Impediment

4.1.3.1 By overall impediments

First, let’s break these down for those with:

  • motivation impediments
  • ability impediments


4.1.3.2 By motivation sub-impediments

Costs per completed survey broken down by ad for those with motivation sub-impediments:

  • No benefits
  • Risky
  • Against beliefs


4.1.3.3 By ability sub-impediments

Costs per completed survey broken down by ad for those with ability sub-impediments:

  • No time
  • No money
  • No availability

Note: Blank cells represent no respondents for that ad-impediment combination.



4.1.4 Costs per completion: By ad and demographic

4.1.4.1 Gender

4.1.4.2 Education

4.1.4.3 Income

4.1.4.4 Religion

4.1.4.5 Location



4.1.5 Impediments by ad category clicked

4.1.5.1 Motivational

4.1.5.2 Ability

4.2 Chatbot Engagement Analysis

Goals: Identify ways to improve chatbot engagement by analyzing comfort, enjoyment, parts that can be improved further, and drop-off statistics.

4.2.1 Funnel Analysis

We first consider the funnel dropoff and cost comparison across the last two pilot waves.


Dropoff by Fork Path (Motivation/Ability/Both/None) for current pilot

This table looks at how much respondents dropoff from their conversation based on what impediments they have grouped by vaccination status. Note that if the respondents have both motivation and ability impediments, they will need to fill out both the ability and the motivation section (i.e. twice the length). Note:Percentages are calculated within the group.

Impediment Dropoff count (unvax) Dropoff % (unvax) Dropoff count (vax) Dropoff % (vax)
Both motivation and ability 81 31.27 20 18.18
Ability 4 23.53 65 35.71
Motivation 83 16.50 25 6.38
None 15 14.56 203 26.54

4.2.2 Engagement Analysis

Enjoyment levels for current and previous pilots. Please note that we filter out responses that do not belong to one of the three pre-defined choices shown.

Takeaway: Most participants enjoyed interacting with the chatbot.

Comfort levels for current and past pilots:

Takeaway: Most participants were comfortable interacting with the chatbot.


Parts to improve:

4.2.2.1 Parts not enjoyable (n = 54)

4.2.2.2 Parts not comfortable (n = 68)