Purpose

  • The purpose of this script is to clean the raw FB Misinformation Chatfuel followup data, document key decisions made, and generate two clean datasets for further analysis.

The key outputs are as follows:

  1. A wide-form dataset, misinfo_followup_clean_wide.csv
  • This dataset contains one row per respondent. It includes all the responents who consented to the follow up study and passed data-quality checks, regardless of whether they finished the follow-up misinformation quiz. For the users who did not complete followup quiz, the relevant variables are set to missing.
  1. A long-form dataset, misinfo_followup_clean_long.csv
  • This dataset contains 5 rows per respondent, one for each post (excluding attention check) that the user saw. It includes only the respondents who completed the followup quiz, and passed data-quality checks (such as there being no missing values for the quiz questions).

Summary

  • The cleaning begins by loading the anonymized version of the dataset, which is stored in Github directory ~fb_misinfo_interventions/data/chatfuel/raw. The raw Chatfuel dataset was last pulled on 02/20/2024 and processed by the anonymization script. The anonymized version of dataset contains the variable analytic_id as the unique identifier for each respondent.

  • We classified individuals who began the follow-up process by noting a timestamp in the MisinfoChat_start_time_followup. To ensure participant uniqueness, we compared the quantity of unique analytical_id to the total number of rows, confirming that each entry is indeed unique.

  • We defined time_since_completed_intervention as the time duration between completing the intervention and starting the follow up. We also defined time_since_completed_quiz as the time duration between completing the main survey misinformation quiz and starting the follow up.

  • We only selected participants who consented by answering “I consent, start now” to the consent_followup variable. To align with IRB, responses that expressed agreement were not considered the same as “I consent, start now”.

  • We performed a series of checks for abnormality including:

    1. We identified participants who did not have a recorded entry for completing the chatbot, but started the follow up. These participants were dropped from dataset.
    2. We identified participants who have negative time duration for completing the followup. These participants were dropped from dataset.
    3. For the text responses at the end of the follow up, we noticed a Chatfuel bug largely caused by internet interuption where actual responses were recorded as random links. Abnormal responses were coded as binary variables for future exclusion from the dataset.

  • For the purpose of our analysis, we dropped participants with at least one missing value in sharing, manipulative, reliability scores. Participants who completed the follow up survey is defined as not having any missing values in all of the follow up quiz questions.

  • We noticed 583 participants who completed the follow-up misinformation quiz but were indicated as not completing the main survey misinformation quiz. We generated a spreadsheet named abnormal_completed_followup.csv.gz to analyze these participants in more detail. The spreadsheet is stored at ~fb_misinfo_interventions/data/chatfuel/processed/. We noticed that these participants who at least one missing values for main survey quiz variables. None of them had all missing values for all quiz variables in the main survey. These participants had non missing values for all of the follow-up quiz variables. The primary cause of this issue is attributed to the lack of forced responses for quiz questions in the main survey misinformation quiz between November 16, 2023, and November 30, 2023. Consequently, participants could advance to subsequent quiz questions by entering any response into the Chatbot. In our main cleaning script, we classified responses that differed from the predefined selections as missing values. Therefore, those participants who responded to the quiz questions without choosing the predetermined options were deemed to have not completed the main survey misinformation quiz. We will drop these 583 participants from the dataset.

Loading the anonymized dataset for cleaning

Data

The raw data for was downloaded from Chatfuel and undergone an anonymization process before being stored in Sherlock. The anynomized data was then downloaded from Sherlock and stored in the data folder. We also checked to make sure all observations are unique by comparing the number of unique id with the number of observations in the dataset.

  • The anonymized dataset is stored in Github directory ~fb_misinfo_interventions/data/chatfuel

  • The working file path is ~fb_misinfo_interventions/code/SurveyAnalysis/

# file path `~fb_misinfo_interventions/data/chatfuel/raw`
data <- fread("./data/chatfuel/raw/fbmisinfo_anon.csv.gz")

clean_data_wide <- fread("./data/chatfuel/processed/misinfo_clean_wide.csv.gz")

Analyzing the follow up data

  • We identified people who started the follow up by checking for the recorded entry in the MisinfoChat_start_time_followup variable.
data_followup <- data %>% 
  filter(!is.na(MisinfoChat_start_time_followup))

n_start_followup = as.character(nrow(data_followup))
  • We identifed 24631 people who started the follow up.

Select follow-up participants whose analytic_id appeared in the clean version of the wide dataset for the main survey

  • We filtered out follow-up participants whose analytic_id appear on the the clean wide-form dataset for the main survey. This is to ensure that we only include participants who passed quality checks in the main survey.
data_followup <- data_followup %>% 
  filter(analytic_id %in% clean_data_wide$analytic_id)
n_start_followup2 = as.character(nrow(data_followup)) 

diff = as.character(as.numeric(n_start_followup) - as.numeric(n_start_followup2))

  • After filtering for analytic_id that appears in the cleaned wide dataset, we have 22193 people who started the follow up. We dropped 2438 participants.

  • The users dropped include, among others, the actual repeaters who started the initial chatbot multiple times.

Checking for abnormal entries

  • In the clean data set for the main survey, the variable quiz_completed_coded records main survey quiz completer. We define main survey quiz completers as participants who did not have a missing value for the end time stamp for the misinformation quiz AND those who did not have missing values for the quiz questions in the main survey.

  • We identified participants who started the follow up but did not have a recorded entry for having completed the original chatbot.

abnormal_complete <- data_followup %>%
  select(analytic_id, MisinfoChat_start_time_followup) 

check_abnormal_complete <- clean_data_wide %>% 
  select(analytic_id, quiz_completed_coded, phase_coded, arm_coded, consent_coded_num, intervention_duration, attention_check_passed) %>%
  filter(quiz_completed_coded == "FALSE") %>%
  filter(analytic_id %in% abnormal_complete$analytic_id)

n_abnormal_complete <- as.character(nrow(check_abnormal_complete))

check_abnormal_complete %>%
  kable("html") %>%
  kableExtra::kable_styling(bootstrap_options = c("striped", "hover")) %>%
  scroll_box(width = "100%", height = "400px")
analytic_id quiz_completed_coded phase_coded arm_coded consent_coded_num intervention_duration attention_check_passed
590_2023-11-17 03:17:33_2023-11-17 03:17:33 FALSE Phase 1 Original Baseline 1 10.866667 NA
663_2023-11-17 04:14:38_2023-11-17 04:44:42 FALSE Phase 1 Original Baseline 1 6.066667 NA
687_2023-11-17 05:09:44_2023-11-17 05:09:44 FALSE Phase 1 Video 1 399.833333 NA
776_2023-11-17 06:03:46_2023-11-17 06:03:46 FALSE Phase 1 SMS 1 21.516667 NA
1007_2023-11-17 08:10:30_2023-11-17 08:10:30 FALSE Phase 1 Video 1 16.033333 NA
1103_2023-11-17 08:51:47_2023-11-17 08:51:47 FALSE Phase 1 Game 1 279.550000 NA
1141_2023-11-17 09:07:26_2023-11-17 09:08:01 FALSE Phase 1 Original Baseline 1 30.083333 NA
1190_2023-11-17 09:30:41_2023-11-17 09:30:41 FALSE Phase 1 SMS 1 12.133333 NA
1196_2023-11-17 09:31:45_2023-11-17 09:31:45 FALSE Phase 1 SMS 1 30.416667 NA
1211_2023-11-17 09:38:27_2023-11-17 09:38:27 FALSE Phase 1 Game 1 30.883333 NA
1238_2023-11-17 09:50:41_2023-11-17 09:50:41 FALSE Phase 1 Video 1 20.966667 NA
1250_2023-11-17 09:57:22_2023-11-17 09:57:22 FALSE Phase 1 SMS 1 21.500000 NA
1535_2023-11-17 11:46:34_2023-11-17 11:46:34 FALSE Phase 1 Game 1 172.200000 NA
1547_2023-11-17 11:49:51_2023-11-17 11:49:51 FALSE Phase 1 Video 1 11.150000 NA
1580_2023-11-17 11:59:48_2023-11-17 11:59:48 FALSE Phase 1 Game 1 6.716667 NA
1701_2023-11-17 12:47:40_2023-11-17 12:47:40 FALSE Phase 1 Video 1 20.683333 NA
1832_2023-11-17 13:39:39_2023-11-17 13:39:39 FALSE Phase 1 Original Baseline 1 60.950000 NA
1946_2023-11-17 14:15:47_2023-11-17 14:15:47 FALSE Phase 1 Original Baseline 1 8.633333 NA
1963_2023-11-17 14:22:17_2023-11-17 14:22:17 FALSE Phase 1 Video 1 16.133333 NA
1999_2023-11-17 14:40:57_2023-11-17 14:40:57 FALSE Phase 1 Game 1 10.916667 NA
2000_2023-11-17 14:41:38_2023-11-17 14:41:38 FALSE Phase 1 Original Baseline 1 10.850000 NA
2001_2023-11-17 14:41:41_2023-11-17 14:41:41 FALSE Phase 1 Original Baseline 1 10.666667 NA
2026_2023-11-17 14:50:32_2023-11-17 14:50:32 FALSE Phase 1 Original Baseline 1 7.583333 NA
2041_2023-11-17 14:55:51_2023-11-17 14:55:51 FALSE Phase 1 Video 1 14.166667 NA
2102_2023-11-17 15:21:24_2023-11-17 15:21:24 FALSE Phase 1 Game 1 45.283333 NA
2174_2023-11-17 15:54:46_2023-11-17 15:54:46 FALSE Phase 1 Original Baseline 1 11.966667 NA
2212_2023-11-17 16:13:09_2023-11-17 16:13:09 FALSE Phase 1 Game 1 34.316667 NA
2311_2023-11-17 16:49:41_2023-11-17 16:49:42 FALSE Phase 1 Game 1 36.716667 NA
2364_2023-11-17 17:13:47_2023-11-17 17:13:47 FALSE Phase 1 SMS 1 34.050000 NA
2384_2023-11-17 17:20:55_2023-11-17 17:20:55 FALSE Phase 1 Video 1 193.866667 NA
2645_2023-11-17 18:59:35_2023-11-17 18:59:35 FALSE Phase 1 Video 1 11.350000 NA
2701_2023-11-17 19:20:12_2023-11-17 19:20:13 FALSE Phase 1 SMS 1 19.633333 NA
2725_2023-11-17 12:06:38_2023-11-17 19:26:51 FALSE Phase 1 Video 1 21.400000 NA
2784_2023-11-17 03:54:27_2023-11-17 19:43:16 FALSE Phase 1 Video 1 11.750000 NA
2818_2023-11-17 19:52:50_2023-11-17 19:52:50 FALSE Phase 1 Video 1 20.866667 NA
2889_2023-11-17 20:13:39_2023-11-17 20:15:07 FALSE Phase 1 Original Baseline 1 10.866667 NA
3024_2023-11-18 03:20:16_2023-11-18 03:20:16 FALSE Phase 1 Original Baseline 1 14.483333 NA
3056_2023-11-18 05:10:35_2023-11-18 05:10:35 FALSE Phase 1 SMS 1 23.566667 NA
3089_2023-11-18 05:23:40_2023-11-18 05:23:40 FALSE Phase 1 Video 1 12.733333 NA
3174_2023-11-18 05:43:14_2023-11-18 05:43:14 FALSE Phase 1 Video 1 12.550000 NA
3217_2023-11-18 05:53:23_2023-11-18 05:53:23 FALSE Phase 1 Game 1 73.633333 NA
3352_2023-11-17 13:52:05_2023-11-18 06:30:04 FALSE Phase 1 SMS 1 14.283333 NA
3359_2023-11-18 05:59:12_2023-11-18 06:31:42 FALSE Phase 1 Video 1 23.883333 NA
3374_2023-11-18 06:35:31_2023-11-18 06:35:31 FALSE Phase 1 Game 1 7.700000 NA
3516_2023-11-18 07:12:25_2023-11-18 07:12:25 FALSE Phase 1 Video 1 102.750000 NA
3600_2023-11-18 07:39:53_2023-11-18 07:39:53 FALSE Phase 1 Game 1 10.533333 NA
3619_2023-11-18 07:43:58_2023-11-18 07:43:58 FALSE Phase 1 SMS 1 23.200000 NA
3634_2023-11-18 07:47:26_2023-11-18 07:47:26 FALSE Phase 1 Original Baseline 1 16.116667 NA
3736_2023-11-18 08:20:41_2023-11-18 08:20:41 FALSE Phase 1 SMS 1 11.566667 NA
3760_2023-11-18 08:25:54_2023-11-18 08:25:54 FALSE Phase 1 Original Baseline 1 6.666667 NA
3800_2023-11-18 08:35:06_2023-11-18 08:35:06 FALSE Phase 1 SMS 1 24.816667 NA
3885_2023-11-18 09:04:46_2023-11-18 09:04:46 FALSE Phase 1 Video 1 21.066667 NA
3976_2023-11-18 09:35:29_2023-11-18 09:35:29 FALSE Phase 1 SMS 1 19.783333 NA
4196_2023-11-18 06:15:42_2023-11-18 10:46:33 FALSE Phase 1 SMS 1 17.450000 NA
4211_2023-11-18 10:50:26_2023-11-18 10:50:26 FALSE Phase 1 Original Baseline 1 15.833333 NA
4262_2023-11-18 11:04:13_2023-11-18 11:04:13 FALSE Phase 1 Video 1 11.483333 NA
4483_2023-11-18 12:08:23_2023-11-18 12:08:23 FALSE Phase 1 Video 1 18.050000 NA
4583_2023-11-18 12:35:41_2023-11-18 12:35:41 FALSE Phase 1 Original Baseline 1 25.333333 NA
4600_2023-11-18 12:42:03_2023-11-18 12:42:03 FALSE Phase 1 Video 1 11.116667 NA
4626_2023-11-18 12:17:54_2023-11-18 12:51:33 FALSE Phase 1 SMS 1 21.383333 NA
4634_2023-11-17 17:43:01_2023-11-18 12:53:18 FALSE Phase 1 Video 1 14.933333 NA
4686_2023-11-18 13:11:27_2023-11-18 13:11:27 FALSE Phase 1 Game 1 8.683333 NA
4701_2023-11-18 13:14:31_2023-11-18 13:14:31 FALSE Phase 1 Video 1 13.333333 NA
4706_2023-11-18 13:17:04_2023-11-18 13:17:04 FALSE Phase 1 Original Baseline 1 9.516667 NA
4726_2023-11-18 13:22:16_2023-11-18 13:22:16 FALSE Phase 1 Video 1 10.833333 NA
4750_2023-11-18 13:28:17_2023-11-18 13:28:19 FALSE Phase 1 Original Baseline 1 9.350000 NA
4758_2023-11-18 13:32:04_2023-11-18 13:32:04 FALSE Phase 1 SMS 1 13.616667 NA
4907_2023-11-18 07:36:55_2023-11-18 14:09:29 FALSE Phase 1 Original Baseline 1 5.916667 NA
4917_2023-11-18 14:11:19_2023-11-18 14:11:19 FALSE Phase 1 SMS 1 43.033333 NA
5011_2023-11-18 14:36:36_2023-11-18 14:36:36 FALSE Phase 1 SMS 1 59.350000 NA
5029_2023-11-18 14:40:49_2023-11-18 14:40:49 FALSE Phase 1 Game 1 20.650000 NA
5092_2023-11-18 10:35:14_2023-11-18 15:00:50 FALSE Phase 1 Game 1 18.383333 NA
5131_2023-11-17 03:51:47_2023-11-18 15:09:38 FALSE Phase 1 SMS 1 2674.683333 NA
5191_2023-11-18 06:47:18_2023-11-18 15:24:49 FALSE Phase 1 Original Baseline 1 6.250000 NA
5238_2023-11-18 15:38:25_2023-11-18 15:38:25 FALSE Phase 1 Video 1 13.100000 NA
5502_2023-11-18 16:55:53_2023-11-18 16:55:53 FALSE Phase 1 Original Baseline 1 5.800000 NA
5536_2023-11-18 17:06:41_2023-11-18 17:06:41 FALSE Phase 1 Original Baseline 1 16.150000 NA
5666_2023-11-18 17:43:44_2023-11-18 17:43:44 FALSE Phase 1 SMS 1 16.850000 NA
5790_2023-11-18 18:17:50_2023-11-18 18:17:50 FALSE Phase 1 SMS 1 17.350000 NA
5815_2023-11-18 18:24:41_2023-11-18 18:24:41 FALSE Phase 1 Game 1 29.400000 NA
5951_2023-11-18 19:01:08_2023-11-18 19:01:08 FALSE Phase 1 SMS 1 12.350000 NA
5976_2023-11-18 19:06:49_2023-11-18 19:06:49 FALSE Phase 1 Game 1 18.900000 NA
6035_2023-11-18 19:20:13_2023-11-18 19:20:13 FALSE Phase 1 SMS 1 15.950000 NA
6045_2023-11-18 19:21:56_2023-11-18 19:21:56 FALSE Phase 1 SMS 1 13.783333 NA
6082_2023-11-18 19:31:00_2023-11-18 19:31:00 FALSE Phase 1 Video 1 5281.750000 NA
6110_2023-11-18 19:36:27_2023-11-18 19:36:27 FALSE Phase 1 Original Baseline 1 12.966667 NA
6258_2023-11-18 20:16:19_2023-11-18 20:16:19 FALSE Phase 1 Original Baseline 1 11.000000 NA
6283_2023-11-17 16:33:01_2023-11-18 20:20:56 FALSE Phase 1 Video 1 12.566667 NA
6289_2023-11-18 20:22:45_2023-11-18 20:22:45 FALSE Phase 1 Video 1 12.500000 NA
6541_2023-11-19 01:03:18_2023-11-19 01:03:27 FALSE Phase 1 Original Baseline 1 16.000000 NA
6616_2023-11-19 02:53:24_2023-11-19 02:53:24 FALSE Phase 1 SMS 1 17.833333 NA
6728_2023-11-19 04:17:58_2023-11-19 04:17:58 FALSE Phase 1 Game 1 9.900000 NA
6733_2023-11-19 04:20:58_2023-11-19 04:20:58 FALSE Phase 1 Video 1 18.483333 NA
6765_2023-11-19 04:38:45_2023-11-19 04:38:45 FALSE Phase 1 Video 1 10.250000 NA
6770_2023-11-19 04:40:57_2023-11-19 04:40:57 FALSE Phase 1 Video 1 20.700000 NA
6909_2023-11-19 05:23:44_2023-11-19 05:23:44 FALSE Phase 1 Original Baseline 1 8.533333 NA
6914_2023-11-19 05:24:32_2023-11-19 05:24:32 FALSE Phase 1 Game 1 1644.133333 NA
6921_2023-11-19 05:27:29_2023-11-19 05:27:29 FALSE Phase 1 Video 1 11.700000 NA
6939_2023-11-19 05:33:10_2023-11-19 05:33:10 FALSE Phase 1 SMS 1 19.333333 NA
7062_2023-11-19 06:09:31_2023-11-19 06:09:31 FALSE Phase 1 SMS 1 12.716667 NA
7172_2023-11-19 06:36:54_2023-11-19 06:36:55 FALSE Phase 1 Original Baseline 1 14.483333 NA
7206_2023-11-19 06:44:18_2023-11-19 06:44:18 FALSE Phase 1 Video 1 20.250000 NA
7315_2023-11-19 07:10:58_2023-11-19 07:10:58 FALSE Phase 1 Original Baseline 1 8.766667 NA
7394_2023-11-19 06:16:30_2023-11-19 07:30:59 FALSE Phase 1 SMS 1 13.983333 NA
7423_2023-11-19 07:37:22_2023-11-19 07:37:22 FALSE Phase 1 Original Baseline 1 23.933333 NA
7430_2023-11-19 07:39:08_2023-11-19 07:39:08 FALSE Phase 1 Video 1 38.250000 NA
7462_2023-11-18 12:18:12_2023-11-19 07:46:11 FALSE Phase 1 SMS 1 18.650000 NA
7480_2023-11-19 07:49:21_2023-11-19 07:49:21 FALSE Phase 1 SMS 1 12.316667 NA
7662_2023-11-19 08:31:11_2023-11-19 08:31:11 FALSE Phase 1 SMS 1 16.233333 NA
7683_2023-11-19 08:35:43_2023-11-19 08:35:43 FALSE Phase 1 Game 1 7.433333 NA
7688_2023-11-19 08:37:42_2023-11-19 08:37:42 FALSE Phase 1 Game 1 7.333333 NA
7897_2023-11-19 09:23:35_2023-11-19 09:23:35 FALSE Phase 1 Original Baseline 1 9.266667 NA
7924_2023-11-19 09:28:27_2023-11-19 09:28:27 FALSE Phase 1 Original Baseline 1 24.500000 NA
7973_2023-11-18 18:16:58_2023-11-19 09:40:15 FALSE Phase 1 Game 1 6.316667 NA
8025_2023-11-19 09:50:20_2023-11-19 09:50:20 FALSE Phase 1 Video 1 4977.950000 NA
8090_2023-11-19 10:04:54_2023-11-19 10:04:54 FALSE Phase 1 SMS 1 118.966667 NA
8138_2023-11-19 10:15:57_2023-11-19 10:15:57 FALSE Phase 1 Game 1 58.133333 NA
8173_2023-11-19 10:22:05_2023-11-19 10:22:05 FALSE Phase 1 Video 1 23.516667 NA
8277_2023-11-19 10:45:29_2023-11-19 10:45:29 FALSE Phase 1 Game 1 6.516667 NA
8305_2023-11-19 10:53:09_2023-11-19 10:53:10 FALSE Phase 1 SMS 1 21.216667 NA
8634_2023-11-19 11:55:39_2023-11-19 11:55:39 FALSE Phase 1 Original Baseline 1 17.233333 NA
8667_2023-11-19 10:53:52_2023-11-19 12:02:39 FALSE Phase 1 Original Baseline 1 10.133333 NA
8702_2023-11-19 12:09:05_2023-11-19 12:09:05 FALSE Phase 1 Original Baseline 1 6.883333 NA
8704_2023-11-19 12:09:19_2023-11-19 12:09:19 FALSE Phase 1 Original Baseline 1 8.750000 NA
8733_2023-11-19 12:14:26_2023-11-19 12:14:26 FALSE Phase 1 SMS 1 13.500000 NA
8805_2023-11-19 12:29:41_2023-11-19 12:29:41 FALSE Phase 1 Game 1 13.666667 NA
8830_2023-11-19 12:34:58_2023-11-19 12:34:58 FALSE Phase 1 Original Baseline 1 22.700000 NA
8860_2023-11-19 12:42:28_2023-11-19 12:42:28 FALSE Phase 1 Video 1 5900.683333 NA
9019_2023-11-19 13:12:23_2023-11-19 13:12:23 FALSE Phase 1 SMS 1 168.850000 NA
9022_2023-11-19 08:47:08_2023-11-19 13:12:45 FALSE Phase 1 Game 1 191.383333 NA
9037_2023-11-19 13:15:38_2023-11-19 13:15:38 FALSE Phase 1 Video 1 9.783333 NA
9091_2023-11-19 13:27:04_2023-11-19 13:27:04 FALSE Phase 1 SMS 1 21.783333 NA
9153_2023-11-19 13:40:18_2023-11-19 13:40:18 FALSE Phase 1 Original Baseline 1 18.850000 NA
9321_2023-11-19 14:18:46_2023-11-19 14:18:46 FALSE Phase 1 SMS 1 30.733333 NA
9438_2023-11-19 11:53:29_2023-11-19 14:43:34 FALSE Phase 1 Game 1 23.183333 NA
9550_2023-11-19 15:06:44_2023-11-19 15:06:44 FALSE Phase 1 Video 1 19.633333 NA
9568_2023-11-18 12:19:44_2023-11-19 15:11:04 FALSE Phase 1 Original Baseline 1 8.333333 NA
9588_2023-11-19 15:18:18_2023-11-19 15:18:18 FALSE Phase 1 Original Baseline 1 17.150000 NA
9595_2023-11-19 15:20:35_2023-11-19 15:20:35 FALSE Phase 1 Game 1 8.316667 NA
9653_2023-11-19 15:32:36_2023-11-19 15:32:36 FALSE Phase 1 SMS 1 12.133333 NA
9657_2023-11-19 15:33:39_2023-11-19 15:33:39 FALSE Phase 1 Game 1 17.100000 NA
9737_2023-11-19 15:53:21_2023-11-19 15:53:21 FALSE Phase 1 Video 1 40.883333 NA
9857_2023-11-19 16:23:32_2023-11-19 16:23:33 FALSE Phase 1 Original Baseline 1 11.000000 NA
9871_2023-11-19 16:27:14_2023-11-19 16:27:14 FALSE Phase 1 SMS 1 14.666667 NA
10026_2023-11-19 08:08:54_2023-11-19 17:09:19 FALSE Phase 1 Video 1 12.933333 NA
10227_2023-11-19 17:56:11_2023-11-19 17:56:11 FALSE Phase 1 Video 1 10.750000 NA
10245_2023-11-19 17:59:00_2023-11-19 17:59:00 FALSE Phase 1 Original Baseline 1 8.316667 NA
10252_2023-11-19 18:00:29_2023-11-19 18:00:29 FALSE Phase 1 Original Baseline 1 8.566667 NA
10323_2023-11-17 13:33:59_2023-11-19 18:17:15 FALSE Phase 1 Original Baseline 1 14.450000 NA
10432_2023-11-19 18:34:34_2023-11-19 18:34:34 FALSE Phase 1 Video 1 13.000000 NA
10507_2023-11-19 15:43:50_2023-11-19 18:51:15 FALSE Phase 1 Original Baseline 1 6.650000 NA
10521_2023-11-19 18:53:36_2023-11-19 18:53:36 FALSE Phase 1 SMS 1 17.366667 NA
10637_2023-11-19 19:16:29_2023-11-19 19:16:29 FALSE Phase 1 Original Baseline 1 9.083333 NA
10655_2023-11-19 19:17:15_2023-11-19 19:19:08 FALSE Phase 1 Video 1 11.816667 NA
10728_2023-11-19 19:29:50_2023-11-19 19:30:37 FALSE Phase 1 Game 1 14.200000 NA
10739_2023-11-19 19:34:41_2023-11-19 19:34:41 FALSE Phase 1 SMS 1 12.033333 NA
10794_2023-11-19 19:43:32_2023-11-19 19:43:32 FALSE Phase 1 Game 1 14.150000 NA
11082_2023-11-19 20:45:10_2023-11-19 20:45:10 FALSE Phase 1 Original Baseline 1 14.083333 NA
11100_2023-11-19 20:50:35_2023-11-19 20:50:35 FALSE Phase 1 Game 1 14.283333 NA
11111_2023-11-19 20:53:09_2023-11-19 20:53:09 FALSE Phase 1 Original Baseline 1 7.700000 NA
11141_2023-11-19 21:03:06_2023-11-19 21:03:06 FALSE Phase 1 Game 1 34.733333 NA
11199_2023-11-19 20:21:07_2023-11-19 21:22:41 FALSE Phase 1 Video 1 10.700000 NA
11235_2023-11-19 21:35:30_2023-11-19 21:35:30 FALSE Phase 1 Game 1 13.250000 NA
11332_2023-11-19 22:20:34_2023-11-19 22:20:34 FALSE Phase 1 Game 1 36.683333 NA
11416_2023-11-19 23:41:39_2023-11-19 23:41:39 FALSE Phase 1 Original Baseline 1 8.850000 NA
11424_2023-11-19 23:50:33_2023-11-19 23:50:33 FALSE Phase 1 SMS 1 22.416667 NA
11502_2023-11-20 02:05:56_2023-11-20 02:05:56 FALSE Phase 1 Game 1 14.950000 NA
11534_2023-11-20 02:48:29_2023-11-20 02:48:29 FALSE Phase 1 Original Baseline 1 8.083333 NA
11608_2023-11-20 03:50:13_2023-11-20 03:50:13 FALSE Phase 1 Video 1 465.150000 NA
11619_2023-11-20 03:57:51_2023-11-20 03:57:51 FALSE Phase 1 SMS 1 19.566667 NA
11650_2023-11-20 04:21:57_2023-11-20 04:21:57 FALSE Phase 1 Game 1 31.116667 NA
11654_2023-11-20 04:23:24_2023-11-20 04:23:24 FALSE Phase 1 Game 1 15.950000 NA
11674_2023-11-20 04:34:40_2023-11-20 04:34:40 FALSE Phase 1 Video 1 15.200000 NA
11680_2023-11-20 04:37:14_2023-11-20 04:37:14 FALSE Phase 1 Game 1 7.233333 NA
11706_2023-11-20 04:51:18_2023-11-20 04:51:18 FALSE Phase 1 Video 1 284.000000 NA
11715_2023-11-20 04:57:06_2023-11-20 04:57:06 FALSE Phase 1 Video 1 14.000000 NA
11836_2023-11-20 05:42:05_2023-11-20 05:42:05 FALSE Phase 1 SMS 1 15.016667 NA
11878_2023-11-20 05:55:22_2023-11-20 05:55:22 FALSE Phase 1 Original Baseline 1 9.333333 NA
11906_2023-11-20 06:05:57_2023-11-20 06:05:57 FALSE Phase 1 Game 1 9.816667 NA
11978_2023-11-20 06:27:11_2023-11-20 06:27:11 FALSE Phase 1 Game 1 6.566667 NA
11982_2023-11-20 06:28:09_2023-11-20 06:28:09 FALSE Phase 1 Game 1 299.350000 NA
11984_2023-11-19 15:34:39_2023-11-20 06:28:31 FALSE Phase 1 SMS 1 13.000000 NA
12000_2023-11-20 06:34:17_2023-11-20 06:34:17 FALSE Phase 1 SMS 1 28.666667 NA
12009_2023-11-20 06:37:15_2023-11-20 06:37:15 FALSE Phase 1 SMS 1 16.366667 NA
12012_2023-11-20 06:05:27_2023-11-20 06:37:42 FALSE Phase 1 Video 1 164.083333 NA
12086_2023-11-20 06:59:55_2023-11-20 06:59:55 FALSE Phase 1 SMS 1 13.800000 NA
12101_2023-11-20 07:07:02_2023-11-20 07:07:02 FALSE Phase 1 Game 1 27.200000 NA
12102_2023-11-20 07:07:04_2023-11-20 07:07:04 FALSE Phase 1 Original Baseline 1 138.650000 NA
12111_2023-11-20 07:08:50_2023-11-20 07:08:52 FALSE Phase 1 SMS 1 15.783333 NA
12236_2023-11-19 11:24:13_2023-11-20 07:49:20 FALSE Phase 1 SMS 1 23.783333 NA
12264_2023-11-20 07:55:46_2023-11-20 07:55:52 FALSE Phase 1 Game 1 21.200000 NA
12283_2023-11-20 08:06:34_2023-11-20 08:06:34 FALSE Phase 1 Video 1 11.233333 NA
12325_2023-11-17 20:22:10_2023-11-20 08:17:45 FALSE Phase 1 Original Baseline 1 6.450000 NA
12359_2023-11-20 08:27:25_2023-11-20 08:27:25 FALSE Phase 1 Original Baseline 1 12.883333 NA
12374_2023-11-18 09:04:04_2023-11-20 08:34:29 FALSE Phase 1 SMS 1 14.516667 NA
12429_2023-11-20 08:57:13_2023-11-20 08:57:21 FALSE Phase 1 Game 1 6.700000 NA
12436_2023-11-20 09:00:36_2023-11-20 09:00:36 FALSE Phase 1 Game 1 59.583333 NA
12453_2023-11-18 10:09:00_2023-11-20 09:10:28 FALSE Phase 1 Game 1 23.916667 NA
12605_2023-11-20 10:03:02_2023-11-20 10:03:02 FALSE Phase 1 SMS 1 20.283333 NA
12643_2023-11-20 10:18:20_2023-11-20 10:18:20 FALSE Phase 1 Game 1 8.016667 NA
12665_2023-11-20 10:26:47_2023-11-20 10:26:47 FALSE Phase 1 Game 1 40.850000 NA
12715_2023-11-19 21:02:14_2023-11-20 10:37:10 FALSE Phase 1 SMS 1 16.366667 NA
12748_2023-11-20 10:45:34_2023-11-20 10:45:34 FALSE Phase 1 SMS 1 17.283333 NA
12760_2023-11-20 10:48:53_2023-11-20 10:48:53 FALSE Phase 1 Video 1 14.100000 NA
12814_2023-11-20 11:06:38_2023-11-20 11:06:38 FALSE Phase 1 Game 1 6.333333 NA
12832_2023-11-20 11:14:36_2023-11-20 11:14:36 FALSE Phase 1 Original Baseline 1 12.566667 NA
12871_2023-11-20 11:27:10_2023-11-20 11:27:10 FALSE Phase 1 Original Baseline 1 323.583333 NA
12948_2023-11-20 11:53:11_2023-11-20 11:53:11 FALSE Phase 1 SMS 1 16.766667 NA
12994_2023-11-20 12:07:17_2023-11-20 12:07:17 FALSE Phase 1 SMS 1 11.416667 NA
13008_2023-11-20 12:13:04_2023-11-20 12:13:04 FALSE Phase 1 SMS 1 13.066667 NA
13036_2023-11-20 12:23:00_2023-11-20 12:23:00 FALSE Phase 1 Original Baseline 1 12.916667 NA
13037_2023-11-20 12:23:18_2023-11-20 12:23:18 FALSE Phase 1 SMS 1 12.066667 NA
13046_2023-11-20 11:28:50_2023-11-20 12:26:52 FALSE Phase 1 Video 1 30.916667 NA
13055_2023-11-20 12:30:41_2023-11-20 12:30:41 FALSE Phase 1 SMS 1 17.083333 NA
13064_2023-11-20 12:35:12_2023-11-20 12:35:12 FALSE Phase 1 SMS 1 11.083333 NA
13122_2023-11-20 10:56:59_2023-11-20 12:51:11 FALSE Phase 1 Original Baseline 1 25.266667 NA
13165_2023-11-20 13:06:22_2023-11-20 13:06:22 FALSE Phase 1 Original Baseline 1 8.216667 NA
13178_2023-11-19 16:14:45_2023-11-20 13:11:02 FALSE Phase 1 Original Baseline 1 17.666667 NA
13179_2023-11-20 13:11:07_2023-11-20 13:11:07 FALSE Phase 1 Game 1 16.583333 NA
13210_2023-11-18 17:01:49_2023-11-20 13:22:59 FALSE Phase 1 Game 1 15.166667 NA
13219_2023-11-20 00:19:37_2023-11-20 13:26:32 FALSE Phase 1 Original Baseline 1 8.833333 NA
13273_2023-11-20 13:45:05_2023-11-20 13:45:05 FALSE Phase 1 Video 1 5453.116667 NA
13331_2023-11-20 14:07:36_2023-11-20 14:07:36 FALSE Phase 1 Game 1 10.466667 NA
13338_2023-11-20 14:10:59_2023-11-20 14:10:59 FALSE Phase 1 Game 1 31.916667 NA
13343_2023-11-20 14:13:34_2023-11-20 14:13:34 FALSE Phase 1 Game 1 96.733333 NA
13383_2023-11-20 14:26:42_2023-11-20 14:26:42 FALSE Phase 1 Video 1 72.616667 NA
13402_2023-11-20 14:36:15_2023-11-20 14:36:15 FALSE Phase 1 Original Baseline 1 13.600000 NA
13403_2023-11-20 14:36:23_2023-11-20 14:36:23 FALSE Phase 1 Original Baseline 1 14.950000 NA
13422_2023-11-20 14:45:04_2023-11-20 14:45:05 FALSE Phase 1 Game 1 25.633333 NA
13475_2023-11-20 15:00:58_2023-11-20 15:00:58 FALSE Phase 1 Original Baseline 1 8.833333 NA
13535_2023-11-20 15:25:13_2023-11-20 15:25:13 FALSE Phase 1 Original Baseline 1 17.150000 NA
13623_2023-11-20 15:55:48_2023-11-20 15:55:48 FALSE Phase 1 SMS 1 14.666667 NA
13756_2023-11-20 16:50:41_2023-11-20 16:50:44 FALSE Phase 1 Game 1 31.366667 NA
13782_2023-11-20 17:04:05_2023-11-20 17:04:05 FALSE Phase 1 Original Baseline 1 10.383333 NA
13883_2023-11-20 17:54:58_2023-11-20 17:54:58 FALSE Phase 1 SMS 1 33.050000 NA
13903_2023-11-20 18:03:51_2023-11-20 18:03:51 FALSE Phase 1 Game 1 9.650000 NA
13909_2023-11-20 18:07:01_2023-11-20 18:07:01 FALSE Phase 1 Game 1 12.200000 NA
13989_2023-11-20 18:42:21_2023-11-20 18:42:21 FALSE Phase 1 Video 1 18.000000 NA
14056_2023-11-20 19:06:53_2023-11-20 19:06:53 FALSE Phase 1 Original Baseline 1 27.566667 NA
14164_2023-11-20 19:54:55_2023-11-20 19:54:55 FALSE Phase 1 SMS 1 13.216667 NA
14171_2023-11-20 19:57:50_2023-11-20 19:57:50 FALSE Phase 1 Video 1 104.383333 NA
14215_2023-11-20 20:14:31_2023-11-20 20:14:31 FALSE Phase 1 Video 1 2584.750000 NA
14233_2023-11-20 06:43:03_2023-11-20 20:21:36 FALSE Phase 1 Game 1 35.916667 NA
14234_2023-11-20 19:59:03_2023-11-20 20:22:21 FALSE Phase 1 Original Baseline 1 9.500000 NA
14253_2023-11-20 20:30:16_2023-11-20 20:30:16 FALSE Phase 1 Original Baseline 1 19.066667 NA
14277_2023-11-20 20:43:44_2023-11-20 20:43:44 FALSE Phase 1 Video 1 26.416667 NA
14305_2023-11-20 20:57:14_2023-11-20 20:57:46 FALSE Phase 1 Original Baseline 1 17.750000 NA
14342_2023-11-19 20:06:13_2023-11-20 21:13:10 FALSE Phase 1 Game 1 1437.333333 NA
14369_2023-11-20 21:16:02_2023-11-20 21:20:48 FALSE Phase 1 SMS 1 13.583333 NA
14408_2023-11-19 06:46:11_2023-11-20 21:38:21 FALSE Phase 1 Original Baseline 1 10.966667 NA
14416_2023-11-20 21:41:35_2023-11-20 21:41:35 FALSE Phase 1 SMS 1 21.750000 NA
14458_2023-11-20 22:02:22_2023-11-20 22:02:22 FALSE Phase 1 Original Baseline 1 13.850000 NA
14476_2023-11-20 22:08:54_2023-11-20 22:08:54 FALSE Phase 1 Video 1 40.633333 NA
14516_2023-11-20 13:28:59_2023-11-20 22:40:19 FALSE Phase 1 Game 1 7.416667 NA
14569_2023-11-21 00:05:16_2023-11-21 00:05:16 FALSE Phase 1 Video 1 23.500000 NA
14571_2023-11-21 00:09:53_2023-11-21 00:09:53 FALSE Phase 1 Video 1 15.866667 NA
14680_2023-11-21 04:14:54_2023-11-21 04:14:54 FALSE Phase 1 SMS 1 20.216667 NA
14716_2023-11-21 04:45:27_2023-11-21 04:45:27 FALSE Phase 1 Original Baseline 1 8.266667 NA
14733_2023-11-21 04:54:20_2023-11-21 04:54:20 FALSE Phase 1 Video 1 12.466667 NA
14789_2023-11-21 05:32:41_2023-11-21 05:32:41 FALSE Phase 1 SMS 1 17.033333 NA
14795_2023-11-21 05:35:49_2023-11-21 05:35:49 FALSE Phase 1 Game 1 138.383333 NA
14831_2023-11-21 03:33:58_2023-11-21 06:00:26 FALSE Phase 1 Video 1 11.866667 NA
14871_2023-11-21 06:33:26_2023-11-21 06:33:27 FALSE Phase 1 Video 1 22.500000 NA
14899_2023-11-21 06:52:45_2023-11-21 06:52:45 FALSE Phase 1 Game 1 477.166667 NA
14937_2023-11-21 07:10:05_2023-11-21 07:10:05 FALSE Phase 1 Game 1 56.750000 NA
14949_2023-11-21 07:16:25_2023-11-21 07:16:25 FALSE Phase 1 Original Baseline 1 40.716667 NA
14985_2023-11-21 07:33:35_2023-11-21 07:33:35 FALSE Phase 1 Original Baseline 1 11.450000 NA
15024_2023-11-21 07:56:21_2023-11-21 07:56:21 FALSE Phase 1 Original Baseline 1 24.433333 NA
15051_2023-11-21 08:13:02_2023-11-21 08:13:02 FALSE Phase 1 Game 1 16.166667 NA
15116_2023-11-21 08:54:01_2023-11-21 08:54:01 FALSE Phase 1 SMS 1 19.450000 NA
15119_2023-11-21 08:19:39_2023-11-21 08:54:58 FALSE Phase 1 Game 1 19.966667 NA
15144_2023-11-21 09:06:51_2023-11-21 09:06:51 FALSE Phase 1 Original Baseline 1 16.350000 NA
15202_2023-11-21 09:38:17_2023-11-21 09:38:17 FALSE Phase 1 Game 1 19.450000 NA
15218_2023-11-21 09:48:23_2023-11-21 09:48:23 FALSE Phase 1 Game 1 7.850000 NA
15221_2023-11-21 09:49:10_2023-11-21 09:49:10 FALSE Phase 1 Original Baseline 1 16.233333 NA
15231_2023-11-21 09:54:16_2023-11-21 09:54:16 FALSE Phase 1 SMS 1 21.916667 NA
15252_2023-11-21 10:02:43_2023-11-21 10:02:43 FALSE Phase 1 Video 1 13.633333 NA
15264_2023-11-21 10:10:10_2023-11-21 10:10:10 FALSE Phase 1 SMS 1 22.016667 NA
15414_2023-11-21 11:29:49_2023-11-21 11:29:57 FALSE Phase 1 Game 1 9.333333 NA
15458_2023-11-21 11:58:12_2023-11-21 11:59:12 FALSE Phase 1 SMS 1 27.716667 NA
15487_2023-11-21 12:16:30_2023-11-21 12:16:30 FALSE Phase 1 SMS 1 14.833333 NA
15529_2023-11-21 12:34:56_2023-11-21 12:34:56 FALSE Phase 1 Original Baseline 1 7.316667 NA
15552_2023-11-21 12:45:52_2023-11-21 12:45:52 FALSE Phase 1 Original Baseline 1 14.116667 NA
15628_2023-11-21 13:27:29_2023-11-21 13:27:29 FALSE Phase 1 SMS 1 23.683333 NA
15647_2023-11-21 13:38:17_2023-11-21 13:38:17 FALSE Phase 1 Video 1 21.450000 NA
15701_2023-11-20 20:39:44_2023-11-21 14:03:55 FALSE Phase 1 SMS 1 14.666667 NA
15707_2023-11-21 14:06:22_2023-11-21 14:06:22 FALSE Phase 1 Original Baseline 1 7.700000 NA
15738_2023-11-21 14:22:29_2023-11-21 14:22:29 FALSE Phase 1 SMS 1 19.433333 NA
15755_2023-11-21 14:33:15_2023-11-21 14:33:15 FALSE Phase 1 Video 1 451.750000 NA
15764_2023-11-21 14:38:50_2023-11-21 14:38:50 FALSE Phase 1 SMS 1 14.950000 NA
15780_2023-11-21 14:46:11_2023-11-21 14:46:13 FALSE Phase 1 Game 1 75.650000 NA
15907_2023-11-21 15:51:49_2023-11-21 15:51:56 FALSE Phase 1 Original Baseline 1 8.633333 NA
15912_2023-11-21 15:54:55_2023-11-21 15:54:55 FALSE Phase 1 Original Baseline 1 6.600000 NA
15978_2023-11-21 16:30:13_2023-11-21 16:30:13 FALSE Phase 1 SMS 1 59.816667 NA
16043_2023-11-21 17:12:21_2023-11-21 17:12:21 FALSE Phase 1 SMS 1 15.666667 NA
16073_2023-11-21 17:31:07_2023-11-21 17:31:07 FALSE Phase 1 Game 1 7.050000 NA
16193_2023-11-21 18:35:08_2023-11-21 18:35:08 FALSE Phase 1 Original Baseline 1 17.150000 NA
16196_2023-11-21 18:35:26_2023-11-21 18:35:26 FALSE Phase 1 SMS 1 14.966667 NA
16247_2023-11-21 19:04:34_2023-11-21 19:04:34 FALSE Phase 1 Original Baseline 1 13.966667 NA
16275_2023-11-21 18:46:52_2023-11-21 19:18:33 FALSE Phase 1 Original Baseline 1 9.533333 NA
16303_2023-11-21 19:31:29_2023-11-21 19:31:29 FALSE Phase 1 Video 1 11.166667 NA
16323_2023-11-21 19:41:23_2023-11-21 19:41:24 FALSE Phase 1 Original Baseline 1 10.916667 NA
16421_2023-11-21 20:30:15_2023-11-21 20:30:15 FALSE Phase 1 Original Baseline 1 11.766667 NA
16458_2023-11-21 20:47:09_2023-11-21 20:47:09 FALSE Phase 1 SMS 1 17.600000 NA
16475_2023-11-21 20:57:46_2023-11-21 20:57:46 FALSE Phase 1 Video 1 34.700000 NA
16531_2023-11-21 21:27:46_2023-11-21 21:27:46 FALSE Phase 1 Game 1 19.183333 NA
16538_2023-11-19 21:49:50_2023-11-21 21:31:49 FALSE Phase 1 Game 1 14.283333 NA
16594_2023-11-21 22:07:20_2023-11-21 22:07:20 FALSE Phase 1 Game 1 13.033333 NA
16636_2023-11-21 22:50:54_2023-11-21 22:50:54 FALSE Phase 1 Game 1 30.500000 NA
16748_2023-11-22 03:15:49_2023-11-22 03:15:49 FALSE Phase 1 SMS 1 18.183333 NA
16799_2023-11-22 04:22:41_2023-11-22 04:22:41 FALSE Phase 1 Video 1 10.433333 NA
16822_2023-11-22 04:47:20_2023-11-22 04:47:20 FALSE Phase 1 SMS 1 19.133333 NA
16843_2023-11-22 05:08:01_2023-11-22 05:08:21 FALSE Phase 1 Video 1 260.716667 NA
16883_2023-11-22 05:37:53_2023-11-22 05:37:53 FALSE Phase 1 Game 1 12.916667 NA
16903_2023-11-22 05:48:29_2023-11-22 05:48:29 FALSE Phase 1 Original Baseline 1 3177.500000 NA
16994_2023-11-22 06:33:44_2023-11-22 06:33:44 FALSE Phase 1 Video 1 19.233333 NA
17042_2023-11-20 20:51:48_2023-11-22 06:58:46 FALSE Phase 1 Video 1 14.166667 NA
17066_2023-11-22 07:12:41_2023-11-22 07:12:41 FALSE Phase 1 Original Baseline 1 9.983333 NA
17137_2023-11-22 07:56:49_2023-11-22 07:56:49 FALSE Phase 1 Video 1 16.783333 NA
17211_2023-11-19 18:44:12_2023-11-22 08:34:32 FALSE Phase 1 SMS 1 25.733333 NA
17394_2023-11-22 10:09:30_2023-11-22 10:09:30 FALSE Phase 1 Original Baseline 1 10.550000 NA
17432_2023-11-22 10:29:36_2023-11-22 10:29:36 FALSE Phase 1 SMS 1 28.233333 NA
17512_2023-11-22 11:08:07_2023-11-22 11:08:07 FALSE Phase 1 SMS 1 18.266667 NA
17606_2023-11-22 11:57:32_2023-11-22 11:57:32 FALSE Phase 1 Video 1 18.633333 NA
17625_2023-11-22 12:05:54_2023-11-22 12:05:54 FALSE Phase 1 Game 1 9.633333 NA
17666_2023-11-22 12:24:56_2023-11-22 12:24:56 FALSE Phase 1 Original Baseline 1 14.033333 NA
17671_2023-11-22 12:29:21_2023-11-22 12:29:21 FALSE Phase 1 Original Baseline 1 6.433333 NA
17701_2023-11-22 12:49:27_2023-11-22 12:49:28 FALSE Phase 1 Video 1 32.916667 NA
17719_2023-11-22 12:59:32_2023-11-22 12:59:32 FALSE Phase 1 SMS 1 12.700000 NA
17755_2023-11-22 13:12:07_2023-11-22 13:12:07 FALSE Phase 1 SMS 1 11.833333 NA
17758_2023-11-22 13:15:08_2023-11-22 13:15:08 FALSE Phase 1 Game 1 7.283333 NA
17773_2023-11-22 13:26:35_2023-11-22 13:26:35 FALSE Phase 1 SMS 1 712.733333 NA
17807_2023-11-22 13:44:14_2023-11-22 13:44:14 FALSE Phase 1 Original Baseline 1 12.300000 NA
17846_2023-11-22 14:03:41_2023-11-22 14:03:41 FALSE Phase 1 Original Baseline 1 11.700000 NA
17850_2023-11-22 14:06:18_2023-11-22 14:06:18 FALSE Phase 1 Original Baseline 1 8.266667 NA
17937_2023-11-22 14:47:18_2023-11-22 14:47:18 FALSE Phase 1 Game 1 8.216667 NA
17983_2023-11-22 15:15:22_2023-11-22 15:15:22 FALSE Phase 1 SMS 1 11.966667 NA
17988_2023-11-22 15:17:35_2023-11-22 15:17:35 FALSE Phase 1 Game 1 8.933333 NA
18089_2023-11-22 16:15:34_2023-11-22 16:15:34 FALSE Phase 1 SMS 1 107.333333 NA
18127_2023-11-22 16:35:30_2023-11-22 16:35:30 FALSE Phase 1 Video 1 11.400000 NA
18142_2023-11-22 07:39:51_2023-11-22 16:41:41 FALSE Phase 1 Game 1 9.933333 NA
18163_2023-11-22 16:54:27_2023-11-22 16:54:27 FALSE Phase 1 SMS 1 10.933333 NA
18187_2023-11-22 17:08:09_2023-11-22 17:08:09 FALSE Phase 1 Original Baseline 1 17.733333 NA
18221_2023-11-22 17:08:27_2023-11-22 17:28:11 FALSE Phase 1 SMS 1 21.300000 NA
18245_2023-11-22 17:41:48_2023-11-22 17:41:48 FALSE Phase 1 Original Baseline 1 6.183333 NA
18246_2023-11-22 17:44:29_2023-11-22 17:44:29 FALSE Phase 1 Original Baseline 1 10.650000 NA
18256_2023-11-22 17:50:55_2023-11-22 17:50:55 FALSE Phase 1 SMS 1 41.933333 NA
18333_2023-11-22 18:30:38_2023-11-22 18:30:38 FALSE Phase 1 Game 1 13.900000 NA
18339_2023-11-22 07:25:00_2023-11-22 18:32:33 FALSE Phase 1 Video 1 1534.116667 NA
18402_2023-11-22 18:59:44_2023-11-22 19:00:27 FALSE Phase 1 Video 1 19.800000 NA
18442_2023-11-22 19:14:51_2023-11-22 19:14:51 FALSE Phase 1 SMS 1 13.283333 NA
18444_2023-11-22 19:15:51_2023-11-22 19:15:51 FALSE Phase 1 Game 1 124.616667 NA
18454_2023-11-22 19:20:52_2023-11-22 19:20:52 FALSE Phase 1 Video 1 14.516667 NA
18550_2023-11-22 20:07:47_2023-11-22 20:07:47 FALSE Phase 1 Game 1 12.200000 NA
18552_2023-11-22 20:08:21_2023-11-22 20:08:21 FALSE Phase 1 Video 1 12.750000 NA
18571_2023-11-22 20:15:33_2023-11-22 20:15:33 FALSE Phase 1 SMS 1 31.183333 NA
18572_2023-11-22 20:16:44_2023-11-22 20:16:44 FALSE Phase 1 Video 1 18.733333 NA
18627_2023-11-22 20:41:35_2023-11-22 20:41:35 FALSE Phase 1 SMS 1 18.833333 NA
18629_2023-11-22 20:41:47_2023-11-22 20:41:47 FALSE Phase 1 SMS 1 12.533333 NA
18639_2023-11-22 20:46:02_2023-11-22 20:46:02 FALSE Phase 1 Video 1 568.950000 NA
18643_2023-11-22 20:47:06_2023-11-22 20:47:06 FALSE Phase 1 SMS 1 16.683333 NA
18644_2023-11-22 20:47:11_2023-11-22 20:47:11 FALSE Phase 1 Original Baseline 1 14.950000 NA
18718_2023-11-22 20:22:17_2023-11-22 21:19:30 FALSE Phase 1 Original Baseline 1 14.266667 NA
18741_2023-11-18 14:06:47_2023-11-22 21:31:53 FALSE Phase 1 Video 1 13.350000 NA
18752_2023-11-22 10:10:04_2023-11-22 21:40:58 FALSE Phase 1 Video 1 15.300000 NA
18812_2023-11-22 22:21:04_2023-11-22 22:21:04 FALSE Phase 1 Game 1 8.550000 NA
19067_2023-11-23 05:08:43_2023-11-23 05:08:43 FALSE Phase 1 Game 1 24.533333 NA
19190_2023-11-23 06:22:30_2023-11-23 06:22:30 FALSE Phase 1 SMS 1 16.300000 NA
19200_2023-11-23 06:26:04_2023-11-23 06:26:04 FALSE Phase 1 Video 1 37.750000 NA
19230_2023-11-23 06:39:41_2023-11-23 06:39:41 FALSE Phase 1 Original Baseline 1 7.133333 NA
19232_2023-11-23 06:40:07_2023-11-23 06:40:07 FALSE Phase 1 SMS 1 37.950000 NA
19237_2023-11-23 06:43:21_2023-11-23 06:43:21 FALSE Phase 1 Original Baseline 1 17.233333 NA
19314_2023-11-23 07:21:06_2023-11-23 07:21:06 FALSE Phase 1 SMS 1 136.250000 NA
19329_2023-11-23 07:26:49_2023-11-23 07:28:51 FALSE Phase 1 Original Baseline 1 11.816667 NA
19492_2023-11-23 08:51:52_2023-11-23 08:51:52 FALSE Phase 1 SMS 1 27.950000 NA
19562_2023-11-23 09:27:51_2023-11-23 09:27:51 FALSE Phase 1 Original Baseline 1 7.316667 NA
19595_2023-11-23 09:40:51_2023-11-23 09:40:51 FALSE Phase 1 Video 1 15.316667 NA
19778_2023-11-23 11:13:05_2023-11-23 11:13:05 FALSE Phase 1 Video 1 116.833333 NA
19789_2023-11-23 11:18:18_2023-11-23 11:18:18 FALSE Phase 1 Game 1 7.200000 NA
19794_2023-11-23 11:20:46_2023-11-23 11:20:46 FALSE Phase 1 Game 1 9.100000 NA
19802_2023-11-23 11:24:25_2023-11-23 11:24:25 FALSE Phase 1 Original Baseline 1 40.216667 NA
19830_2023-11-23 11:35:51_2023-11-23 11:35:51 FALSE Phase 1 SMS 1 10.850000 NA
19891_2023-11-23 12:02:13_2023-11-23 12:02:13 FALSE Phase 1 Video 1 14.316667 NA
19943_2023-11-23 12:24:56_2023-11-23 12:24:56 FALSE Phase 1 Original Baseline 1 6.650000 NA
19983_2023-11-23 12:41:50_2023-11-23 12:41:50 FALSE Phase 1 Game 1 10.466667 NA
19994_2023-11-23 12:24:27_2023-11-23 12:45:38 FALSE Phase 1 Original Baseline 1 12.700000 NA
20068_2023-11-23 13:13:24_2023-11-23 13:13:24 FALSE Phase 1 SMS 1 19.650000 NA
20197_2023-11-23 14:17:03_2023-11-23 14:17:03 FALSE Phase 1 Game 1 66.116667 NA
20297_2023-11-23 15:00:07_2023-11-23 15:00:07 FALSE Phase 1 Original Baseline 1 12.833333 NA
20304_2023-11-23 15:02:51_2023-11-23 15:02:51 FALSE Phase 1 Game 1 38.350000 NA
20313_2023-11-23 15:05:56_2023-11-23 15:05:56 FALSE Phase 1 Video 1 20.900000 NA
20326_2023-11-23 15:08:54_2023-11-23 15:08:54 FALSE Phase 1 SMS 1 19.333333 NA
20389_2023-11-23 15:42:25_2023-11-23 15:42:25 FALSE Phase 1 Video 1 10.783333 NA
20398_2023-11-23 15:49:57_2023-11-23 15:49:57 FALSE Phase 1 SMS 1 366.850000 NA
20406_2023-11-23 15:57:39_2023-11-23 15:57:41 FALSE Phase 1 SMS 1 17.116667 NA
20421_2023-11-23 16:07:33_2023-11-23 16:07:33 FALSE Phase 1 Original Baseline 1 14.200000 NA
20458_2023-11-23 16:23:21_2023-11-23 16:23:21 FALSE Phase 1 Original Baseline 1 16.200000 NA
20498_2023-11-23 16:38:53_2023-11-23 16:38:53 FALSE Phase 1 SMS 1 14.233333 NA
20510_2023-11-23 16:45:36_2023-11-23 16:45:36 FALSE Phase 1 Video 1 11.983333 NA
20517_2023-11-23 16:47:12_2023-11-23 16:47:12 FALSE Phase 1 Original Baseline 1 10.600000 NA
20521_2023-11-23 16:51:06_2023-11-23 16:51:06 FALSE Phase 1 Video 1 12.566667 NA
20568_2023-11-23 17:11:26_2023-11-23 17:11:26 FALSE Phase 1 Game 1 17.500000 NA
20575_2023-11-23 17:13:58_2023-11-23 17:13:58 FALSE Phase 1 Original Baseline 1 11.450000 NA
20634_2023-11-23 17:33:52_2023-11-23 17:33:52 FALSE Phase 1 Original Baseline 1 9.433333 NA
20703_2023-11-23 18:05:49_2023-11-23 18:05:49 FALSE Phase 1 SMS 1 16.450000 NA
20708_2023-11-23 18:09:19_2023-11-23 18:09:19 FALSE Phase 1 SMS 1 15.866667 NA
20806_2023-11-23 18:46:42_2023-11-23 18:46:42 FALSE Phase 1 Video 1 10.800000 NA
20817_2023-11-23 18:50:30_2023-11-23 18:50:30 FALSE Phase 1 Video 1 10.583333 NA
20836_2023-11-23 18:58:07_2023-11-23 18:58:08 FALSE Phase 1 SMS 1 13.800000 NA
20839_2023-11-23 18:59:39_2023-11-23 18:59:39 FALSE Phase 1 Video 1 17.950000 NA
20847_2023-11-23 19:01:48_2023-11-23 19:01:48 FALSE Phase 1 Original Baseline 1 10.483333 NA
20858_2023-11-23 19:05:58_2023-11-23 19:05:58 FALSE Phase 1 Original Baseline 1 10.300000 NA
20919_2023-11-23 19:33:07_2023-11-23 19:33:07 FALSE Phase 1 SMS 1 13.783333 NA
20939_2023-11-23 19:39:44_2023-11-23 19:39:44 FALSE Phase 1 SMS 1 23.300000 NA
20958_2023-11-23 19:47:31_2023-11-23 19:47:31 FALSE Phase 1 SMS 1 12.333333 NA
21055_2023-11-23 20:55:01_2023-11-23 20:55:01 FALSE Phase 1 SMS 1 26.050000 NA
21131_2023-11-23 21:34:14_2023-11-23 21:34:14 FALSE Phase 1 Original Baseline 1 10.800000 NA
21136_2023-11-23 21:35:59_2023-11-23 21:35:59 FALSE Phase 1 Game 1 68.083333 NA
21157_2023-11-23 21:45:35_2023-11-23 21:45:35 FALSE Phase 1 Original Baseline 1 15.950000 NA
21168_2023-11-23 21:49:23_2023-11-23 21:49:23 FALSE Phase 1 Video 1 13.366667 NA
21248_2023-11-23 22:39:41_2023-11-23 22:39:41 FALSE Phase 1 SMS 1 25.716667 NA
21290_2023-11-23 23:34:26_2023-11-23 23:34:26 FALSE Phase 1 Original Baseline 1 14.433333 NA
21335_2023-11-24 00:36:01_2023-11-24 00:36:01 FALSE Phase 1 Original Baseline 1 10.283333 NA
21419_2023-11-20 15:43:12_2023-11-24 03:08:37 FALSE Phase 1 Game 1 17.366667 NA
21557_2023-11-24 05:58:16_2023-11-24 05:58:16 FALSE Phase 1 Video 1 419.283333 NA
21643_2023-11-24 06:38:44_2023-11-24 06:38:44 FALSE Phase 1 Game 1 15.466667 NA
21731_2023-11-24 07:08:55_2023-11-24 07:08:55 FALSE Phase 1 Video 1 233.500000 NA
21758_2023-11-24 07:18:12_2023-11-24 07:18:12 FALSE Phase 1 Game 1 11.566667 NA
21788_2023-11-24 07:31:55_2023-11-24 07:31:55 FALSE Phase 1 Original Baseline 1 11.416667 NA
21851_2023-11-24 07:59:37_2023-11-24 07:59:37 FALSE Phase 1 Video 1 115.416667 NA
22034_2023-11-24 09:11:45_2023-11-24 09:11:45 FALSE Phase 1 SMS 1 25.350000 NA
22061_2023-11-24 09:24:14_2023-11-24 09:24:14 FALSE Phase 1 Original Baseline 1 13.516667 NA
22118_2023-11-24 09:54:13_2023-11-24 09:54:13 FALSE Phase 1 SMS 1 18.966667 NA
22143_2023-11-24 10:05:30_2023-11-24 10:05:30 FALSE Phase 1 SMS 1 52.733333 NA
22150_2023-11-24 10:09:11_2023-11-24 10:09:12 FALSE Phase 1 Video 1 1868.550000 NA
22153_2023-11-24 10:09:37_2023-11-24 10:09:37 FALSE Phase 1 Video 1 903.866667 NA
22155_2023-11-24 10:10:42_2023-11-24 10:10:42 FALSE Phase 1 Video 1 795.066667 NA
22158_2023-11-24 10:12:15_2023-11-24 10:12:15 FALSE Phase 1 Game 1 14.850000 NA
22165_2023-11-24 10:15:56_2023-11-24 10:15:56 FALSE Phase 1 Game 1 13.100000 NA
22169_2023-11-24 10:17:28_2023-11-24 10:17:28 FALSE Phase 1 Video 1 12.750000 NA
22291_2023-11-24 11:15:05_2023-11-24 11:15:05 FALSE Phase 1 Game 1 1104.266667 NA
22347_2023-11-24 11:41:36_2023-11-24 11:41:36 FALSE Phase 1 SMS 1 15.800000 NA
22380_2023-11-24 11:53:36_2023-11-24 11:53:36 FALSE Phase 1 Original Baseline 1 11.816667 NA
22430_2023-11-24 12:13:50_2023-11-24 12:14:02 FALSE Phase 1 Original Baseline 1 9.383333 NA
22453_2023-11-24 12:19:34_2023-11-24 12:19:34 FALSE Phase 1 Game 1 6.150000 NA
22491_2023-11-24 12:35:22_2023-11-24 12:35:22 FALSE Phase 1 SMS 1 29.300000 NA
22498_2023-11-24 12:39:06_2023-11-24 12:39:07 FALSE Phase 1 Original Baseline 1 10.200000 NA
22570_2023-11-24 13:21:15_2023-11-24 13:21:15 FALSE Phase 1 SMS 1 14.850000 NA
22583_2023-11-24 13:26:06_2023-11-24 13:26:07 FALSE Phase 1 Video 1 16.816667 NA
22620_2023-11-24 13:42:52_2023-11-24 13:42:52 FALSE Phase 1 Original Baseline 1 9.300000 NA
22639_2023-11-24 13:52:58_2023-11-24 13:52:58 FALSE Phase 1 Original Baseline 1 23.600000 NA
22691_2023-11-24 14:17:21_2023-11-24 14:17:21 FALSE Phase 1 Video 1 25.100000 NA
22713_2023-11-24 14:31:05_2023-11-24 14:31:05 FALSE Phase 1 SMS 1 23.866667 NA
22773_2023-11-21 13:26:11_2023-11-24 15:07:11 FALSE Phase 1 SMS 1 16.350000 NA
22774_2023-11-24 15:08:17_2023-11-24 15:08:17 FALSE Phase 1 Game 1 296.633333 NA
22794_2023-11-24 15:20:09_2023-11-24 15:20:09 FALSE Phase 1 Game 1 10.550000 NA
22871_2023-11-24 15:59:30_2023-11-24 15:59:35 FALSE Phase 1 Original Baseline 1 6.900000 NA
22889_2023-11-24 16:06:40_2023-11-24 16:06:40 FALSE Phase 1 SMS 1 15.066667 NA
22891_2023-11-19 01:53:19_2023-11-24 16:08:06 FALSE Phase 1 Original Baseline 1 10.500000 NA
22903_2023-11-24 16:15:08_2023-11-24 16:15:08 FALSE Phase 1 SMS 1 13.866667 NA
22938_2023-11-24 16:35:43_2023-11-24 16:35:43 FALSE Phase 1 Game 1 25.900000 NA
22974_2023-11-24 16:53:03_2023-11-24 16:53:03 FALSE Phase 1 Game 1 13.600000 NA
22999_2023-11-24 17:03:53_2023-11-24 17:04:07 FALSE Phase 1 Original Baseline 1 20.483333 NA
23037_2023-11-24 17:18:02_2023-11-24 17:18:02 FALSE Phase 1 Game 1 15.350000 NA
23184_2023-11-24 18:33:56_2023-11-24 18:33:56 FALSE Phase 1 Video 1 19.116667 NA
23208_2023-11-24 18:48:43_2023-11-24 18:48:43 FALSE Phase 1 Video 1 17.066667 NA
23242_2023-11-24 19:01:46_2023-11-24 19:01:46 FALSE Phase 1 Video 1 640.433333 NA
23351_2023-11-24 19:53:45_2023-11-24 19:53:45 FALSE Phase 1 Game 1 7.350000 NA
23443_2023-11-24 20:48:56_2023-11-24 20:48:56 FALSE Phase 1 Game 1 7.216667 NA
23481_2023-11-24 21:39:32_2023-11-24 21:39:32 FALSE Phase 1 Video 1 13.133333 NA
23522_2023-11-24 22:16:03_2023-11-24 22:16:03 FALSE Phase 1 Original Baseline 1 14.400000 NA
23572_2023-11-24 23:12:25_2023-11-24 23:12:25 FALSE Phase 1 Game 1 4996.900000 NA
23625_2023-11-25 01:05:26_2023-11-25 01:05:29 FALSE Phase 1 Video 1 14.550000 NA
23732_2023-11-25 04:04:41_2023-11-25 04:04:41 FALSE Phase 1 Video 1 12.033333 NA
23738_2023-11-24 05:23:19_2023-11-25 04:12:49 FALSE Phase 1 Original Baseline 1 6.850000 NA
23773_2023-11-24 22:35:19_2023-11-25 04:47:22 FALSE Phase 1 Original Baseline 1 11.683333 NA
23810_2023-11-25 05:13:10_2023-11-25 05:13:10 FALSE Phase 1 Game 1 8.550000 NA
23830_2023-11-25 05:24:44_2023-11-25 05:24:45 FALSE Phase 1 Video 1 13.050000 NA
23909_2023-11-25 06:18:02_2023-11-25 06:18:02 FALSE Phase 1 Video 1 13.700000 NA
23929_2023-11-25 06:34:11_2023-11-25 06:34:11 FALSE Phase 1 Game 1 26.466667 NA
23939_2023-11-25 06:41:46_2023-11-25 06:41:47 FALSE Phase 1 Video 1 12.566667 NA
24002_2023-11-25 07:17:44_2023-11-25 07:17:44 FALSE Phase 1 Video 1 16.350000 NA
24055_2023-11-25 07:50:48_2023-11-25 07:50:48 FALSE Phase 1 Game 1 181.533333 NA
24173_2023-11-25 09:18:41_2023-11-25 09:18:41 FALSE Phase 1 Game 1 8.333333 NA
24314_2023-11-25 11:13:26_2023-11-25 11:13:26 FALSE Phase 1 Game 1 24.966667 NA
24421_2023-11-20 04:06:49_2023-11-25 12:20:14 FALSE Phase 1 Game 1 12.600000 NA
24431_2023-11-25 12:27:32_2023-11-25 12:27:32 FALSE Phase 1 Game 1 1542.316667 NA
24437_2023-11-20 12:15:36_2023-11-25 12:34:27 FALSE Phase 1 Game 1 10.500000 NA
24496_2023-11-25 13:24:35_2023-11-25 13:24:35 FALSE Phase 1 SMS 1 13.716667 NA
24623_2023-11-25 14:51:33_2023-11-25 14:51:33 FALSE Phase 1 Video 1 12.900000 NA
24629_2023-11-25 14:55:01_2023-11-25 14:55:01 FALSE Phase 1 SMS 1 12.733333 NA
24651_2023-11-25 15:17:45_2023-11-25 15:17:45 FALSE Phase 1 Game 1 28.483333 NA
24657_2023-11-25 15:27:44_2023-11-25 15:27:44 FALSE Phase 1 SMS 1 937.000000 NA
24660_2023-11-25 15:30:32_2023-11-25 15:30:32 FALSE Phase 1 Video 1 355.500000 NA
24780_2023-11-25 16:53:56_2023-11-25 16:53:56 FALSE Phase 1 Video 1 22.100000 NA
24786_2023-11-25 17:01:36_2023-11-25 17:01:36 FALSE Phase 1 SMS 1 20.400000 NA
24791_2023-11-25 17:04:03_2023-11-25 17:04:03 FALSE Phase 1 Original Baseline 1 18.283333 NA
24872_2023-11-25 18:08:05_2023-11-25 18:08:05 FALSE Phase 1 Original Baseline 1 13.533333 NA
24876_2023-11-25 18:11:40_2023-11-25 18:11:40 FALSE Phase 1 Game 1 26.783333 NA
24884_2023-11-25 18:17:43_2023-11-25 18:17:43 FALSE Phase 1 Video 1 65.733333 NA
24928_2023-11-25 18:36:59_2023-11-25 18:36:59 FALSE Phase 1 Original Baseline 1 7.800000 NA
24970_2023-11-25 18:58:55_2023-11-25 18:58:55 FALSE Phase 1 Game 1 7.183333 NA
25002_2023-11-24 23:18:39_2023-11-25 19:17:57 FALSE Phase 1 Video 1 1531.433333 NA
25020_2023-11-25 19:26:34_2023-11-25 19:26:34 FALSE Phase 1 SMS 1 16.933333 NA
25106_2023-11-25 20:10:33_2023-11-25 20:10:33 FALSE Phase 1 SMS 1 17.816667 NA
25123_2023-11-25 20:17:54_2023-11-25 20:17:54 FALSE Phase 1 Original Baseline 1 18.183333 NA
25148_2023-11-25 20:30:24_2023-11-25 20:30:24 FALSE Phase 1 Video 1 16.533333 NA
25260_2023-11-25 21:19:49_2023-11-25 21:19:49 FALSE Phase 1 Video 1 195.250000 NA
25310_2023-11-25 21:45:16_2023-11-25 21:45:16 FALSE Phase 1 SMS 1 22.600000 NA
25363_2023-11-25 22:19:42_2023-11-25 22:22:27 FALSE Phase 1 Original Baseline 1 8.000000 NA
25413_2023-11-25 23:39:03_2023-11-25 23:39:03 FALSE Phase 1 Video 1 10.466667 NA
25473_2023-11-26 01:20:27_2023-11-26 01:20:27 FALSE Phase 1 Video 1 16.400000 NA
25503_2023-11-26 02:08:33_2023-11-26 02:08:33 FALSE Phase 1 Original Baseline 1 13.816667 NA
25510_2023-11-26 02:15:03_2023-11-26 02:15:03 FALSE Phase 1 SMS 1 4514.516667 NA
25637_2023-11-26 04:50:58_2023-11-26 04:50:58 FALSE Phase 1 Original Baseline 1 16.683333 NA
25658_2023-11-26 02:04:13_2023-11-26 05:04:19 FALSE Phase 1 Game 1 17.400000 NA
25685_2023-11-26 05:14:36_2023-11-26 05:14:36 FALSE Phase 1 Video 1 529.416667 NA
25824_2023-11-26 06:27:31_2023-11-26 06:27:31 FALSE Phase 1 SMS 1 15.816667 NA
25839_2023-11-26 06:48:12_2023-11-26 06:48:12 FALSE Phase 1 Original Baseline 1 15.716667 NA
25842_2023-11-26 06:50:15_2023-11-26 06:50:15 FALSE Phase 1 Game 1 33.266667 NA
25933_2023-11-26 07:45:35_2023-11-26 07:45:35 FALSE Phase 1 Video 1 13.583333 NA
26014_2023-11-26 08:22:14_2023-11-26 08:22:14 FALSE Phase 1 Original Baseline 1 11.466667 NA
26038_2023-11-26 08:30:59_2023-11-26 08:30:59 FALSE Phase 1 Game 1 28.133333 NA
26100_2023-11-26 08:54:17_2023-11-26 08:54:17 FALSE Phase 1 Video 1 26.250000 NA
26102_2023-11-26 08:55:22_2023-11-26 08:55:22 FALSE Phase 1 Original Baseline 1 20.633333 NA
26147_2023-11-26 09:10:00_2023-11-26 09:10:00 FALSE Phase 1 Original Baseline 1 11.400000 NA
26331_2023-11-26 10:34:53_2023-11-26 10:34:53 FALSE Phase 1 SMS 1 24.683333 NA
26345_2023-11-26 10:41:50_2023-11-26 10:41:50 FALSE Phase 1 SMS 1 518.166667 NA
26361_2023-11-26 10:49:54_2023-11-26 10:49:54 FALSE Phase 1 Original Baseline 1 7.200000 NA
26374_2023-11-22 15:53:18_2023-11-26 10:57:20 FALSE Phase 1 Game 1 72.433333 NA
26378_2023-11-26 10:58:29_2023-11-26 10:58:29 FALSE Phase 1 SMS 1 35.450000 NA
26379_2023-11-26 10:58:32_2023-11-26 10:58:32 FALSE Phase 1 SMS 1 15.050000 NA
26382_2023-11-26 11:01:13_2023-11-26 11:01:13 FALSE Phase 1 Original Baseline 1 8.533333 NA
26493_2023-11-25 12:00:07_2023-11-26 12:00:59 FALSE Phase 1 Original Baseline 1 8.933333 NA
26494_2023-11-26 12:01:13_2023-11-26 12:01:13 FALSE Phase 1 Video 1 15.950000 NA
26499_2023-11-26 12:04:25_2023-11-26 12:04:25 FALSE Phase 1 Original Baseline 1 6.616667 NA
26503_2023-11-26 12:05:49_2023-11-26 12:05:49 FALSE Phase 1 Original Baseline 1 7.383333 NA
26533_2023-11-26 12:20:33_2023-11-26 12:20:33 FALSE Phase 1 Game 1 21.483333 NA
26572_2023-11-26 12:36:25_2023-11-26 12:36:25 FALSE Phase 1 Game 1 224.716667 NA
26695_2023-11-26 13:34:57_2023-11-26 13:34:57 FALSE Phase 1 Video 1 10.183333 NA
26728_2023-11-26 13:48:49_2023-11-26 13:48:49 FALSE Phase 1 Game 1 30.750000 NA
26796_2023-11-26 14:18:10_2023-11-26 14:18:10 FALSE Phase 1 Video 1 14.816667 NA
26833_2023-11-26 14:32:25_2023-11-26 14:32:25 FALSE Phase 1 Original Baseline 1 13.016667 NA
26890_2023-11-26 15:00:41_2023-11-26 15:00:41 FALSE Phase 1 Original Baseline 1 8.200000 NA
26894_2023-11-26 15:01:41_2023-11-26 15:01:41 FALSE Phase 1 Video 1 14.916667 NA
26941_2023-11-26 15:30:25_2023-11-26 15:30:25 FALSE Phase 1 Original Baseline 1 6.016667 NA
26967_2023-11-23 19:05:04_2023-11-26 15:43:15 FALSE Phase 1 Game 1 10.316667 NA
26993_2023-11-26 15:55:06_2023-11-26 15:55:06 FALSE Phase 1 Video 1 18.533333 NA
27055_2023-11-26 16:29:37_2023-11-26 16:29:37 FALSE Phase 1 Video 1 18.316667 NA
27117_2023-11-26 17:09:20_2023-11-26 17:09:20 FALSE Phase 1 Game 1 35.266667 NA
27169_2023-11-26 17:37:12_2023-11-26 17:37:12 FALSE Phase 1 SMS 1 26.083333 NA
27216_2023-11-26 18:03:26_2023-11-26 18:03:26 FALSE Phase 1 SMS 1 17.383333 NA
27366_2023-11-26 19:32:25_2023-11-26 19:32:25 FALSE Phase 1 Video 1 16.800000 NA
27369_2023-11-26 19:35:15_2023-11-26 19:35:15 FALSE Phase 1 SMS 1 16.950000 NA
27395_2023-11-26 19:49:45_2023-11-26 19:49:45 FALSE Phase 1 Game 1 16.283333 NA
27410_2023-11-26 19:58:44_2023-11-26 19:58:44 FALSE Phase 1 SMS 1 13.900000 NA
27470_2023-11-26 20:30:27_2023-11-26 20:30:27 FALSE Phase 1 SMS 1 21.066667 NA
27527_2023-11-24 18:55:59_2023-11-26 21:10:17 FALSE Phase 1 Original Baseline 1 8.233333 NA
27610_2023-11-26 22:17:00_2023-11-26 22:17:00 FALSE Phase 1 Original Baseline 1 18.200000 NA
27638_2023-11-26 22:51:22_2023-11-26 22:51:22 FALSE Phase 1 Video 1 16.250000 NA
27666_2023-11-26 23:28:23_2023-11-26 23:28:23 FALSE Phase 1 Video 1 20.400000 NA
27976_2023-11-27 06:28:55_2023-11-27 06:28:55 FALSE Phase 1 Original Baseline 1 8.216667 NA
28017_2023-11-27 06:50:42_2023-11-27 06:50:42 FALSE Phase 1 Game 1 6.466667 NA
28042_2023-11-27 07:03:55_2023-11-27 07:03:55 FALSE Phase 1 Original Baseline 1 11.600000 NA
28079_2023-11-27 07:24:30_2023-11-27 07:24:30 FALSE Phase 1 SMS 1 23.666667 NA
28094_2023-11-27 07:31:44_2023-11-27 07:31:44 FALSE Phase 1 Video 1 12.266667 NA
28125_2023-11-27 07:49:51_2023-11-27 07:49:51 FALSE Phase 1 Video 1 11.883333 NA
28152_2023-11-27 08:00:55_2023-11-27 08:01:38 FALSE Phase 1 SMS 1 19.316667 NA
28173_2023-11-27 08:14:39_2023-11-27 08:14:39 FALSE Phase 1 Video 1 11.383333 NA
28191_2023-11-27 08:24:45_2023-11-27 08:24:45 FALSE Phase 1 Game 1 18.516667 NA
28240_2023-11-27 05:39:39_2023-11-27 08:48:30 FALSE Phase 1 SMS 1 18.966667 NA
28312_2023-11-27 09:23:12_2023-11-27 09:23:12 FALSE Phase 1 SMS 1 17.016667 NA
28324_2023-11-27 09:30:31_2023-11-27 09:30:31 FALSE Phase 1 SMS 1 21.883333 NA
28355_2023-11-27 09:46:36_2023-11-27 09:46:36 FALSE Phase 1 Game 1 39.383333 NA
28368_2023-11-27 09:55:59_2023-11-27 09:55:59 FALSE Phase 1 Original Baseline 1 14.583333 NA
28392_2023-11-27 10:06:32_2023-11-27 10:06:32 FALSE Phase 1 SMS 1 34.683333 NA
28452_2023-11-27 10:39:58_2023-11-27 10:39:58 FALSE Phase 1 Game 1 10.183333 NA
28556_2023-11-27 10:09:53_2023-11-27 11:36:33 FALSE Phase 1 Video 1 16.283333 NA
28586_2023-11-24 14:24:12_2023-11-27 11:50:19 FALSE Phase 1 Video 1 114.266667 NA
28587_2023-11-27 11:51:04_2023-11-27 11:51:04 FALSE Phase 1 Original Baseline 1 11.133333 NA
28591_2023-11-27 08:18:11_2023-11-27 11:53:43 FALSE Phase 1 Game 1 31.516667 NA
28624_2023-11-20 15:55:58_2023-11-27 12:10:15 FALSE Phase 1 Video 1 11.616667 NA
28746_2023-11-27 13:16:49_2023-11-27 13:16:49 FALSE Phase 1 Game 1 23.316667 NA
28810_2023-11-27 13:45:03_2023-11-27 13:45:03 FALSE Phase 1 Original Baseline 1 13.433333 NA
28844_2023-11-27 13:57:42_2023-11-27 13:57:42 FALSE Phase 1 SMS 1 55.883333 NA
28902_2023-11-27 14:29:27_2023-11-27 14:29:27 FALSE Phase 1 Original Baseline 1 11.016667 NA
28993_2023-11-27 15:09:29_2023-11-27 15:09:29 FALSE Phase 1 Video 1 604.000000 NA
29004_2023-11-27 15:13:33_2023-11-27 15:13:33 FALSE Phase 1 Game 1 36.250000 NA
29033_2023-11-27 15:23:50_2023-11-27 15:23:50 FALSE Phase 1 Game 1 49.200000 NA
29173_2023-11-27 16:23:19_2023-11-27 16:23:19 FALSE Phase 1 SMS 1 14.116667 NA
29186_2023-11-27 16:27:14_2023-11-27 16:27:14 FALSE Phase 1 Original Baseline 1 10.850000 NA
29193_2023-11-27 16:31:08_2023-11-27 16:31:08 FALSE Phase 1 Video 1 11.716667 NA
29199_2023-11-27 16:34:58_2023-11-27 16:34:58 FALSE Phase 1 Original Baseline 1 7.416667 NA
29214_2023-11-27 16:38:31_2023-11-27 16:38:31 FALSE Phase 1 SMS 1 12.183333 NA
29293_2023-11-18 08:22:24_2023-11-27 17:13:58 FALSE Phase 1 Game 1 10.283333 NA
29346_2023-11-27 17:46:02_2023-11-27 17:46:02 FALSE Phase 1 Game 1 27.650000 NA
29403_2023-11-27 09:13:28_2023-11-27 18:12:46 FALSE Phase 1 Original Baseline 1 10.350000 NA
29452_2023-11-27 18:33:03_2023-11-27 18:33:03 FALSE Phase 1 Original Baseline 1 9.850000 NA
29484_2023-11-27 18:48:16_2023-11-27 18:48:16 FALSE Phase 1 Game 1 26.533333 NA
29508_2023-11-27 18:56:50_2023-11-27 18:56:50 FALSE Phase 1 Original Baseline 1 10.566667 NA
29630_2023-11-27 19:48:02_2023-11-27 19:48:02 FALSE Phase 1 Video 1 18.250000 NA
29663_2023-11-25 11:32:42_2023-11-27 20:01:16 FALSE Phase 1 Game 1 28.766667 NA
29698_2023-11-27 20:17:18_2023-11-27 20:17:18 FALSE Phase 1 Original Baseline 1 635.483333 NA
29751_2023-11-27 20:47:21_2023-11-27 20:47:21 FALSE Phase 1 Game 1 1037.750000 NA
29775_2023-11-27 20:58:40_2023-11-27 20:58:42 FALSE Phase 1 SMS 1 28.350000 NA
29804_2023-11-27 21:11:30_2023-11-27 21:11:30 FALSE Phase 1 Video 1 11.933333 NA
29901_2023-11-27 22:16:25_2023-11-27 22:16:25 FALSE Phase 1 Video 1 20.816667 NA
29906_2023-11-27 22:20:28_2023-11-27 22:20:28 FALSE Phase 1 Original Baseline 1 8.250000 NA
30081_2023-11-28 03:57:40_2023-11-28 03:57:40 FALSE Phase 1 Game 1 811.933333 NA
30372_2023-11-28 07:12:32_2023-11-28 07:12:33 FALSE Phase 1 Game 1 61.816667 NA
30406_2023-11-28 07:27:47_2023-11-28 07:27:47 FALSE Phase 1 Video 1 13.233333 NA
30428_2023-11-28 07:36:15_2023-11-28 07:36:15 FALSE Phase 1 SMS 1 72.833333 NA
30505_2023-11-28 08:12:27_2023-11-28 08:12:27 FALSE Phase 1 Original Baseline 1 13.483333 NA
30603_2023-11-28 09:15:55_2023-11-28 09:15:55 FALSE Phase 1 SMS 1 12.133333 NA
30637_2023-11-28 09:41:59_2023-11-28 09:41:59 FALSE Phase 1 Original Baseline 1 10.600000 NA
30671_2023-11-28 10:05:11_2023-11-28 10:05:12 FALSE Phase 1 SMS 1 14.916667 NA
30691_2023-11-28 10:20:51_2023-11-28 10:20:51 FALSE Phase 1 Game 1 7.216667 NA
30856_2023-11-28 11:58:27_2023-11-28 11:58:27 FALSE Phase 1 SMS 1 17.266667 NA
30859_2023-11-28 11:59:43_2023-11-28 11:59:43 FALSE Phase 1 Game 1 28.383333 NA
30894_2023-11-28 12:24:04_2023-11-28 12:24:04 FALSE Phase 1 SMS 1 25.016667 NA
30913_2023-11-28 12:32:08_2023-11-28 12:32:08 FALSE Phase 1 Original Baseline 1 9.366667 NA
30939_2023-11-28 12:46:16_2023-11-28 12:46:16 FALSE Phase 1 Original Baseline 1 16.783333 NA
31117_2023-11-28 14:24:19_2023-11-28 14:24:19 FALSE Phase 1 SMS 1 15.350000 NA
31156_2023-11-28 14:45:09_2023-11-28 14:45:09 FALSE Phase 1 Game 1 14.416667 NA
31249_2023-11-28 15:42:35_2023-11-28 15:42:35 FALSE Phase 1 Game 1 11.000000 NA
31311_2023-11-28 15:42:01_2023-11-28 16:21:48 FALSE Phase 1 Game 1 39.700000 NA
31387_2023-11-28 17:12:01_2023-11-28 17:12:01 FALSE Phase 1 Original Baseline 1 255.500000 NA
31406_2023-11-28 17:14:20_2023-11-28 17:21:59 FALSE Phase 1 Video 1 15.150000 NA
31431_2023-11-28 17:40:38_2023-11-28 17:40:38 FALSE Phase 1 Original Baseline 1 22.616667 NA
31441_2023-11-28 17:52:46_2023-11-28 17:52:46 FALSE Phase 1 SMS 1 23.266667 NA
31513_2023-11-21 04:51:24_2023-11-28 18:36:31 FALSE Phase 1 Original Baseline 1 7.733333 NA
31530_2023-11-28 18:45:43_2023-11-28 18:45:43 FALSE Phase 1 SMS 1 29.650000 NA
31568_2023-11-28 19:07:42_2023-11-28 19:08:11 FALSE Phase 1 Original Baseline 1 9.250000 NA
31595_2023-11-28 19:21:44_2023-11-28 19:21:44 FALSE Phase 1 Game 1 7.633333 NA
31600_2023-11-28 19:23:24_2023-11-28 19:23:26 FALSE Phase 1 Game 1 8.866667 NA
31621_2023-11-28 19:31:22_2023-11-28 19:31:22 FALSE Phase 1 Original Baseline 1 13.433333 NA
31625_2023-11-28 19:32:52_2023-11-28 19:32:52 FALSE Phase 1 Video 1 11.850000 NA
31651_2023-11-28 19:47:04_2023-11-28 19:47:12 FALSE Phase 1 Video 1 13.383333 NA
31673_2023-11-26 20:50:52_2023-11-28 19:58:34 FALSE Phase 1 Game 1 45.766667 NA
31691_2023-11-28 20:05:30_2023-11-28 20:05:30 FALSE Phase 1 Original Baseline 1 6.750000 NA
31736_2023-11-26 11:20:51_2023-11-28 20:26:21 FALSE Phase 1 Game 1 9.883333 NA
31838_2023-11-28 21:26:15_2023-11-28 21:26:15 FALSE Phase 1 SMS 1 12.816667 NA
31948_2023-11-28 23:11:36_2023-11-28 23:11:36 FALSE Phase 1 SMS 1 28.866667 NA
31985_2023-11-24 19:28:59_2023-11-29 01:33:47 FALSE Phase 1 Original Baseline 1 8.916667 NA
31986_2023-11-29 01:35:49_2023-11-29 01:35:49 FALSE Phase 1 Video 1 13.183333 NA
32032_2023-11-29 03:14:16_2023-11-29 03:14:16 FALSE Phase 1 Video 1 14.650000 NA
32037_2023-11-29 03:23:22_2023-11-29 03:23:22 FALSE Phase 1 Game 1 21.100000 NA
32048_2023-11-29 03:36:18_2023-11-29 03:36:18 FALSE Phase 1 SMS 1 18.400000 NA
32083_2023-11-29 04:18:10_2023-11-29 04:18:10 FALSE Phase 1 Video 1 15.600000 NA
32098_2023-11-29 04:32:08_2023-11-29 04:32:08 FALSE Phase 1 Game 1 35.366667 NA
32164_2023-11-29 05:33:17_2023-11-29 05:33:17 FALSE Phase 1 Game 1 27.166667 NA
32242_2023-11-29 06:31:19_2023-11-29 06:31:19 FALSE Phase 1 Video 1 16.800000 NA
32338_2023-11-29 07:36:25_2023-11-29 07:36:25 FALSE Phase 1 Game 1 69.916667 NA
32342_2023-11-29 07:37:15_2023-11-29 07:37:15 FALSE Phase 1 SMS 1 16.300000 NA
32368_2023-11-28 11:49:52_2023-11-29 07:53:23 FALSE Phase 1 Game 1 12.150000 NA
32376_2023-11-29 07:57:25_2023-11-29 07:57:25 FALSE Phase 1 Game 1 29.383333 NA
32446_2023-11-29 08:48:06_2023-11-29 08:48:06 FALSE Phase 1 Original Baseline 1 9.266667 NA
32464_2023-11-29 08:54:57_2023-11-29 08:55:03 FALSE Phase 1 SMS 1 18.200000 NA
32472_2023-11-29 08:59:21_2023-11-29 08:59:21 FALSE Phase 1 Video 1 12.583333 NA
32549_2023-11-20 05:05:05_2023-11-29 09:42:14 FALSE Phase 1 Original Baseline 1 6.450000 NA
32585_2023-11-29 10:07:33_2023-11-29 10:07:33 FALSE Phase 1 Game 1 22.816667 NA
32603_2023-11-29 10:16:33_2023-11-29 10:16:33 FALSE Phase 1 Original Baseline 1 11.866667 NA
32609_2023-11-29 10:20:24_2023-11-29 10:20:40 FALSE Phase 1 Game 1 67.250000 NA
32810_2023-11-29 12:27:00_2023-11-29 12:27:00 FALSE Phase 1 Original Baseline 1 43.500000 NA
32821_2023-11-29 12:34:03_2023-11-29 12:34:03 FALSE Phase 1 Video 1 15.633333 NA
32839_2023-11-29 12:48:08_2023-11-29 12:48:08 FALSE Phase 1 SMS 1 21.050000 NA
32997_2023-11-29 14:40:05_2023-11-29 14:40:05 FALSE Phase 1 SMS 1 24.383333 NA
32999_2023-11-21 17:46:46_2023-11-29 14:41:15 FALSE Phase 1 Video 1 14.916667 NA
33017_2023-11-29 14:50:22_2023-11-29 14:50:23 FALSE Phase 1 Original Baseline 1 9.666667 NA
33062_2023-11-29 15:12:05_2023-11-29 15:12:05 FALSE Phase 1 SMS 1 16.350000 NA
33203_2023-11-29 16:38:33_2023-11-29 16:38:33 FALSE Phase 1 Video 1 13.866667 NA
33226_2023-11-29 16:52:48_2023-11-29 16:52:48 FALSE Phase 1 Original Baseline 1 12.916667 NA
33229_2023-11-29 16:53:54_2023-11-29 16:53:54 FALSE Phase 1 Video 1 38.666667 NA
33242_2023-11-29 17:07:07_2023-11-29 17:07:07 FALSE Phase 1 Video 1 14.350000 NA
33333_2023-11-29 18:08:11_2023-11-29 18:08:11 FALSE Phase 1 Original Baseline 1 7.450000 NA
33372_2023-11-29 18:26:48_2023-11-29 18:26:48 FALSE Phase 1 SMS 1 13.633333 NA
33394_2023-11-29 18:38:22_2023-11-29 18:38:22 FALSE Phase 1 Video 1 18.633333 NA
33545_2023-11-29 19:53:24_2023-11-29 19:53:25 FALSE Phase 1 Original Baseline 1 9.950000 NA
33548_2023-11-29 19:55:58_2023-11-29 19:55:58 FALSE Phase 1 Original Baseline 1 8.700000 NA
33552_2023-11-29 19:57:51_2023-11-29 19:57:51 FALSE Phase 1 Video 1 13.283333 NA
33738_2023-11-29 21:31:17_2023-11-29 21:31:17 FALSE Phase 1 Original Baseline 1 14.300000 NA
34816_2023-11-30 21:14:16_2023-11-30 21:14:16 FALSE Phase 1 SMS 1 24.933333 NA
35736_2023-11-20 02:25:15_2023-12-01 13:44:41 FALSE Phase 1 Original Baseline 1 NA NA
36278_2023-12-01 21:49:47_2023-12-01 21:53:02 FALSE Phase 1 SMS 1 18.650000 NA
36813_2023-12-02 09:33:19_2023-12-02 09:33:19 FALSE Phase 1 Original Baseline 1 15.683333 NA
36869_2023-12-02 10:15:50_2023-12-02 10:15:50 FALSE Phase 1 Video 1 17.683333 NA
37294_2023-12-02 16:05:20_2023-12-02 16:05:20 FALSE Phase 1 Original Baseline 1 15.750000 NA
37872_2023-12-03 03:04:29_2023-12-03 03:04:29 FALSE Phase 1 Video 1 18.400000 NA
43681_2023-12-13 07:34:09_2023-12-13 07:34:09 FALSE Phase 2 SMS 1 15.033333 NA
45186_2023-12-13 11:18:49_2023-12-13 11:18:49 FALSE Phase 2 SMS 1 147.366667 NA
45996_2023-12-13 13:27:58_2023-12-13 13:27:58 FALSE Phase 2 SMS 1 89.833333 NA
46358_2023-12-13 14:28:26_2023-12-13 14:28:26 FALSE Phase 2 Long Baseline 1 20.650000 NA
46431_2023-12-13 14:41:07_2023-12-13 14:41:07 FALSE Phase 2 SMS 1 15.283333 NA
52943_2023-12-15 00:44:53_2023-12-15 00:44:53 FALSE Phase 2 Original Baseline 1 9.250000 NA
53391_2023-12-15 06:22:34_2023-12-15 06:22:34 FALSE Phase 2 Long Baseline 1 24.550000 NA
54116_2023-12-15 10:41:34_2023-12-15 10:41:34 FALSE Phase 1 Video 1 13.733333 NA
57294_2023-12-16 10:19:15_2023-12-16 10:19:15 FALSE Phase 2 Long Baseline 1 19.383333 NA
60756_2023-12-17 12:41:16_2023-12-17 12:41:16 FALSE Phase 2 Original Baseline 1 8.700000 NA
64464_2023-12-18 19:36:43_2023-12-18 19:36:44 FALSE Phase 2 Long Baseline 1 14.750000 NA
68989_2023-12-20 10:20:50_2023-12-20 10:20:50 FALSE Phase 2 SMS 1 14.600000 NA
81572_2023-12-25 21:16:39_2023-12-25 21:16:39 FALSE Phase 2 SMS 1 NA NA
83578_2023-12-26 17:52:17_2023-12-26 17:52:17 FALSE Phase 2 SMS 1 28.450000 NA
85292_2023-12-27 12:41:05_2023-12-27 12:41:05 FALSE Phase 2 Original Baseline 1 15.750000 NA

  • There are 703 people who started the follow up but did not complete the main survey quiz.

  • Upon inspection, these participants did not complete the misinformation quiz in the survey.

  • We create variable abnormal_start_followup to denotes participants who started the follow up but did not complete the main survey quiz where 1 indicates abnormal start and 0 indicates normal start.

data_followup <- data_followup %>% 
  mutate(abnormal_start_followup = ifelse(analytic_id %in% check_abnormal_complete$analytic_id, 1, 0))
#
#before_drop_abnormal_complete = as.character(nrow(data_followup))

# dropping abnormal completers based on analytic id

#data_followup <- data_followup %>% 
  #filter(!analytic_id %in% abnormal_complete$analytic_id)

#after_drop_abnormal_complete = as.character(nrow(data_followup))

Checking entry points

  • Variable followup_entry_point records the entry point for the follow up. Particiapnts can enter the followup by registering for and receiving a one-time notification (OTN), or through a Sponsored Message (SM) (an in-Messenger ad send to users who completed the original chatbot)

  • The eligible participants received OTNs 6 weeks after completing the original chatbot. Initially we used signed up variable to select users. On Jan 13, we realized that some users were receiving the OTN too early. This was due to the fact that signed up recorded the time a user first messaged the chatbot. Consequently, we switched to using EndPay_start_time to select users. This variable records the time a user entered the last block of the chatbot (the payment block; after completing the quiz).

  • We started the SM campaign on Jan 15, 2024, having noticed that the OTN campaign was not effective in reaching the target sample size. The original audience for SMs included users who: (a) completed the original chatbot, (b) completed the chatbot at least 6 weeks and 3 days prior, and (c) did not complete the follow-up survey.

data_followup = data_followup |>
  mutate(
    followup_entry_point_clean = case_when(
      !(followup_entry_point == "") ~ followup_entry_point,
      followup_entry_point == "" ~ "otn"
    )
  )

data_followup %>% count(followup_entry_point_clean) %>% 
  kable("html", col.names = c("Entry Point", "Count")) %>%
  kableExtra::kable_styling(bootstrap_options = c("striped", "hover")) %>%
  scroll_box(width = "100%")
Entry Point Count
otn 6936
sponsored_message 15257

Checking time variables

Checking time since completed survey intervention and completed survey quiz

# combining intervention end time

data_followup <- data_followup %>%
  mutate(intervention_start_time = coalesce(InterArmsBase_end_time, interArmsGame_end_time, InterArmsSMS_end_time, InterArmsVideo_end_time, InterArmsLongBase_end_time))

abnormal_time <- data_followup %>% filter(is.na(intervention_start_time)) 

n_abnormal_time <- abnormal_time %>% nrow() %>% as.character()

before_drop_treatmenttime = as.character(nrow(data_followup))

data_followup <- data_followup %>% 
  filter(!is.na(intervention_start_time))

after_drop_treatmenttime = as.character(nrow(data_followup))

  • We noticed 2 participants who did not have a time stamp for completing the one of the interventions, we will drop them from the dataset.

  • Before dropping we had 20605 observations, after dropping we have 20603 observations.

  • Variable time_since_completed_intervention indicates the time since the participant completed the intervention to starting the follow up in days.

  • Variable time_since_completed_quiz indicates the time since the participant completed the intervention to starting the follow up survey in days.

  • Variable time_since_signup indicates the time since the participant signed up to starting the follow up survey in days.

data_followup <- data_followup %>%
  mutate(time_since_completed_intervention = as.numeric(difftime(MisinfoChat_start_time_followup, intervention_start_time, units = "days")),
         time_since_completed_quiz = as.numeric(difftime(MisinfoChat_start_time_followup, misinfoQuiz_end_time, units = "days")),
         time_since_signup = as.numeric(difftime(MisinfoChat_start_time_followup, `signed up`, units = "days")))

Checking abnormal duration

abnormal_time_since <- data_followup %>% 
  select(
    analytic_id, time_since_completed_intervention, time_since_completed_quiz, time_since_signup
    ) %>%
    filter(
      time_since_completed_intervention < 0 |
      time_since_completed_quiz < 0 |
      time_since_signup < 0
    )

n_abnormal_time_since <- as.character(nrow(abnormal_time_since))

before_drop_abnormal_time_duration <- as.character(nrow(data_followup))

data_followup <- data_followup %>% 
  filter(!analytic_id %in% abnormal_time_since$analytic_id)

after_drop_abnormal_time_duration <- as.character(nrow(data_followup))

  • Checking for negative time duration between intervention and followup and between quiz and followup, we found 67 participants with negative time duration. We will drop them from the dataset.

  • Before dropping we had 20603 observations, after dropping we have 20536 observations.

Flagging participants with time duration since intervention and quiz completion less than 41 days

flag_time_duration <- data_followup %>% 
  filter(time_since_completed_intervention < 41 | time_since_completed_quiz < 41) %>% 
  select(analytic_id, time_since_completed_intervention, time_since_completed_quiz)

flag <- as.character(nrow(flag_time_duration))

# generate binary variable for them in data_followup 

data_followup$flag_time_duration <- ifelse(data_followup$analytic_id %in% flag_time_duration$analytic_id, 1, 0)

_ We are concerned that about one of error in the implementation of the signed up variables causing people to start the follow up survey early. Currently, there are 343 participants with time duration between started the follow up and completed quiz and started the follow up and completed the intervention with less than 41 days. We will flag these participants and decide to drop them later if needed.

  • Variable flag-time_duration is a binary variable that indicates if the participant has a time duration less than 41 days since completing the intervention or quiz.

Distribution of time started follow up since completed intervention

ggplot(data_followup , aes(x = time_since_completed_intervention)) +
  geom_histogram(binwidth = 1, fill = "skyblue", color = "black") +
  labs(title = "Histogram of Time Since Completed Intervention in days",
       x = "Time Since Completed Intervention (days)",
       y = "Frequency") +
  theme_minimal()

### Statistics of time_since_completed_intervention

summary(data_followup$time_since_completed_intervention)
##    Min. 1st Qu.  Median    Mean 3rd Qu.    Max. 
##   1.705  43.057  56.749  56.208  64.255  96.917

Distribution of time started follow up since completed quiz

ggplot(data_followup , aes(x = time_since_completed_quiz)) +
  geom_histogram(binwidth = 1, fill = "purple", color = "black") +
  labs(title = "Histogram of Time Since Completed Quiz in days",
       x = "Time Since Completed Quiz (days)",
       y = "Frequency") +
  theme_minimal()

### Statistics of time_since_completed_intervention

summary(data_followup$time_since_completed_intervention) 
##    Min. 1st Qu.  Median    Mean 3rd Qu.    Max. 
##   1.705  43.057  56.749  56.208  64.255  96.917

Distribution of time started follow up since sign up

ggplot(data_followup , aes(x = time_since_signup)) +
  geom_histogram(binwidth = 1, fill = "violet", color = "black") +
  labs(title = "Histogram of Time Since Sign Up in days",
       x = "Time Since Sign Up (days)",
       y = "Frequency") +
  theme_minimal()

### Statistics of time_since_signup

summary(data_followup$time_since_signup) 
##    Min. 1st Qu.  Median    Mean 3rd Qu.    Max. 
##   41.87   43.42   57.12   57.22   64.94  224.52

Checking time to complete follow up Misinformation quiz followup

data_followup <- data_followup %>%
  mutate(duration_complete_quiz_followup = as.numeric(difftime(misinfoQuiz_end_time_followup, MisinfoQuiz_start_time_followup, units = "mins")))

data_followup <- data_followup %>%
  mutate(abnormal_followup_quiz_duration = (duration_complete_quiz_followup<0 & !is.na(duration_complete_quiz_followup)))

n_abnormal_followup_quiz_duration= as.character(sum(data_followup$abnormal_followup_quiz_duration, na.rm = TRUE))  

before_drop_negduration = as.character(nrow(data_followup))

data_followup <- data_followup %>% 
  filter(!abnormal_followup_quiz_duration)

after_drop_negduration = as.character(nrow(data_followup))

  • Variable duration_complete_quiz_followup indicates duration between the start and the end of the followup misinformation quiz

  • We noticed about 2 participants having negative time duration to complete the quiz. We’ll drop these participants from the dataset.

  • Before dropping participants with negative time duration, we had 20536 observations, after dropping we have 20534 observations.

Distribution of time (in minutes) to complete follow up Misinformation quiz

  • The distribution ignores outliers and only shows the main distribution of the time to complete the quiz.
complete_quiz_followup <- data_followup %>% filter(!is.na(duration_complete_quiz_followup))

x_min <- quantile(complete_quiz_followup$duration_complete_quiz_followup, 0.01, na.rm = TRUE)
x_max <- quantile(complete_quiz_followup$duration_complete_quiz_followup, 0.95, na.rm = TRUE)

ggplot(complete_quiz_followup, aes(x = duration_complete_quiz_followup)) +
  geom_density(fill = "skyblue", color = "black", alpha = 0.7) +
  labs(title = "Density Plot of Time to Complete Misinformation Quiz in Follow Up",
       x = "Time to Complete Misinformation Quiz (minutes)",
       y = "Density") +
  scale_x_continuous(limits = c(x_min, x_max)) + 
  theme_minimal()

### Statistics of duration_complete_quiz_followup

summary(complete_quiz_followup$duration_complete_quiz_followup)
##     Min.  1st Qu.   Median     Mean  3rd Qu.     Max. 
##     1.05     3.82     5.10   198.30     7.62 67621.22

Checking payment amount

data_followup %>% count(user_payment_amount_followup) > kable("html") |>
  kableExtra::kable_styling(bootstrap_options = c("striped", "hover")) |> scroll_box(width = "100%")
##      user_payment_amount_followup    n
## [1,]                         TRUE TRUE
## [2,]                         TRUE TRUE
## [3,]                        FALSE TRUE
## [4,]                        FALSE TRUE

  • Variable user_payment_amount_followup indicates the amount of money the participant received for completing the follow up.

  • We did not notice anything abnormal

Checking attention check

  • Variable attention_check_passed_followup indicates whether the participant passed the attention check in the follow up. NA indicates that the participant did not answer the attention check question (i.e. dropped off before the attention check).
data_followup %>% count(attention_check_passed_followup) > kable("html") |>
  kableExtra::kable_styling(bootstrap_options = c("striped", "hover")) |> scroll_box(width = "100%")
##      attention_check_passed_followup    n
## [1,]                            TRUE TRUE
## [2,]                            TRUE TRUE
## [3,]                              NA TRUE
  • attention_check_passed_followup_coded_num is the coded version of attention_check_passed_followup where 1 indicates the participant passed the attention check and 0 indicates the participant did not pass the attention check.
data_followup$attention_check_passed_followup_coded_num <- ifelse(data_followup$attention_check_passed_followup == "TRUE", 1, 0)

data_followup %>% count(attention_check_passed_followup_coded_num) > kable("html") |>
  kableExtra::kable_styling(bootstrap_options = c("striped", "hover")) |> scroll_box(width = "100%")
##      attention_check_passed_followup_coded_num    n
## [1,]                                      TRUE TRUE
## [2,]                                      TRUE TRUE
## [3,]                                        NA TRUE

Checking NA in attention_check_passed_followup

attention_check_missing <- data_followup %>% 
  select(analytic_id, consent_followup_coded_num, attention_check_passed_followup, misinfoQuiz_end_time_followup) %>% 
  filter(is.na(attention_check_passed_followup))
  • We checked for missing values in attention_check_passed_followup. These participants did not complete the follow up quiz, so we can confirm that they dropped off before the attention check.

Checking free response questions

  • Variables followup_reflection_1, followup_reflection_2, followup_reflection_3 are text responses. We’ll check for abnormal responses such as random links. They correspond to the following questions in the bot:
    • followup_reflection_1: “Can you remember any example in the last two weeks where thinking about our previous chat changed your behavior?”
    • followup_reflection_2: “Have you noticed any misinformation/disinformation in your timeline in the past 6 weeks?”
    • followup_reflection_3: “If you noticed a close friend sharing posts that you thought might have misinformation, what might you say to them that would help them make different choices in the future?”
data_followup %>% 
  select(followup_reflection_1, followup_reflection_2, followup_reflection_3) %>%
  slice_sample(n = 100) %>%
  kable("html") %>%
  kableExtra::kable_styling(bootstrap_options = c("striped", "hover")) %>%
  scroll_box(width = "100%", height = "400px")
followup_reflection_1 followup_reflection_2 followup_reflection_3
Yes No They must verify the info first
Yes Yes Please remove your post and make sure to review facts about something before posting
Yes Yes Please be sure you have facts before sharing fake news or news thats not partly true
There are people today starving on the streets, if you are not part of the solution, you are part of the problem. NO I will tell them to retrace their bad steps and turn a new leaf to start posting the right information
No Yes Stop sharing
Yes… I decided to be very intentional about the content I produce because it affects the minds of people No… I don’t allow them I’ll advice them to put themselves in the place of the masses and see if the information sounds nice to their ears
Yes No To stop, because it can cause easily misunderstanding between him and others
Yes No They should post exactly the truth. Nothing but the truth
Yes Yes I will tell them to do some investigations first, to confirm the authenticity of the source of the said post before sharing them.
Yes Yes Tell them it’s a fake news that can mislead others
No No I will tell them to verify anything that want to post
Yes Yes To be extra careful with everything they post online
Yeah Somehow Yes
Yes it did change my behaviour Yes I would tell them the dangers involved in misinformation and disinformation
I read a post which was misleading in the past two weeks and I made sure i that i didnt pay attention to it Yes I will educate them on how dangerous it is to share a misleading information that can negatively impact lifes
No Yes I will send them an accurate source
No Yes To stop misleading people or youth with mis information
Yes I remember not taking everything online that seriously until further inquiry Not really I will advise them to find out more about the particular information before believing in it
Yes I got to learn to do my own research and verify before I go public with it. Yes Correct them.
That posts that contain misleading information, and should not be taken at face value. Yes You must not post information that you not have facts about it
I check on how manipulative and reliable a post is before sharing Yeah I should tell them to think of how the information they are sharing should affect others positively/ negatively before posting or sharing
Yes. Yes I would tell them to research first, and not spread posts that doesnt have a reliable source attached, especially if the post invokes strong emotions
Yes. I always read past carefully before sharing Yes I would ask them to ensure the source of their message is genuine
Yes Yed To be careful with the information shared to avoid being manipulated or misinformed. Also to always do a background check on any given info
No No Inform them
Not really Yes To change, since it’s manipulative to people
Noo Nooo I will advise them
9k Ok I will tell them to be sure of both source and the information
No No I would gladly tell them the disadvantages of sharing posts that have misinformation and the impact it will have on others
Yes No I will tell him/her this is fake news and it has no reliable sources avoid such kind post
Yes No To get to learn from project don’t get duped
A post about a political party members swearing No Before they share any information they have to confirm that it’s from a reliable source
Yes Yes idid By telling them to stop sharing post that has misinformation
Yes Yes I Don’t like what they do…must opt to doing nicer things to others
Yes No I’ll advice them to take it down and post a reliable and no manipulative post
Yes No Any misleading information is not good at all
Yes Yes Educate them on how unhealthy it is for misinformation..which may cause havoc to the society
Yes No To stop
There are many false information online Yes Don’t believe everything you see online.
Not really Yes Tell them to make sure how correct is the information on the post
Yes l got more interactive and my communication skills improved tremendously Yes I would encourage him to stop sharing false information
yes yes I would tell them to stop the fake informations
Yes No I will ask that the source and authenticity of the information to check its reliability before being disseminated
Yes No They should confirm their information before sharing.
No Yes Yes
No Yes I’ll advise them to research more carefully before posting anything
Maybe No Misinfo is truly a global phenomenon affecting all of us.
No No They should think before they post and very the authenticity of the information
Yes Yes I will tell them that they should confirm a news before sharing it
Yes Yes I will tell h/er to share the posts
Yes Yes Re-read & understand before you share any post
Yes Yes I will tell him or her to stop sharing misinformation because it can lead someone into trouble
No No I’ll tell them to remove the post
It’s about surveying Yeah Yeah
No Yes That they too may Gotta good behavior Acknowledgment and Kindness Loved to their Neighbors
Yes Yes Desist from sharing misinformed posts
Yes No No never look down on their selves
I refused to post any thing am not sure of and determine not to share wrong information Not really I haven’t been online often because I put to bed Not really
Yes Yes, pls I will tell them it’s illegal so they should stop making post’s like that
Yes Yes To delete the information and stop misleading others
Yes I can Yes I will tell to ignore it.. is misinformation
Yes Yes I will tell him/her to try not to use misinformation
Yes Yes Inform them on the consequences of misinformation
Yes I can remember but not a lot No Nope it’s not
Misinfo and disinfo Yes Okay
no.it is been so long no i will encourage them not to fail into trap bcs there are many scam all over the world
Yes Yes I will ask them to stop Posting Such information
Mood People No Yes
Social media damage Yes To get facts before just sharing posts
Yes No I will tell them to stop it because it can cause social media disorder
Yes Yes I will show them how they impact negatively
Yes Yes To avoid
No Yes Yes
No Yh I will tell them that is not good and advisable to spread misinformation so they should put a stop to that
Yeah Yes. Many misinformation I’ll tell them to think about what he shared. How manipulative is it?
Yes No I would tell them to get the facts right
No No Ues
No No They should delete it
Yes No Yes
yes no I will tell them to make a good choice
Yes Yes I will advice him/her to stop in other to avoid misleading others
Not really Not really Always verify
Yes Yes Tell them to check that its accurate before sharing
Yes Yes I would ask if they have verified the information before sharing
Yes Yes Check the facts before sharing
Yes No Yes
Yeah No I will admonish him/her to avoid disseminating wrong information, for it would leads to deterioration of the community and the nation at large. Some informations needn’t to be broadcasted on media, due to their impact and terrifying in the community.
Yes Yes I would advice him/her to investigate more before posting anything as misinformation can be dangerous
I remember very well that sharing fake rumors can damage people mentally and physically Many Do you witness the scene cause seeing is believing and not all you see at times are not what they are so make sure you know the truth of all discussion before sharing
Example changes in thinking faculty Yes To RESEARCH AND STUDY VERY WELL BEFORE SPREADING NEWS
Yes Yes Stop posting thing without getting better knowledge
Yes Yes Guide them with research
No No I’d tell them they are false information and provide a link that tells them the teuth
Yes Yes Not to share the posts, and should be sure is not fake news if she must share.
Nooe No Delete the post
Yes Yes Yes
Yes Yes I would comment a link to the actual facts or message them privately to take it down
  • We’ll check for any links in the free response questions.
abnormal_text_responses_1 <- data_followup %>% select(analytic_id, followup_reflection_1) %>% filter(str_detect(followup_reflection_1, "http"))

n_abnormal_text_1 <- abnormal_text_responses_1 %>% nrow() %>% as.character()

abnormal_text_responses_2 <- data_followup %>% select(analytic_id, followup_reflection_2) %>% filter(str_detect(followup_reflection_2, "http"))

n_abnormal_text_2 <- abnormal_text_responses_2 %>% nrow() %>% as.character()

abnormal_text_responses_3 <- data_followup %>% select(analytic_id, followup_reflection_3) %>% filter(str_detect(followup_reflection_3, "http"))

n_abnormal_text_3 <- abnormal_text_responses_3 %>% nrow() %>% as.character()

  • We noticed 156 participants who provided a link in followup_reflection_1, 77 participants who provided a link in followup_reflection_2, and 68 participants who provided a link in followup_reflection_3.

  • The links primarily point to ‘thumbs up’ image.

  • For responses with links, we generate a binary variable for abnormal responses

data_followup$abnormal_followup_reflection_1 <- ifelse(str_detect(data_followup$followup_reflection_1, "http"), 1, 0)
data_followup$abnormal_followup_reflection_2 <- ifelse(str_detect(data_followup$followup_reflection_2, "http"), 1, 0)
data_followup$abnormal_followup_reflection_3 <- ifelse(str_detect(data_followup$followup_reflection_3, "http"), 1, 0)

Create binary variables for free response questions

  • We’ll create binary variables for the free response questions.

  • followup_reflection_1_coded_num is the coded version of followup_reflection_1 where 1 indicates the participant provided a response and 0 indicates the participant did not provide a response.

  • followup_reflection_2_coded_num is the coded version of followup_reflection_2 where 1 indicates the participant provided a response with a link and 0 indicates the participant did not provide a response with a link.

  • followup_reflection_3_coded_num is the coded version of followup_reflection_3 where 1 indicates the participant provided a response with a link and 0 indicates the participant did not provide a response with a link.

data_followup$followup_reflection_1_coded_num <- ifelse(!(data_followup$followup_reflection_1==""), 1, 0)
text_1 <- as.character(sum(data_followup$followup_reflection_1_coded_num))
data_followup$followup_reflection_2_coded_num <- ifelse(!(data_followup$followup_reflection_2==""), 1, 0)
text_2 <- as.character(sum(data_followup$followup_reflection_2_coded_num))
data_followup$followup_reflection_3_coded_num <- ifelse(!(data_followup$followup_reflection_3==""), 1, 0)
text_3 <- as.character(sum(data_followup$followup_reflection_3_coded_num))
  • We have 18975 participants who provided a response for followup_reflection_1, 18943 participants who provided a response for followup_reflection_2, and 18853 participants who provided a response for followup_reflection_3.

Checking manipulative realiability order

  • Variable manipulative_reliable_order_followup indicates the order of the manipulative and reliable questions in the follow up.

  • We did not notice anything abnormal.

data_followup %>% count(manipulative_reliable_order_followup) > kable("html") |>
  kableExtra::kable_styling(bootstrap_options = c("striped", "hover")) |> scroll_box(width = "100%")
##      manipulative_reliable_order_followup    n
## [1,]                                 TRUE TRUE
## [2,]                                 TRUE TRUE
## [3,]                                   NA TRUE

Checking completing followup misinfo quiz

  • Variable completed_quiz_followup_coded_num indicates whether the participant completed the misinfo quiz in the follow up. We define quiz completion as having a time duration for the quiz.
data_followup <- data_followup %>%
  mutate(completed_quiz_followup_coded_num = ifelse(!is.na(duration_complete_quiz_followup), 1, 0))

Checking post-level variables

# Reshape post ids
data_long <- data_followup %>% 
    select(starts_with("post_id"), analytic_id, attention_check_passed_followup_coded_num, completed_quiz_followup_coded_num) %>%
    select(ends_with("_followup"),analytic_id, attention_check_passed_followup_coded_num, completed_quiz_followup_coded_num) %>%
  pivot_longer(
    cols=starts_with("post_id"),
    names_to="post_number_followup",
    values_to="post_id_followup",
    names_pattern="post_id_(.*)_followup",
    )


# Reshape manipulative scores
manipulative_score <- data_followup %>% 
  select(starts_with("post_id"), contains(c("_manipulative")), analytic_id) %>%
  select(ends_with("_followup"), analytic_id) %>%
  pivot_longer(
    cols = contains("_manipulative_followup"),
    names_to = "post_number_followup",
    values_to = "manipulative_score_followup",
    names_pattern = "post_(.*)_manipulative_followup"
  ) %>%
  select(post_number_followup, analytic_id, manipulative_score_followup)

# Reshape reliable scores
reliable_score <- data_followup %>% 
  select(starts_with("post_id"), contains(c("_reliable")), analytic_id) %>%
  select(ends_with("_followup"), analytic_id) %>%
  pivot_longer(
    cols = contains("_reliable_followup"),
    names_to = "post_number_followup",
    values_to = "reliable_score_followup",
    names_pattern = "post_(.*)_reliable_followup"
  ) %>%
  select(post_number_followup, analytic_id, reliable_score_followup)

# Reshape share scores
share_score <- data_followup %>%
  select(starts_with("post_id"), ends_with("_share_followup"), analytic_id) %>%
  pivot_longer(
    cols = contains("_share_followup"),
    names_to = "post_number_followup",
    values_to = "share_score_followup",
    names_pattern = "post_(.*)_share_followup"
  ) %>%
  select(post_number_followup, analytic_id, share_score_followup)


# Merging reshaped variables

data_long = data_long |>
  left_join(manipulative_score,
    by = c("analytic_id", "post_number_followup"),
    relationship = "one-to-one",
    unmatched = "error"
  ) |>
  left_join(reliable_score,
    by = c("analytic_id", "post_number_followup"),
    relationship = "one-to-one",
    unmatched = "error"
  ) |>
  left_join(share_score,
    by = c("analytic_id", "post_number_followup"),
    relationship = "one-to-one",
    unmatched = "error"
  )

# converting to numeric responses
    # for manipulative and reliable scores: 1 = not at all, 5 = very
    # for share score: 1 = yes, 0 = no


data_long = data_long |> 
  mutate(
    manipulative_score_followup = parse_number(manipulative_score_followup),
    reliable_score_followup = parse_number(reliable_score_followup),
    share_score_followup = case_when(
      tolower(share_score_followup) == "yes" ~ 1,
      tolower(share_score_followup) == "no" ~ 0,
      TRUE ~ NA_real_
    )
  )

Checking abnormal reliable and manipulative scores

  • abnormal_manipulativescore_followup or abnormal_reliablescore_followup responses for manipulative and reliable scores are not in {1,2,3,4,5}.
data_long <- data_long %>%
  mutate(
    abnormal_manipulativescore_followup = ifelse(!(manipulative_score_followup %in% 1:5) & !is.na(manipulative_score_followup), 1, 0),
    abnormal_reliablescore_followup = ifelse(!(reliable_score_followup %in% 1:5) & !is.na(reliable_score_followup), 1, 0)
  ) |>
  mutate(
    manipulative_score_followup = ifelse(abnormal_manipulativescore_followup == 1, NA_real_, manipulative_score_followup) |> as.integer(),
    reliable_score_followup = ifelse(abnormal_reliablescore_followup == 1, NA_real_, reliable_score_followup) |> as.integer()
  )
  • We identified 1 participant-answers with abnormal scores in the manipulative and reliable scores. We will exclude these scores from the analysis by recoding them as missing values.

Inspecting missing values

  • We are cautious of missing values in the quiz among completed_quiz_followup_coded_num. We will now evaluate the issue of missingness

  • We dropped attention check posts

# Creating post_type for each post
data_long <- data_long |>
  mutate(post_type_followup = case_when(
    str_detect(post_id_followup, "non_misinfo") ~ "non_misinfo",
    str_detect(post_id_followup, "discrediting") ~ "discrediting",
    str_detect(post_id_followup, "false") ~ "false_dichotomy",
    str_detect(post_id_followup, "attention_check") ~ "attention_check",
    str_detect(post_id_followup, "emotional") ~ "emotional",
    TRUE ~ "NA"
  ))

data_long = data_long |> filter(!post_type_followup == "attention_check") |> filter(completed_quiz_followup_coded_num == 1)

Checking missing values in post id

data_long |> group_by(post_id_followup) |>
   dplyr::summarize(n = n()) |>
  arrange(desc(n)) |> kable("html") |>
  kableExtra::kable_styling(bootstrap_options = c("striped", "hover")) |> scroll_box(width = "100%")
post_id_followup n
emotional_27 9642
discrediting_17 9601
false_dichotomy_23 9599
non_misinfo_2 9596
non_misinfo_6 9569
non_misinfo_10 9543
non_misinfo_8 9542
false_dichotomy_21 9526
discrediting_14 9524
emotional_28 9483

We did not notice any issues with missing values in the post id for followup.

Missing values per phase

Missing values per post order

We now look into whether the missing values are concentrated in a particular post order.

data_long |>
  group_by(post_number_followup) |>
   dplyr::summarize(
    `Total` = n(),
    `Missing Share Score` = sum(is.na(share_score_followup)),
    `Missing Reliable Score` = sum(is.na(reliable_score_followup)),
    `Missing Manipulative Score` = sum(is.na(manipulative_score_followup)),
    `Missing All Scores` = sum(is.na(share_score_followup) & is.na(reliable_score_followup) & is.na(manipulative_score_followup)),
    `All Scores Non-missing` = sum(!is.na(share_score_followup) & !is.na(reliable_score_followup) & !is.na(manipulative_score_followup)),
  ) |>
  kable("html", caption = "Missing values per post order") %>%
  kableExtra::kable_styling(bootstrap_options = c("striped", "hover")) %>%
  scroll_box(width = "100%")
Missing values per post order
post_number_followup Total Missing Share Score Missing Reliable Score Missing Manipulative Score Missing All Scores All Scores Non-missing
1 15934 0 0 2 0 15932
2 15957 1 2 1 1 15955
3 15898 1 2 2 1 15896
4 15967 0 1 2 0 15965
5 15921 1 1 2 0 15918
6 15948 4 1 0 0 15944

Missing values per post id

  • The missing values are equally distributed across the post ids.
data_long |>
  group_by(post_id_followup) |>
   dplyr::summarize(
    `Total` = n(),
    `Missing Share Score` = sum(is.na(share_score_followup)),
    `Missing Reliable Score` = sum(is.na(reliable_score_followup)),
    `Missing Manipulative Score` = sum(is.na(manipulative_score_followup)),
    `Missing All Scores` = sum(is.na(share_score_followup) & is.na(reliable_score_followup) & is.na(manipulative_score_followup)),
    `All Scores Non-missing` = sum(!is.na(share_score_followup) & !is.na(reliable_score_followup) & !is.na(manipulative_score_followup)),
  ) |>
  kable("html", caption = "Missing values per post id") |>
  kableExtra::kable_styling(bootstrap_options = c("striped", "hover")) |>
  scroll_box(width = "100%")
Missing values per post id
post_id_followup Total Missing Share Score Missing Reliable Score Missing Manipulative Score Missing All Scores All Scores Non-missing
discrediting_14 9524 1 1 2 1 9522
discrediting_17 9601 3 1 0 0 9597
emotional_27 9642 0 0 0 0 9642
emotional_28 9483 0 0 0 0 9483
false_dichotomy_21 9526 0 0 0 0 9526
false_dichotomy_23 9599 1 2 2 0 9596
non_misinfo_10 9543 1 2 1 0 9541
non_misinfo_2 9596 1 1 1 1 9595
non_misinfo_6 9569 0 0 1 0 9568
non_misinfo_8 9542 0 0 2 0 9540

Calculating mean scores for each participant

Note will use a restrictive sample definition, where we only consider the users with no missing values.

Variable definitions:

  • mean_share_misinfo: mean (across posts) intention to share misinformation posts for a given user; range [0, 1]
  • mean_reliable_misinfo: mean (across posts) reliable score for misinformation posts for a given user; range [1, 5]
  • mean_manipulative_misinfo: mean (across posts) manipulative score for misinformation posts for a given user; range [1, 5]
  • mean_share_nonmisinfo: mean (across posts) intention to share non-misinformation post for a given user; range [0, 1]
  • mean_reliable_nonmisinfo: mean (across posts) reliable score for non-misinformation posts for a given user; range [1, 5]
  • mean_manipulative_nonmisinfo: mean (across posts) manipulative score for non-misinformation posts for a given user; range [1, 5]
  • sharing_discernment: difference in mean share score between non-misinformation and misinformation posts for a given user; range [-1, 1]
  • reliability_discernment: difference in mean reliable score between non-misinformation and misinformation posts for a given user; range [-4, 4]
  • manipulation_discernment: difference in mean manipulative score between misinformation and non-misinformation posts for a given user; range [-4, 4]

Note that the discernment scores are constructed in such a way that a positive value indicates better discernment. For example, positive value for reliability discernment indicates that user scored non-misinformation posts as more reliable than misinformation posts. On the other hand, positive monipulative discernment indicates that user scored non-misinformation posts as less manipulative than misinformation posts.

n_before_drop_score_na <- as.character(length(unique(data_long$analytic_id)))

# Find users with missing answers
missing_scores = data_long |>
  group_by(analytic_id) |>
   dplyr::summarize(
    any_missing_share = any(is.na(share_score_followup)),
    any_missing_reliable = any(is.na(reliable_score_followup)),
    any_missing_manipulative = any(is.na(manipulative_score_followup)),
    any_missing = any(is.na(share_score_followup) | is.na(reliable_score_followup) | is.na(manipulative_score))
  ) |>
  filter(any_missing)

# Drop answers of users with missing scores
data_long = data_long |> filter(!(analytic_id %in% missing_scores$analytic_id))

n_after_drop_score_na <- as.character(length(unique(data_long$analytic_id)))

outcomes_misinfo = data_long |>
  filter(
    post_type_followup %in% c("discrediting", "false_dichotomy", "emotional")
  ) |>
  group_by(analytic_id) |>
   dplyr::summarize(
    mean_share_misinfo_followup = mean(share_score_followup),
    mean_reliable_misinfo_followup = mean(reliable_score_followup),
    mean_manipulative_misinfo_followup = mean(manipulative_score_followup)
  )

outcomes_nonmisinfo = data_long |>
  filter(post_type_followup == "non_misinfo") |>
  group_by(analytic_id) |>
   dplyr::summarize(
    mean_share_nonmisinfo_followup = mean(share_score_followup),
    mean_reliable_nonmisinfo_followup = mean(reliable_score_followup),
    mean_manipulative_nonmisinfo_followup = mean(manipulative_score_followup)
  )

# merging 
outcomes = outcomes_misinfo |>
  left_join(outcomes_nonmisinfo,
  by = "analytic_id",
  relationship = "one-to-one",
  unmatched = "error"
  )


outcomes = outcomes |>
  mutate(
    sharing_discernment_followup = mean_share_nonmisinfo_followup - mean_share_misinfo_followup,
    reliability_discernment_followup = mean_reliable_nonmisinfo_followup - mean_reliable_misinfo_followup,
    manipulation_discernment_followup = mean_manipulative_misinfo_followup - mean_manipulative_nonmisinfo_followup
  )

  • For the purpose of our analysis, we dropped participants with at least one missing value in sharing, manipulative, reliability scores.

  • Before dropping, we had 19125 participants and after dropping we have 19115 participants.

data_followup_wide_final <- data_followup %>% 
  select(
    analytic_id, MisinfoChat_start_time_followup, MisinfoQuiz_start_time_followup,
    misinfoQuiz_end_time_followup, duration_complete_quiz_followup,
    time_since_completed_intervention, time_since_completed_quiz,
    attention_check_passed_followup_coded_num,
    user_payment_amount_followup, followup_entry_point, followup_reflection_1, followup_reflection_2,
    followup_reflection_3, abnormal_followup_reflection_1, abnormal_followup_reflection_2,
    abnormal_followup_reflection_3, completed_quiz_followup_coded_num) |>
  left_join(
    outcomes,
    by = "analytic_id",
    relationship = "one-to-one")

data_followup_wide_final = data_followup_wide_final |> 
  mutate(
    quiz_completed_followup = !is.na(mean_share_misinfo_followup) & !is.na(mean_reliable_misinfo_followup) & !is.na(mean_manipulative_misinfo_followup) & !is.na(mean_share_nonmisinfo_followup) & !is.na(mean_reliable_nonmisinfo_followup) & !is.na(mean_manipulative_nonmisinfo_followup)
  )

# Recode attention check to NA for those who did not complete the quiz
data_followup_wide_final = data_followup_wide_final |> 
  mutate(
    attention_check_passed_followup_coded_num = ifelse(quiz_completed_followup, attention_check_passed_followup_coded_num, NA_real_)
  )

Merge main and follow up dataset for more checks

df_wide <- fread("./data/chatfuel/processed/misinfo_clean_wide.csv.gz")
data_followup_wide_final$analytic_id <- as.character(data_followup_wide_final$analytic_id)
df_wide_followup = df_wide  |> 
    inner_join(
        data_followup_wide_final,
        by = "analytic_id",
        relationship = "one-to-one",
        unmatched = c("drop", "error")
    )

Checking quiz completers in the follow up and quiz completers in the main survey

  • We first check the number of participants who completed the follow-up misinformation quiz but were indicated as not completing the main misinformation quiz.

  • We defined main survey quiz completers as participants who had a recorded ending time stamp for the misinformation quiz in the main survey AND had non-missing values for all of the quiz-specific variables in the main survey.

  • We defined follow-up quiz completers as participants who had a recorded ending time stamp for the misinformation quiz in the follow-up survey AND had non-missing values for all of the quiz-specific variables in the follow-up survey.

abnormal_completed_followup <- df_wide_followup %>% 
  filter(quiz_completed_followup == "TRUE" & quiz_completed_coded == "FALSE")


n_abnormal_completed_followup <- as.character(nrow(abnormal_completed_followup)) 

abnormal_completed_followup %>% select(analytic_id, phase_coded, arm_coded, quiz_completed_followup, quiz_completed_coded, 
                                       mean_reliable_misinfo, mean_manipulative_misinfo, mean_share_misinfo, 
                                       mean_reliable_nonmisinfo, mean_manipulative_nonmisinfo, mean_share_nonmisinfo,
                                       sharing_discernment, reliability_discernment, manipulation_discernment, 
                                       mean_reliable_misinfo_followup, mean_manipulative_misinfo_followup, mean_share_misinfo_followup,
                                       mean_reliable_nonmisinfo_followup, mean_manipulative_nonmisinfo_followup, mean_share_nonmisinfo_followup,
                                       sharing_discernment_followup, reliability_discernment_followup, manipulation_discernment_followup) %>% 
  kable("html") %>%
  kableExtra::kable_styling(bootstrap_options = c("striped", "hover")) %>%
  scroll_box(width = "100%", height = "400px")
analytic_id phase_coded arm_coded quiz_completed_followup quiz_completed_coded mean_reliable_misinfo mean_manipulative_misinfo mean_share_misinfo mean_reliable_nonmisinfo mean_manipulative_nonmisinfo mean_share_nonmisinfo sharing_discernment reliability_discernment manipulation_discernment mean_reliable_misinfo_followup mean_manipulative_misinfo_followup mean_share_misinfo_followup mean_reliable_nonmisinfo_followup mean_manipulative_nonmisinfo_followup mean_share_nonmisinfo_followup sharing_discernment_followup reliability_discernment_followup manipulation_discernment_followup
590_2023-11-17 03:17:33_2023-11-17 03:17:33 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.333333 2.333333 0.6666667 4.0 2.0 1.0 0.3333333 0.6666667 0.3333333
663_2023-11-17 04:14:38_2023-11-17 04:44:42 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 4.666667 4.000000 1.0000000 3.5 4.0 1.0 0.0000000 -1.1666667 0.0000000
776_2023-11-17 06:03:46_2023-11-17 06:03:46 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 1.000000 0.6666667 2.5 3.0 0.5 -0.1666667 1.1666667 -2.0000000
1007_2023-11-17 08:10:30_2023-11-17 08:10:30 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 3.666667 1.0000000 4.5 4.5 1.0 0.0000000 2.1666667 -0.8333333
1103_2023-11-17 08:51:47_2023-11-17 08:51:47 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 1.333333 1.0000000 2.0 2.0 1.0 0.0000000 0.3333333 -0.6666667
1141_2023-11-17 09:07:26_2023-11-17 09:08:01 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 5.000000 1.0000000 3.5 5.0 0.5 -0.5000000 -1.5000000 0.0000000
1190_2023-11-17 09:30:41_2023-11-17 09:30:41 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 5.000000 1.0000000 5.0 1.0 1.0 0.0000000 1.3333333 4.0000000
1196_2023-11-17 09:31:45_2023-11-17 09:31:45 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 5.000000 0.3333333 3.5 3.0 1.0 0.6666667 1.1666667 2.0000000
1211_2023-11-17 09:38:27_2023-11-17 09:38:27 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 4.666667 1.000000 1.0000000 4.5 1.0 1.0 0.0000000 -0.1666667 0.0000000
1238_2023-11-17 09:50:41_2023-11-17 09:50:41 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 3.666667 1.0000000 3.0 2.5 1.0 0.0000000 0.6666667 1.1666667
1250_2023-11-17 09:57:22_2023-11-17 09:57:22 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 5.000000 0.0000000 1.0 2.5 0.0 0.0000000 0.0000000 2.5000000
1535_2023-11-17 11:46:34_2023-11-17 11:46:34 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 1.000000 1.0000000 2.0 1.5 1.0 0.0000000 0.3333333 -0.5000000
1547_2023-11-17 11:49:51_2023-11-17 11:49:51 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 2.333333 0.6666667 2.0 2.0 1.0 0.3333333 0.3333333 0.3333333
1580_2023-11-17 11:59:48_2023-11-17 11:59:48 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 3.333333 3.333333 1.0000000 4.0 3.0 1.0 0.0000000 0.6666667 0.3333333
1701_2023-11-17 12:47:40_2023-11-17 12:47:40 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 2.333333 1.0000000 2.0 2.5 1.0 0.0000000 0.0000000 -0.1666667
1946_2023-11-17 14:15:47_2023-11-17 14:15:47 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 1.666667 0.6666667 2.0 2.0 1.0 0.3333333 0.6666667 -0.3333333
2000_2023-11-17 14:41:38_2023-11-17 14:41:38 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 4.000000 1.0000000 4.0 5.0 1.0 0.0000000 -1.0000000 -1.0000000
2001_2023-11-17 14:41:41_2023-11-17 14:41:41 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 4.333333 0.0000000 4.5 1.0 1.0 1.0000000 2.8333333 3.3333333
2026_2023-11-17 14:50:32_2023-11-17 14:50:32 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 4.000000 2.666667 1.0000000 4.0 1.5 1.0 0.0000000 0.0000000 1.1666667
2041_2023-11-17 14:55:51_2023-11-17 14:55:51 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 2.000000 0.0000000 2.0 1.0 1.0 1.0000000 1.0000000 1.0000000
2102_2023-11-17 15:21:24_2023-11-17 15:21:24 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 2.666667 1.0000000 2.5 3.0 1.0 0.0000000 0.5000000 -0.3333333
2174_2023-11-17 15:54:46_2023-11-17 15:54:46 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 1.333333 0.6666667 2.0 1.0 1.0 0.3333333 0.3333333 0.3333333
2212_2023-11-17 16:13:09_2023-11-17 16:13:09 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 3.333333 0.3333333 4.0 2.0 1.0 0.6666667 2.0000000 1.3333333
2311_2023-11-17 16:49:41_2023-11-17 16:49:42 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 3.000000 2.666667 0.3333333 4.5 1.0 1.0 0.6666667 1.5000000 1.6666667
2384_2023-11-17 17:20:55_2023-11-17 17:20:55 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 4.000000 1.0000000 5.0 4.5 1.0 0.0000000 0.0000000 -0.5000000
2645_2023-11-17 18:59:35_2023-11-17 18:59:35 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 1.000000 0.0000000 1.0 1.0 0.0 0.0000000 0.0000000 0.0000000
2725_2023-11-17 12:06:38_2023-11-17 19:26:51 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 2.000000 0.6666667 1.5 1.5 0.5 -0.1666667 -0.1666667 0.5000000
2784_2023-11-17 03:54:27_2023-11-17 19:43:16 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 2.666667 5.000000 0.6666667 2.0 5.0 0.5 -0.1666667 -0.6666667 0.0000000
2818_2023-11-17 19:52:50_2023-11-17 19:52:50 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 2.666667 0.3333333 4.0 1.0 1.0 0.6666667 1.6666667 1.6666667
2889_2023-11-17 20:13:39_2023-11-17 20:15:07 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 1.666667 0.3333333 1.5 2.0 0.5 0.1666667 0.1666667 -0.3333333
3024_2023-11-18 03:20:16_2023-11-18 03:20:16 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 4.000000 3.666667 1.0000000 4.0 2.5 1.0 0.0000000 0.0000000 1.1666667
3056_2023-11-18 05:10:35_2023-11-18 05:10:35 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 4.666667 0.0000000 1.5 4.0 0.0 0.0000000 -0.5000000 0.6666667
3089_2023-11-18 05:23:40_2023-11-18 05:23:40 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 1.000000 0.3333333 1.5 1.0 1.0 0.6666667 -0.1666667 0.0000000
3174_2023-11-18 05:43:14_2023-11-18 05:43:14 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 2.333333 0.6666667 5.0 1.0 1.0 0.3333333 1.3333333 1.3333333
3352_2023-11-17 13:52:05_2023-11-18 06:30:04 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 3.666667 0.3333333 3.0 1.5 1.0 0.6666667 0.6666667 2.1666667
3359_2023-11-18 05:59:12_2023-11-18 06:31:42 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 2.000000 0.3333333 2.0 1.0 1.0 0.6666667 1.0000000 1.0000000
3374_2023-11-18 06:35:31_2023-11-18 06:35:31 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 3.000000 0.3333333 3.0 3.5 0.5 0.1666667 0.6666667 -0.5000000
3516_2023-11-18 07:12:25_2023-11-18 07:12:25 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 5.000000 0.0000000 1.0 4.5 0.0 0.0000000 0.0000000 0.5000000
3600_2023-11-18 07:39:53_2023-11-18 07:39:53 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 2.333333 1.0000000 3.0 3.0 1.0 0.0000000 0.6666667 -0.6666667
3619_2023-11-18 07:43:58_2023-11-18 07:43:58 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 2.333333 1.0000000 2.0 2.0 1.0 0.0000000 0.0000000 0.3333333
3634_2023-11-18 07:47:26_2023-11-18 07:47:26 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 1.333333 1.0000000 1.5 2.0 0.0 -1.0000000 -0.1666667 -0.6666667
3736_2023-11-18 08:20:41_2023-11-18 08:20:41 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 3.000000 0.3333333 3.5 1.0 1.0 0.6666667 1.5000000 2.0000000
3760_2023-11-18 08:25:54_2023-11-18 08:25:54 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 1.666667 1.0000000 1.5 2.0 1.0 0.0000000 0.1666667 -0.3333333
3800_2023-11-18 08:35:06_2023-11-18 08:35:06 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.666667 3.666667 0.3333333 3.0 2.5 0.5 0.1666667 0.3333333 1.1666667
3885_2023-11-18 09:04:46_2023-11-18 09:04:46 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 1.000000 1.0000000 5.0 1.0 1.0 0.0000000 0.0000000 0.0000000
3976_2023-11-18 09:35:29_2023-11-18 09:35:29 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 1.333333 0.3333333 1.0 3.0 0.0 -0.3333333 -0.3333333 -1.6666667
4196_2023-11-18 06:15:42_2023-11-18 10:46:33 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 2.000000 0.6666667 2.0 1.0 1.0 0.3333333 0.3333333 1.0000000
4211_2023-11-18 10:50:26_2023-11-18 10:50:26 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 4.333333 4.333333 0.6666667 4.5 3.5 1.0 0.3333333 0.1666667 0.8333333
4262_2023-11-18 11:04:13_2023-11-18 11:04:13 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 4.000000 4.000000 1.0000000 4.0 4.0 1.0 0.0000000 0.0000000 0.0000000
4483_2023-11-18 12:08:23_2023-11-18 12:08:23 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 1.333333 1.0000000 4.5 3.0 1.0 0.0000000 0.8333333 -1.6666667
4600_2023-11-18 12:42:03_2023-11-18 12:42:03 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 1.000000 1.0000000 5.0 3.0 1.0 0.0000000 0.0000000 -2.0000000
4634_2023-11-17 17:43:01_2023-11-18 12:53:18 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 2.000000 1.0000000 2.0 2.0 1.0 0.0000000 0.0000000 0.0000000
4686_2023-11-18 13:11:27_2023-11-18 13:11:27 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 4.666667 4.666667 1.0000000 3.0 3.0 0.5 -0.5000000 -1.6666667 1.6666667
4701_2023-11-18 13:14:31_2023-11-18 13:14:31 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 1.000000 1.0000000 5.0 1.0 1.0 0.0000000 0.0000000 0.0000000
4706_2023-11-18 13:17:04_2023-11-18 13:17:04 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 4.000000 0.0000000 3.5 2.5 0.5 0.5000000 1.5000000 1.5000000
4726_2023-11-18 13:22:16_2023-11-18 13:22:16 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 3.000000 0.0000000 2.0 1.5 0.5 0.5000000 0.3333333 1.5000000
4750_2023-11-18 13:28:17_2023-11-18 13:28:19 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 5.000000 0.0000000 1.0 5.0 0.0 0.0000000 0.0000000 0.0000000
4758_2023-11-18 13:32:04_2023-11-18 13:32:04 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 5.000000 0.0000000 2.5 4.5 0.0 0.0000000 1.5000000 0.5000000
4907_2023-11-18 07:36:55_2023-11-18 14:09:29 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 4.666667 1.333333 1.0000000 4.0 2.5 0.5 -0.5000000 -0.6666667 -1.1666667
4917_2023-11-18 14:11:19_2023-11-18 14:11:19 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 4.000000 0.0000000 4.0 1.0 1.0 1.0000000 2.6666667 3.0000000
5011_2023-11-18 14:36:36_2023-11-18 14:36:36 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 3.666667 0.3333333 2.0 1.5 1.0 0.6666667 0.0000000 2.1666667
5029_2023-11-18 14:40:49_2023-11-18 14:40:49 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 1.000000 1.0000000 5.0 1.0 1.0 0.0000000 0.0000000 0.0000000
5092_2023-11-18 10:35:14_2023-11-18 15:00:50 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 4.000000 3.666667 1.0000000 3.0 4.0 1.0 0.0000000 -1.0000000 -0.3333333
5131_2023-11-17 03:51:47_2023-11-18 15:09:38 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 1.000000 1.0000000 2.0 1.5 1.0 0.0000000 0.6666667 -0.5000000
5191_2023-11-18 06:47:18_2023-11-18 15:24:49 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 2.000000 1.0000000 2.0 2.0 1.0 0.0000000 0.0000000 0.0000000
5238_2023-11-18 15:38:25_2023-11-18 15:38:25 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 3.666667 0.0000000 5.0 1.0 1.0 1.0000000 2.6666667 2.6666667
5502_2023-11-18 16:55:53_2023-11-18 16:55:53 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 1.000000 0.6666667 1.5 1.5 1.0 0.3333333 0.1666667 -0.5000000
5536_2023-11-18 17:06:41_2023-11-18 17:06:41 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 3.666667 0.3333333 2.5 3.0 0.0 -0.3333333 0.1666667 0.6666667
5666_2023-11-18 17:43:44_2023-11-18 17:43:44 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 4.333333 0.0000000 3.0 3.0 0.5 0.5000000 1.6666667 1.3333333
5790_2023-11-18 18:17:50_2023-11-18 18:17:50 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 4.333333 0.3333333 4.0 3.0 0.5 0.1666667 1.6666667 1.3333333
5815_2023-11-18 18:24:41_2023-11-18 18:24:41 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 1.000000 0.0000000 5.0 1.0 0.5 0.5000000 0.0000000 0.0000000
5976_2023-11-18 19:06:49_2023-11-18 19:06:49 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 4.000000 4.333333 1.0000000 1.5 3.0 0.5 -0.5000000 -2.5000000 1.3333333
6045_2023-11-18 19:21:56_2023-11-18 19:21:56 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 5.000000 0.0000000 3.5 1.0 1.0 1.0000000 2.5000000 4.0000000
6082_2023-11-18 19:31:00_2023-11-18 19:31:00 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 3.666667 0.6666667 2.5 3.0 1.0 0.3333333 -1.1666667 0.6666667
6258_2023-11-18 20:16:19_2023-11-18 20:16:19 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 2.333333 0.0000000 2.0 2.0 1.0 1.0000000 0.6666667 0.3333333
6283_2023-11-17 16:33:01_2023-11-18 20:20:56 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 2.666667 1.666667 1.0000000 4.0 1.5 1.0 0.0000000 1.3333333 0.1666667
6541_2023-11-19 01:03:18_2023-11-19 01:03:27 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 4.666667 4.333333 1.0000000 4.5 4.5 1.0 0.0000000 -0.1666667 -0.1666667
6733_2023-11-19 04:20:58_2023-11-19 04:20:58 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 1.000000 1.0000000 1.0 1.0 1.0 0.0000000 0.0000000 0.0000000
6765_2023-11-19 04:38:45_2023-11-19 04:38:45 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 4.000000 1.0000000 3.5 4.5 1.0 0.0000000 -1.5000000 -0.5000000
6770_2023-11-19 04:40:57_2023-11-19 04:40:57 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 3.666667 1.0000000 5.0 5.0 1.0 0.0000000 0.0000000 -1.3333333
6914_2023-11-19 05:24:32_2023-11-19 05:24:32 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 3.333333 0.3333333 5.0 1.5 1.0 0.6666667 2.6666667 1.8333333
6921_2023-11-19 05:27:29_2023-11-19 05:27:29 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 4.000000 3.000000 1.0000000 3.5 3.5 1.0 0.0000000 -0.5000000 -0.5000000
7062_2023-11-19 06:09:31_2023-11-19 06:09:31 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 2.000000 0.0000000 3.0 2.0 0.5 0.5000000 1.6666667 0.0000000
7172_2023-11-19 06:36:54_2023-11-19 06:36:55 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.333333 2.666667 0.6666667 3.0 3.0 0.5 -0.1666667 -0.3333333 -0.3333333
7206_2023-11-19 06:44:18_2023-11-19 06:44:18 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 1.000000 1.0000000 2.0 1.0 1.0 0.0000000 0.3333333 0.0000000
7315_2023-11-19 07:10:58_2023-11-19 07:10:58 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 1.000000 1.0000000 2.0 1.0 1.0 0.0000000 0.3333333 0.0000000
7394_2023-11-19 06:16:30_2023-11-19 07:30:59 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 3.666667 0.3333333 2.5 2.0 1.0 0.6666667 0.5000000 1.6666667
7423_2023-11-19 07:37:22_2023-11-19 07:37:22 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 2.333333 0.6666667 4.5 2.5 1.0 0.3333333 2.5000000 -0.1666667
7430_2023-11-19 07:39:08_2023-11-19 07:39:08 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 2.333333 1.0000000 3.0 3.0 0.5 -0.5000000 -0.6666667 -0.6666667
7462_2023-11-18 12:18:12_2023-11-19 07:46:11 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 4.333333 0.3333333 5.0 1.0 1.0 0.6666667 3.3333333 3.3333333
7480_2023-11-19 07:49:21_2023-11-19 07:49:21 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 3.000000 0.0000000 1.5 3.0 0.0 0.0000000 0.5000000 0.0000000
7683_2023-11-19 08:35:43_2023-11-19 08:35:43 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 3.000000 1.666667 0.6666667 4.5 1.0 1.0 0.3333333 1.5000000 0.6666667
7688_2023-11-19 08:37:42_2023-11-19 08:37:42 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 3.333333 0.3333333 1.0 5.0 0.0 -0.3333333 -1.3333333 -1.6666667
7897_2023-11-19 09:23:35_2023-11-19 09:23:35 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 4.333333 1.000000 1.0000000 3.0 2.5 1.0 0.0000000 -1.3333333 -1.5000000
7924_2023-11-19 09:28:27_2023-11-19 09:28:27 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 2.333333 1.0000000 5.0 1.0 1.0 0.0000000 0.0000000 1.3333333
7973_2023-11-18 18:16:58_2023-11-19 09:40:15 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 2.000000 1.0000000 2.5 1.0 0.0 -1.0000000 0.5000000 1.0000000
8025_2023-11-19 09:50:20_2023-11-19 09:50:20 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 1.333333 1.0000000 2.0 1.0 1.0 0.0000000 -1.6666667 0.3333333
8090_2023-11-19 10:04:54_2023-11-19 10:04:54 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 3.333333 3.000000 0.6666667 4.5 1.5 1.0 0.3333333 1.1666667 1.5000000
8277_2023-11-19 10:45:29_2023-11-19 10:45:29 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 2.666667 1.0000000 2.5 3.0 1.0 0.0000000 0.8333333 -0.3333333
8305_2023-11-19 10:53:09_2023-11-19 10:53:10 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 3.000000 0.3333333 2.0 3.0 0.5 0.1666667 0.3333333 0.0000000
8702_2023-11-19 12:09:05_2023-11-19 12:09:05 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 4.000000 2.333333 0.6666667 3.0 1.0 1.0 0.3333333 -1.0000000 1.3333333
8704_2023-11-19 12:09:19_2023-11-19 12:09:19 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 3.666667 0.3333333 4.0 2.5 1.0 0.6666667 1.6666667 1.1666667
8733_2023-11-19 12:14:26_2023-11-19 12:14:26 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 3.000000 4.666667 0.6666667 3.0 3.0 1.0 0.3333333 0.0000000 1.6666667
8805_2023-11-19 12:29:41_2023-11-19 12:29:41 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 2.000000 1.0000000 2.0 2.0 1.0 0.0000000 0.0000000 0.0000000
8860_2023-11-19 12:42:28_2023-11-19 12:42:28 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 2.000000 0.0000000 1.5 2.0 0.5 0.5000000 0.1666667 0.0000000
9019_2023-11-19 13:12:23_2023-11-19 13:12:23 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 3.333333 1.0000000 3.0 2.0 1.0 0.0000000 1.0000000 1.3333333
9022_2023-11-19 08:47:08_2023-11-19 13:12:45 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 4.666667 1.0000000 5.0 5.0 1.0 0.0000000 0.0000000 -0.3333333
9037_2023-11-19 13:15:38_2023-11-19 13:15:38 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 2.000000 1.0000000 5.0 2.5 1.0 0.0000000 1.3333333 -0.5000000
9091_2023-11-19 13:27:04_2023-11-19 13:27:04 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 2.000000 0.3333333 1.5 1.0 1.0 0.6666667 0.1666667 1.0000000
9153_2023-11-19 13:40:18_2023-11-19 13:40:18 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 2.333333 0.6666667 2.5 2.0 1.0 0.3333333 0.1666667 0.3333333
9321_2023-11-19 14:18:46_2023-11-19 14:18:46 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 4.000000 0.0000000 1.5 3.0 0.0 0.0000000 -0.8333333 1.0000000
9438_2023-11-19 11:53:29_2023-11-19 14:43:34 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 3.666667 0.3333333 3.5 1.0 1.0 0.6666667 2.1666667 2.6666667
9550_2023-11-19 15:06:44_2023-11-19 15:06:44 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 4.000000 5.000000 1.0000000 5.0 3.0 1.0 0.0000000 1.0000000 2.0000000
9568_2023-11-18 12:19:44_2023-11-19 15:11:04 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 2.333333 0.0000000 5.0 1.0 0.5 0.5000000 3.0000000 1.3333333
9588_2023-11-19 15:18:18_2023-11-19 15:18:18 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 2.333333 0.6666667 1.5 3.0 0.5 -0.1666667 -0.1666667 -0.6666667
9595_2023-11-19 15:20:35_2023-11-19 15:20:35 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 1.333333 1.0000000 3.5 1.0 1.0 0.0000000 -1.5000000 0.3333333
9653_2023-11-19 15:32:36_2023-11-19 15:32:36 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 5.000000 1.0000000 5.0 5.0 1.0 0.0000000 0.0000000 0.0000000
9657_2023-11-19 15:33:39_2023-11-19 15:33:39 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 2.000000 1.0000000 2.0 2.0 1.0 0.0000000 0.0000000 0.0000000
9737_2023-11-19 15:53:21_2023-11-19 15:53:21 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 3.333333 0.0000000 3.5 3.0 0.5 0.5000000 1.1666667 0.3333333
9857_2023-11-19 16:23:32_2023-11-19 16:23:33 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 1.000000 0.0000000 1.0 1.0 0.0 0.0000000 0.0000000 0.0000000
9871_2023-11-19 16:27:14_2023-11-19 16:27:14 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 5.000000 0.0000000 1.0 5.0 0.0 0.0000000 0.0000000 0.0000000
10026_2023-11-19 08:08:54_2023-11-19 17:09:19 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 3.333333 4.000000 0.6666667 2.0 2.0 0.5 -0.1666667 -1.3333333 2.0000000
10227_2023-11-19 17:56:11_2023-11-19 17:56:11 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 4.000000 2.666667 1.0000000 2.0 3.5 0.0 -1.0000000 -2.0000000 -0.8333333
10245_2023-11-19 17:59:00_2023-11-19 17:59:00 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 4.000000 1.0000000 5.0 3.0 1.0 0.0000000 0.0000000 1.0000000
10252_2023-11-19 18:00:29_2023-11-19 18:00:29 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 3.666667 0.3333333 3.0 5.0 0.5 0.1666667 2.0000000 -1.3333333
10432_2023-11-19 18:34:34_2023-11-19 18:34:34 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 3.000000 4.000000 0.6666667 2.5 3.5 0.5 -0.1666667 -0.5000000 0.5000000
10507_2023-11-19 15:43:50_2023-11-19 18:51:15 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.333333 1.000000 0.0000000 2.0 2.5 0.0 0.0000000 -1.3333333 -1.5000000
10521_2023-11-19 18:53:36_2023-11-19 18:53:36 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 1.000000 1.0000000 5.0 1.0 1.0 0.0000000 0.0000000 0.0000000
10637_2023-11-19 19:16:29_2023-11-19 19:16:29 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 2.333333 0.0000000 2.0 1.5 1.0 1.0000000 -0.3333333 0.8333333
10655_2023-11-19 19:17:15_2023-11-19 19:19:08 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 3.666667 0.6666667 4.0 2.0 1.0 0.3333333 0.3333333 1.6666667
10728_2023-11-19 19:29:50_2023-11-19 19:30:37 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 3.000000 2.666667 1.0000000 4.0 4.0 0.0 -1.0000000 1.0000000 -1.3333333
10739_2023-11-19 19:34:41_2023-11-19 19:34:41 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 4.000000 1.333333 1.0000000 2.5 3.0 0.5 -0.5000000 -1.5000000 -1.6666667
10794_2023-11-19 19:43:32_2023-11-19 19:43:32 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 1.000000 0.0000000 1.5 1.0 0.5 0.5000000 -0.1666667 0.0000000
11082_2023-11-19 20:45:10_2023-11-19 20:45:10 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.000000 3.333333 1.0000000 5.0 1.0 1.0 0.0000000 2.0000000 2.3333333
11100_2023-11-19 20:50:35_2023-11-19 20:50:35 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 1.666667 1.0000000 1.5 2.0 1.0 0.0000000 -0.5000000 -0.3333333
11111_2023-11-19 20:53:09_2023-11-19 20:53:09 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 2.333333 0.0000000 3.5 3.0 0.0 0.0000000 -0.1666667 -0.6666667
11141_2023-11-19 21:03:06_2023-11-19 21:03:06 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 1.666667 1.0000000 2.5 2.5 1.0 0.0000000 -1.1666667 -0.8333333
11199_2023-11-19 20:21:07_2023-11-19 21:22:41 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 2.666667 4.333333 0.3333333 4.0 3.0 0.5 0.1666667 1.3333333 1.3333333
11235_2023-11-19 21:35:30_2023-11-19 21:35:30 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 1.000000 1.0000000 3.5 1.0 1.0 0.0000000 -1.5000000 0.0000000
11332_2023-11-19 22:20:34_2023-11-19 22:20:34 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 2.000000 0.6666667 1.5 1.0 1.0 0.3333333 -0.1666667 1.0000000
11416_2023-11-19 23:41:39_2023-11-19 23:41:39 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 2.333333 0.0000000 1.0 3.0 0.5 0.5000000 -1.3333333 -0.6666667
11424_2023-11-19 23:50:33_2023-11-19 23:50:33 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 1.333333 0.0000000 2.0 1.0 0.5 0.5000000 0.3333333 0.3333333
11502_2023-11-20 02:05:56_2023-11-20 02:05:56 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 3.000000 1.666667 0.3333333 1.5 1.5 0.5 0.1666667 -1.5000000 0.1666667
11534_2023-11-20 02:48:29_2023-11-20 02:48:29 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 5.000000 0.0000000 1.5 2.0 0.5 0.5000000 0.5000000 3.0000000
11608_2023-11-20 03:50:13_2023-11-20 03:50:13 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 3.333333 3.666667 0.6666667 1.0 1.0 0.0 -0.6666667 -2.3333333 2.6666667
11619_2023-11-20 03:57:51_2023-11-20 03:57:51 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.666667 2.000000 1.0000000 3.5 3.5 0.5 -0.5000000 0.8333333 -1.5000000
11650_2023-11-20 04:21:57_2023-11-20 04:21:57 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 3.000000 2.666667 0.6666667 5.0 1.5 1.0 0.3333333 2.0000000 1.1666667
11654_2023-11-20 04:23:24_2023-11-20 04:23:24 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 2.333333 0.3333333 2.0 2.0 1.0 0.6666667 0.0000000 0.3333333
11674_2023-11-20 04:34:40_2023-11-20 04:34:40 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 3.333333 3.333333 0.6666667 4.0 2.5 1.0 0.3333333 0.6666667 0.8333333
11680_2023-11-20 04:37:14_2023-11-20 04:37:14 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 1.333333 0.3333333 2.0 1.5 0.5 0.1666667 0.6666667 -0.1666667
11706_2023-11-20 04:51:18_2023-11-20 04:51:18 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 3.000000 1.666667 1.0000000 3.0 1.0 1.0 0.0000000 0.0000000 0.6666667
11715_2023-11-20 04:57:06_2023-11-20 04:57:06 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 3.000000 2.666667 0.0000000 3.5 3.0 0.5 0.5000000 0.5000000 -0.3333333
11836_2023-11-20 05:42:05_2023-11-20 05:42:05 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 1.666667 0.3333333 1.0 2.0 0.5 0.1666667 -0.6666667 -0.3333333
11878_2023-11-20 05:55:22_2023-11-20 05:55:22 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 2.333333 1.0000000 5.0 1.0 1.0 0.0000000 1.3333333 1.3333333
11906_2023-11-20 06:05:57_2023-11-20 06:05:57 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 1.666667 1.0000000 2.5 2.0 1.0 0.0000000 0.1666667 -0.3333333
11978_2023-11-20 06:27:11_2023-11-20 06:27:11 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.666667 2.000000 0.6666667 5.0 1.0 1.0 0.3333333 2.3333333 1.0000000
11982_2023-11-20 06:28:09_2023-11-20 06:28:09 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 3.000000 3.000000 0.6666667 3.0 3.0 1.0 0.3333333 0.0000000 0.0000000
12000_2023-11-20 06:34:17_2023-11-20 06:34:17 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 3.666667 0.6666667 1.0 3.0 0.5 -0.1666667 -2.6666667 0.6666667
12086_2023-11-20 06:59:55_2023-11-20 06:59:55 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 1.666667 0.3333333 2.5 2.5 1.0 0.6666667 0.8333333 -0.8333333
12101_2023-11-20 07:07:02_2023-11-20 07:07:02 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 3.000000 2.666667 0.6666667 1.5 1.5 0.5 -0.1666667 -1.5000000 1.1666667
12102_2023-11-20 07:07:04_2023-11-20 07:07:04 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 4.333333 0.0000000 4.0 2.0 1.0 1.0000000 2.6666667 2.3333333
12111_2023-11-20 07:08:50_2023-11-20 07:08:52 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.666667 2.000000 0.3333333 4.5 1.5 1.0 0.6666667 1.8333333 0.5000000
12283_2023-11-20 08:06:34_2023-11-20 08:06:34 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 4.666667 3.666667 1.0000000 5.0 5.0 1.0 0.0000000 0.3333333 -1.3333333
12325_2023-11-17 20:22:10_2023-11-20 08:17:45 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 5.000000 1.0000000 5.0 5.0 1.0 0.0000000 0.0000000 0.0000000
12374_2023-11-18 09:04:04_2023-11-20 08:34:29 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 5.000000 0.0000000 5.0 1.0 1.0 1.0000000 4.0000000 4.0000000
12453_2023-11-18 10:09:00_2023-11-20 09:10:28 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 1.333333 0.3333333 2.0 1.5 0.5 0.1666667 0.0000000 -0.1666667
12605_2023-11-20 10:03:02_2023-11-20 10:03:02 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 2.000000 1.0000000 5.0 1.0 1.0 0.0000000 2.6666667 1.0000000
12665_2023-11-20 10:26:47_2023-11-20 10:26:47 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 3.666667 0.6666667 5.0 5.0 1.0 0.3333333 3.0000000 -1.3333333
12715_2023-11-19 21:02:14_2023-11-20 10:37:10 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 1.333333 1.0000000 2.0 1.0 1.0 0.0000000 0.0000000 0.3333333
12748_2023-11-20 10:45:34_2023-11-20 10:45:34 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 3.333333 0.6666667 3.5 3.0 0.5 -0.1666667 -0.1666667 0.3333333
12760_2023-11-20 10:48:53_2023-11-20 10:48:53 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 4.000000 0.6666667 2.0 3.5 0.0 -0.6666667 -0.3333333 0.5000000
12814_2023-11-20 11:06:38_2023-11-20 11:06:38 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 2.666667 0.3333333 4.0 3.5 1.0 0.6666667 1.6666667 -0.8333333
12832_2023-11-20 11:14:36_2023-11-20 11:14:36 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 1.000000 1.0000000 1.5 1.5 0.5 -0.5000000 0.5000000 -0.5000000
12948_2023-11-20 11:53:11_2023-11-20 11:53:11 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 2.333333 0.6666667 1.0 5.0 0.0 -0.6666667 -2.6666667 -2.6666667
12994_2023-11-20 12:07:17_2023-11-20 12:07:17 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 3.333333 0.6666667 2.5 3.5 1.0 0.3333333 0.5000000 -0.1666667
13008_2023-11-20 12:13:04_2023-11-20 12:13:04 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 2.666667 0.0000000 3.5 3.0 1.0 1.0000000 2.1666667 -0.3333333
13037_2023-11-20 12:23:18_2023-11-20 12:23:18 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 1.333333 0.0000000 1.0 1.5 0.0 0.0000000 -0.6666667 -0.1666667
13046_2023-11-20 11:28:50_2023-11-20 12:26:52 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 1.000000 1.0000000 3.5 4.0 0.5 -0.5000000 -1.5000000 -3.0000000
13055_2023-11-20 12:30:41_2023-11-20 12:30:41 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 1.000000 0.0000000 2.0 2.5 1.0 1.0000000 0.3333333 -1.5000000
13122_2023-11-20 10:56:59_2023-11-20 12:51:11 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 1.000000 1.0000000 3.5 1.0 1.0 0.0000000 -1.5000000 0.0000000
13165_2023-11-20 13:06:22_2023-11-20 13:06:22 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 2.666667 2.666667 0.6666667 3.0 2.0 1.0 0.3333333 0.3333333 0.6666667
13178_2023-11-19 16:14:45_2023-11-20 13:11:02 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 4.000000 1.0000000 3.5 3.0 1.0 0.0000000 1.5000000 1.0000000
13179_2023-11-20 13:11:07_2023-11-20 13:11:07 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 1.333333 1.0000000 1.5 5.0 0.5 -0.5000000 -2.1666667 -3.6666667
13210_2023-11-18 17:01:49_2023-11-20 13:22:59 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 3.666667 0.3333333 3.5 3.0 1.0 0.6666667 1.1666667 0.6666667
13219_2023-11-20 00:19:37_2023-11-20 13:26:32 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 5.000000 1.0000000 5.0 5.0 1.0 0.0000000 0.0000000 0.0000000
13273_2023-11-20 13:45:05_2023-11-20 13:45:05 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 5.000000 0.3333333 3.0 3.0 0.0 -0.3333333 -0.6666667 2.0000000
13331_2023-11-20 14:07:36_2023-11-20 14:07:36 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 3.000000 3.666667 1.0000000 2.5 2.0 1.0 0.0000000 -0.5000000 1.6666667
13338_2023-11-20 14:10:59_2023-11-20 14:10:59 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 2.000000 0.3333333 1.5 1.0 0.5 0.1666667 0.1666667 1.0000000
13383_2023-11-20 14:26:42_2023-11-20 14:26:42 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 4.000000 2.333333 1.0000000 3.0 1.0 1.0 0.0000000 -1.0000000 1.3333333
13402_2023-11-20 14:36:15_2023-11-20 14:36:15 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 2.000000 0.6666667 1.5 2.0 0.5 -0.1666667 0.1666667 0.0000000
13403_2023-11-20 14:36:23_2023-11-20 14:36:23 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 2.000000 0.0000000 1.0 2.0 0.0 0.0000000 0.0000000 0.0000000
13422_2023-11-20 14:45:04_2023-11-20 14:45:05 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 2.666667 1.0000000 2.0 4.0 0.5 -0.5000000 1.0000000 -1.3333333
13475_2023-11-20 15:00:58_2023-11-20 15:00:58 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 3.666667 1.0000000 4.5 4.0 1.0 0.0000000 0.8333333 -0.3333333
13535_2023-11-20 15:25:13_2023-11-20 15:25:13 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 5.000000 1.0000000 3.0 3.0 0.5 -0.5000000 -2.0000000 2.0000000
13623_2023-11-20 15:55:48_2023-11-20 15:55:48 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 4.333333 0.3333333 5.0 1.0 1.0 0.6666667 3.3333333 3.3333333
13756_2023-11-20 16:50:41_2023-11-20 16:50:44 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 5.000000 0.6666667 3.0 3.0 1.0 0.3333333 -0.6666667 2.0000000
13782_2023-11-20 17:04:05_2023-11-20 17:04:05 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 3.333333 0.6666667 2.0 2.5 0.5 -0.1666667 0.0000000 0.8333333
13883_2023-11-20 17:54:58_2023-11-20 17:54:58 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.666667 1.666667 0.3333333 2.5 1.5 0.5 0.1666667 -0.1666667 0.1666667
13909_2023-11-20 18:07:01_2023-11-20 18:07:01 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 1.000000 0.6666667 1.0 1.0 1.0 0.3333333 -0.3333333 0.0000000
13989_2023-11-20 18:42:21_2023-11-20 18:42:21 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 2.666667 1.666667 1.0000000 2.0 1.5 1.0 0.0000000 -0.6666667 0.1666667
14056_2023-11-20 19:06:53_2023-11-20 19:06:53 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 3.000000 0.6666667 5.0 1.0 1.0 0.3333333 3.6666667 2.0000000
14164_2023-11-20 19:54:55_2023-11-20 19:54:55 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 2.666667 1.0000000 2.0 3.0 1.0 0.0000000 0.0000000 -0.3333333
14215_2023-11-20 20:14:31_2023-11-20 20:14:31 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 1.000000 1.0000000 2.5 1.0 1.0 0.0000000 0.8333333 0.0000000
14233_2023-11-20 06:43:03_2023-11-20 20:21:36 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 2.000000 1.0000000 2.5 2.0 1.0 0.0000000 0.5000000 0.0000000
14234_2023-11-20 19:59:03_2023-11-20 20:22:21 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 4.000000 5.000000 1.0000000 5.0 5.0 1.0 0.0000000 1.0000000 0.0000000
14253_2023-11-20 20:30:16_2023-11-20 20:30:16 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 4.666667 4.666667 1.0000000 5.0 5.0 1.0 0.0000000 0.3333333 -0.3333333
14277_2023-11-20 20:43:44_2023-11-20 20:43:44 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 2.666667 1.333333 1.0000000 4.0 3.0 1.0 0.0000000 1.3333333 -1.6666667
14305_2023-11-20 20:57:14_2023-11-20 20:57:46 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 3.000000 0.3333333 2.5 3.5 0.5 0.1666667 -1.1666667 -0.5000000
14369_2023-11-20 21:16:02_2023-11-20 21:20:48 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 4.333333 1.666667 1.0000000 4.5 1.0 1.0 0.0000000 0.1666667 0.6666667
14408_2023-11-19 06:46:11_2023-11-20 21:38:21 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 2.666667 3.000000 1.0000000 2.0 2.0 1.0 0.0000000 -0.6666667 1.0000000
14416_2023-11-20 21:41:35_2023-11-20 21:41:35 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 1.333333 0.3333333 5.0 4.0 0.5 0.1666667 3.0000000 -2.6666667
14458_2023-11-20 22:02:22_2023-11-20 22:02:22 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 4.333333 0.3333333 5.0 3.0 1.0 0.6666667 2.6666667 1.3333333
14516_2023-11-20 13:28:59_2023-11-20 22:40:19 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 4.000000 0.0000000 2.5 3.0 0.0 0.0000000 0.5000000 1.0000000
14569_2023-11-21 00:05:16_2023-11-21 00:05:16 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 1.000000 1.0000000 5.0 1.0 1.0 0.0000000 1.3333333 0.0000000
14571_2023-11-21 00:09:53_2023-11-21 00:09:53 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 3.333333 3.000000 1.0000000 4.0 3.0 1.0 0.0000000 0.6666667 0.0000000
14716_2023-11-21 04:45:27_2023-11-21 04:45:27 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 3.333333 0.6666667 4.5 1.5 1.0 0.3333333 0.8333333 1.8333333
14733_2023-11-21 04:54:20_2023-11-21 04:54:20 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 2.000000 1.0000000 2.0 2.0 0.5 -0.5000000 0.3333333 0.0000000
14789_2023-11-21 05:32:41_2023-11-21 05:32:41 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 4.333333 0.0000000 4.0 3.0 0.5 0.5000000 2.3333333 1.3333333
14795_2023-11-21 05:35:49_2023-11-21 05:35:49 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 1.000000 1.0000000 3.0 2.0 1.0 0.0000000 2.0000000 -1.0000000
14831_2023-11-21 03:33:58_2023-11-21 06:00:26 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 1.000000 1.0000000 5.0 1.0 1.0 0.0000000 0.0000000 0.0000000
14899_2023-11-21 06:52:45_2023-11-21 06:52:45 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 1.666667 0.0000000 2.0 1.5 1.0 1.0000000 0.6666667 0.1666667
14937_2023-11-21 07:10:05_2023-11-21 07:10:05 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 3.000000 2.000000 0.6666667 2.0 2.0 1.0 0.3333333 -1.0000000 0.0000000
14949_2023-11-21 07:16:25_2023-11-21 07:16:25 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.000000 3.000000 1.0000000 3.0 3.0 1.0 0.0000000 0.0000000 0.0000000
15024_2023-11-21 07:56:21_2023-11-21 07:56:21 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 2.000000 1.0000000 2.0 1.5 1.0 0.0000000 0.3333333 0.5000000
15051_2023-11-21 08:13:02_2023-11-21 08:13:02 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 1.666667 1.0000000 1.0 1.5 1.0 0.0000000 -0.6666667 0.1666667
15116_2023-11-21 08:54:01_2023-11-21 08:54:01 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 4.666667 0.0000000 1.0 5.0 0.0 0.0000000 0.0000000 -0.3333333
15119_2023-11-21 08:19:39_2023-11-21 08:54:58 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 2.000000 0.6666667 4.5 2.5 1.0 0.3333333 0.8333333 -0.5000000
15218_2023-11-21 09:48:23_2023-11-21 09:48:23 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.666667 4.000000 0.3333333 2.5 3.5 1.0 0.6666667 -0.1666667 0.5000000
15231_2023-11-21 09:54:16_2023-11-21 09:54:16 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 1.000000 1.0000000 4.5 3.0 0.5 -0.5000000 -0.5000000 -2.0000000
15252_2023-11-21 10:02:43_2023-11-21 10:02:43 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 5.000000 1.0000000 5.0 5.0 1.0 0.0000000 0.0000000 0.0000000
15264_2023-11-21 10:10:10_2023-11-21 10:10:10 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 2.000000 0.3333333 2.0 1.0 1.0 0.6666667 0.0000000 1.0000000
15458_2023-11-21 11:58:12_2023-11-21 11:59:12 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 1.666667 0.3333333 2.0 2.0 1.0 0.6666667 0.3333333 -0.3333333
15487_2023-11-21 12:16:30_2023-11-21 12:16:30 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 2.666667 0.3333333 2.0 4.0 0.0 -0.3333333 0.0000000 -1.3333333
15552_2023-11-21 12:45:52_2023-11-21 12:45:52 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 1.666667 0.6666667 2.0 1.0 1.0 0.3333333 0.3333333 0.6666667
15628_2023-11-21 13:27:29_2023-11-21 13:27:29 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 4.333333 4.000000 1.0000000 3.5 2.5 1.0 0.0000000 -0.8333333 1.5000000
15647_2023-11-21 13:38:17_2023-11-21 13:38:17 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 3.000000 2.333333 0.6666667 2.0 2.0 1.0 0.3333333 -1.0000000 0.3333333
15707_2023-11-21 14:06:22_2023-11-21 14:06:22 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 1.000000 1.0000000 4.0 4.0 1.0 0.0000000 0.3333333 -3.0000000
15738_2023-11-21 14:22:29_2023-11-21 14:22:29 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 2.333333 0.0000000 1.0 3.0 0.0 0.0000000 0.0000000 -0.6666667
15780_2023-11-21 14:46:11_2023-11-21 14:46:13 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 4.666667 1.000000 1.0000000 4.0 1.5 1.0 0.0000000 -0.6666667 -0.5000000
15907_2023-11-21 15:51:49_2023-11-21 15:51:56 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 3.333333 0.6666667 5.0 3.0 1.0 0.3333333 0.0000000 0.3333333
15912_2023-11-21 15:54:55_2023-11-21 15:54:55 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 4.666667 0.0000000 4.0 1.0 1.0 1.0000000 3.0000000 3.6666667
15978_2023-11-21 16:30:13_2023-11-21 16:30:13 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 1.000000 0.0000000 5.0 1.0 1.0 1.0000000 2.6666667 0.0000000
16043_2023-11-21 17:12:21_2023-11-21 17:12:21 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 3.666667 0.6666667 4.5 4.0 1.0 0.3333333 0.8333333 -0.3333333
16073_2023-11-21 17:31:07_2023-11-21 17:31:07 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 1.333333 0.6666667 1.0 1.0 1.0 0.3333333 0.0000000 0.3333333
16193_2023-11-21 18:35:08_2023-11-21 18:35:08 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 1.666667 0.6666667 2.0 2.0 1.0 0.3333333 0.3333333 -0.3333333
16196_2023-11-21 18:35:26_2023-11-21 18:35:26 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 4.333333 2.333333 1.0000000 5.0 1.0 1.0 0.0000000 0.6666667 1.3333333
16247_2023-11-21 19:04:34_2023-11-21 19:04:34 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.000000 3.000000 0.6666667 2.0 4.0 0.5 -0.1666667 -1.0000000 -1.0000000
16275_2023-11-21 18:46:52_2023-11-21 19:18:33 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 2.000000 1.0000000 3.0 2.5 0.5 -0.5000000 1.0000000 -0.5000000
16303_2023-11-21 19:31:29_2023-11-21 19:31:29 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 3.666667 0.3333333 5.0 4.0 1.0 0.6666667 3.0000000 -0.3333333
16323_2023-11-21 19:41:23_2023-11-21 19:41:24 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 3.666667 0.3333333 2.0 3.0 0.5 0.1666667 -0.3333333 0.6666667
16421_2023-11-21 20:30:15_2023-11-21 20:30:15 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 1.333333 0.0000000 1.0 1.0 1.0 1.0000000 0.0000000 0.3333333
16458_2023-11-21 20:47:09_2023-11-21 20:47:09 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 3.000000 3.333333 1.0000000 1.0 2.0 1.0 0.0000000 -2.0000000 1.3333333
16531_2023-11-21 21:27:46_2023-11-21 21:27:46 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 2.333333 0.3333333 1.5 1.0 1.0 0.6666667 -0.8333333 1.3333333
16538_2023-11-19 21:49:50_2023-11-21 21:31:49 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 2.333333 1.0000000 2.0 2.0 1.0 0.0000000 0.3333333 0.3333333
16636_2023-11-21 22:50:54_2023-11-21 22:50:54 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 2.000000 1.0000000 2.0 1.5 1.0 0.0000000 0.3333333 0.5000000
16748_2023-11-22 03:15:49_2023-11-22 03:15:49 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 3.666667 0.3333333 3.0 1.0 1.0 0.6666667 0.6666667 2.6666667
16799_2023-11-22 04:22:41_2023-11-22 04:22:41 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 4.333333 4.666667 1.0000000 2.5 3.0 0.5 -0.5000000 -1.8333333 1.6666667
16822_2023-11-22 04:47:20_2023-11-22 04:47:20 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 2.000000 0.3333333 2.0 2.0 0.5 0.1666667 0.0000000 0.0000000
16883_2023-11-22 05:37:53_2023-11-22 05:37:53 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 4.000000 0.3333333 2.5 2.5 0.5 0.1666667 0.1666667 1.5000000
16994_2023-11-22 06:33:44_2023-11-22 06:33:44 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 4.666667 5.000000 1.0000000 5.0 5.0 1.0 0.0000000 0.3333333 0.0000000
17042_2023-11-20 20:51:48_2023-11-22 06:58:46 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 3.333333 0.3333333 2.0 1.0 1.0 0.6666667 0.3333333 2.3333333
17066_2023-11-22 07:12:41_2023-11-22 07:12:41 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 1.333333 1.0000000 5.0 1.0 1.0 0.0000000 0.0000000 0.3333333
17137_2023-11-22 07:56:49_2023-11-22 07:56:49 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 1.000000 1.0000000 1.5 1.0 1.0 0.0000000 0.5000000 0.0000000
17211_2023-11-19 18:44:12_2023-11-22 08:34:32 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 4.333333 0.0000000 3.0 4.0 0.5 0.5000000 0.6666667 0.3333333
17394_2023-11-22 10:09:30_2023-11-22 10:09:30 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 4.333333 0.6666667 3.5 5.0 0.5 -0.1666667 -0.1666667 -0.6666667
17432_2023-11-22 10:29:36_2023-11-22 10:29:36 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 3.000000 1.0000000 2.5 2.0 1.0 0.0000000 0.8333333 1.0000000
17512_2023-11-22 11:08:07_2023-11-22 11:08:07 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 3.333333 1.000000 0.6666667 3.5 1.5 1.0 0.3333333 0.1666667 -0.5000000
17606_2023-11-22 11:57:32_2023-11-22 11:57:32 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 1.666667 1.0000000 2.0 1.0 1.0 0.0000000 0.6666667 0.6666667
17625_2023-11-22 12:05:54_2023-11-22 12:05:54 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 2.000000 1.0000000 2.0 2.0 1.0 0.0000000 0.0000000 0.0000000
17666_2023-11-22 12:24:56_2023-11-22 12:24:56 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 4.000000 1.0000000 3.5 3.0 1.0 0.0000000 -0.1666667 1.0000000
17671_2023-11-22 12:29:21_2023-11-22 12:29:21 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.000000 2.666667 1.0000000 5.0 4.0 1.0 0.0000000 2.0000000 -1.3333333
17701_2023-11-22 12:49:27_2023-11-22 12:49:28 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 2.666667 3.666667 0.6666667 3.5 1.5 1.0 0.3333333 0.8333333 2.1666667
17755_2023-11-22 13:12:07_2023-11-22 13:12:07 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 4.333333 0.0000000 3.0 3.5 0.0 0.0000000 1.0000000 0.8333333
17773_2023-11-22 13:26:35_2023-11-22 13:26:35 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 1.333333 0.6666667 2.0 1.0 1.0 0.3333333 0.3333333 0.3333333
17807_2023-11-22 13:44:14_2023-11-22 13:44:14 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 1.666667 0.6666667 3.5 3.5 1.0 0.3333333 1.5000000 -1.8333333
17846_2023-11-22 14:03:41_2023-11-22 14:03:41 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 4.333333 0.0000000 1.0 4.0 0.0 0.0000000 0.0000000 0.3333333
17850_2023-11-22 14:06:18_2023-11-22 14:06:18 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 4.666667 5.000000 1.0000000 5.0 5.0 1.0 0.0000000 0.3333333 0.0000000
17983_2023-11-22 15:15:22_2023-11-22 15:15:22 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 5.000000 0.3333333 3.5 5.0 1.0 0.6666667 2.5000000 0.0000000
17988_2023-11-22 15:17:35_2023-11-22 15:17:35 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 2.666667 1.0000000 5.0 1.0 1.0 0.0000000 0.0000000 1.6666667
18089_2023-11-22 16:15:34_2023-11-22 16:15:34 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 1.333333 1.0000000 3.0 1.0 1.0 0.0000000 -0.6666667 0.3333333
18127_2023-11-22 16:35:30_2023-11-22 16:35:30 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 4.000000 0.0000000 5.0 1.0 1.0 1.0000000 4.0000000 3.0000000
18142_2023-11-22 07:39:51_2023-11-22 16:41:41 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 4.666667 1.333333 1.0000000 5.0 1.0 1.0 0.0000000 0.3333333 0.3333333
18163_2023-11-22 16:54:27_2023-11-22 16:54:27 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 2.000000 1.0000000 1.5 1.5 1.0 0.0000000 -0.5000000 0.5000000
18187_2023-11-22 17:08:09_2023-11-22 17:08:09 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 1.666667 0.3333333 1.5 2.0 0.5 0.1666667 -0.5000000 -0.3333333
18245_2023-11-22 17:41:48_2023-11-22 17:41:48 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 1.666667 0.6666667 1.5 1.0 0.0 -0.6666667 -0.1666667 0.6666667
18246_2023-11-22 17:44:29_2023-11-22 17:44:29 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 4.333333 0.0000000 3.5 2.0 1.0 1.0000000 2.1666667 2.3333333
18256_2023-11-22 17:50:55_2023-11-22 17:50:55 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 4.000000 4.000000 1.0000000 2.5 3.0 1.0 0.0000000 -1.5000000 1.0000000
18333_2023-11-22 18:30:38_2023-11-22 18:30:38 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 3.333333 2.000000 1.0000000 2.0 3.5 1.0 0.0000000 -1.3333333 -1.5000000
18339_2023-11-22 07:25:00_2023-11-22 18:32:33 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 4.333333 2.666667 0.6666667 4.5 2.5 0.5 -0.1666667 0.1666667 0.1666667
18402_2023-11-22 18:59:44_2023-11-22 19:00:27 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 1.666667 1.0000000 2.0 1.0 1.0 0.0000000 0.6666667 0.6666667
18444_2023-11-22 19:15:51_2023-11-22 19:15:51 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 4.000000 5.000000 0.6666667 3.0 5.0 0.5 -0.1666667 -1.0000000 0.0000000
18454_2023-11-22 19:20:52_2023-11-22 19:20:52 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 1.333333 1.0000000 1.5 2.0 0.0 -1.0000000 -0.1666667 -0.6666667
18571_2023-11-22 20:15:33_2023-11-22 20:15:33 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 5.000000 1.0000000 5.0 1.0 1.0 0.0000000 1.3333333 4.0000000
18572_2023-11-22 20:16:44_2023-11-22 20:16:44 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 4.666667 1.0000000 1.5 1.5 0.5 -0.5000000 -2.1666667 3.1666667
18627_2023-11-22 20:41:35_2023-11-22 20:41:35 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 2.666667 0.0000000 2.0 3.5 1.0 1.0000000 1.0000000 -0.8333333
18629_2023-11-22 20:41:47_2023-11-22 20:41:47 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 1.000000 1.0000000 5.0 1.0 1.0 0.0000000 0.0000000 0.0000000
18639_2023-11-22 20:46:02_2023-11-22 20:46:02 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 3.666667 0.6666667 5.0 1.0 1.0 0.3333333 1.3333333 2.6666667
18643_2023-11-22 20:47:06_2023-11-22 20:47:06 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 3.666667 0.3333333 5.0 1.0 1.0 0.6666667 1.3333333 2.6666667
18644_2023-11-22 20:47:11_2023-11-22 20:47:11 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 4.333333 0.0000000 5.0 1.0 1.0 1.0000000 4.0000000 3.3333333
18718_2023-11-22 20:22:17_2023-11-22 21:19:30 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 1.666667 1.0000000 3.5 3.5 1.0 0.0000000 1.8333333 -1.8333333
18741_2023-11-18 14:06:47_2023-11-22 21:31:53 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 3.666667 0.6666667 4.5 4.5 1.0 0.3333333 0.8333333 -0.8333333
18812_2023-11-22 22:21:04_2023-11-22 22:21:04 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 4.333333 1.333333 1.0000000 4.5 1.0 1.0 0.0000000 0.1666667 0.3333333
19067_2023-11-23 05:08:43_2023-11-23 05:08:43 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.666667 3.333333 0.3333333 2.0 1.5 0.5 0.1666667 -0.6666667 1.8333333
19190_2023-11-23 06:22:30_2023-11-23 06:22:30 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 1.666667 0.6666667 2.0 1.5 0.5 -0.1666667 0.3333333 0.1666667
19200_2023-11-23 06:26:04_2023-11-23 06:26:04 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 3.666667 0.0000000 5.0 1.0 1.0 1.0000000 4.0000000 2.6666667
19230_2023-11-23 06:39:41_2023-11-23 06:39:41 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 2.333333 0.6666667 1.5 1.0 0.5 -0.1666667 -0.5000000 1.3333333
19232_2023-11-23 06:40:07_2023-11-23 06:40:07 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 3.000000 1.000000 1.0000000 3.0 2.0 1.0 0.0000000 0.0000000 -1.0000000
19237_2023-11-23 06:43:21_2023-11-23 06:43:21 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 1.000000 0.0000000 1.0 1.0 0.0 0.0000000 0.0000000 0.0000000
19492_2023-11-23 08:51:52_2023-11-23 08:51:52 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 1.000000 1.0000000 2.5 2.0 0.5 -0.5000000 1.1666667 -1.0000000
19562_2023-11-23 09:27:51_2023-11-23 09:27:51 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 1.000000 1.0000000 5.0 1.0 1.0 0.0000000 0.0000000 0.0000000
19595_2023-11-23 09:40:51_2023-11-23 09:40:51 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 4.000000 0.6666667 3.0 3.0 1.0 0.3333333 -0.6666667 1.0000000
19778_2023-11-23 11:13:05_2023-11-23 11:13:05 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 4.333333 1.333333 1.0000000 2.0 4.5 0.5 -0.5000000 -2.3333333 -3.1666667
19789_2023-11-23 11:18:18_2023-11-23 11:18:18 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 1.333333 0.3333333 1.5 1.5 0.5 0.1666667 -0.5000000 -0.1666667
19794_2023-11-23 11:20:46_2023-11-23 11:20:46 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 2.000000 0.6666667 1.5 1.5 1.0 0.3333333 0.1666667 0.5000000
19802_2023-11-23 11:24:25_2023-11-23 11:24:25 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 1.333333 1.0000000 1.5 1.0 1.0 0.0000000 -0.1666667 0.3333333
19830_2023-11-23 11:35:51_2023-11-23 11:35:51 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 4.000000 0.0000000 2.0 2.5 0.0 0.0000000 0.3333333 1.5000000
19891_2023-11-23 12:02:13_2023-11-23 12:02:13 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 4.000000 2.000000 0.3333333 2.5 3.5 0.0 -0.3333333 -1.5000000 -1.5000000
19994_2023-11-23 12:24:27_2023-11-23 12:45:38 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 4.666667 5.000000 0.6666667 1.5 1.0 1.0 0.3333333 -3.1666667 4.0000000
20068_2023-11-23 13:13:24_2023-11-23 13:13:24 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 4.666667 0.0000000 4.5 4.5 0.5 0.5000000 2.8333333 0.1666667
20197_2023-11-23 14:17:03_2023-11-23 14:17:03 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 1.666667 1.0000000 1.0 1.5 1.0 0.0000000 -0.6666667 0.1666667
20297_2023-11-23 15:00:07_2023-11-23 15:00:07 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 2.333333 0.6666667 5.0 1.5 0.5 -0.1666667 0.0000000 0.8333333
20326_2023-11-23 15:08:54_2023-11-23 15:08:54 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 2.000000 0.0000000 5.0 5.0 1.0 1.0000000 2.6666667 -3.0000000
20389_2023-11-23 15:42:25_2023-11-23 15:42:25 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 2.000000 0.0000000 2.0 2.0 0.5 0.5000000 0.3333333 0.0000000
20398_2023-11-23 15:49:57_2023-11-23 15:49:57 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 1.666667 1.0000000 2.0 1.0 0.5 -0.5000000 0.6666667 0.6666667
20406_2023-11-23 15:57:39_2023-11-23 15:57:41 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 2.333333 0.0000000 4.0 3.0 1.0 1.0000000 3.0000000 -0.6666667
20421_2023-11-23 16:07:33_2023-11-23 16:07:33 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 5.000000 0.0000000 1.0 5.0 0.0 0.0000000 0.0000000 0.0000000
20458_2023-11-23 16:23:21_2023-11-23 16:23:21 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 1.333333 0.6666667 4.5 1.0 1.0 0.3333333 2.1666667 0.3333333
20498_2023-11-23 16:38:53_2023-11-23 16:38:53 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 2.000000 0.0000000 2.0 2.0 0.0 0.0000000 0.0000000 0.0000000
20510_2023-11-23 16:45:36_2023-11-23 16:45:36 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 1.666667 1.0000000 2.0 2.0 1.0 0.0000000 0.0000000 -0.3333333
20517_2023-11-23 16:47:12_2023-11-23 16:47:12 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 2.333333 0.6666667 3.0 3.0 0.5 -0.1666667 -0.6666667 -0.6666667
20521_2023-11-23 16:51:06_2023-11-23 16:51:06 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 3.333333 0.0000000 5.0 3.0 1.0 1.0000000 2.6666667 0.3333333
20568_2023-11-23 17:11:26_2023-11-23 17:11:26 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 1.333333 1.0000000 2.5 3.0 0.0 -1.0000000 0.5000000 -1.6666667
20575_2023-11-23 17:13:58_2023-11-23 17:13:58 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 1.666667 0.3333333 4.5 3.5 0.5 0.1666667 0.8333333 -1.8333333
20708_2023-11-23 18:09:19_2023-11-23 18:09:19 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 4.000000 1.333333 1.0000000 3.5 1.5 1.0 0.0000000 -0.5000000 -0.1666667
20806_2023-11-23 18:46:42_2023-11-23 18:46:42 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 3.333333 1.0000000 3.0 3.5 1.0 0.0000000 -0.6666667 -0.1666667
20836_2023-11-23 18:58:07_2023-11-23 18:58:08 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 1.666667 0.6666667 1.5 1.0 0.0 -0.6666667 -0.8333333 0.6666667
20839_2023-11-23 18:59:39_2023-11-23 18:59:39 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 1.000000 1.0000000 2.0 1.0 1.0 0.0000000 0.3333333 0.0000000
20847_2023-11-23 19:01:48_2023-11-23 19:01:48 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 3.666667 0.3333333 3.0 3.0 0.0 -0.3333333 -2.0000000 0.6666667
20858_2023-11-23 19:05:58_2023-11-23 19:05:58 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.000000 5.000000 0.0000000 3.5 3.5 0.5 0.5000000 0.5000000 1.5000000
20919_2023-11-23 19:33:07_2023-11-23 19:33:07 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 3.666667 0.0000000 1.0 5.0 0.0 0.0000000 -1.3333333 -1.3333333
20939_2023-11-23 19:39:44_2023-11-23 19:39:44 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 3.333333 2.333333 1.0000000 3.5 3.0 1.0 0.0000000 0.1666667 -0.6666667
20958_2023-11-23 19:47:31_2023-11-23 19:47:31 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 4.666667 0.0000000 3.0 1.5 1.0 1.0000000 1.6666667 3.1666667
21055_2023-11-23 20:55:01_2023-11-23 20:55:01 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 2.000000 0.0000000 5.0 5.0 1.0 1.0000000 4.0000000 -3.0000000
21131_2023-11-23 21:34:14_2023-11-23 21:34:14 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.000000 2.666667 1.0000000 4.5 5.0 1.0 0.0000000 1.5000000 -2.3333333
21136_2023-11-23 21:35:59_2023-11-23 21:35:59 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 4.333333 2.666667 1.0000000 5.0 1.5 1.0 0.0000000 0.6666667 1.1666667
21157_2023-11-23 21:45:35_2023-11-23 21:45:35 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 1.000000 0.0000000 1.0 1.0 0.0 0.0000000 0.0000000 0.0000000
21168_2023-11-23 21:49:23_2023-11-23 21:49:23 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 2.666667 0.3333333 3.0 3.0 0.5 0.1666667 -0.6666667 -0.3333333
21248_2023-11-23 22:39:41_2023-11-23 22:39:41 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 1.000000 1.0000000 1.5 1.0 1.0 0.0000000 -0.5000000 0.0000000
21290_2023-11-23 23:34:26_2023-11-23 23:34:26 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 3.666667 1.0000000 1.5 5.0 1.0 0.0000000 -3.5000000 -1.3333333
21335_2023-11-24 00:36:01_2023-11-24 00:36:01 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.000000 1.666667 1.0000000 4.5 3.5 1.0 0.0000000 1.5000000 -1.8333333
21419_2023-11-20 15:43:12_2023-11-24 03:08:37 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 2.000000 0.6666667 2.5 2.5 1.0 0.3333333 0.5000000 -0.5000000
21557_2023-11-24 05:58:16_2023-11-24 05:58:16 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 3.000000 3.000000 0.6666667 4.5 4.5 1.0 0.3333333 1.5000000 -1.5000000
21643_2023-11-24 06:38:44_2023-11-24 06:38:44 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 5.000000 0.3333333 3.0 5.0 0.0 -0.3333333 -2.0000000 0.0000000
21731_2023-11-24 07:08:55_2023-11-24 07:08:55 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 4.666667 0.6666667 3.5 4.5 1.0 0.3333333 1.1666667 0.1666667
21758_2023-11-24 07:18:12_2023-11-24 07:18:12 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 1.666667 0.3333333 3.5 3.5 1.0 0.6666667 2.1666667 -1.8333333
21788_2023-11-24 07:31:55_2023-11-24 07:31:55 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 3.666667 0.0000000 1.5 2.5 0.0 0.0000000 0.5000000 1.1666667
22034_2023-11-24 09:11:45_2023-11-24 09:11:45 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 1.000000 0.0000000 5.0 1.0 0.0 0.0000000 0.0000000 0.0000000
22061_2023-11-24 09:24:14_2023-11-24 09:24:14 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 2.333333 0.0000000 2.5 2.5 1.0 1.0000000 0.8333333 -0.1666667
22118_2023-11-24 09:54:13_2023-11-24 09:54:13 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 4.000000 0.0000000 3.5 2.5 0.5 0.5000000 1.8333333 1.5000000
22143_2023-11-24 10:05:30_2023-11-24 10:05:30 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 3.666667 0.0000000 3.0 3.0 0.0 0.0000000 0.6666667 0.6666667
22150_2023-11-24 10:09:11_2023-11-24 10:09:12 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 2.666667 3.000000 0.6666667 2.0 2.0 1.0 0.3333333 -0.6666667 1.0000000
22153_2023-11-24 10:09:37_2023-11-24 10:09:37 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 3.333333 0.6666667 1.5 1.0 1.0 0.3333333 -0.8333333 2.3333333
22155_2023-11-24 10:10:42_2023-11-24 10:10:42 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 3.333333 1.333333 1.0000000 3.5 1.5 1.0 0.0000000 0.1666667 -0.1666667
22158_2023-11-24 10:12:15_2023-11-24 10:12:15 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 2.333333 1.0000000 5.0 1.0 1.0 0.0000000 0.0000000 1.3333333
22165_2023-11-24 10:15:56_2023-11-24 10:15:56 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.666667 3.000000 1.0000000 5.0 4.0 1.0 0.0000000 2.3333333 -1.0000000
22169_2023-11-24 10:17:28_2023-11-24 10:17:28 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 1.000000 1.0000000 1.0 1.0 1.0 0.0000000 0.0000000 0.0000000
22380_2023-11-24 11:53:36_2023-11-24 11:53:36 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 3.000000 1.0000000 3.5 2.0 1.0 0.0000000 1.1666667 1.0000000
22430_2023-11-24 12:13:50_2023-11-24 12:14:02 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 2.333333 0.6666667 3.0 3.0 0.5 -0.1666667 -0.6666667 -0.6666667
22453_2023-11-24 12:19:34_2023-11-24 12:19:34 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 1.666667 0.6666667 2.0 1.0 1.0 0.3333333 0.0000000 0.6666667
22491_2023-11-24 12:35:22_2023-11-24 12:35:22 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 3.666667 0.0000000 1.0 1.0 1.0 1.0000000 -0.3333333 2.6666667
22498_2023-11-24 12:39:06_2023-11-24 12:39:07 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.000000 4.000000 0.6666667 1.0 1.5 0.5 -0.1666667 -2.0000000 2.5000000
22570_2023-11-24 13:21:15_2023-11-24 13:21:15 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 3.666667 0.3333333 3.0 3.0 0.5 0.1666667 0.6666667 0.6666667
22583_2023-11-24 13:26:06_2023-11-24 13:26:07 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 4.333333 3.666667 1.0000000 3.5 4.5 1.0 0.0000000 -0.8333333 -0.8333333
22620_2023-11-24 13:42:52_2023-11-24 13:42:52 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.000000 1.666667 1.0000000 3.0 2.0 1.0 0.0000000 0.0000000 -0.3333333
22639_2023-11-24 13:52:58_2023-11-24 13:52:58 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 4.333333 3.333333 1.0000000 3.5 3.5 0.5 -0.5000000 -0.8333333 -0.1666667
22691_2023-11-24 14:17:21_2023-11-24 14:17:21 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 1.000000 1.0000000 2.0 1.0 1.0 0.0000000 0.0000000 0.0000000
22713_2023-11-24 14:31:05_2023-11-24 14:31:05 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 4.000000 0.3333333 4.5 1.0 1.0 0.6666667 2.1666667 3.0000000
22773_2023-11-21 13:26:11_2023-11-24 15:07:11 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 1.666667 0.6666667 1.5 1.5 0.5 -0.1666667 -0.1666667 0.1666667
22794_2023-11-24 15:20:09_2023-11-24 15:20:09 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 4.666667 0.0000000 1.0 5.0 0.0 0.0000000 -0.3333333 -0.3333333
22871_2023-11-24 15:59:30_2023-11-24 15:59:35 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 3.000000 0.3333333 1.0 5.0 0.5 0.1666667 -0.3333333 -2.0000000
22889_2023-11-24 16:06:40_2023-11-24 16:06:40 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.666667 1.666667 0.6666667 3.5 3.5 1.0 0.3333333 0.8333333 -1.8333333
22903_2023-11-24 16:15:08_2023-11-24 16:15:08 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 5.000000 0.0000000 5.0 3.0 1.0 1.0000000 4.0000000 2.0000000
22938_2023-11-24 16:35:43_2023-11-24 16:35:43 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 1.666667 1.0000000 2.0 1.5 1.0 0.0000000 0.6666667 0.1666667
22974_2023-11-24 16:53:03_2023-11-24 16:53:03 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 4.333333 0.6666667 4.0 3.5 1.0 0.3333333 0.3333333 0.8333333
22999_2023-11-24 17:03:53_2023-11-24 17:04:07 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 4.666667 0.3333333 3.0 4.5 0.5 0.1666667 0.6666667 0.1666667
23037_2023-11-24 17:18:02_2023-11-24 17:18:02 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 1.333333 1.0000000 1.0 1.5 1.0 0.0000000 -0.3333333 -0.1666667
23184_2023-11-24 18:33:56_2023-11-24 18:33:56 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 3.333333 3.666667 0.3333333 3.0 3.5 0.5 0.1666667 -0.3333333 0.1666667
23242_2023-11-24 19:01:46_2023-11-24 19:01:46 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 2.333333 1.0000000 5.0 1.5 1.0 0.0000000 0.0000000 0.8333333
23351_2023-11-24 19:53:45_2023-11-24 19:53:45 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 4.666667 1.000000 1.0000000 5.0 1.0 1.0 0.0000000 0.3333333 0.0000000
23522_2023-11-24 22:16:03_2023-11-24 22:16:03 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 1.000000 0.0000000 1.0 1.0 0.0 0.0000000 0.0000000 0.0000000
23572_2023-11-24 23:12:25_2023-11-24 23:12:25 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 4.666667 1.0000000 4.0 3.0 1.0 0.0000000 0.3333333 1.6666667
23625_2023-11-25 01:05:26_2023-11-25 01:05:29 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 2.000000 0.6666667 1.5 1.5 1.0 0.3333333 -0.8333333 0.5000000
23732_2023-11-25 04:04:41_2023-11-25 04:04:41 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 3.333333 4.000000 0.3333333 2.5 5.0 1.0 0.6666667 -0.8333333 -1.0000000
23738_2023-11-24 05:23:19_2023-11-25 04:12:49 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 4.000000 0.6666667 2.5 3.0 0.5 -0.1666667 0.5000000 1.0000000
23773_2023-11-24 22:35:19_2023-11-25 04:47:22 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 5.000000 0.0000000 2.0 2.0 0.5 0.5000000 1.0000000 3.0000000
23810_2023-11-25 05:13:10_2023-11-25 05:13:10 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 3.333333 0.3333333 1.0 2.5 0.5 0.1666667 0.0000000 0.8333333
23830_2023-11-25 05:24:44_2023-11-25 05:24:45 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 2.000000 0.0000000 1.0 2.0 0.0 0.0000000 0.0000000 0.0000000
23909_2023-11-25 06:18:02_2023-11-25 06:18:02 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 3.666667 0.0000000 3.5 2.0 0.5 0.5000000 1.1666667 1.6666667
23929_2023-11-25 06:34:11_2023-11-25 06:34:11 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 1.000000 1.0000000 2.0 1.5 1.0 0.0000000 0.0000000 -0.5000000
23939_2023-11-25 06:41:46_2023-11-25 06:41:47 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 4.333333 2.666667 1.0000000 4.0 2.5 1.0 0.0000000 -0.3333333 0.1666667
24002_2023-11-25 07:17:44_2023-11-25 07:17:44 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 1.666667 0.3333333 3.5 1.0 1.0 0.6666667 1.1666667 0.6666667
24055_2023-11-25 07:50:48_2023-11-25 07:50:48 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 2.000000 1.0000000 2.0 1.0 1.0 0.0000000 0.3333333 1.0000000
24173_2023-11-25 09:18:41_2023-11-25 09:18:41 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 3.666667 1.0000000 1.0 3.5 0.5 -0.5000000 -1.3333333 0.1666667
24314_2023-11-25 11:13:26_2023-11-25 11:13:26 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 2.000000 0.0000000 2.0 1.5 1.0 1.0000000 0.3333333 0.5000000
24421_2023-11-20 04:06:49_2023-11-25 12:20:14 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 1.666667 0.6666667 1.5 1.5 0.0 -0.6666667 0.1666667 0.1666667
24431_2023-11-25 12:27:32_2023-11-25 12:27:32 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 1.000000 1.0000000 2.0 1.0 1.0 0.0000000 0.3333333 0.0000000
24496_2023-11-25 13:24:35_2023-11-25 13:24:35 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 3.000000 3.666667 0.6666667 4.0 1.5 1.0 0.3333333 1.0000000 2.1666667
24623_2023-11-25 14:51:33_2023-11-25 14:51:33 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 3.333333 2.000000 1.0000000 3.5 2.5 1.0 0.0000000 0.1666667 -0.5000000
24629_2023-11-25 14:55:01_2023-11-25 14:55:01 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 4.333333 0.0000000 2.5 3.0 0.5 0.5000000 0.8333333 1.3333333
24657_2023-11-25 15:27:44_2023-11-25 15:27:44 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 4.000000 3.000000 0.3333333 2.5 3.0 0.5 0.1666667 -1.5000000 0.0000000
24786_2023-11-25 17:01:36_2023-11-25 17:01:36 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 4.666667 0.0000000 5.0 2.5 0.5 0.5000000 4.0000000 2.1666667
24791_2023-11-25 17:04:03_2023-11-25 17:04:03 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 4.000000 4.333333 1.0000000 3.0 3.0 0.5 -0.5000000 -1.0000000 1.3333333
24872_2023-11-25 18:08:05_2023-11-25 18:08:05 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 1.666667 1.0000000 3.0 2.0 1.0 0.0000000 0.6666667 -0.3333333
24876_2023-11-25 18:11:40_2023-11-25 18:11:40 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 2.666667 1.0000000 5.0 1.0 1.0 0.0000000 0.0000000 1.6666667
24928_2023-11-25 18:36:59_2023-11-25 18:36:59 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 1.333333 0.6666667 2.5 1.0 1.0 0.3333333 0.5000000 0.3333333
24970_2023-11-25 18:58:55_2023-11-25 18:58:55 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 3.333333 2.000000 1.0000000 4.0 2.0 1.0 0.0000000 0.6666667 0.0000000
25002_2023-11-24 23:18:39_2023-11-25 19:17:57 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 1.666667 0.6666667 1.5 1.5 0.5 -0.1666667 -0.1666667 0.1666667
25020_2023-11-25 19:26:34_2023-11-25 19:26:34 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 1.666667 0.3333333 2.0 1.0 1.0 0.6666667 0.6666667 0.6666667
25123_2023-11-25 20:17:54_2023-11-25 20:17:54 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 5.000000 1.0000000 5.0 5.0 1.0 0.0000000 0.0000000 0.0000000
25148_2023-11-25 20:30:24_2023-11-25 20:30:24 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 1.000000 1.0000000 1.5 1.5 1.0 0.0000000 -0.5000000 -0.5000000
25260_2023-11-25 21:19:49_2023-11-25 21:19:49 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 3.333333 0.3333333 4.5 1.0 1.0 0.6666667 2.1666667 2.3333333
25310_2023-11-25 21:45:16_2023-11-25 21:45:16 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 1.666667 0.3333333 1.0 2.0 0.5 0.1666667 -1.3333333 -0.3333333
25363_2023-11-25 22:19:42_2023-11-25 22:22:27 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 2.333333 0.6666667 2.0 2.0 1.0 0.3333333 0.0000000 0.3333333
25413_2023-11-25 23:39:03_2023-11-25 23:39:03 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 1.333333 0.6666667 5.0 1.0 1.0 0.3333333 1.3333333 0.3333333
25473_2023-11-26 01:20:27_2023-11-26 01:20:27 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 1.000000 1.0000000 2.0 1.0 1.0 0.0000000 0.6666667 0.0000000
25503_2023-11-26 02:08:33_2023-11-26 02:08:33 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 1.333333 0.0000000 1.0 1.5 0.5 0.5000000 0.0000000 -0.1666667
25510_2023-11-26 02:15:03_2023-11-26 02:15:03 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 1.666667 1.0000000 2.0 2.0 1.0 0.0000000 0.0000000 -0.3333333
25637_2023-11-26 04:50:58_2023-11-26 04:50:58 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 2.666667 2.333333 0.3333333 1.0 1.5 0.5 0.1666667 -1.6666667 0.8333333
25658_2023-11-26 02:04:13_2023-11-26 05:04:19 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 4.000000 1.000000 1.0000000 3.5 1.0 1.0 0.0000000 -0.5000000 0.0000000
25685_2023-11-26 05:14:36_2023-11-26 05:14:36 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 4.666667 4.666667 0.3333333 2.0 3.5 1.0 0.6666667 -2.6666667 1.1666667
25824_2023-11-26 06:27:31_2023-11-26 06:27:31 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 1.666667 0.0000000 2.0 1.5 0.5 0.5000000 0.6666667 0.1666667
25839_2023-11-26 06:48:12_2023-11-26 06:48:12 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 1.000000 1.0000000 5.0 3.0 1.0 0.0000000 0.0000000 -2.0000000
25842_2023-11-26 06:50:15_2023-11-26 06:50:15 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 2.333333 0.0000000 3.5 1.5 1.0 1.0000000 2.5000000 0.8333333
25933_2023-11-26 07:45:35_2023-11-26 07:45:35 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 4.666667 0.0000000 1.0 4.5 0.0 0.0000000 0.0000000 0.1666667
26014_2023-11-26 08:22:14_2023-11-26 08:22:14 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 2.333333 1.0000000 1.5 3.5 1.0 0.0000000 -0.8333333 -1.1666667
26038_2023-11-26 08:30:59_2023-11-26 08:30:59 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 1.666667 1.0000000 2.0 2.0 1.0 0.0000000 0.0000000 -0.3333333
26100_2023-11-26 08:54:17_2023-11-26 08:54:17 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 3.000000 3.000000 1.0000000 1.0 1.0 1.0 0.0000000 -2.0000000 2.0000000
26147_2023-11-26 09:10:00_2023-11-26 09:10:00 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.333333 1.000000 0.6666667 4.5 1.5 1.0 0.3333333 1.1666667 -0.5000000
26331_2023-11-26 10:34:53_2023-11-26 10:34:53 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 3.666667 0.0000000 1.0 3.0 0.0 0.0000000 -0.3333333 0.6666667
26374_2023-11-22 15:53:18_2023-11-26 10:57:20 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 3.666667 1.0000000 5.0 5.0 1.0 0.0000000 1.3333333 -1.3333333
26378_2023-11-26 10:58:29_2023-11-26 10:58:29 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 3.666667 0.3333333 4.5 1.0 1.0 0.6666667 2.8333333 2.6666667
26379_2023-11-26 10:58:32_2023-11-26 10:58:32 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 4.666667 4.000000 1.0000000 1.5 3.0 0.5 -0.5000000 -3.1666667 1.0000000
26382_2023-11-26 11:01:13_2023-11-26 11:01:13 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 1.000000 1.0000000 1.0 1.0 1.0 0.0000000 0.0000000 0.0000000
26493_2023-11-25 12:00:07_2023-11-26 12:00:59 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 1.000000 1.0000000 2.5 1.0 1.0 0.0000000 0.1666667 0.0000000
26494_2023-11-26 12:01:13_2023-11-26 12:01:13 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 1.333333 1.0000000 2.0 1.0 1.0 0.0000000 0.0000000 0.3333333
26533_2023-11-26 12:20:33_2023-11-26 12:20:33 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 1.666667 1.0000000 1.5 1.5 1.0 0.0000000 0.1666667 0.1666667
26728_2023-11-26 13:48:49_2023-11-26 13:48:49 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 1.333333 1.0000000 1.0 1.5 1.0 0.0000000 -0.6666667 -0.1666667
26796_2023-11-26 14:18:10_2023-11-26 14:18:10 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 2.000000 1.0000000 4.5 2.0 1.0 0.0000000 0.8333333 0.0000000
26894_2023-11-26 15:01:41_2023-11-26 15:01:41 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 3.333333 2.333333 0.3333333 3.0 1.5 0.5 0.1666667 -0.3333333 0.8333333
26941_2023-11-26 15:30:25_2023-11-26 15:30:25 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 2.666667 0.6666667 2.0 2.5 1.0 0.3333333 -1.6666667 0.1666667
26967_2023-11-23 19:05:04_2023-11-26 15:43:15 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 1.000000 1.0000000 5.0 1.0 1.0 0.0000000 0.0000000 0.0000000
27117_2023-11-26 17:09:20_2023-11-26 17:09:20 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 3.333333 3.000000 1.0000000 4.0 4.0 1.0 0.0000000 0.6666667 -1.0000000
27216_2023-11-26 18:03:26_2023-11-26 18:03:26 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 2.333333 0.0000000 3.5 1.5 0.5 0.5000000 1.5000000 0.8333333
27366_2023-11-26 19:32:25_2023-11-26 19:32:25 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 3.666667 1.0000000 4.0 1.0 1.0 0.0000000 -1.0000000 2.6666667
27395_2023-11-26 19:49:45_2023-11-26 19:49:45 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 3.000000 2.333333 0.6666667 2.5 2.0 0.5 -0.1666667 -0.5000000 0.3333333
27470_2023-11-26 20:30:27_2023-11-26 20:30:27 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 1.666667 1.0000000 1.5 1.5 0.5 -0.5000000 -0.1666667 0.1666667
27527_2023-11-24 18:55:59_2023-11-26 21:10:17 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 2.333333 1.0000000 5.0 1.0 1.0 0.0000000 0.0000000 1.3333333
27638_2023-11-26 22:51:22_2023-11-26 22:51:22 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 1.666667 0.6666667 2.0 2.0 1.0 0.3333333 0.3333333 -0.3333333
27666_2023-11-26 23:28:23_2023-11-26 23:28:23 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 2.000000 1.0000000 2.0 2.0 1.0 0.0000000 0.0000000 0.0000000
27976_2023-11-27 06:28:55_2023-11-27 06:28:55 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 3.666667 0.6666667 1.5 3.0 0.5 -0.1666667 -2.1666667 0.6666667
28042_2023-11-27 07:03:55_2023-11-27 07:03:55 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 5.000000 1.0000000 5.0 5.0 1.0 0.0000000 1.3333333 0.0000000
28079_2023-11-27 07:24:30_2023-11-27 07:24:30 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 3.333333 0.3333333 1.5 2.0 0.5 0.1666667 -0.1666667 1.3333333
28094_2023-11-27 07:31:44_2023-11-27 07:31:44 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 2.333333 0.6666667 1.0 5.0 0.0 -0.6666667 -0.6666667 -2.6666667
28125_2023-11-27 07:49:51_2023-11-27 07:49:51 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 2.333333 0.6666667 5.0 1.0 1.0 0.3333333 1.3333333 1.3333333
28152_2023-11-27 08:00:55_2023-11-27 08:01:38 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 3.333333 0.3333333 3.0 5.0 0.5 0.1666667 1.3333333 -1.6666667
28173_2023-11-27 08:14:39_2023-11-27 08:14:39 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 1.000000 1.0000000 1.0 1.0 1.0 0.0000000 0.0000000 0.0000000
28191_2023-11-27 08:24:45_2023-11-27 08:24:45 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 3.333333 3.666667 1.0000000 3.0 2.0 1.0 0.0000000 -0.3333333 1.6666667
28240_2023-11-27 05:39:39_2023-11-27 08:48:30 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 4.666667 0.0000000 2.5 1.5 0.5 0.5000000 1.1666667 3.1666667
28312_2023-11-27 09:23:12_2023-11-27 09:23:12 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 1.333333 0.6666667 2.0 1.0 1.0 0.3333333 0.3333333 0.3333333
28324_2023-11-27 09:30:31_2023-11-27 09:30:31 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 2.666667 0.0000000 4.0 3.0 1.0 1.0000000 2.0000000 -0.3333333
28355_2023-11-27 09:46:36_2023-11-27 09:46:36 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 3.333333 1.666667 0.3333333 1.5 2.5 1.0 0.6666667 -1.8333333 -0.8333333
28392_2023-11-27 10:06:32_2023-11-27 10:06:32 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 3.000000 2.666667 1.0000000 3.5 1.0 1.0 0.0000000 0.5000000 1.6666667
28452_2023-11-27 10:39:58_2023-11-27 10:39:58 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 3.333333 2.000000 0.6666667 3.0 5.0 0.0 -0.6666667 -0.3333333 -3.0000000
28556_2023-11-27 10:09:53_2023-11-27 11:36:33 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 4.666667 3.333333 1.0000000 3.0 1.0 0.5 -0.5000000 -1.6666667 2.3333333
28586_2023-11-24 14:24:12_2023-11-27 11:50:19 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 2.000000 0.3333333 1.0 1.5 0.5 0.1666667 0.0000000 0.5000000
28587_2023-11-27 11:51:04_2023-11-27 11:51:04 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 4.666667 4.333333 1.0000000 4.0 4.0 1.0 0.0000000 -0.6666667 0.3333333
28591_2023-11-27 08:18:11_2023-11-27 11:53:43 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 1.666667 0.3333333 3.5 2.5 0.5 0.1666667 2.1666667 -0.8333333
28624_2023-11-20 15:55:58_2023-11-27 12:10:15 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 4.666667 2.666667 1.0000000 4.5 3.5 1.0 0.0000000 -0.1666667 -0.8333333
28810_2023-11-27 13:45:03_2023-11-27 13:45:03 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.333333 1.333333 0.3333333 1.5 3.5 0.0 -0.3333333 -1.8333333 -2.1666667
28844_2023-11-27 13:57:42_2023-11-27 13:57:42 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 1.333333 1.0000000 1.5 1.5 1.0 0.0000000 0.1666667 -0.1666667
28902_2023-11-27 14:29:27_2023-11-27 14:29:27 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 4.000000 0.0000000 2.5 3.0 1.0 1.0000000 1.5000000 1.0000000
28993_2023-11-27 15:09:29_2023-11-27 15:09:29 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 2.000000 1.0000000 2.0 2.5 1.0 0.0000000 0.3333333 -0.5000000
29004_2023-11-27 15:13:33_2023-11-27 15:13:33 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 4.000000 4.000000 1.0000000 2.0 5.0 1.0 0.0000000 -2.0000000 -1.0000000
29033_2023-11-27 15:23:50_2023-11-27 15:23:50 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 4.000000 3.333333 1.0000000 4.0 3.0 1.0 0.0000000 0.0000000 0.3333333
29173_2023-11-27 16:23:19_2023-11-27 16:23:19 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 3.000000 4.000000 0.3333333 3.0 3.5 0.5 0.1666667 0.0000000 0.5000000
29186_2023-11-27 16:27:14_2023-11-27 16:27:14 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 1.000000 0.6666667 5.0 1.0 1.0 0.3333333 1.3333333 0.0000000
29193_2023-11-27 16:31:08_2023-11-27 16:31:08 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 1.333333 0.6666667 1.0 1.0 1.0 0.3333333 -0.3333333 0.3333333
29199_2023-11-27 16:34:58_2023-11-27 16:34:58 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 1.333333 1.0000000 2.0 2.0 1.0 0.0000000 0.3333333 -0.6666667
29214_2023-11-27 16:38:31_2023-11-27 16:38:31 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 3.666667 0.0000000 2.0 3.5 0.5 0.5000000 0.0000000 0.1666667
29293_2023-11-18 08:22:24_2023-11-27 17:13:58 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 4.000000 4.000000 0.0000000 4.0 1.5 1.0 1.0000000 0.0000000 2.5000000
29346_2023-11-27 17:46:02_2023-11-27 17:46:02 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 2.000000 0.6666667 2.0 2.0 1.0 0.3333333 0.0000000 0.0000000
29403_2023-11-27 09:13:28_2023-11-27 18:12:46 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 1.666667 0.3333333 3.5 3.0 1.0 0.6666667 1.1666667 -1.3333333
29452_2023-11-27 18:33:03_2023-11-27 18:33:03 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 5.000000 0.0000000 1.0 5.0 0.0 0.0000000 0.0000000 0.0000000
29484_2023-11-27 18:48:16_2023-11-27 18:48:16 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.666667 3.333333 0.6666667 3.5 1.5 1.0 0.3333333 0.8333333 1.8333333
29508_2023-11-27 18:56:50_2023-11-27 18:56:50 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 4.666667 3.333333 1.0000000 3.0 2.0 0.5 -0.5000000 -1.6666667 1.3333333
29630_2023-11-27 19:48:02_2023-11-27 19:48:02 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 4.000000 5.000000 1.0000000 3.5 5.0 1.0 0.0000000 -0.5000000 0.0000000
29663_2023-11-25 11:32:42_2023-11-27 20:01:16 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 5.000000 1.0000000 5.0 5.0 1.0 0.0000000 0.0000000 0.0000000
29698_2023-11-27 20:17:18_2023-11-27 20:17:18 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 4.666667 5.000000 1.0000000 4.5 4.5 1.0 0.0000000 -0.1666667 0.5000000
29751_2023-11-27 20:47:21_2023-11-27 20:47:21 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 3.666667 0.0000000 3.5 4.0 1.0 1.0000000 1.8333333 -0.3333333
29775_2023-11-27 20:58:40_2023-11-27 20:58:42 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 1.666667 0.6666667 3.0 3.0 0.5 -0.1666667 0.6666667 -1.3333333
29804_2023-11-27 21:11:30_2023-11-27 21:11:30 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 4.666667 4.666667 1.0000000 4.5 4.5 0.5 -0.5000000 -0.1666667 0.1666667
29901_2023-11-27 22:16:25_2023-11-27 22:16:25 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 5.000000 1.0000000 5.0 5.0 1.0 0.0000000 0.0000000 0.0000000
29906_2023-11-27 22:20:28_2023-11-27 22:20:28 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 2.666667 1.333333 0.6666667 2.0 1.0 0.5 -0.1666667 -0.6666667 0.3333333
30081_2023-11-28 03:57:40_2023-11-28 03:57:40 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 4.333333 3.666667 1.0000000 3.5 4.0 1.0 0.0000000 -0.8333333 -0.3333333
30372_2023-11-28 07:12:32_2023-11-28 07:12:33 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 2.000000 1.0000000 1.5 2.0 1.0 0.0000000 -0.5000000 0.0000000
30406_2023-11-28 07:27:47_2023-11-28 07:27:47 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 1.666667 0.3333333 2.0 1.0 1.0 0.6666667 0.0000000 0.6666667
30428_2023-11-28 07:36:15_2023-11-28 07:36:15 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 1.000000 0.3333333 3.0 3.0 0.5 0.1666667 -2.0000000 -2.0000000
30505_2023-11-28 08:12:27_2023-11-28 08:12:27 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 2.333333 0.0000000 1.5 3.5 0.0 0.0000000 0.1666667 -1.1666667
30603_2023-11-28 09:15:55_2023-11-28 09:15:55 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 1.000000 1.0000000 1.5 1.0 1.0 0.0000000 0.1666667 0.0000000
30637_2023-11-28 09:41:59_2023-11-28 09:41:59 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 5.000000 1.0000000 5.0 5.0 1.0 0.0000000 0.0000000 0.0000000
30671_2023-11-28 10:05:11_2023-11-28 10:05:12 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 2.000000 0.0000000 1.5 1.5 0.5 0.5000000 0.1666667 0.5000000
30691_2023-11-28 10:20:51_2023-11-28 10:20:51 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 2.000000 1.0000000 2.0 2.0 1.0 0.0000000 0.3333333 0.0000000
30856_2023-11-28 11:58:27_2023-11-28 11:58:27 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 3.666667 0.3333333 5.0 1.0 1.0 0.6666667 3.3333333 2.6666667
30859_2023-11-28 11:59:43_2023-11-28 11:59:43 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 2.000000 0.6666667 2.0 2.0 1.0 0.3333333 0.0000000 0.0000000
30894_2023-11-28 12:24:04_2023-11-28 12:24:04 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 4.666667 0.0000000 1.0 5.0 0.0 0.0000000 -1.3333333 -0.3333333
30913_2023-11-28 12:32:08_2023-11-28 12:32:08 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 5.000000 1.0000000 5.0 5.0 1.0 0.0000000 0.0000000 0.0000000
30939_2023-11-28 12:46:16_2023-11-28 12:46:16 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 1.666667 1.0000000 4.0 1.0 0.5 -0.5000000 2.6666667 0.6666667
31117_2023-11-28 14:24:19_2023-11-28 14:24:19 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 1.333333 0.3333333 2.0 2.0 1.0 0.6666667 0.6666667 -0.6666667
31156_2023-11-28 14:45:09_2023-11-28 14:45:09 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 4.666667 3.000000 1.0000000 3.0 5.0 1.0 0.0000000 -1.6666667 -2.0000000
31249_2023-11-28 15:42:35_2023-11-28 15:42:35 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 4.000000 1.0000000 1.5 1.0 1.0 0.0000000 -0.8333333 3.0000000
31311_2023-11-28 15:42:01_2023-11-28 16:21:48 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 3.333333 2.666667 0.6666667 1.5 2.5 1.0 0.3333333 -1.8333333 0.1666667
31387_2023-11-28 17:12:01_2023-11-28 17:12:01 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.000000 2.333333 1.0000000 3.5 3.0 1.0 0.0000000 0.5000000 -0.6666667
31406_2023-11-28 17:14:20_2023-11-28 17:21:59 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 2.333333 1.0000000 5.0 1.0 1.0 0.0000000 0.0000000 1.3333333
31431_2023-11-28 17:40:38_2023-11-28 17:40:38 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.000000 2.333333 1.0000000 2.0 3.0 1.0 0.0000000 -1.0000000 -0.6666667
31441_2023-11-28 17:52:46_2023-11-28 17:52:46 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 3.000000 1.000000 0.6666667 2.0 1.5 1.0 0.3333333 -1.0000000 -0.5000000
31513_2023-11-21 04:51:24_2023-11-28 18:36:31 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 1.000000 1.0000000 2.0 1.0 0.5 -0.5000000 0.0000000 0.0000000
31568_2023-11-28 19:07:42_2023-11-28 19:08:11 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 4.666667 4.666667 0.6666667 4.5 4.5 1.0 0.3333333 -0.1666667 0.1666667
31600_2023-11-28 19:23:24_2023-11-28 19:23:26 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 4.333333 4.000000 1.0000000 4.0 2.5 1.0 0.0000000 -0.3333333 1.5000000
31625_2023-11-28 19:32:52_2023-11-28 19:32:52 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 3.333333 4.000000 1.0000000 2.5 2.5 0.5 -0.5000000 -0.8333333 1.5000000
31651_2023-11-28 19:47:04_2023-11-28 19:47:12 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 5.000000 1.0000000 5.0 3.0 1.0 0.0000000 0.0000000 2.0000000
31673_2023-11-26 20:50:52_2023-11-28 19:58:34 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 3.000000 1.0000000 1.5 1.5 0.0 -1.0000000 -0.5000000 1.5000000
31691_2023-11-28 20:05:30_2023-11-28 20:05:30 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.000000 3.333333 0.6666667 3.0 3.5 1.0 0.3333333 0.0000000 -0.1666667
31736_2023-11-26 11:20:51_2023-11-28 20:26:21 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 1.666667 1.0000000 2.0 2.0 0.5 -0.5000000 0.0000000 -0.3333333
31838_2023-11-28 21:26:15_2023-11-28 21:26:15 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 2.333333 0.3333333 1.0 2.0 0.0 -0.3333333 -1.0000000 0.3333333
31948_2023-11-28 23:11:36_2023-11-28 23:11:36 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 4.666667 0.0000000 3.0 3.0 0.5 0.5000000 2.0000000 1.6666667
31985_2023-11-24 19:28:59_2023-11-29 01:33:47 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 3.666667 0.3333333 4.0 1.0 1.0 0.6666667 1.6666667 2.6666667
31986_2023-11-29 01:35:49_2023-11-29 01:35:49 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 3.000000 0.3333333 4.0 1.5 1.0 0.6666667 1.6666667 1.5000000
32032_2023-11-29 03:14:16_2023-11-29 03:14:16 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 2.666667 1.0000000 5.0 3.0 1.0 0.0000000 3.0000000 -0.3333333
32037_2023-11-29 03:23:22_2023-11-29 03:23:22 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 3.666667 0.0000000 5.0 1.0 1.0 1.0000000 3.0000000 2.6666667
32048_2023-11-29 03:36:18_2023-11-29 03:36:18 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 1.333333 0.6666667 1.5 1.0 1.0 0.3333333 -0.1666667 0.3333333
32098_2023-11-29 04:32:08_2023-11-29 04:32:08 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 3.000000 1.0000000 2.0 3.0 1.0 0.0000000 -0.3333333 0.0000000
32338_2023-11-29 07:36:25_2023-11-29 07:36:25 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 2.333333 0.6666667 3.0 3.0 0.5 -0.1666667 -0.6666667 -0.6666667
32342_2023-11-29 07:37:15_2023-11-29 07:37:15 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 4.000000 1.000000 0.6666667 5.0 1.5 1.0 0.3333333 1.0000000 -0.5000000
32368_2023-11-28 11:49:52_2023-11-29 07:53:23 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 4.000000 4.000000 1.0000000 3.5 4.0 1.0 0.0000000 -0.5000000 0.0000000
32376_2023-11-29 07:57:25_2023-11-29 07:57:25 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 1.000000 1.0000000 5.0 1.5 1.0 0.0000000 2.6666667 -0.5000000
32446_2023-11-29 08:48:06_2023-11-29 08:48:06 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 1.666667 1.0000000 2.0 1.0 1.0 0.0000000 1.0000000 0.6666667
32464_2023-11-29 08:54:57_2023-11-29 08:55:03 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 2.666667 0.6666667 3.5 3.0 0.5 -0.1666667 -0.1666667 -0.3333333
32472_2023-11-29 08:59:21_2023-11-29 08:59:21 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 1.000000 1.0000000 1.5 1.0 1.0 0.0000000 0.1666667 0.0000000
32549_2023-11-20 05:05:05_2023-11-29 09:42:14 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.333333 2.333333 1.0000000 2.5 3.5 0.5 -0.5000000 -0.8333333 -1.1666667
32603_2023-11-29 10:16:33_2023-11-29 10:16:33 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 1.333333 1.0000000 4.5 2.0 1.0 0.0000000 0.8333333 -0.6666667
32609_2023-11-29 10:20:24_2023-11-29 10:20:40 Phase 1 Game TRUE FALSE NA NA NA NA NA NA NA NA NA 3.000000 3.666667 0.6666667 5.0 1.5 1.0 0.3333333 2.0000000 2.1666667
32810_2023-11-29 12:27:00_2023-11-29 12:27:00 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 3.000000 0.3333333 3.0 3.0 1.0 0.6666667 -0.6666667 0.0000000
32821_2023-11-29 12:34:03_2023-11-29 12:34:03 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 1.666667 0.0000000 1.0 2.0 0.0 0.0000000 0.0000000 -0.3333333
32839_2023-11-29 12:48:08_2023-11-29 12:48:08 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 4.666667 0.0000000 2.5 4.0 0.0 0.0000000 1.5000000 0.6666667
32997_2023-11-29 14:40:05_2023-11-29 14:40:05 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 2.000000 0.0000000 1.5 2.0 0.5 0.5000000 0.5000000 0.0000000
32999_2023-11-21 17:46:46_2023-11-29 14:41:15 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 1.333333 0.6666667 1.5 3.0 1.0 0.3333333 0.1666667 -1.6666667
33062_2023-11-29 15:12:05_2023-11-29 15:12:05 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 2.000000 0.0000000 1.5 1.5 0.5 0.5000000 0.5000000 0.5000000
33203_2023-11-29 16:38:33_2023-11-29 16:38:33 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 4.333333 0.3333333 3.0 3.5 1.0 0.6666667 1.0000000 0.8333333
33226_2023-11-29 16:52:48_2023-11-29 16:52:48 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 4.000000 0.6666667 3.0 2.5 0.5 -0.1666667 -0.6666667 1.5000000
33242_2023-11-29 17:07:07_2023-11-29 17:07:07 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 4.333333 0.6666667 5.0 4.0 1.0 0.3333333 1.3333333 0.3333333
33333_2023-11-29 18:08:11_2023-11-29 18:08:11 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 1.333333 0.6666667 2.0 2.0 0.5 -0.1666667 0.3333333 -0.6666667
33372_2023-11-29 18:26:48_2023-11-29 18:26:48 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 3.333333 0.6666667 4.5 1.0 1.0 0.3333333 2.1666667 2.3333333
33394_2023-11-29 18:38:22_2023-11-29 18:38:22 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 2.666667 0.3333333 3.0 3.0 0.5 0.1666667 0.6666667 -0.3333333
33545_2023-11-29 19:53:24_2023-11-29 19:53:25 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 1.000000 1.0000000 1.0 1.0 1.0 0.0000000 0.0000000 0.0000000
33548_2023-11-29 19:55:58_2023-11-29 19:55:58 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 3.666667 1.0000000 3.5 3.0 1.0 0.0000000 -0.1666667 0.6666667
33552_2023-11-29 19:57:51_2023-11-29 19:57:51 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 2.000000 0.6666667 1.5 1.5 0.5 -0.1666667 -0.1666667 0.5000000
33738_2023-11-29 21:31:17_2023-11-29 21:31:17 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 1.333333 1.0000000 1.0 1.5 1.0 0.0000000 -0.6666667 -0.1666667
34816_2023-11-30 21:14:16_2023-11-30 21:14:16 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.333333 4.333333 0.0000000 4.5 1.5 1.0 1.0000000 3.1666667 2.8333333
36278_2023-12-01 21:49:47_2023-12-01 21:53:02 Phase 1 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 2.333333 0.3333333 5.0 1.5 1.0 0.6666667 1.3333333 0.8333333
36813_2023-12-02 09:33:19_2023-12-02 09:33:19 Phase 1 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.666667 2.666667 1.0000000 3.0 5.0 1.0 0.0000000 -0.6666667 -2.3333333
37872_2023-12-03 03:04:29_2023-12-03 03:04:29 Phase 1 Video TRUE FALSE NA NA NA NA NA NA NA NA NA 5.000000 1.000000 1.0000000 5.0 1.0 1.0 0.0000000 0.0000000 0.0000000
43681_2023-12-13 07:34:09_2023-12-13 07:34:09 Phase 2 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 1.000000 4.000000 0.0000000 2.5 4.5 0.5 0.5000000 1.5000000 -0.5000000
45186_2023-12-13 11:18:49_2023-12-13 11:18:49 Phase 2 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 3.333333 0.0000000 2.0 4.0 0.0 0.0000000 0.0000000 -0.6666667
45996_2023-12-13 13:27:58_2023-12-13 13:27:58 Phase 2 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 2.333333 0.3333333 1.0 1.0 0.5 0.1666667 -1.3333333 1.3333333
46358_2023-12-13 14:28:26_2023-12-13 14:28:26 Phase 2 Long Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 5.000000 0.3333333 5.0 3.5 1.0 0.6666667 3.0000000 1.5000000
46431_2023-12-13 14:41:07_2023-12-13 14:41:07 Phase 2 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.000000 4.000000 0.3333333 5.0 3.0 0.5 0.1666667 3.0000000 1.0000000
52943_2023-12-15 00:44:53_2023-12-15 00:44:53 Phase 2 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 1.666667 0.6666667 1.5 2.5 1.0 0.3333333 -0.8333333 -0.8333333
53391_2023-12-15 06:22:34_2023-12-15 06:22:34 Phase 2 Long Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 1.333333 0.6666667 2.0 2.0 1.0 0.3333333 -0.3333333 -0.6666667
57294_2023-12-16 10:19:15_2023-12-16 10:19:15 Phase 2 Long Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 3.000000 2.000000 1.0000000 2.5 2.0 1.0 0.0000000 -0.5000000 0.0000000
60756_2023-12-17 12:41:16_2023-12-17 12:41:16 Phase 2 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 4.666667 5.000000 1.0000000 4.5 5.0 1.0 0.0000000 -0.1666667 0.0000000
64464_2023-12-18 19:36:43_2023-12-18 19:36:44 Phase 2 Long Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 2.333333 3.000000 0.0000000 5.0 1.0 1.0 1.0000000 2.6666667 2.0000000
68989_2023-12-20 10:20:50_2023-12-20 10:20:50 Phase 2 SMS TRUE FALSE NA NA NA NA NA NA NA NA NA 2.666667 2.666667 0.0000000 2.0 2.5 0.0 0.0000000 -0.6666667 0.1666667
85292_2023-12-27 12:41:05_2023-12-27 12:41:05 Phase 2 Original Baseline TRUE FALSE NA NA NA NA NA NA NA NA NA 1.666667 5.000000 0.0000000 5.0 3.0 1.0 1.0000000 3.3333333 2.0000000

  • We noticed 583 participants who completed the follow-up misinformation quiz but were indicated as not completing the main misinformation quiz. We checked for the sharing, reliable, and manipulative scores for these participants and noticed that these scores are missing in the main survey but present in the follow-up.

  • We will create a flag for these participants. Variable abnormal_completed_followup will be 1 for these abnormal participants and 0 otherwise.

df_wide_followup <- df_wide_followup |> 
  mutate(abnormal_completed_followup = ifelse(quiz_completed_followup == "TRUE" & quiz_completed_coded == "FALSE", 1, 0))

df_wide_followup %>% count(abnormal_completed_followup) %>% kable("html") %>%
  kableExtra::kable_styling(bootstrap_options = c("striped", "hover"))
abnormal_completed_followup n
0 19951
1 583
  • We will save these participants in a separate spreadsheet for more detail analysis
abnormal_completed_followup %>% 
  select(analytic_id) %>% 
  fwrite("data/chatfuel/processed/abnormal_completed_followup.csv.gz")

  • Upon inspection, We noticed that these 583 participants who at least one missing values for main survey quiz variables. None of them had all missing values for all quiz variables in the main survey. These participants had non missing values for all of the follow-up quiz variables.

  • The distribution of time entered the chatbot and time started the main survey misinformation quiz is concentrated between November 16, 2023 and November 30, 2023. The frequency is almost zero after November 30, 2023.

  • The concentration of entries into the chatbot and starting the main survey misinformation quiz of these participants primarily occurred between November 16, 2023, and November 30, 2023. Following November 30, 2023, the frequency dropped to nearly zero.

  • The primary cause of this issue is attributed to the lack of forced responses for quiz questions in the main survey misinformation quiz between November 16, 2023, and November 30, 2023. Consequently, participants could advance to subsequent quiz questions by entering any response into the Chatbot. In our main cleaning script, we classified responses that differed from the predefined selections as missing values. Therefore, those participants who responded to the quiz questions without choosing the predetermined options were deemed to have not completed the main survey misinformation quiz.

  • Forced response was put into effect on November 30, 2023, which addressed the issue. Observing the time distribution below, there are scarcely any instances of participants encountering this problem post-November 30, 2023.

  • We decided to drop these participants from the analysis.

before <- as.character(nrow(df_wide_followup))

df_wide_followup <- df_wide_followup |> 
  filter(abnormal_completed_followup == 0)

after <- as.character(nrow(df_wide_followup))
  • Before dropping, we had 20534 participants and after dropping we have 19951 participants.

Checking quiz completers in the follow up who had missing values for starting followup time stamp

abnormal_start_time_followup <- df_wide_followup %>% 
  filter(quiz_completed_followup == "TRUE" & is.na(MisinfoChat_start_time_followup))

n_abnormal_start_time_followup <- as.character(nrow(abnormal_start_time_followup))
  • We noticed 0 participants who completed the follow-up misinformation quiz but had missing values for the starting time stamp of the follow-up chat. We will drop this participant from the follow-up data set.

Checking quiz completers in the follow up who had missing values for main survey intervention duration

abnormal_intervention_duration <- df_wide_followup %>% 
  filter(quiz_completed_followup == "TRUE" & is.na(intervention_duration))

n_abnormal_intervention_duration <- as.character(nrow(abnormal_intervention_duration))
  • We noticed 1 participants who completed the follow-up misinformation quiz but had missing values for the main survey intervention duration. We will drop this participant from the follow-up data set.
abnormal_intervention_duration %>% select(analytic_id, arm_coded, phase_coded, quiz_completed_coded, intervention_duration, quiz_completed_followup) %>%
  kable("html") %>%
  kableExtra::kable_styling(bootstrap_options = c("striped", "hover"))
analytic_id arm_coded phase_coded quiz_completed_coded intervention_duration quiz_completed_followup
90947_2023-12-31 04:54:46_2023-12-31 04:57:33 SMS Phase 2 TRUE NA TRUE 
before <- as.character(nrow(df_wide_followup))
df_wide_followup <- df_wide_followup |> 
  filter(!analytic_id %in% abnormal_intervention_duration$analytic_id)
after <- as.character(nrow(df_wide_followup))
  • We dropped 1 participants who completed the follow-up misinformation quiz but had missing values for the main survey intervention duration. Before dropping, we had 19951 participants and after dropping we have 19950 participants.

Storing these participants analytic_id

  • In this section, we will create a spreadsheet file containing all the analytic_id of the participants who passed quality checks after merging the main survey and follow-up survey data. We will then drop participants whose analytic_id is not in this spreadsheet.
  • The spreadsheet analytic_id_followup.csv.gz contains the final list of follow-up participants passing quality checks.
df_wide_followup %>% 
  select(analytic_id) %>% 
  fwrite("data/chatfuel/processed/analytic_id_followup.csv.gz")

Save

Generating long dataset

data_followup_long_final <- data_long %>%
  select(analytic_id, attention_check_passed_followup_coded_num, completed_quiz_followup_coded_num, post_number_followup, post_id_followup, manipulative_score_followup, reliable_score_followup,  share_score_followup, post_type_followup)

data_followup_long_final$is_followup <- TRUE 

## filtering out 
data_followup_long_final <- data_followup_long_final |> 
  filter(analytic_id %in% df_wide_followup$analytic_id)


# labeling   
library(Hmisc)

label(data_followup_long_final$analytic_id) <- "Analytic ID"
label(data_followup_long_final$post_id_followup) <- "Follow up Post ID"
label(data_followup_long_final$post_number_followup) <- "Follow up Post Order Number"
label(data_followup_long_final$post_type_followup) <- "Follow up Post Type"
label(data_followup_long_final$attention_check_passed_followup_coded_num) <- "Follow up Attention Check"
label(data_followup_long_final$share_score_followup) <- "Follow up Share Score"
label(data_followup_long_final$reliable_score_followup) <- "Follow up Reliable Score"
label(data_followup_long_final$manipulative_score_followup) <- "Follow up Manipulative Score"
label(data_followup_long_final$completed_quiz_followup_coded_num) <- "Follow up Quiz Completion"
label(data_followup_long_final$is_followup) <- "Is Follow up"


var_names <- names(data_followup_long_final)

# Extracting labels
var_labels <- sapply(data_followup_long_final, label)

# Combine into a data frame
label_long_info <- data.frame(Variable = var_names, Label = var_labels, stringsAsFactors = FALSE)

write.csv(label_long_info, "./data/chatfuel/processed/followup_long_data_variable.csv", row.names = FALSE)

fwrite(data_followup_long_final, "./data/chatfuel/processed/misinfo_followup_clean_long.csv.gz")

saveRDS(data_followup_long_final, "./data/chatfuel/processed/misinfo_followup_clean_long.rds")

  • Long dataset is exported as misinfo_followup_clean_long.csv

  • The dataset contains the following variables:

    • analytic_id: Unique identifier for each participant

    • mean_share_misinfo_followup: Mean share score for misinformation posts in followup

    • mean_reliable_misinfo_followup: Mean reliability score for misinformation posts in followup

    • mean_manipulative_misinfo_followup: Mean manipulation score for misinformation posts in followup

    • any_missing_share_misinfo_followup: TRUE if any missing value in share score for misinformation posts in followup

    • any_missing_reliable_misinfo_followup: TRUE if any missing value in reliability score for misinformation posts in followup

    • is_followup: TRUE for followup data set

The dataset is also saved as misinfo_followup_clean_long.rds for future use.

  • The dataset contains 92655 user-post observations corresponding to 18531 participants.

Generating wide dataset

# Filter out 

data_followup_wide_final <- data_followup_wide_final |> 
  filter(analytic_id %in% df_wide_followup$analytic_id)

# labeling
label(data_followup_wide_final$analytic_id) <- "Analytic ID"
label(data_followup_wide_final$MisinfoChat_start_time_followup) <- "Follow up Start Time"
label(data_followup_wide_final$MisinfoQuiz_start_time_followup) <- "Follow up Quiz Start Time"
label(data_followup_wide_final$misinfoQuiz_end_time_followup) <- "Follow up Quiz End Time"
label(data_followup_wide_final$duration_complete_quiz_followup) <- "Follow up Quiz Duration"
label(data_followup_wide_final$time_since_completed_intervention) <- "Follow up Time Since Completed Intervention in Main Survey"
label(data_followup_wide_final$time_since_completed_quiz) <- "Follow up Time Since Completed Misinformation Quiz in Main Survey"
label(data_followup_wide_final$user_payment_amount_followup) <- "Follow up Payment Amount"
label(data_followup_wide_final$followup_entry_point) <- "Follow up Entry Point"
label(data_followup_wide_final$followup_reflection_1) <- "Follow up Reflection 1"
label(data_followup_wide_final$followup_reflection_2) <- "Follow up Reflection 2"
label(data_followup_wide_final$followup_reflection_3) <- "Follow up Reflection 3"
label(data_followup_wide_final$abnormal_followup_reflection_1) <- "Follow up Abnormal Reflection 1"
label(data_followup_wide_final$abnormal_followup_reflection_2) <- "Follow up Abnormal Reflection 2"
label(data_followup_wide_final$abnormal_followup_reflection_3) <- "Follow up Abnormal Reflection 3"
label(data_followup_wide_final$mean_share_misinfo_followup) <- "Follow up Mean Misinfo Share Score"
label(data_followup_wide_final$mean_reliable_misinfo_followup) <- "Follow up Mean Misinfo Reliable Score"
label(data_followup_wide_final$mean_manipulative_misinfo_followup) <- "Follow up Mean Misinfo Manipulative Score"
label(data_followup_wide_final$mean_share_nonmisinfo_followup) <- "Follow up Mean Nonmisinfo Sharing Score"
label(data_followup_wide_final$mean_reliable_nonmisinfo_followup) <- "Follow up Mean Nonmisinfo Reliability Score"
label(data_followup_wide_final$mean_manipulative_nonmisinfo_followup) <- "Follow up Mean Nonmisinfo Manipulation Score"
label(data_followup_wide_final$sharing_discernment_followup) <- "Follow up Sharing Discernment"
label(data_followup_wide_final$reliability_discernment_followup) <- "Follow up Reliability Discernment"
label(data_followup_wide_final$manipulation_discernment_followup) <- "Follow up Manipulation Discernment"
label(data_followup_wide_final$quiz_completed_followup) <- "Follow up Quiz Completion"
label(data_followup_wide_final$completed_quiz_followup_coded_num) <- "Completed Followup Misinformation Quiz as Binary Variable"


var_names <- names(data_followup_wide_final)

# Extracting labels
var_labels <- sapply(data_followup_wide_final, label)

# Combine into a data frame
label_wide_info <- data.frame(Variable = var_names, Label = var_labels, stringsAsFactors = FALSE)
write.csv(label_wide_info, "./data/chatfuel/processed/followup_wide_data_variable.csv", row.names = FALSE)


# Save data to csv.gz
fwrite(data_followup_wide_final, "./data/chatfuel/processed/misinfo_followup_clean_wide.csv.gz")

# Save data to .rds
saveRDS(data_followup_wide_final, "./data/chatfuel/processed/misinfo_followup_clean_wide.rds")                                                 

# Save to stata format
library(haven)
# shorten variable names to fit stata limit
data_wide_stata = data_followup_wide_final  |>
  rename(attn_passed_fllwp = attention_check_passed_followup_coded_num)|>
  rename_all(~str_replace_all(., "followup", "fllwp")) |>
  rename_all(~str_replace_all(., "reflection", "refl")) |>
  rename_all(~str_replace_all(., "manipulative", "mani")) |>
  rename_all(~str_replace_all(., "reliable", "reli")) |>
  rename_all(~str_replace_all(., "reflection", "refl")) |>
  rename_all(~str_replace_all(., "discernment", "disc")) |>
  rename_all(~str_replace_all(., "misinfo", "mis")) |>
  rename_all(~str_replace_all(., "nonmisinfo", "nonmis")) |>
  rename_all(~str_replace_all(., "share", "shre")) |>
  rename_all(~str_replace_all(., "abnormal", "abn")) |>
  rename_all(~str_replace_all(., "completed", "compl")) |>
  rename_all(~str_replace_all(., "inter", "int"))

write_dta(data_wide_stata, "./data/chatfuel/processed/misinfo_followup_clean_wide.dta")

  • Wide dataset is exported as misinfo_followup_clean_wide.csv

  • The dataset contains the following variables:

    • analytic_id: Unique identifier for each participant
    • MisinfoChat_start_time_followup: Start time of the follow-up chat
    • MisinfoQuiz_start_time_followup: Start time of the follow-up quiz
    • misinfoQuiz_end_time_followup: End time of the follow-up quiz
    • duration_complete_quiz_followup: Duration to complete the follow-up quiz
    • time_since_completed_intervention: Time since the participant completed the intervention in the main survey
    • time_since_completed_quiz: Time since the participant completed the misinformation quiz in the main survey
    • user_payment_amount_followup: Payment amount for the follow-up survey
    • attention_check_passed_followup_coded_num: Attention check passed; 1 for pass, 0 for fail
    • followup_entry_point: Entry point for the follow-up survey
    • followup_reflection_1: Reflection 1 for the follow-up survey: “Can you remember any example in the last two weeks where thinking about our previous chat changed your behavior?”
    • followup_reflection_2: Reflection 2 for the follow-up survey: “Have you noticed any misinformation/disinformation in your timeline in the past 6 weeks?”
    • followup_reflection_3: Reflection 3 for the follow-up survey: “If you noticed a close friend sharing posts that you thought might have misinformation, what might you say to them that would help them make different choices in the future?”
    • abnormal_followup_reflection_1: Abnormal reflection 1 for the follow-up survey
    • abnormal_followup_reflection_2: Abnormal reflection 2 for the follow-up survey
    • abnormal_followup_reflection_3: Abnormal reflection 3 for the follow-up survey
    • mean_share_misinfo_followup: Mean misinformation sharing score for the follow-up survey
    • mean_reliable_misinfo_followup: Mean misinformation reliability score for the follow-up survey
    • mean_manipulative_misinfo_followup: Mean misinformation manipulation score for the follow-up survey
    • mean_share_nonmisinfo_followup: Mean non-misinformation sharing score for the follow-up survey
    • mean_reliable_nonmisinfo_followup: Mean non-misinformation reliability score for the follow-up survey
    • mean_manipulative_nonmisinfo_followup: Mean non-misinformation manipulation score for the follow-up survey
    • sharing_discernment_followup: Sharing discernment score for the follow-up survey
    • reliability_discernment_followup: Reliability discernment score for the follow-up survey
    • manipulation_discernment_followup: Manipulation discernment score for the follow-up survey

The dataset is also saved as misinfo_followup_clean_wide.rds for future use.

  • The dataset contains 19950 user-post observations corresponding to 19950 participants.