OT RT plots
Saren Seeley
10-22-2018
MLM stuff from FSHD617C assignment
About
Overview
This ADA uses data from the project “The effect of intranasal oxytocin on neural functioning in widow(er)s” (#1503744420, PI: Mary-Frances O’Connor, Co-PI: Brian Arizmendi). It was a double-blind randomized crossover study, designed to address conflicting accounts of motivated behavior in complicatedgrief using a novel approach-avoidance task variant (grief AAT; gAAT) that allows for comparison between participant-provided photos and nomothetic grief stimuli. Participants were 40 English-speaking adults ages 55-80, who experienced the death of a spouse or long-term romantic partner between six months and three years prior to their participation.
Task
Participants attended two identical experimental sessions, at which they received one of two intranasal sprays (treatment A/B) and then took part in an fMRI scan, which involved a structural sequence, the gAAT, and a resting state sequence.
For the gAAT, five stimulus categories were presented: (1) deceased spouse, (2) living loved one [attachment figure], (3) stranger, (4) generic grief-related scenes, and (5) neutral scenes. Photos provided by the participant were scanned and resized to a standard 750-pixel height and width, and framed in colored frames to match the stimuli used for non-idiographic categories (i.e., stranger, grief-related, neutral). Photos of the stranger were sex-matched to the participant’s partner.
During the task, participants were instructed to follow rules based on an irrelevant characteristic of the stimuli, namely, the color of the frame around the photo (e.g., “push the joystick when the frame is blue, pull when the frame is yellow”). The task was completed in two runs of approximately seven minutes each. In the second run, the instructions were reversed (e.g. “now pull the joystick for blue framed photos”). Order of instructions was counterbalanced across participants. Stimuli were presented via Inquisit 4 (2014), in a pseudorandomized order determined by genetic algorithm to optimize statistical power and psychological validity (Wager & Nichols, 2003). Each trial last 3000ms, with 2500 ms allowed for response. Intertrial interval was 500ms.
Participants completed the task using an MRI-compatible joystick. The stimuli were animated so that a joystick push would make the image smaller (as if they were pushing it away from them) and a joystick pull would make the image larger (as if they were bringing it nearer to them).
Variables
The primary dependent variable of interest for the present analysis is reaction time bias, computed as RTpush-RTpull. Negative bias scores (faster to push than pull) indicate relative avoidance bias, while positive scores (faster to pull than to push) indicate relative approach bias. Because the two runs were identical in every way except for the instruction provided, each trial had both a push RT and a pull RT (e.g., run1 trial1 was push, run2 trial1 was pull, so subtract RT on run2 trial 1 from run1 trial1 to get the difference - this is further elaborated in the data cleaning script below), unless they failed to reverse the instructions.
Main predictors of interest included trial number (in order to establish whether peoples’ response bias changed over the 7-minute run), stimulus (neutral, spouse, stranger, living loved one, death), and condition (treatment A/B - oxytocin or placebo [I’m still blinded]).
Participants also completed a number of self-report measures (state and trait) and provided biological samples for OXTR genotyping and cortisol assay, some of which were used as predictors.
Equations
Level 1:
We first performed MLM to estimate the effect of trial number (i.e., the random effect of time) on response bias (push RT-pull RT) on a given trial. The level-1 model estimated, for each participant j (j = 1–35), a regression line that predicted each participant’s response bias in milliseconds on each trial i from the trial number. This model was represented as follows:[biasi]j = b0j + b1j [trialnumberi] + rij
where b0j, the intercept, is interpreted as participant j’s mean response bias for a given trial; b1j, the slope, represents the effect of trial number on response bias for each participant j (positive coefficients represent the predictive magnitude of trial number on response bias for a given participant); and rij is the residual error term.
Level 2:
The level-2 models estimated the average effects for the entire sample. The models were represented as follows:
b0j = γ00 + μ0j b1j = γ10 + μ1j
where the intercept, γ00, is interpreted as the average response bias for the entire sample; γ10 is the average effect of represents the effect of trial number on response bias for each participant j (positive coefficients represent the predictive magnitude of trial number on response bias for the sample as a whole), and thus, the primary estimate of interest; and μ0j and μ1j are the residual error terms.
Adding the fixed effect of stimulus type resulted in the following model:
b0j = γ00 + γ01(stimulusi) + μ0j b1j = γ10 + γ11(stimulusi) + μ1j
Data cleaning
Note: Went back to the raw data due to some inconsistencies in the OT_ADAA_Omnibus.xlsx file from BA that I found.
Pre-R steps:
- Removed all .iqdat files under 25KB or so in order to filter out pilot data and false starts.
- Removed non-study data (i.e., tests and OT undergrad files).
- Organized raw .iqdat files for each visit by run 1/run 2 (two separate folders) based on date/time stamp.
In Terminal, within each of the folders in turn…
- Changed file extensions to .tsv (tab-separated) from .iqdat:
find . -iname "*.iqdat" -exec bash -c 'mv "$0" "${0%\.iqdat}.tsv"' {} \; - Merged the files:
cat *.tsv > OT_gAAT_run-1.tsv(orOT_gAAT_run-2.tsv)5. Merged the files:tried to make this work but no luckmlr --tsvlite cat *.tsv > OT_gAAT_run-1.tsv(orOT_gAAT_run-2.tsv)-
5a.
mlr --tsvlitedrops the header from all but the first file, so column names are not repeated throughout the dataset.-
5b. This requires Miller, which can be installed via Homebrew on OSX (http://johnkerl.org/miller/doc/build.html)
- D117: Had 3 visits due to scanner technical issues. Use “_b" and “_c" as visit 1 and visit 2 respectively.
- D114: Has multiple files from visit 2. Use the last two.
- D135: Use files from 6/06/16 and 6/17/18 (scanner issues on 06/13/16). Use “_b" and “_c" as visit 1 and visit 2 respectively.
- D147: Visit 1 run 2 is partial data for some reason (I do have notes that she switched back to PUSH-YELLOW during run 2, but did not re-run because running way over time.)
Creating the MLM dataset
Import data
library(tidyverse)
filter <- dplyr::filter
select <- dplyr::select
# read in the data (only importing a subset of columns)
raw_r1 <- data.frame(read_tsv("~/Desktop/OT-gAAT_MLM-data/Run1_tsv/OT_gAAT_run-1.tsv", col_types=cols_only(
date = col_integer(),
time = col_character(),
subject = col_character(),
blockcode = col_character(),
blocknum = col_character(),
trialcode = col_character(),
values.trialcode = col_character(),
values.stimulus = col_character(),
values.initialresponse = col_character(),
values.RT = col_number()
)))number of columns of result is not a multiple of vector length (arg 1)154 parsing failures.
row [38;5;246m# A tibble: 5 x 5[39m col row col expected actual file expected [3m[38;5;246m<int>[39m[23m [3m[38;5;246m<chr>[39m[23m [3m[38;5;246m<chr>[39m[23m [3m[38;5;246m<chr>[39m[23m [3m[38;5;246m<chr>[39m[23m actual [38;5;250m1[39m 327 date an integer date '~/Desktop/OT-gAAT_MLM-data/Run1_tsv/OT_gAAT_run-1.tsv' file [38;5;250m2[39m 327 values.RT a number . '~/Desktop/OT-gAAT_MLM-data/Run1_tsv/OT_gAAT_run-1.tsv' row [38;5;250m3[39m 653 date an integer date '~/Desktop/OT-gAAT_MLM-data/Run1_tsv/OT_gAAT_run-1.tsv' col [38;5;250m4[39m 653 values.RT a number . '~/Desktop/OT-gAAT_MLM-data/Run1_tsv/OT_gAAT_run-1.tsv' expected [38;5;250m5[39m 974 date an integer date '~/Desktop/OT-gAAT_MLM-data/Run1_tsv/OT_gAAT_run-1.tsv'
... ................................. ... ........................................................................................... ........ ........................................................................................................................................................................................................................ ...... ........................................................................................................... .... ........................................................................................................... ... ........................................................................................................... ... ........................................................................................................... ........ ...........................................................................................................
See problems(...) for more details.raw_r2 <- data.frame(read_tsv("~/Desktop/OT-gAAT_MLM-data/Run2_tsv/OT_gAAT_run-2.tsv", col_types=cols_only(
date = col_integer(),
time = col_character(),
subject = col_character(),
blockcode = col_character(),
blocknum = col_character(),
trialcode = col_character(),
values.trialcode = col_character(),
values.stimulus = col_character(),
values.initialresponse = col_character(),
values.RT = col_number()
)))number of columns of result is not a multiple of vector length (arg 1)154 parsing failures.
row [38;5;246m# A tibble: 5 x 5[39m col row col expected actual file expected [3m[38;5;246m<int>[39m[23m [3m[38;5;246m<chr>[39m[23m [3m[38;5;246m<chr>[39m[23m [3m[38;5;246m<chr>[39m[23m [3m[38;5;246m<chr>[39m[23m actual [38;5;250m1[39m 324 date an integer date '~/Desktop/OT-gAAT_MLM-data/Run2_tsv/OT_gAAT_run-2.tsv' file [38;5;250m2[39m 324 values.RT a number . '~/Desktop/OT-gAAT_MLM-data/Run2_tsv/OT_gAAT_run-2.tsv' row [38;5;250m3[39m 643 date an integer date '~/Desktop/OT-gAAT_MLM-data/Run2_tsv/OT_gAAT_run-2.tsv' col [38;5;250m4[39m 643 values.RT a number . '~/Desktop/OT-gAAT_MLM-data/Run2_tsv/OT_gAAT_run-2.tsv' expected [38;5;250m5[39m 954 date an integer date '~/Desktop/OT-gAAT_MLM-data/Run2_tsv/OT_gAAT_run-2.tsv'
... ................................. ... ........................................................................................... ........ ........................................................................................................................................................................................................................ ...... ........................................................................................................... .... ........................................................................................................... ... ........................................................................................................... ... ........................................................................................................... ........ ...........................................................................................................
See problems(...) for more details.# header line repeats when I used `cat` to merge, so get those out of there
raw_r1 <- raw_r1 %>% filter(!is.na(date))
raw_r2 <- raw_r2 %>% filter(!is.na(date))
unique(raw_r1$subject) [1] "D101" "D101_2" "D102" "D102_B" "D103" "D103_b" "D104" "D104_b" "D105" "D105_b" "D107" "D107_b" "D110" "D110_b" "D113" "D113_b" "D114" "D114_b" "D115"
[20] "D115_b" "D117_b" "D117_c" "test" "D118_b" "D119" "D119_b" "D120" "D120_b" "D121" "D121_b" "D122" "D122_b" "D123" "D123_b" "D125" "D125_b" "D126" "D126_b"
[39] "D127" "D127_b" "D128" "D128_b" "D129" "D129_b" "D130" "D131" "D131_b" "D132" "D132_b" "D133" "D133_b" "D134" "D134_b" "D135" "D135_c" "D137" "D137_b"
[58] "D138" "D138_b" "D139" "D139_b" "D140" "D140_b" "D141" "D141_b" "D142" "D144" "D144_b" "D145" "D145_b" "D146" "D146_b" "D147" "D147_b" "D148" "D148_b"# D118 is showing up as "test" for some reason (checked against the .iqdat file), and D130_b is missing
# both of D130's and D142's visits were entered as "D130"/"D142", so change the subject ID for the visit on 052416 to D130_b and on
raw_r1$subject[raw_r1$date == 020916] <- "D118"
raw_r1$subject[raw_r1$date == 052416] <- "D130_b"
raw_r1$subject[raw_r1$date == 111516] <- "D142_b"
# fixing some other stuff in a similar vein
raw_r1$subject[raw_r1$subject == "D101_2"] <- "D101_b"
raw_r1$subject[raw_r1$subject == "D102_B"] <- "D102_b"
raw_r1$subject[raw_r1$subject == "D117_b"] <- "D117"
raw_r1$subject[raw_r1$subject == "D117_c"] <- "D117_b"
raw_r1$subject[raw_r1$subject == "D135_c"] <- "D135_b"
unique(raw_r1$subject) # 78 unique - that is correct [1] "D101" "D101_b" "D102" "D102_b" "D103" "D103_b" "D104" "D104_b" "D105" "D105_b" "D107" "D107_b" "D110" "D110_b" "D113" "D113_b" "D114" "D114_b" "D115"
[20] "D115_b" "D117" "D117_b" "D118" "D118_b" "D119" "D119_b" "D120" "D120_b" "D121" "D121_b" "D122" "D122_b" "D123" "D123_b" "D125" "D125_b" "D126" "D126_b"
[39] "D127" "D127_b" "D128" "D128_b" "D129" "D129_b" "D130" "D130_b" "D131" "D131_b" "D132" "D132_b" "D133" "D133_b" "D134" "D134_b" "D135" "D135_b" "D137"
[58] "D137_b" "D138" "D138_b" "D139" "D139_b" "D140" "D140_b" "D141" "D141_b" "D142" "D142_b" "D144" "D144_b" "D145" "D145_b" "D146" "D146_b" "D147" "D147_b"
[77] "D148" "D148_b"unique(raw_r2$subject) [1] "D101" "D101_2Y" "D102" "D102_B" "D103" "D103_b" "D104" "D104_b" "D105" "D105_b" "D107" "D107_B_2" "D110" "D110_b" "D113" "D113_b"
[17] "D114" "D114_b" "D115" "D115_b" "D117_b" "D117_c" "D118" "D118_b" "D119" "D119_b" "D120" "D120_b" "D121" "D121_b" "D122" "D122_b"
[33] "D123" "D123_b" "D125" "D125_b" "D126" "D126_B" "D127" "D127_b" "D128" "D128_b" "D129" "D129_b" "D130" "D130_b" "D131" "D131_b"
[49] "D132" "D132_b" "D133" "D133_b" "D134" "D134_b" "D135" "D135_c" "D137" "D137_b" "D138" "D138_b" "D139" "D139_b" "D140" "D140_b"
[65] "D141" "D141_b" "D142" "D144" "D144_b" "D145" "D145_b" "D146" "D146_b" "D147" "D147_b" "D148" "D148_b" # some similar issues to fix
raw_r2$subject[raw_r2$subject == "D101_2Y"] <- "D101_b"
raw_r2$subject[raw_r2$subject == "D102_B"] <- "D102_b"
raw_r2$subject[raw_r2$subject == "D107_B_2"] <- "D107_b"
raw_r2$subject[raw_r2$subject == "D117_b"] <- "D117"
raw_r2$subject[raw_r2$subject == "D117_c"] <- "D117_b"
raw_r2$subject[raw_r2$subject == "D126_B"] <- "D126_b"
raw_r2$subject[raw_r2$subject == "D135_c"] <- "D135_b"
raw_r2$subject[raw_r2$date == 111516] <- "D142_b"
unique(raw_r2$subject) # 78 unique - that is correct [1] "D101" "D101_b" "D102" "D102_b" "D103" "D103_b" "D104" "D104_b" "D105" "D105_b" "D107" "D107_b" "D110" "D110_b" "D113" "D113_b" "D114" "D114_b" "D115"
[20] "D115_b" "D117" "D117_b" "D118" "D118_b" "D119" "D119_b" "D120" "D120_b" "D121" "D121_b" "D122" "D122_b" "D123" "D123_b" "D125" "D125_b" "D126" "D126_b"
[39] "D127" "D127_b" "D128" "D128_b" "D129" "D129_b" "D130" "D130_b" "D131" "D131_b" "D132" "D132_b" "D133" "D133_b" "D134" "D134_b" "D135" "D135_b" "D137"
[58] "D137_b" "D138" "D138_b" "D139" "D139_b" "D140" "D140_b" "D141" "D141_b" "D142" "D142_b" "D144" "D144_b" "D145" "D145_b" "D146" "D146_b" "D147" "D147_b"
[77] "D148" "D148_b"str(raw_r1)'data.frame': 25746 obs. of 10 variables:
$ date : int 101515 101515 101515 101515 101515 101515 101515 101515 101515 101515 ...
$ time : chr "15:38:09" "15:38:09" "15:38:09" "15:38:09" ...
$ subject : chr "D101" "D101" "D101" "D101" ...
$ blockcode : chr "AATpracticeB" "AATpracticeB" "AATpracticeB" "AATpracticeB" ...
$ blocknum : chr "2" "2" "2" "2" ...
$ trialcode : chr "practicetrial_B" "practiceincrease" "practiceincrease" "practiceincrease" ...
$ values.trialcode : chr "practicetrial_B" "practicetrial_B" "practicetrial_B" "practicetrial_B" ...
$ values.stimulus : chr "grayrectangle_Y.jpg" "grayrectangle_Y.jpg" "grayrectangle_Y.jpg" "grayrectangle_Y.jpg" ...
$ values.initialresponse: chr "PULL" "PULL" "PULL" "PULL" ...
$ values.RT : num 1411 1411 1411 1411 1411 ...str(raw_r2)'data.frame': 25457 obs. of 10 variables:
$ date : int 101515 101515 101515 101515 101515 101515 101515 101515 101515 101515 ...
$ time : chr "15:48:12" "15:48:12" "15:48:12" "15:48:12" ...
$ subject : chr "D101" "D101" "D101" "D101" ...
$ blockcode : chr "AATpracticeA" "AATpracticeA" "AATpracticeA" "AATpracticeA" ...
$ blocknum : chr "2" "2" "2" "2" ...
$ trialcode : chr "practicetrial_A" "practicedecrease" "practicedecrease" "practicedecrease" ...
$ values.trialcode : chr "practicetrial_A" "practicetrial_A" "practicetrial_A" "practicetrial_A" ...
$ values.stimulus : chr "grayrectangle_B.jpg" "grayrectangle_B.jpg" "grayrectangle_B.jpg" "grayrectangle_B.jpg" ...
$ values.initialresponse: chr "PUSH" "PUSH" "PUSH" "PUSH" ...
$ values.RT : num 1472 1472 1472 1472 1472 ...# take out ITIs
unique(raw_r1$trialcode) [1] "practicetrial_B" "practiceincrease" "endincrease_practice" "InterTrialInterval" "practicetrial_A" "practicedecrease" "enddecrease_practice"
[8] "AAT_1" "AAT_5" "AAT_6" "AAT_3" "AAT_7" "AAT_4" "AAT_8"
[15] "AAT_9" "AAT_2" "AAT_10" "AAT_11" "AAT_12" mlm_r1 <- filter(raw_r1, grepl("^A",trialcode))
unique(mlm_r1$trialcode) [1] "AAT_1" "AAT_5" "AAT_6" "AAT_3" "AAT_7" "AAT_4" "AAT_8" "AAT_9" "AAT_2" "AAT_10" "AAT_11" "AAT_12"unique(raw_r2$trialcode) [1] "practicetrial_A" "practicedecrease" "enddecrease_practice" "InterTrialInterval" "practicetrial_B" "practiceincrease" "endincrease_practice"
[8] "AAT_1" "AAT_5" "AAT_6" "AAT_3" "AAT_7" "AAT_4" "AAT_8"
[15] "AAT_9" "AAT_2" "AAT_10" "AAT_11" "AAT_12" mlm_r2 <- filter(raw_r2, grepl("^A",trialcode))
unique(mlm_r2$trialcode) [1] "AAT_1" "AAT_5" "AAT_6" "AAT_3" "AAT_7" "AAT_4" "AAT_8" "AAT_9" "AAT_2" "AAT_10" "AAT_11" "AAT_12"# add a "trialnum" variable, grouped by ID
mlm_r1 <- mlm_r1 %>% group_by(subject) %>% mutate(trialnum = row_number())
View(mlm_r2)
mlm_r2 <- mlm_r2 %>% group_by(subject) %>% mutate(trialnum = row_number())
View(mlm_r2)
mlm_r1 %>% group_by(trialnum) %>% count(trialnum) # everyone has 144 trials, hooray!mlm_r2 %>% group_by(trialnum) %>% count(trialnum) # everyone has 144 trials, one person has 177mlm_r2 %>% group_by(subject) %>% count() # that person is D122_b# no clue why that happened, although I do vaguely remember we had one session where the task seemed to go on and on and we force quit it?
# remove trials 145-177 for D122_b
mlm_r2 <- filter(mlm_r2, trialnum <=144)
mlm_r2 %>% group_by(trialnum) %>% count(trialnum)# now everyone has 144 trials
# add a column for "run"
mlm_r1$run <- "1"
mlm_r2$run <- "2"
# add a column for "visit"
mlm_r1$visit <- as.factor(ifelse(grepl("*_b", mlm_r1$subject), "2", "1"))
mlm_r2$visit <- as.factor(ifelse(grepl("*_b", mlm_r2$subject), "2", "1"))
mlm_r1 %>% group_by(subject) %>% count(visit) # all looks goodmlm_r2 %>% group_by(subject) %>% count(visit) # all looks good# now remove the "_b" from visit 2 IDs
mlm_r1 <- mlm_r1 %>% ungroup() %>%
mutate(subject = str_replace(subject, "_b", ""))
unique(mlm_r1$subject) [1] "D101" "D102" "D103" "D104" "D105" "D107" "D110" "D113" "D114" "D115" "D117" "D118" "D119" "D120" "D121" "D122" "D123" "D125" "D126" "D127" "D128" "D129" "D130" "D131" "D132"
[26] "D133" "D134" "D135" "D137" "D138" "D139" "D140" "D141" "D142" "D144" "D145" "D146" "D147" "D148"mlm_r2 <- mlm_r2 %>% ungroup() %>%
mutate(subject = str_replace(subject, "_b", ""))
unique(mlm_r2$subject) [1] "D101" "D102" "D103" "D104" "D105" "D107" "D110" "D113" "D114" "D115" "D117" "D118" "D119" "D120" "D121" "D122" "D123" "D125" "D126" "D127" "D128" "D129" "D130" "D131" "D132"
[26] "D133" "D134" "D135" "D137" "D138" "D139" "D140" "D141" "D142" "D144" "D145" "D146" "D147" "D148"# merge data from the 2 runs
mlm_bx <- bind_rows(mlm_r1, mlm_r2)
# split up by visit
mlm_v1 <- mlm_bx %>% filter(visit == "1")
mlm_v2 <- mlm_bx %>% filter(visit == "2")
mlm_v1 %>% group_by(trialnum) %>% count(trialnum) # everyone has 144 trials, hooray!mlm_v2 %>% group_by(trialnum) %>% count(trialnum) # everyone has 144 trials, hooray!# add columns for "cond" at visit 1 and visit 2 [condition: A or B]
# load in the randomization data
randomize <- readRDS("~/Dropbox/GLASS Lab/OT Study/data/cleaned-data/randomization_clean.rds")
head(randomize)mlm_v1 <- mlm_v1 %>%
rename("ID" = subject)
mlm_v2 <- mlm_v2 %>%
rename("ID" = subject)
# get the IDs for everyone who got treatment A at visit 1
IDs_v1_txA <- randomize %>% filter(tx_v1 == "A")
View(IDs_v1_txA)
# ifelse statement: if ID = any of those listed in txA_list, make cond_v1 = "A", else make it "B"
mlm_v1 <- mlm_v1 %>%
mutate(cond_v1 = as.factor(ifelse(ID == "D101" | ID == "D105" | ID == "D109" | ID == "D110" | ID == "D114" | ID == "D115" | ID == "D116" | ID == "D118" | ID == "D119" | ID == "D120" | ID == "D123" | ID == "D124" | ID == "D126" | ID == "D128" | ID == "D132" | ID == "D135" | ID == "D136" | ID == "D137" | ID == "D138" | ID == "D140" | ID == "D141" | ID == "D145" | ID == "D148" | ID == "D149" | ID == "D117", "A", "B")), cond_v2 = as.factor(ifelse(ID == "D101" | ID == "D105" | ID == "D109" | ID == "D110" | ID == "D114" | ID == "D115" | ID == "D116" | ID == "D118" | ID == "D119" | ID == "D120" | ID == "D123" | ID == "D124" | ID == "D126" | ID == "D128" | ID == "D132" | ID == "D135" | ID == "D136" | ID == "D137" | ID == "D138" | ID == "D140" | ID == "D141" | ID == "D145" | ID == "D148" | ID == "D149" | ID == "D117", "B", "A")))
head(mlm_v1)# ifelse statement: if ID = any of those listed in txA_list, make cond_v2 = "B", else make it "A" (people who were A at visit 1 should be B for visit 2, and vice versa)
mlm_v2 <- mlm_v2 %>%
mutate(cond_v2 = as.factor(ifelse(ID == "D101" | ID == "D105" | ID == "D109" | ID == "D110" | ID == "D114" | ID == "D115" | ID == "D116" | ID == "D118" | ID == "D119" | ID == "D120" | ID == "D123" | ID == "D124" | ID == "D126" | ID == "D128" | ID == "D132" | ID == "D135" | ID == "D136" | ID == "D137" | ID == "D138" | ID == "D140" | ID == "D141" | ID == "D145" | ID == "D148" | ID == "D149" | ID == "D117", "B", "A")), cond_v1 = as.factor(ifelse(ID == "D101" | ID == "D105" | ID == "D109" | ID == "D110" | ID == "D114" | ID == "D115" | ID == "D116" | ID == "D118" | ID == "D119" | ID == "D120" | ID == "D123" | ID == "D124" | ID == "D126" | ID == "D128" | ID == "D132" | ID == "D135" | ID == "D136" | ID == "D137" | ID == "D138" | ID == "D140" | ID == "D141" | ID == "D145" | ID == "D148" | ID == "D149" | ID == "D117", "A", "B")))
levels(mlm_v1$cond_v1)[1] "A" "B"levels(mlm_v2$cond_v2)[1] "A" "B"head(mlm_v1)
IDs_v1_txA$ID [1] "D101" "D105" "D109" "D110" "D114" "D115" "D116" "D118" "D119" "D120" "D123" "D124" "D126" "D128" "D132" "D135" "D136" "D137" "D138" "D140" "D141" "D145" "D148" "D149" "D117"mlm_v1 %>% group_by(cond_v1) %>% count(ID) # IDs and cond match txA_listmlm_v2 %>% group_by(cond_v2) %>% count(ID) # IDs and cond match txA_listmlm_bx <- bind_rows(mlm_v1,mlm_v2)
View(mlm_bx)
# save it
saveRDS(mlm_bx, "~/Dropbox/2018Fall/FSHD617C/mlm_bx.rds")# rename some variables
colnames(mlm_bx) [1] "date" "time" "ID" "blockcode" "blocknum" "trialcode" "values.trialcode"
[8] "values.stimulus" "values.initialresponse" "values.RT" "trialnum" "run" "visit" "cond_v1"
[15] "cond_v2" mlm_bx <- mlm_bx %>% rename("push_pull" = values.initialresponse,
"gAAT_RT" = values.RT)
head(mlm_bx)# add a new variable for condition
mlm_bx1 <- mlm_bx %>% mutate(cond = as.factor(ifelse(cond_v1 == "A" & visit == "1", "A",
ifelse(cond_v2 == "A" & visit == "2", "A",
ifelse(cond_v1 == "B" & visit == "1", "B",
ifelse(cond_v2 == "B" & visit == "2", "B", NA))))))
View(mlm_bx1) # check that it coded the "cond" column correctly
# add a new variable for stimulus category
# in values.stimulus:
# 1 = spouse, 2 = living loved one/WHOTO, 3 = stranger, 4 = nomothetic death-related, 5 = neutral images
sort(unique(mlm_bx1$values.stimulus)) [1] "1B_1.jpg" "1B_2.jpg" "1B_3.jpg" "1Y_1.jpg" "1Y_2.jpg" "1Y_3.jpg" "2B_1.jpg" "2B_2.jpg" "2B_3.jpg" "2Y_1.jpg" "2Y_2.jpg" "2Y_3.jpg" "3B_1.jpg" "3B_2.jpg" "3B_3.jpg" "3Y_1.jpg"
[17] "3Y_2.jpg" "3Y_3.jpg" "4B_1.jpg" "4B_2.jpg" "4B_3.jpg" "4Y_1.jpg" "4Y_2.jpg" "4Y_3.jpg" "5B_1.jpg" "5B_2.jpg" "5B_3.jpg" "5Y_1.jpg" "5Y_2.jpg" "5Y_3.jpg"mlm_bx2 <- mlm_bx1 %>%
mutate(stim = as.factor(ifelse(values.stimulus == "1B_1.jpg"|values.stimulus == "1B_2.jpg"|values.stimulus == "1B_3.jpg"|values.stimulus == "1Y_1.jpg"|values.stimulus == "1Y_2.jpg"|values.stimulus == "1Y_3.jpg", "spouse",
ifelse(values.stimulus == "2B_1.jpg"|values.stimulus == "2B_2.jpg"|values.stimulus == "2B_3.jpg"|values.stimulus == "2Y_1.jpg"|values.stimulus == "2Y_2.jpg"|values.stimulus == "2Y_3.jpg", "living",
ifelse(values.stimulus == "3B_1.jpg"|values.stimulus == "3B_2.jpg"|values.stimulus == "3B_3.jpg"|values.stimulus == "3Y_1.jpg"|values.stimulus == "3Y_2.jpg"|values.stimulus == "3Y_3.jpg", "stranger",
ifelse(values.stimulus == "4B_1.jpg"|values.stimulus == "4B_2.jpg"|values.stimulus == "4B_3.jpg"|values.stimulus == "4Y_1.jpg"|values.stimulus == "4Y_2.jpg"|values.stimulus == "4Y_3.jpg", "death",
ifelse(values.stimulus == "5B_1.jpg"|values.stimulus == "5B_2.jpg"|values.stimulus == "5B_3.jpg"|values.stimulus == "5Y_1.jpg"|values.stimulus == "5Y_2.jpg"|values.stimulus == "5Y_3.jpg", "neutral", NA)))))))
levels(mlm_bx2$stim)[1] "death" "living" "neutral" "spouse" "stranger"mlm_bx2$stim <- relevel(mlm_bx2$stim, ref = "neutral") # make neutral the reference level
# save it
saveRDS(mlm_bx2, "~/Dropbox/2018Fall/FSHD617C/mlm_bx2.rds")Bias scores
Separate out push minus pull, then subtract run1 from run2.
mlm_r1.1 <- mlm_bx2 %>% filter(run == "1")
tail(mlm_r1.1) # does it line up?mlm_r2.1 <- mlm_bx2 %>% filter(run == "2")
tail(mlm_r2.1) p99r1 <- quantile(mlm_r1.1$gAAT_RT, 0.99)
p01r1 <- quantile(mlm_r1.1$gAAT_RT, 0.01)
p99r1 # 99th percentile RTs >= 1713.48ms 99%
1713.38 p01r1 # 1st percentile RTs <= 472ms 1%
472 p99r2 <- quantile(mlm_r2.1$gAAT_RT, 0.99)
p01r2 <- quantile(mlm_r2.1$gAAT_RT, 0.01) # 1st percentile RTs <= 463ms
p99r2 # 99th percentile RTs >= 1712.45ms 99%
1712.45 p01r2 # 1st percentile RTs <= 463ms 1%
463 mlm_r1.2 <- mlm_r1.1 %>%
mutate(outlier_RT = ifelse(gAAT_RT <= p01r1 | gAAT_RT >= p99r1, 1, 0))
table(mlm_r1.2$outlier_RT)
0 1
11005 227 227/11005 # 227 trials will be dropped, 11005 will be retained...about 2% of trials.[1] 0.02062699mlm_r2.2 <- mlm_r2.1 %>%
mutate(outlier_RT = ifelse(gAAT_RT <= p01r2 | gAAT_RT >= p99r2, 1, 0))
table(mlm_r2.2$outlier_RT)
0 1
11002 230 230/11002 # 230 trials will be dropped, 11002 will be retained...about 2% of trials.[1] 0.02090529mlm_r1r2 <- bind_cols(mlm_r1.2, mlm_r2.2) # 11232 trials total.
head(mlm_r1r2) # make sure that trials in the two runs line up post-mergetail(mlm_r1r2) # make sure that trials in the two runs line up post-merge# get rid of any trials with outliers in either run1 or run2
# (need run1/run2 to be the same length so that the trials match up)
mlm_r1r2.1 <- mlm_r1r2 %>% filter(outlier_RT == "0" & outlier_RT1 == "0")
count(mlm_r1r2.1) # 10790 obs.10790/11232 # 96% of trials retained = 4% of trials dropped. That feels acceptable.[1] 0.9606481push_pull <- mlm_r1r2.1 %>% filter(push_pull == "PUSH" & push_pull1 == "PULL") %>% mutate(bias = (gAAT_RT-gAAT_RT1))
pull_push <- mlm_r1r2.1 %>% filter(push_pull == "PULL" & push_pull1 == "PUSH") %>% mutate(bias = (gAAT_RT1-gAAT_RT))
mlm_pp <- bind_rows(push_pull,pull_push)
View(mlm_pp)Transformations
library(psych)
describe(mlm_pp$bias) # skewness is 0.1, kurtosis is 1.69 vars n mean sd median trimmed mad min max range skew kurtosis se
X1 1 9880 11.83 246.66 8 9.97 192.74 -1157 1119 2276 0.1 1.69 2.48hist(mlm_pp$bias)
qqnorm(mlm_pp$bias)
ggplot(mlm_pp, aes(sample=bias))+stat_qq()+stat_qq_line() # not a good look at all...
# install.packages("bestNormalize")
# what's the best transformation for my data?
library(bestNormalize)
orderNorm_bias <- bestNormalize(mlm_pp$bias) # suggested orderNorm transform as bestboxcox did not work; Error in estimate_boxcox_lambda(x, ...) : x must be positive
exp_x did not work; Error in exp_x(standardize = TRUE, warn = TRUE, x = c(26, -187, 45, 782, :
Transformation finite for less than 3 x values
Ties in data, Normal distribution not guaranteed
|=== | 2% ~3 s remaining
|====== | 4% ~3 s remaining
|========= | 6% ~3 s remaining
|============ | 8% ~3 s remaining
|=============== | 10% ~3 s remaining
|================== | 12% ~3 s remaining
|===================== | 14% ~3 s remaining
|========================= | 16% ~3 s remaining
|============================ | 18% ~3 s remaining
|=============================== | 20% ~3 s remaining
|================================== | 22% ~3 s remaining
|===================================== | 24% ~3 s remaining
|======================================== | 26% ~3 s remaining
|=========================================== | 28% ~3 s remaining
|=============================================== | 30% ~3 s remaining
|================================================== | 32% ~3 s remaining
|===================================================== | 34% ~2 s remaining
|======================================================== | 36% ~2 s remaining
|=========================================================== | 38% ~2 s remaining
|============================================================== | 40% ~2 s remaining
|================================================================= | 42% ~2 s remaining
|===================================================================== | 44% ~2 s remaining
|======================================================================== | 46% ~2 s remaining
|=========================================================================== | 48% ~2 s remaining
|============================================================================== | 50% ~2 s remaining
|================================================================================= | 52% ~2 s remaining
|==================================================================================== | 54% ~2 s remaining
|======================================================================================= | 56% ~2 s remaining
|=========================================================================================== | 58% ~2 s remaining
|============================================================================================== | 60% ~2 s remaining
|================================================================================================= | 62% ~1 s remaining
|==================================================================================================== | 64% ~1 s remaining
|======================================================================================================= | 66% ~1 s remaining
|========================================================================================================== | 68% ~1 s remaining
|============================================================================================================= | 70% ~1 s remaining
|================================================================================================================= | 72% ~1 s remaining
|==================================================================================================================== | 74% ~1 s remaining
|======================================================================================================================= | 76% ~1 s remaining
|========================================================================================================================== | 78% ~1 s remaining
|============================================================================================================================= | 80% ~1 s remaining
|================================================================================================================================ | 82% ~1 s remaining
|=================================================================================================================================== | 84% ~1 s remaining
|======================================================================================================================================= | 86% ~1 s remaining
|========================================================================================================================================== | 88% ~0 s remaining
|============================================================================================================================================= | 90% ~0 s remaining
|================================================================================================================================================ | 92% ~0 s remaining
|=================================================================================================================================================== | 94% ~0 s remaining
|====================================================================================================================================================== | 96% ~0 s remaining
|========================================================================================================================================================= | 98% ~0 s remaining
|=============================================================================================================================================================|100% ~0 s remaining mlm_pp$bias_t <- orderNorm_bias$x.t # pull x.t from orderNorm_bias and assign it back into dataset
describe(mlm_pp$bias_t) vars n mean sd median trimmed mad min max range skew kurtosis se
X1 1 9880 0 1 0 0 1 -3.61 3.89 7.5 0 -0.02 0.01hist(mlm_pp$bias_t)
qqnorm(mlm_pp$bias_t)
ggplot(mlm_pp, aes(sample=bias_t))+stat_qq()+stat_qq_line() # so much better!
# back-transformation, just to show how to do it:
p <- predict(orderNorm_bias)
x2 <- predict(orderNorm_bias, newdata = p, inverse = TRUE) # x2 is the back-transformed data
all.equal(x2, mlm_pp$bias_t) [1] "Mean relative difference: 0.9955923"mlm_bx3 <- mlm_pp
saveRDS(mlm_bx3, "~/Dropbox/2018Fall/FSHD617C/mlm_bx3.rds")Checking the data
table <- mlm_bx3 %>% group_by(ID) %>% group_by(cond) %>% count(ID)
table# missing data...
# cond A: D101 (3 trials), D141 (18 trials), D148 (19 trials)
# cond B: D147 (1 trial)
describe(table$n) vars n mean sd median trimmed mad min max range skew kurtosis se
X1 1 78 126.67 28.35 134 133.11 5.93 1 144 143 -3.58 12.05 3.21ggplot(table, aes(sample=n))+stat_qq()+stat_qq_line() # can see those 4 on the QQ plot
# where are the trials getting dropped?
mlm_r1r2 %>% group_by(ID) %>% group_by(cond) %>% count(ID) # everyone has 144 heremlm_r1r2.1 %>% group_by(ID) %>% group_by(cond) %>% count(ID) # after getting rid of outliers, most people missing a few trials (D107 cond A/B and D113 cond A missing >20)
mlm_r1r2.1 %>% filter(ID=="D101" & cond=="A")mlm_r1r2.1 %>% filter(ID=="D141" & cond=="A")mlm_r1r2.1 %>% filter(ID=="D148" & cond=="A")mlm_r1r2.1 %>% filter(ID=="D147" & cond=="B")# so trials are getting dropped because they didn't effectively reverse the instructions or they reverted to the old instructions
# in essence, this removes error trials
# create a "drop" variable for these 4, just in case...
mlm_bx3 <- mlm_bx3 %>% mutate(low_n_trials = ifelse(ID == "D101" | ID == "D141" | ID == "D147" | ID == "D148", 1, 0))
# check whether the rows line up
notlinedup <- mlm_bx3 %>% filter(stim != stim1)
notlinedupnotlinedup <- mlm_bx3 %>% filter(trialcode != trialcode1)
notlinedupnotlinedup <- mlm_bx3 %>% filter(trialnum != trialnum1)
notlinedup# 0 rows returned; all the rows match
head(mlm_bx3)saveRDS(mlm_bx3, "~/Dropbox/2018Fall/FSHD617C/mlm_bx3.rds")Add time-invariant variables
Next step is to add demographics and other variables that we might potentially want to include in the model but that do not change over time. Looking at the codebook for the master dataset, these include:
Demographics:
ageage_yrssex_methnicity_hispracetimesincedeath
Genetic variables:
rs2254298rs2268498rs53576rs2254298_A.carrierrs2268498_C.carrierrs53576_A.carrier
Self-report measures:
tot_icg[grief]tot_bdi[depression]tot_bgq[brief grief questionnaire with impairment item]tot_ecrrs_global_anx[anxious attachment - global]tot_ecrrs_global_avoid[avoidant attachment - global]tot_ecrrs_spouse_anx[anxious attachment - spouse]tot_ecrrs_spouse_avoid[avoidant attachment - spouse]tot_ysl[yearning for the deceased]
# load in master dataset
master <- readRDS("~/Dropbox/GLASS Lab/OT Study/data/cleaned-data/selfreports_oxtr_cortisol_random_AB_bx_clean.rds")
# subset the selected variables
mlm_add <- subset(master, select=c(ID,age, age_yrs, sex_m, ethnicity_hisp, race, timesincedeath, rs2254298, rs2268498, rs53576, rs2254298_A.carrier, rs2268498_C.carrier, rs53576_A.carrier, tot_bdi, tot_bgq, tot_ecrrs_global_anx,tot_ecrrs_global_avoid, tot_ecrrs_spouse_anx, tot_ecrrs_spouse_avoid, tot_ysl, tot_icg))
head(mlm_add)# merge into the behavioral dataset
mlm_bx4 <- left_join(mlm_bx3, mlm_add, by="ID")
head(mlm_bx4)# save it
saveRDS(mlm_bx4, "~/Dropbox/2018Fall/FSHD617C/mlm_bx4.rds")Exploratory analysis and checking assumptions
First step is to overview the entire dataset using summarytools.
library(summarytools)
# overview the entire dataset
# this will look like TOTAL crap in the console (notebook output)
# use view(dfSummary(mlm_bx4)) from the console to see a much more readable and attractive output
dfSummary(mlm_bx4)Data Frame Summary
mlm_bx4
N: 9880
-------------------------------------------------------------------------------------------------------------------------------------------------------
No Variable Stats / Values Freqs (% of Valid) Text Graph Valid Missing
---- ------------------------- ---------------------------------- ----------------------- ---------------------------------------- ---------- ---------
1 date mean (sd) : 63183.18 (35369.28) 73 distinct val. : 9880 0
[integer] min < med < max : : . : (100%) (0%)
11416 < 52316 < 121515 : : . : :
IQR (CV) : 69500 (0.56) : : : : : . : :
: : : : . : : : :
2 time 1. 12:36:02 144 ( 1.5%) 9880 0
[character] 2. 14:24:39 144 ( 1.5%) (100%) (0%)
3. 15:06:35 144 ( 1.5%)
4. 13:46:36 142 ( 1.4%)
5. 16:32:30 142 ( 1.4%)
6. 14:12:22 141 ( 1.4%)
7. 16:29:40 141 ( 1.4%)
8. 11:18:48 140 ( 1.4%)
9. 13:07:05 140 ( 1.4%)
10. 13:15:27 140 ( 1.4%)
[ 68 others ] 8462 (85.8%) IIIIIIIIIIIIIIII
3 ID 1. D110 284 ( 2.9%) 9880 0
[character] 2. D120 283 ( 2.9%) (100%) (0%)
3. D123 282 ( 2.9%)
4. D132 281 ( 2.8%)
5. D127 279 ( 2.8%)
6. D146 277 ( 2.8%)
7. D102 275 ( 2.8%)
8. D130 275 ( 2.8%)
9. D138 274 ( 2.8%)
10. D131 273 ( 2.8%)
[ 29 others ] 7097 (71.8%) IIIIIIIIIIIIIIII
4 blockcode 1. AAT4 894 ( 9.0%) IIIIIIIIIII 9880 0
[character] 2. AAT6 894 ( 9.0%) IIIIIIIIIII (100%) (0%)
3. AAT1 892 ( 9.0%) IIIIIIIIIII
4. AAT5 889 ( 9.0%) IIIIIIIIIII
5. AAT7 886 ( 9.0%) IIIIIIIIIII
6. AAT3 873 ( 8.8%) IIIIIIIIIII
7. AAT10 843 ( 8.5%) IIIIIIIIII
8. AAT9 839 ( 8.5%) IIIIIIIIII
9. AAT8 834 ( 8.4%) IIIIIIIIII
10. AAT2 804 ( 8.1%) IIIIIIIIII
[ 2 others ] 1232 (12.5%) IIIIIIIIIIIIIIII
5 blocknum 1. 154 74 ( 0.8%) 9880 0
[character] 2. 71 74 ( 0.8%) (100%) (0%)
3. 15 73 ( 0.7%)
4. 22 73 ( 0.7%)
5. 102 72 ( 0.7%)
6. 107 72 ( 0.7%)
7. 117 72 ( 0.7%)
8. 124 72 ( 0.7%)
9. 125 72 ( 0.7%)
10. 130 72 ( 0.7%)
[ 134 others ] 9154 (92.9%) IIIIIIIIIIIIIIII
6 trialcode 1. AAT_4 894 ( 9.0%) IIIIIIIIIII 9880 0
[character] 2. AAT_6 894 ( 9.0%) IIIIIIIIIII (100%) (0%)
3. AAT_1 892 ( 9.0%) IIIIIIIIIII
4. AAT_5 889 ( 9.0%) IIIIIIIIIII
5. AAT_7 886 ( 9.0%) IIIIIIIIIII
6. AAT_3 873 ( 8.8%) IIIIIIIIIII
7. AAT_10 843 ( 8.5%) IIIIIIIIII
8. AAT_9 839 ( 8.5%) IIIIIIIIII
9. AAT_8 834 ( 8.4%) IIIIIIIIII
10. AAT_2 804 ( 8.1%) IIIIIIIIII
[ 2 others ] 1232 (12.5%) IIIIIIIIIIIIIIII
7 values.trialcode 1. AAT_4 894 ( 9.0%) IIIIIIIIIII 9880 0
[character] 2. AAT_6 894 ( 9.0%) IIIIIIIIIII (100%) (0%)
3. AAT_1 892 ( 9.0%) IIIIIIIIIII
4. AAT_5 889 ( 9.0%) IIIIIIIIIII
5. AAT_7 886 ( 9.0%) IIIIIIIIIII
6. AAT_3 873 ( 8.8%) IIIIIIIIIII
7. AAT_10 843 ( 8.5%) IIIIIIIIII
8. AAT_9 839 ( 8.5%) IIIIIIIIII
9. AAT_8 834 ( 8.4%) IIIIIIIIII
10. AAT_2 804 ( 8.1%) IIIIIIIIII
[ 2 others ] 1232 (12.5%) IIIIIIIIIIIIIIII
8 values.stimulus 1. 3Y_3.jpg 418 ( 4.2%) I 9880 0
[character] 2. 3Y_2.jpg 413 ( 4.2%) I (100%) (0%)
3. 3Y_1.jpg 411 ( 4.2%) I
4. 2B_3.jpg 386 ( 3.9%) I
5. 2B_2.jpg 382 ( 3.9%)
6. 2B_1.jpg 371 ( 3.8%)
7. 1B_3.jpg 362 ( 3.7%)
8. 1B_2.jpg 336 ( 3.4%)
9. 3B_1.jpg 336 ( 3.4%)
10. 1B_1.jpg 334 ( 3.4%)
[ 20 others ] 6131 (62.1%) IIIIIIIIIIIIIIII
9 push_pull 1. PULL 4953 (50.1%) IIIIIIIIIIIIIIII 9880 0
[character] 2. PUSH 4927 (49.9%) IIIIIIIIIIIIIII (100%) (0%)
10 gAAT_RT mean (sd) : 794.92 (203.04) 959 distinct val. : . 9880 0
[numeric] min < med < max : : : (100%) (0%)
473 < 756 < 1712 . : : :
IQR (CV) : 251 (0.26) : : : : .
: : : : : : .
11 trialnum mean (sd) : 72.87 (41.54) 144 distinct val. : . . : . . : . . : 9880 0
[integer] min < med < max : : : : : : : : : : : (100%) (0%)
1 < 73 < 144 : : : : : : : : : :
IQR (CV) : 72 (0.57) : : : : : : : : : :
: : : : : : : : : :
12 run 1. 1 9880 (100.0%) IIIIIIIIIIIIIIII 9880 0
[character] (100%) (0%)
13 visit 1. 1 4683 (47.4%) IIIIIIIIIIIIII 9880 0
[factor] 2. 2 5197 (52.6%) IIIIIIIIIIIIIIII (100%) (0%)
14 cond_v1 1. A 5014 (50.7%) IIIIIIIIIIIIIIII 9880 0
[factor] 2. B 4866 (49.2%) IIIIIIIIIIIIIII (100%) (0%)
15 cond_v2 1. A 4866 (49.2%) IIIIIIIIIIIIIII 9880 0
[factor] 2. B 5014 (50.7%) IIIIIIIIIIIIIIII (100%) (0%)
16 cond 1. A 4787 (48.4%) IIIIIIIIIIIIIII 9880 0
[factor] 2. B 5093 (51.5%) IIIIIIIIIIIIIIII (100%) (0%)
17 stim 1. neutral 1882 (19.1%) IIIIIIIIIIIII 9880 0
[factor] 2. death 1790 (18.1%) IIIIIIIIIIIII (100%) (0%)
3. living 2101 (21.3%) IIIIIIIIIIIIIII
4. spouse 1906 (19.3%) IIIIIIIIIIIII
5. stranger 2201 (22.3%) IIIIIIIIIIIIIIII
18 outlier_RT mean (sd) : 0 (0) 0.00 : 9880 (100.0%) IIIIIIIIIIIIIIII 9880 0
[numeric] min < med < max : (100%) (0%)
0 < 0 < 0
IQR (CV) : 0 (NaN)
19 date1 mean (sd) : 63183.18 (35369.28) 73 distinct val. : 9880 0
[integer] min < med < max : : . : (100%) (0%)
11416 < 52316 < 121515 : : . : :
IQR (CV) : 69500 (0.56) : : : : : . : :
: : : : . : : : :
20 time1 1. 12:45:25 144 ( 1.5%) 9880 0
[character] 2. 14:34:34 144 ( 1.5%) (100%) (0%)
3. 15:15:51 144 ( 1.5%)
4. 13:55:57 142 ( 1.4%)
5. 16:42:40 142 ( 1.4%)
6. 14:22:28 141 ( 1.4%)
7. 16:40:38 141 ( 1.4%)
8. 11:28:07 140 ( 1.4%)
9. 13:15:44 140 ( 1.4%)
10. 13:26:09 140 ( 1.4%)
[ 68 others ] 8462 (85.8%) IIIIIIIIIIIIIIII
21 ID1 1. D110 284 ( 2.9%) 9880 0
[character] 2. D120 283 ( 2.9%) (100%) (0%)
3. D123 282 ( 2.9%)
4. D132 281 ( 2.8%)
5. D127 279 ( 2.8%)
6. D146 277 ( 2.8%)
7. D102 275 ( 2.8%)
8. D130 275 ( 2.8%)
9. D138 274 ( 2.8%)
10. D131 273 ( 2.8%)
[ 29 others ] 7097 (71.8%) IIIIIIIIIIIIIIII
22 blockcode1 1. AAT4 894 ( 9.0%) IIIIIIIIIII 9880 0
[character] 2. AAT6 894 ( 9.0%) IIIIIIIIIII (100%) (0%)
3. AAT1 892 ( 9.0%) IIIIIIIIIII
4. AAT5 889 ( 9.0%) IIIIIIIIIII
5. AAT7 886 ( 9.0%) IIIIIIIIIII
6. AAT3 873 ( 8.8%) IIIIIIIIIII
7. AAT10 843 ( 8.5%) IIIIIIIIII
8. AAT9 839 ( 8.5%) IIIIIIIIII
9. AAT8 834 ( 8.4%) IIIIIIIIII
10. AAT2 804 ( 8.1%) IIIIIIIIII
[ 2 others ] 1232 (12.5%) IIIIIIIIIIIIIIII
23 blocknum1 1. 154 74 ( 0.8%) 9880 0
[character] 2. 71 74 ( 0.8%) (100%) (0%)
3. 15 73 ( 0.7%)
4. 22 73 ( 0.7%)
5. 102 72 ( 0.7%)
6. 107 72 ( 0.7%)
7. 117 72 ( 0.7%)
8. 124 72 ( 0.7%)
9. 125 72 ( 0.7%)
10. 130 72 ( 0.7%)
[ 134 others ] 9154 (92.9%) IIIIIIIIIIIIIIII
24 trialcode1 1. AAT_4 894 ( 9.0%) IIIIIIIIIII 9880 0
[character] 2. AAT_6 894 ( 9.0%) IIIIIIIIIII (100%) (0%)
3. AAT_1 892 ( 9.0%) IIIIIIIIIII
4. AAT_5 889 ( 9.0%) IIIIIIIIIII
5. AAT_7 886 ( 9.0%) IIIIIIIIIII
6. AAT_3 873 ( 8.8%) IIIIIIIIIII
7. AAT_10 843 ( 8.5%) IIIIIIIIII
8. AAT_9 839 ( 8.5%) IIIIIIIIII
9. AAT_8 834 ( 8.4%) IIIIIIIIII
10. AAT_2 804 ( 8.1%) IIIIIIIIII
[ 2 others ] 1232 (12.5%) IIIIIIIIIIIIIIII
25 values.trialcode1 1. AAT_4 894 ( 9.0%) IIIIIIIIIII 9880 0
[character] 2. AAT_6 894 ( 9.0%) IIIIIIIIIII (100%) (0%)
3. AAT_1 892 ( 9.0%) IIIIIIIIIII
4. AAT_5 889 ( 9.0%) IIIIIIIIIII
5. AAT_7 886 ( 9.0%) IIIIIIIIIII
6. AAT_3 873 ( 8.8%) IIIIIIIIIII
7. AAT_10 843 ( 8.5%) IIIIIIIIII
8. AAT_9 839 ( 8.5%) IIIIIIIIII
9. AAT_8 834 ( 8.4%) IIIIIIIIII
10. AAT_2 804 ( 8.1%) IIIIIIIIII
[ 2 others ] 1232 (12.5%) IIIIIIIIIIIIIIII
26 values.stimulus1 1. 3Y_1.jpg 427 ( 4.3%) I 9880 0
[character] 2. 3Y_3.jpg 417 ( 4.2%) I (100%) (0%)
3. 3Y_2.jpg 398 ( 4.0%) I
4. 2B_3.jpg 391 ( 4.0%) I
5. 2B_1.jpg 384 ( 3.9%) I
6. 2B_2.jpg 364 ( 3.7%)
7. 1B_1.jpg 349 ( 3.5%)
8. 1B_2.jpg 344 ( 3.5%)
9. 1B_3.jpg 339 ( 3.4%)
10. 5B_3.jpg 332 ( 3.4%)
[ 20 others ] 6135 (62.1%) IIIIIIIIIIIIIIII
27 push_pull1 1. PULL 4927 (49.9%) IIIIIIIIIIIIIII 9880 0
[character] 2. PUSH 4953 (50.1%) IIIIIIIIIIIIIIII (100%) (0%)
28 gAAT_RT1 mean (sd) : 769.98 (197.98) 957 distinct val. : 9880 0
[numeric] min < med < max : : : (100%) (0%)
464 < 727 < 1709 . : :
IQR (CV) : 236 (0.26) : : : : .
: : : : : . .
29 trialnum1 mean (sd) : 72.87 (41.54) 144 distinct val. : . . : . . : . . : 9880 0
[integer] min < med < max : : : : : : : : : : : (100%) (0%)
1 < 73 < 144 : : : : : : : : : :
IQR (CV) : 72 (0.57) : : : : : : : : : :
: : : : : : : : : :
30 run1 1. 2 9880 (100.0%) IIIIIIIIIIIIIIII 9880 0
[character] (100%) (0%)
31 visit1 1. 1 4683 (47.4%) IIIIIIIIIIIIII 9880 0
[factor] 2. 2 5197 (52.6%) IIIIIIIIIIIIIIII (100%) (0%)
32 cond_v11 1. A 5014 (50.7%) IIIIIIIIIIIIIIII 9880 0
[factor] 2. B 4866 (49.2%) IIIIIIIIIIIIIII (100%) (0%)
33 cond_v21 1. A 4866 (49.2%) IIIIIIIIIIIIIII 9880 0
[factor] 2. B 5014 (50.7%) IIIIIIIIIIIIIIII (100%) (0%)
34 cond1 1. A 4787 (48.4%) IIIIIIIIIIIIIII 9880 0
[factor] 2. B 5093 (51.5%) IIIIIIIIIIIIIIII (100%) (0%)
35 stim1 1. neutral 1882 (19.1%) IIIIIIIIIIIII 9880 0
[factor] 2. death 1790 (18.1%) IIIIIIIIIIIII (100%) (0%)
3. living 2101 (21.3%) IIIIIIIIIIIIIII
4. spouse 1906 (19.3%) IIIIIIIIIIIII
5. stranger 2201 (22.3%) IIIIIIIIIIIIIIII
36 outlier_RT1 mean (sd) : 0 (0) 0.00 : 9880 (100.0%) IIIIIIIIIIIIIIII 9880 0
[numeric] min < med < max : (100%) (0%)
0 < 0 < 0
IQR (CV) : 0 (NaN)
37 bias mean (sd) : 11.83 (246.66) 1342 distinct val. : 9880 0
[numeric] min < med < max : : : (100%) (0%)
-1157 < 8 < 1119 : :
IQR (CV) : 260 (20.85) : : .
. : : : : .
38 bias_t mean (sd) : 0 (1) 1342 distinct val. : . 9880 0
[numeric] min < med < max : : : (100%) (0%)
-3.61 < 0 < 3.89 : : : .
IQR (CV) : 1.35 (2539.72) : : : :
. : : : : : .
39 low_n_trials mean (sd) : 0.06 (0.24) 0.00 : 9289 (94.0%) IIIIIIIIIIIIIIII 9880 0
[numeric] min < med < max : 1.00 : 591 ( 6.0%) I (100%) (0%)
0 < 0 < 1
IQR (CV) : 0 (3.96)
40 age mean (sd) : 25229.12 (2370.06) 39 distinct val. : 9880 0
[numeric] min < med < max : : (100%) (0%)
20845 < 25597 < 29101 : . . : .
IQR (CV) : 3573 (0.09) : : : : : : :
: : . : : : : : : :
41 age_yrs mean (sd) : 69.12 (6.49) 39 distinct val. : 9880 0
[numeric] min < med < max : : (100%) (0%)
57.11 < 70.13 < 79.73 : . . : .
IQR (CV) : 9.79 (0.09) : : : : : : :
: : . : : : : : : :
42 sex_m 1. female 7250 (73.4%) IIIIIIIIIIIIIIII 9880 0
[ordered, factor] 2. male 2630 (26.6%) IIIII (100%) (0%)
43 ethnicity_hisp 1. not Hispanic or Latino 9449 (95.6%) IIIIIIIIIIIIIIII 9880 0
[ordered, factor] 2. Hispanic or Latino 431 ( 4.4%) (100%) (0%)
44 race 1. White 9724 (98.4%) IIIIIIIIIIIIIIII 9880 0
[factor] 2. Other (specify) 156 ( 1.6%) (100%) (0%)
45 timesincedeath mean (sd) : 460.85 (245.61) 36 distinct val. : 9880 0
[numeric] min < med < max : : (100%) (0%)
151 < 411 < 1095 : :
IQR (CV) : 320 (0.53) . : :
: : . : : . . : .
46 rs2254298 1. GG 7005 (72.8%) IIIIIIIIIIIIIIII 9627 253
[factor] 2. A/G 2622 (27.2%) IIIII (97.44%) (2.56%)
47 rs2268498 1. C/T 4325 (43.8%) IIIIIIIIIIIIIIII 9880 0
[character] 2. CC 2636 (26.7%) IIIIIIIII (100%) (0%)
3. TT 2919 (29.5%) IIIIIIIIII
48 rs53576 1. A/G 5207 (52.7%) IIIIIIIIIIIIIIII 9880 0
[character] 2. GG 4673 (47.3%) IIIIIIIIIIIIII (100%) (0%)
49 rs2254298_A.carrier 1. 0 7005 (72.8%) IIIIIIIIIIIIIIII 9627 253
[ordered, factor] 2. 1 2622 (27.2%) IIIII (97.44%) (2.56%)
50 rs2268498_C.carrier 1. 0 2919 (29.5%) IIIIII 9880 0
[ordered, factor] 2. 1 6961 (70.5%) IIIIIIIIIIIIIIII (100%) (0%)
51 rs53576_A.carrier 1. 0 4673 (47.3%) IIIIIIIIIIIIII 9880 0
[ordered, factor] 2. 1 5207 (52.7%) IIIIIIIIIIIIIIII (100%) (0%)
52 tot_bdi mean (sd) : 10.47 (7.69) 22 distinct val. : 9880 0
[numeric] min < med < max : : (100%) (0%)
0 < 10 < 28 : : . .
IQR (CV) : 12 (0.73) : : : : : . :
: : : : : : : . : :
53 tot_bgq mean (sd) : 9.56 (2.26) 6.00 : 958 ( 9.7%) IIIII 9880 0
[numeric] min < med < max : 7.00 : 809 ( 8.2%) IIII (100%) (0%)
6 < 9 < 15 8.00 : 1079 (10.9%) IIIIII
IQR (CV) : 2 (0.24) 9.00 : 2640 (26.7%) IIIIIIIIIIIIIIII
10.00 : 1997 (20.2%) IIIIIIIIIIII
11.00 : 495 ( 5.0%) III
12.00 : 591 ( 6.0%) III
13.00 : 508 ( 5.1%) III
14.00 : 528 ( 5.3%) III
15.00 : 275 ( 2.8%) I
54 tot_ecrrs_global_anx mean (sd) : 3.24 (1.45) 16 distinct val. : . 9880 0
[numeric] min < med < max : : : (100%) (0%)
1 < 3.33 < 6.33 . : : :
IQR (CV) : 2.33 (0.45) : : : . : : :
: : : : : : : . : :
55 tot_ecrrs_global_avoid mean (sd) : 3.42 (1.07) 22 distinct val. : 9880 0
[numeric] min < med < max : : : (100%) (0%)
1 < 3.5 < 6.33 . : :
IQR (CV) : 1.17 (0.31) . : : :
: : : : : : : : . .
56 tot_ecrrs_spouse_anx mean (sd) : 2.22 (1.53) 12 distinct val. : 9880 0
[numeric] min < med < max : : (100%) (0%)
1 < 1.33 < 6 :
IQR (CV) : 2.33 (0.69) :
: : . : : : . .
57 tot_ecrrs_spouse_avoid mean (sd) : 2.13 (1.15) 16 distinct val. : 9880 0
[numeric] min < med < max : : (100%) (0%)
1 < 1.67 < 5.33 :
IQR (CV) : 1.83 (0.54) : . .
: : . : : : . .
58 tot_ysl mean (sd) : 67.32 (18.45) 31 distinct val. . : : 9880 0
[numeric] min < med < max : : . . : : (100%) (0%)
31 < 69 < 100 . : : : . : : :
IQR (CV) : 32 (0.27) : : : : : : : : . :
: : : : : : : : : :
59 tot_icg mean (sd) : 23.07 (12.16) 28 distinct val. : . 9880 0
[numeric] min < med < max : : : : (100%) (0%)
4 < 22 < 51 : . : : : :
IQR (CV) : 13 (0.53) : : : : : : : . .
: : : : : : : : : :
------------------------------------------------------------------------------------------------------------------------------------------------------- # no missing data on any of the variables!Descriptives
library(psych)
library(stargazer)
Please cite as:
Hlavac, Marek (2018). stargazer: Well-Formatted Regression and Summary Statistics Tables.
R package version 5.2.1. https://CRAN.R-project.org/package=stargazer library(summarytools)
# descriptives for the time-invariant variables are going to be wrong if we use mlm_bx4 (since observations are duplicated)
# so going back to the mlm_add object...
# note that n = 40, but n = 39 with RT data
# D149's behavioral data was dropped (ran outside of scanner), so drop his case
mlm_add <- filter(mlm_add, !grepl("D149",ID))
unique(mlm_add$ID) # it worked [1] "D101" "D103" "D102" "D104" "D105" "D107" "D110" "D114" "D115" "D113" "D118" "D119" "D121" "D117" "D120" "D122" "D123" "D125" "D127" "D130" "D132" "D128" "D134" "D126" "D133"
[26] "D135" "D131" "D129" "D137" "D138" "D140" "D139" "D141" "D144" "D145" "D142" "D147" "D146" "D148"nums <- select_if(mlm_add, is.numeric) # just get the numeric variables
view(dfSummary(nums))
stargazer(nums, type="text", title="Descriptives", digits=2, out="table1.txt", notes = "Note: 'stargazer' makes nicer looking tables, but doesn't provide skewness or kurtosis statistics, so we'll use 'psych' for that.")
Descriptives
======================================================================================================================================
Statistic N Mean St. Dev. Min Max
--------------------------------------------------------------------------------------------------------------------------------------
age 39 25,309.79 2,382.79 20,845 29,101
age_yrs 39 69.34 6.53 57.11 79.73
timesincedeath 39 468.64 251.59 151 1,095
tot_bdi 39 10.54 7.70 0 28
tot_bgq 39 9.59 2.29 6 15
tot_ecrrs_global_anx 39 3.29 1.45 1.00 6.33
tot_ecrrs_global_avoid 39 3.40 1.10 1.00 6.33
tot_ecrrs_spouse_anx 39 2.17 1.54 1.00 6.00
tot_ecrrs_spouse_avoid 39 2.10 1.15 1.00 5.33
tot_ysl 39 67.85 18.79 31 100
tot_icg 39 23.38 12.63 4 51
--------------------------------------------------------------------------------------------------------------------------------------
Note: 'stargazer' makes nicer looking tables, but doesn't provide skewness or kurtosis statistics, so we'll use 'psych' for that. describe(nums) vars n mean sd median trimmed mad min max range skew kurtosis se
age 1 39 25309.79 2382.79 25640.00 25366.85 2659.78 20845.00 29101.00 8256.00 -0.27 -1.01 381.55
age_yrs 2 39 69.34 6.53 70.25 69.50 7.29 57.11 79.73 22.62 -0.27 -1.01 1.05
timesincedeath 3 39 468.64 251.59 411.00 442.36 198.67 151.00 1095.00 944.00 1.02 -0.02 40.29
tot_bdi 4 39 10.54 7.70 10.00 10.06 8.90 0.00 28.00 28.00 0.52 -0.78 1.23
tot_bgq 5 39 9.59 2.29 9.00 9.48 1.48 6.00 15.00 9.00 0.43 -0.38 0.37
tot_ecrrs_global_anx 6 39 3.29 1.45 3.33 3.23 1.98 1.00 6.33 5.33 0.34 -0.84 0.23
tot_ecrrs_global_avoid 7 39 3.40 1.10 3.50 3.39 0.99 1.00 6.33 5.33 0.07 0.14 0.18
tot_ecrrs_spouse_anx 8 39 2.17 1.54 1.33 1.96 0.49 1.00 6.00 5.00 1.08 -0.10 0.25
tot_ecrrs_spouse_avoid 9 39 2.10 1.15 1.67 1.98 0.99 1.00 5.33 4.33 0.88 -0.20 0.18
tot_ysl 10 39 67.85 18.79 70.00 67.88 19.27 31.00 100.00 69.00 -0.08 -1.14 3.01
tot_icg 11 39 23.38 12.63 22.00 22.79 10.38 4.00 51.00 47.00 0.36 -0.76 2.02Frequencies
# which variables are factors?
mlm_add %>% select_if(is.factor) %>% colnames()[1] "sex_m" "ethnicity_hisp" "race" "rs2254298" "rs2254298_A.carrier" "rs2268498_C.carrier" "rs53576_A.carrier" # hmm, rs2268498 and rs53576 should also be factors, so fix that now
mlm_add <- mlm_add %>% mutate(rs2268498 = recode_factor(rs2268498, "C/T" = "C/T", "CC" = "CC", "TT" = "TT"), rs53576 = recode_factor(rs53576, "A/G" = "A/G", "AA" = "AA", "GG" = "GG"))
mlm_add %>% select_if(is.factor) %>% colnames()[1] "sex_m" "ethnicity_hisp" "race" "rs2254298" "rs2268498" "rs53576" "rs2254298_A.carrier" "rs2268498_C.carrier"
[9] "rs53576_A.carrier" # function to count frequencies for variables that are factors...this isn't working
# countAll <- function(basedata)
# {
# facs <- sapply(basedata, is.factor)
# facdata <- basedata[ ,facs]
# for(i in 1:length(facdata))
# {
# count(facdata)
# }
# }
# countAll(mlm_bx4)
mlm_add %>% count(sex_m) # 28 females, 11 malesmlm_add %>% count(race) # 38 white, 1 another race not listedmlm_add %>% count(ethnicity_hisp) # 37 non-Hispanic/Latino, 2 Hispanic/Latinomlm_add %>% count(rs2254298) # 22 GG, 10 A/G, 1 NA/missing (0 AA)mlm_add %>% count(rs2268498) # 17 C/T, 10 CC, 12 TTmlm_add %>% count(rs53576) # 21 A/G, 18 GG (0 AA)mlm_add %>% count(rs2254298_A.carrier) # yes = 10, no = 28, NA = 1mlm_add %>% count(rs2268498_C.carrier) # yes = 27, no = 12mlm_add %>% count(rs53576_A.carrier) # yes = 21, no = 18Checking distribution shapes and normality
Got a preview of this above when we used summarytools, but here’s a closer look at some histograms and QQ plots.
# a function to produce histograms for all numeric variables in a dataframe
histAll <- function(basedata)
{
nums <- sapply((basedata), is.numeric)
numdata <- basedata[ ,nums]
par(mfrow=c(4,4))
for(i in 1:length(numdata))
{
hist(numdata[,i], xlab=NULL, main=names(numdata[i]))
}
}
histAll(as.data.frame(mlm_bx4))
Centering L2 predictors
# pull out only the total score variables, age, timesincedeath
gcvars <- as.data.frame(mlm_bx4[, grep('^tot|age|timesincedeath|ID', names(mlm_bx4))])
gcvars1 <- gcvars[!duplicated(gcvars$ID), ]
stargazer(gcvars1, type="text", median = T, digits=3)
===================================================================
Statistic N Mean St. Dev. Min Median Max
-------------------------------------------------------------------
age 39 25,309.790 2,382.786 20,845 25,640 29,101
age_yrs 39 69.342 6.528 57.110 70.247 79.729
timesincedeath 39 468.641 251.589 151 411 1,095
tot_bdi 39 10.538 7.701 0 10 28
tot_bgq 39 9.590 2.291 6 9 15
tot_ecrrs_global_anx 39 3.291 1.449 1.000 3.333 6.333
tot_ecrrs_global_avoid 39 3.402 1.101 1.000 3.500 6.333
tot_ecrrs_spouse_anx 39 2.171 1.543 1.000 1.333 6.000
tot_ecrrs_spouse_avoid 39 2.098 1.152 1.000 1.667 5.333
tot_ysl 39 67.846 18.790 31 70 100
tot_icg 39 23.385 12.630 4 22 51
-------------------------------------------------------------------gmean_age <- mean(gcvars1$age)
gmean_age_yrs <- mean(gcvars1$age_yrs)
gmean_time <- mean(gcvars1$timesincedeath)
gmean_bdi <- mean(gcvars1$tot_bdi)
gmean_bgq <- mean(gcvars1$tot_bgq)
gmean_ecrrs_g_anx <- mean(gcvars1$tot_ecrrs_global_anx)
gmean_ecrrs_g_av <- mean(gcvars1$tot_ecrrs_global_avoid)
gmean_ecrrs_s_anx <- mean(gcvars1$tot_ecrrs_spouse_anx)
gmean_ecrrs_s_av <- mean(gcvars1$tot_ecrrs_spouse_avoid)
gmean_icg <- mean(gcvars1$tot_icg)
gmean_ysl <- mean(gcvars1$tot_ysl)
mlm_bx5 <- mlm_bx4 %>% mutate(gmean_age = age-gmean_age, gmean_age_yrs = age_yrs-gmean_age_yrs, gmean_timesincedeath = timesincedeath-gmean_time, gmean_bdi = tot_bdi-gmean_bdi, gmean_bgq = tot_bgq-gmean_bgq, gmean_ecrrs_global_anx = tot_ecrrs_global_anx-gmean_ecrrs_g_anx, gmean_ecrrs_global_avoid = tot_ecrrs_global_avoid-gmean_ecrrs_g_av, gmean_ecrrs_spouse_anx = tot_ecrrs_spouse_anx-gmean_ecrrs_s_anx, gmean_ecrrs_spouse_avoid = tot_ecrrs_spouse_avoid-gmean_ecrrs_s_av, gmean_ysl = tot_ysl-gmean_ysl, gmean_icg = tot_icg-gmean_icg)
stargazer(as.data.frame(mlm_bx5), type="text") # note that means of the group-mean centered variables are not zero - I think this is because some people had more trials than others
=========================================================================
Statistic N Mean St. Dev. Min Max
-------------------------------------------------------------------------
date 9,880 63,183.180 35,369.280 11,416 121,515
gAAT_RT 9,880 794.920 203.041 473 1,712
trialnum 9,880 72.873 41.538 1 144
outlier_RT 9,880 0.000 0.000 0 0
date1 9,880 63,183.180 35,369.280 11,416 121,515
gAAT_RT1 9,880 769.980 197.980 464 1,709
trialnum1 9,880 72.873 41.538 1 144
outlier_RT1 9,880 0.000 0.000 0 0
bias 9,880 11.828 246.662 -1,157 1,119
bias_t 9,880 0.0004 0.999 -3.612 3.888
low_n_trials 9,880 0.060 0.237 0 1
age 9,880 25,229.120 2,370.058 20,845 29,101
age_yrs 9,880 69.121 6.493 57.110 79.729
timesincedeath 9,880 460.855 245.608 151 1,095
tot_bdi 9,880 10.467 7.688 0 28
tot_bgq 9,880 9.558 2.258 6 15
tot_ecrrs_global_anx 9,880 3.241 1.450 1.000 6.333
tot_ecrrs_global_avoid 9,880 3.416 1.070 1.000 6.333
tot_ecrrs_spouse_anx 9,880 2.218 1.532 1.000 6.000
tot_ecrrs_spouse_avoid 9,880 2.127 1.150 1.000 5.333
tot_ysl 9,880 67.317 18.448 31 100
tot_icg 9,880 23.066 12.156 4 51
gmean_age 9,880 -80.671 2,370.058 -4,464.795 3,791.205
gmean_age_yrs 9,880 -0.221 6.493 -12.232 10.387
gmean_timesincedeath 9,880 -7.786 245.608 -317.641 626.359
gmean_bdi 9,880 -0.071 7.688 -10.538 17.462
gmean_bgq 9,880 -0.032 2.258 -3.590 5.410
gmean_ecrrs_global_anx 9,880 -0.050 1.450 -2.291 3.043
gmean_ecrrs_global_avoid 9,880 0.015 1.070 -2.402 2.932
gmean_ecrrs_spouse_anx 9,880 0.047 1.532 -1.171 3.829
gmean_ecrrs_spouse_avoid 9,880 0.029 1.150 -1.098 3.235
gmean_ysl 9,880 -0.529 18.448 -36.846 32.154
gmean_icg 9,880 -0.318 12.156 -19.385 27.615
-------------------------------------------------------------------------# test that hypothesis with the non-duplicated data
gcvars2 <- gcvars1 %>% mutate(gmean_age = age-gmean_age, gmean_age_yrs = age_yrs-gmean_age_yrs, gmean_timesincedeath = timesincedeath-gmean_time, gmean_bdi = tot_bdi-gmean_bdi, gmean_bgq = tot_bgq-gmean_bgq, gmean_ecrrs_global_anx = tot_ecrrs_global_anx-gmean_ecrrs_g_anx, gmean_ecrrs_global_avoid = tot_ecrrs_global_avoid-gmean_ecrrs_g_av, gmean_ecrrs_spouse_anx = tot_ecrrs_spouse_anx-gmean_ecrrs_s_anx, gmean_ecrrs_spouse_avoid = tot_ecrrs_spouse_avoid-gmean_ecrrs_s_av, gmean_ysl = tot_ysl-gmean_ysl, gmean_icg = tot_icg-gmean_icg)
stargazer(as.data.frame(gcvars2), type="text") # yes, the latter are zero
=====================================================================
Statistic N Mean St. Dev. Min Max
---------------------------------------------------------------------
age 39 25,309.790 2,382.786 20,845 29,101
age_yrs 39 69.342 6.528 57.110 79.729
timesincedeath 39 468.641 251.589 151 1,095
tot_bdi 39 10.538 7.701 0 28
tot_bgq 39 9.590 2.291 6 15
tot_ecrrs_global_anx 39 3.291 1.449 1.000 6.333
tot_ecrrs_global_avoid 39 3.402 1.101 1.000 6.333
tot_ecrrs_spouse_anx 39 2.171 1.543 1.000 6.000
tot_ecrrs_spouse_avoid 39 2.098 1.152 1.000 5.333
tot_ysl 39 67.846 18.790 31 100
tot_icg 39 23.385 12.630 4 51
gmean_age 39 0.000 2,382.786 -4,464.795 3,791.205
gmean_age_yrs 39 0.000 6.528 -12.232 10.387
gmean_timesincedeath 39 0.000 251.589 -317.641 626.359
gmean_bdi 39 0.000 7.701 -10.538 17.462
gmean_bgq 39 0.000 2.291 -3.590 5.410
gmean_ecrrs_global_anx 39 0.000 1.449 -2.291 3.043
gmean_ecrrs_global_avoid 39 0.000 1.101 -2.402 2.932
gmean_ecrrs_spouse_anx 39 0.000 1.543 -1.171 3.829
gmean_ecrrs_spouse_avoid 39 -0.000 1.152 -1.098 3.235
gmean_ysl 39 0.000 18.790 -36.846 32.154
gmean_icg 39 0.000 12.630 -19.385 27.615
---------------------------------------------------------------------saveRDS(mlm_bx5, "~/Dropbox/2018Fall/FSHD617C/mlm_bx5.rds")Evaluate missing data
mlm_bx5 %>%
select_if(function(x) any(is.na(x))) %>%
summarise_all(funs(mean(is.na(.)))) -> mlm_bx5_NAs # or use sum() instead of mean() to find n missing values
mlm_bx5_NAs <- gather(mlm_bx5_NAs) # create long data that lists variables with any NAs, and % of data missing
mlm_bx5_NAsOne person is missing rs2254298 genotype (rs2254298 and rs2254298_A.carrier), which we already knew about.
Scale reliabilities
This dataset does not include the item-level data, but we can get that from the master dataset we loaded in earlier.
library(psych)
mlm_scales <- filter(master, !grepl("D149",ID))
## BDI
mlm_tot_bdi <- subset(mlm_scales, select=c(bdi_1c:bdi_21c))
psych::alpha(mlm_tot_bdi)
Reliability analysis
Call: psych::alpha(x = mlm_tot_bdi)
raw_alpha std.alpha G6(smc) average_r S/N ase mean sd median_r
0.9 0.9 0.97 0.31 9.4 0.023 0.51 0.37 0.32
lower alpha upper 95% confidence boundaries
0.85 0.9 0.94
Reliability if an item is dropped:
raw_alpha std.alpha G6(smc) average_r S/N alpha se var.r med.r
bdi_1c 0.89 0.90 0.97 0.31 8.9 0.024 0.036 0.32
bdi_2c 0.89 0.90 0.97 0.31 9.0 0.024 0.035 0.32
bdi_3c 0.90 0.90 0.97 0.32 9.3 0.023 0.034 0.33
bdi_4c 0.89 0.89 0.97 0.30 8.5 0.025 0.034 0.30
bdi_5c 0.89 0.90 0.97 0.30 8.7 0.024 0.036 0.31
bdi_6c 0.90 0.91 0.97 0.32 9.6 0.023 0.031 0.34
bdi_7c 0.89 0.90 0.97 0.30 8.7 0.024 0.035 0.30
bdi_8c 0.89 0.90 0.97 0.31 8.8 0.024 0.036 0.32
bdi_9c 0.89 0.90 0.97 0.31 9.1 0.024 0.035 0.33
bdi_10c 0.89 0.90 0.97 0.30 8.6 0.025 0.035 0.30
bdi_11c 0.89 0.90 0.97 0.32 9.3 0.023 0.035 0.33
bdi_12c 0.88 0.89 0.97 0.29 8.2 0.027 0.033 0.30
bdi_13c 0.89 0.90 0.97 0.31 9.1 0.024 0.035 0.32
bdi_14c 0.89 0.90 0.97 0.30 8.7 0.024 0.035 0.31
bdi_15c 0.89 0.90 0.96 0.30 8.5 0.026 0.035 0.30
bdi_16c 0.89 0.90 0.97 0.31 8.9 0.024 0.037 0.31
bdi_17c 0.89 0.90 0.97 0.31 9.0 0.024 0.035 0.32
bdi_18c 0.90 0.91 0.97 0.33 9.8 0.022 0.033 0.35
bdi_19c 0.89 0.90 0.97 0.31 8.9 0.024 0.033 0.31
bdi_20c 0.89 0.90 0.97 0.30 8.6 0.025 0.035 0.30
bdi_21c 0.91 0.91 0.97 0.32 9.5 0.021 0.033 0.33
Item statistics
n raw.r std.r r.cor r.drop mean sd
bdi_1c 38 0.58 0.60 0.59 0.53 0.42 0.50
bdi_2c 39 0.55 0.56 0.55 0.47 0.36 0.63
bdi_3c 39 0.41 0.46 0.45 0.36 0.21 0.47
bdi_4c 39 0.75 0.75 0.75 0.71 0.79 0.70
bdi_5c 39 0.66 0.69 0.68 0.62 0.41 0.50
bdi_6c 39 0.29 0.35 0.33 0.25 0.10 0.38
bdi_7c 38 0.64 0.68 0.68 0.59 0.32 0.66
bdi_8c 38 0.63 0.63 0.62 0.56 0.32 0.53
bdi_9c 38 0.50 0.54 0.53 0.46 0.13 0.34
bdi_10c 39 0.70 0.70 0.70 0.66 0.67 0.62
bdi_11c 39 0.47 0.46 0.45 0.40 0.54 0.60
bdi_12c 39 0.87 0.85 0.85 0.84 0.64 0.84
bdi_13c 38 0.56 0.52 0.51 0.49 0.66 0.75
bdi_14c 39 0.63 0.65 0.65 0.58 0.38 0.63
bdi_15c 38 0.79 0.73 0.74 0.71 0.55 0.72
bdi_16c 39 0.60 0.60 0.58 0.53 0.77 0.67
bdi_17c 39 0.55 0.57 0.56 0.50 0.23 0.48
bdi_18c 39 0.27 0.27 0.24 0.20 0.64 0.67
bdi_19c 38 0.63 0.61 0.60 0.58 0.63 0.63
bdi_20c 39 0.74 0.70 0.70 0.69 0.67 0.66
bdi_21c 39 0.44 0.36 0.34 0.32 1.18 1.14
Non missing response frequency for each item
0 1 2 3 miss
bdi_1c 0.58 0.42 0.00 0.00 0.03
bdi_2c 0.72 0.21 0.08 0.00 0.00
bdi_3c 0.82 0.15 0.03 0.00 0.00
bdi_4c 0.33 0.56 0.08 0.03 0.00
bdi_5c 0.59 0.41 0.00 0.00 0.00
bdi_6c 0.92 0.05 0.03 0.00 0.00
bdi_7c 0.79 0.11 0.11 0.00 0.03
bdi_8c 0.71 0.26 0.03 0.00 0.03
bdi_9c 0.87 0.13 0.00 0.00 0.03
bdi_10c 0.38 0.59 0.00 0.03 0.00
bdi_11c 0.51 0.44 0.05 0.00 0.00
bdi_12c 0.54 0.33 0.08 0.05 0.00
bdi_13c 0.50 0.34 0.16 0.00 0.03
bdi_14c 0.69 0.23 0.08 0.00 0.00
bdi_15c 0.58 0.29 0.13 0.00 0.03
bdi_16c 0.36 0.51 0.13 0.00 0.00
bdi_17c 0.79 0.18 0.03 0.00 0.00
bdi_18c 0.44 0.51 0.03 0.03 0.00
bdi_19c 0.45 0.47 0.08 0.00 0.03
bdi_20c 0.44 0.46 0.10 0.00 0.00
bdi_21c 0.41 0.15 0.28 0.15 0.00## BGQ
mlm_tot_bgq <- subset(mlm_scales, select=c(bgq_1:bgq_5))
psych::alpha(mlm_tot_bgq)
Reliability analysis
Call: psych::alpha(x = mlm_tot_bgq)
raw_alpha std.alpha G6(smc) average_r S/N ase mean sd median_r
0.71 0.72 0.73 0.34 2.5 0.071 1.9 0.46 0.31
lower alpha upper 95% confidence boundaries
0.57 0.71 0.85
Reliability if an item is dropped:
raw_alpha std.alpha G6(smc) average_r S/N alpha se var.r med.r
bgq_1 0.62 0.63 0.60 0.29 1.7 0.097 0.030 0.32
bgq_2 0.56 0.55 0.51 0.23 1.2 0.112 0.014 0.29
bgq_3 0.72 0.73 0.73 0.41 2.8 0.074 0.028 0.32
bgq_4 0.67 0.67 0.68 0.34 2.1 0.085 0.052 0.32
bgq_5 0.73 0.73 0.73 0.40 2.7 0.070 0.033 0.35
Item statistics
n raw.r std.r r.cor r.drop mean sd
bgq_1 39 0.76 0.76 0.72 0.57 1.9 0.72
bgq_2 39 0.85 0.86 0.88 0.74 2.1 0.62
bgq_3 39 0.49 0.56 0.38 0.30 2.0 0.51
bgq_4 39 0.69 0.68 0.55 0.47 1.8 0.71
bgq_5 39 0.61 0.57 0.38 0.34 1.7 0.76
Non missing response frequency for each item
1 2 3 miss
bgq_1 0.28 0.49 0.23 0
bgq_2 0.15 0.62 0.23 0
bgq_3 0.13 0.74 0.13 0
bgq_4 0.33 0.49 0.18 0
bgq_5 0.46 0.36 0.18 0## ICG
mlm_tot_icg <- subset(mlm_scales, select=c(icg_1:icg_19))
psych::alpha(mlm_tot_icg)
Reliability analysis
Call: psych::alpha(x = mlm_tot_icg)
raw_alpha std.alpha G6(smc) average_r S/N ase mean sd median_r
0.92 0.92 0.96 0.37 11 0.017 1.2 0.66 0.36
lower alpha upper 95% confidence boundaries
0.89 0.92 0.96
Reliability if an item is dropped:
raw_alpha std.alpha G6(smc) average_r S/N alpha se var.r med.r
icg_1 0.92 0.91 0.96 0.36 10 0.018 0.036 0.35
icg_2 0.92 0.92 0.96 0.37 11 0.018 0.039 0.37
icg_3 0.91 0.91 0.96 0.36 10 0.019 0.036 0.35
icg_4 0.92 0.91 0.96 0.37 10 0.018 0.041 0.35
icg_5 0.92 0.92 0.96 0.39 12 0.017 0.040 0.39
icg_6 0.92 0.91 0.96 0.37 11 0.018 0.038 0.35
icg_7 0.91 0.91 0.96 0.36 10 0.019 0.037 0.35
icg_8 0.92 0.91 0.96 0.36 10 0.018 0.039 0.35
icg_9 0.92 0.91 0.96 0.36 10 0.018 0.040 0.35
icg_10 0.92 0.91 0.96 0.37 11 0.018 0.041 0.34
icg_11 0.93 0.92 0.96 0.40 12 0.017 0.034 0.40
icg_12 0.92 0.92 0.96 0.40 12 0.016 0.039 0.41
icg_13 0.91 0.91 0.96 0.36 10 0.019 0.039 0.33
icg_14 0.93 0.92 0.96 0.39 12 0.016 0.037 0.40
icg_15 0.92 0.92 0.96 0.39 11 0.017 0.039 0.38
icg_16 0.92 0.91 0.96 0.37 11 0.018 0.041 0.35
icg_17 0.92 0.91 0.96 0.37 11 0.018 0.039 0.36
icg_18 0.92 0.92 0.96 0.38 11 0.017 0.042 0.38
icg_19 0.92 0.91 0.95 0.37 10 0.018 0.040 0.35
Item statistics
n raw.r std.r r.cor r.drop mean sd
icg_1 39 0.82 0.81 0.81 0.80 1.41 0.88
icg_2 39 0.65 0.64 0.63 0.60 1.79 0.95
icg_3 39 0.83 0.82 0.82 0.80 1.21 1.20
icg_4 39 0.72 0.72 0.71 0.67 2.54 1.14
icg_5 39 0.43 0.43 0.39 0.36 1.87 0.92
icg_6 39 0.73 0.71 0.71 0.68 1.46 1.19
icg_7 39 0.80 0.79 0.79 0.77 1.64 1.16
icg_8 39 0.76 0.76 0.76 0.72 1.36 1.09
icg_9 39 0.75 0.76 0.76 0.72 0.72 0.76
icg_10 39 0.69 0.71 0.70 0.65 0.90 0.94
icg_11 39 0.24 0.28 0.23 0.19 0.26 0.55
icg_12 39 0.37 0.38 0.33 0.30 0.72 0.92
icg_13 39 0.82 0.81 0.81 0.78 1.97 1.27
icg_14 39 0.37 0.39 0.38 0.31 0.67 0.96
icg_15 39 0.47 0.49 0.48 0.42 0.33 0.84
icg_16 39 0.69 0.68 0.66 0.64 0.77 1.22
icg_17 39 0.68 0.67 0.66 0.63 0.85 1.09
icg_18 39 0.56 0.56 0.55 0.50 0.92 1.09
icg_19 39 0.73 0.72 0.72 0.69 2.00 1.08
Non missing response frequency for each item
0 1 2 3 4 miss
icg_1 0.15 0.38 0.36 0.10 0.00 0
icg_2 0.08 0.31 0.38 0.21 0.03 0
icg_3 0.38 0.21 0.28 0.08 0.05 0
icg_4 0.08 0.08 0.28 0.36 0.21 0
icg_5 0.05 0.28 0.46 0.15 0.05 0
icg_6 0.26 0.28 0.26 0.15 0.05 0
icg_7 0.18 0.31 0.26 0.21 0.05 0
icg_8 0.26 0.31 0.28 0.13 0.03 0
icg_9 0.46 0.36 0.18 0.00 0.00 0
icg_10 0.41 0.36 0.15 0.08 0.00 0
icg_11 0.79 0.15 0.05 0.00 0.00 0
icg_12 0.54 0.26 0.15 0.05 0.00 0
icg_13 0.13 0.26 0.28 0.18 0.15 0
icg_14 0.59 0.21 0.18 0.00 0.03 0
icg_15 0.82 0.08 0.08 0.00 0.03 0
icg_16 0.64 0.13 0.10 0.08 0.05 0
icg_17 0.54 0.18 0.21 0.05 0.03 0
icg_18 0.49 0.23 0.15 0.13 0.00 0
icg_19 0.08 0.26 0.33 0.26 0.08 0## YSL
mlm_tot_ysl <- subset(mlm_scales, select=c(ysl_1:ysl_21))
psych::alpha(mlm_tot_ysl)
Reliability analysis
Call: psych::alpha(x = mlm_tot_ysl)
raw_alpha std.alpha G6(smc) average_r S/N ase mean sd median_r
0.96 0.96 0.98 0.52 22 0.0094 3.2 0.89 0.55
lower alpha upper 95% confidence boundaries
0.94 0.96 0.98
Reliability if an item is dropped:
raw_alpha std.alpha G6(smc) average_r S/N alpha se var.r med.r
ysl_1 0.96 0.96 0.98 0.55 24 0.0093 0.018 0.57
ysl_2 0.95 0.95 0.98 0.51 21 0.0100 0.026 0.54
ysl_3 0.95 0.95 0.98 0.51 21 0.0101 0.026 0.54
ysl_4 0.96 0.96 0.98 0.52 21 0.0098 0.026 0.55
ysl_5 0.95 0.95 0.98 0.51 21 0.0100 0.026 0.54
ysl_6 0.95 0.95 0.98 0.51 21 0.0101 0.026 0.54
ysl_7 0.96 0.96 0.98 0.52 21 0.0097 0.025 0.55
ysl_8 0.95 0.95 0.98 0.51 21 0.0102 0.025 0.54
ysl_9 0.95 0.95 0.98 0.51 21 0.0102 0.025 0.54
ysl_10 0.95 0.95 0.98 0.51 21 0.0101 0.025 0.53
ysl_11 0.95 0.95 0.98 0.51 21 0.0101 0.025 0.54
ysl_12 0.96 0.96 0.98 0.52 22 0.0095 0.026 0.57
ysl_13 0.96 0.96 0.98 0.53 23 0.0092 0.024 0.57
ysl_14 0.95 0.95 0.98 0.51 21 0.0100 0.026 0.53
ysl_15 0.96 0.96 0.98 0.53 23 0.0092 0.024 0.57
ysl_16 0.96 0.96 0.98 0.53 22 0.0095 0.026 0.57
ysl_17 0.95 0.96 0.98 0.52 21 0.0099 0.025 0.54
ysl_18 0.96 0.96 0.98 0.52 22 0.0097 0.026 0.55
ysl_19 0.95 0.95 0.98 0.51 21 0.0099 0.026 0.54
ysl_20 0.95 0.96 0.98 0.52 21 0.0099 0.025 0.55
ysl_21 0.95 0.95 0.98 0.51 21 0.0102 0.024 0.54
Item statistics
n raw.r std.r r.cor r.drop mean sd
ysl_1 39 0.37 0.39 0.38 0.33 4.4 0.74
ysl_2 39 0.79 0.80 0.79 0.77 3.6 1.10
ysl_3 39 0.85 0.85 0.85 0.83 2.4 0.99
ysl_4 39 0.73 0.74 0.73 0.71 2.8 0.90
ysl_5 39 0.79 0.79 0.79 0.76 2.9 1.14
ysl_6 39 0.82 0.82 0.82 0.79 2.9 1.20
ysl_7 39 0.74 0.73 0.73 0.70 3.2 1.63
ysl_8 39 0.84 0.83 0.82 0.82 2.5 1.50
ysl_9 39 0.84 0.83 0.83 0.81 2.7 1.40
ysl_10 39 0.82 0.82 0.82 0.80 2.6 1.35
ysl_11 39 0.83 0.82 0.82 0.80 2.9 1.32
ysl_12 39 0.65 0.65 0.65 0.61 2.7 1.28
ysl_13 39 0.57 0.57 0.57 0.53 3.7 1.25
ysl_14 39 0.80 0.80 0.79 0.78 3.7 1.21
ysl_15 39 0.56 0.57 0.56 0.52 3.9 1.24
ysl_16 39 0.58 0.60 0.58 0.55 4.5 0.76
ysl_17 39 0.75 0.74 0.74 0.72 3.5 1.14
ysl_18 39 0.71 0.71 0.70 0.68 3.1 1.20
ysl_19 39 0.77 0.77 0.76 0.74 3.4 1.12
ysl_20 39 0.76 0.76 0.76 0.73 3.3 1.36
ysl_21 39 0.84 0.84 0.84 0.82 3.2 1.38
Non missing response frequency for each item
1 2 3 4 5 miss
ysl_1 0.00 0.00 0.15 0.33 0.51 0
ysl_2 0.03 0.15 0.28 0.31 0.23 0
ysl_3 0.26 0.21 0.44 0.10 0.00 0
ysl_4 0.08 0.28 0.46 0.15 0.03 0
ysl_5 0.08 0.36 0.26 0.21 0.10 0
ysl_6 0.18 0.18 0.28 0.31 0.05 0
ysl_7 0.23 0.15 0.15 0.10 0.36 0
ysl_8 0.36 0.21 0.18 0.08 0.18 0
ysl_9 0.28 0.15 0.31 0.10 0.15 0
ysl_10 0.28 0.23 0.21 0.18 0.10 0
ysl_11 0.15 0.23 0.31 0.13 0.18 0
ysl_12 0.21 0.28 0.23 0.18 0.10 0
ysl_13 0.08 0.08 0.23 0.26 0.36 0
ysl_14 0.05 0.10 0.28 0.21 0.36 0
ysl_15 0.03 0.15 0.21 0.15 0.46 0
ysl_16 0.00 0.00 0.15 0.15 0.69 0
ysl_17 0.05 0.13 0.33 0.26 0.23 0
ysl_18 0.10 0.26 0.21 0.33 0.10 0
ysl_19 0.05 0.13 0.36 0.26 0.21 0
ysl_20 0.10 0.23 0.21 0.21 0.26 0
ysl_21 0.18 0.10 0.26 0.26 0.21 0## ECRRS-global anxiety
mlm_tot_ecrrs_global_anx <- subset(mlm_scales, select=c(ecrrs_global_7c:ecrrs_global_9c))
psych::alpha(mlm_tot_ecrrs_global_anx)
Reliability analysis
Call: psych::alpha(x = mlm_tot_ecrrs_global_anx)
raw_alpha std.alpha G6(smc) average_r S/N ase mean sd median_r
0.9 0.9 0.86 0.74 8.6 0.029 3.3 1.4 0.75
lower alpha upper 95% confidence boundaries
0.84 0.9 0.95
Reliability if an item is dropped:
raw_alpha std.alpha G6(smc) average_r S/N alpha se var.r med.r
ecrrs_global_7c 0.88 0.88 0.79 0.79 7.3 0.038 NA 0.79
ecrrs_global_8c 0.82 0.82 0.69 0.69 4.4 0.059 NA 0.69
ecrrs_global_9c 0.86 0.86 0.75 0.75 6.1 0.045 NA 0.75
Item statistics
n raw.r std.r r.cor r.drop mean sd
ecrrs_global_7c 39 0.89 0.89 0.80 0.76 3.6 1.6
ecrrs_global_8c 39 0.93 0.93 0.89 0.84 3.1 1.6
ecrrs_global_9c 39 0.91 0.91 0.84 0.79 3.2 1.6
Non missing response frequency for each item
1 2 3 4 5 6 7 miss
ecrrs_global_7c 0.08 0.23 0.18 0.26 0.13 0.08 0.05 0
ecrrs_global_8c 0.13 0.31 0.23 0.18 0.03 0.10 0.03 0
ecrrs_global_9c 0.15 0.28 0.08 0.23 0.18 0.08 0.00 0## ECRRS-global avoid
mlm_tot_ecrrs_global_avoid <- subset(mlm_scales, select=c(ecrrs_global_1r:ecrrs_global_4r, ecrrs_global_5c, ecrrs_global_6c))
psych::alpha(mlm_tot_ecrrs_global_avoid)
Reliability analysis
Call: psych::alpha(x = mlm_tot_ecrrs_global_avoid)
raw_alpha std.alpha G6(smc) average_r S/N ase mean sd median_r
0.84 0.85 0.88 0.48 5.6 0.038 3.4 1.1 0.5
lower alpha upper 95% confidence boundaries
0.77 0.84 0.92
Reliability if an item is dropped:
raw_alpha std.alpha G6(smc) average_r S/N alpha se var.r med.r
ecrrs_global_1r 0.84 0.85 0.88 0.53 5.7 0.041 0.029 0.50
ecrrs_global_2r 0.78 0.78 0.81 0.42 3.7 0.052 0.030 0.40
ecrrs_global_3r 0.80 0.80 0.82 0.45 4.1 0.048 0.033 0.47
ecrrs_global_4r 0.84 0.84 0.88 0.51 5.3 0.040 0.043 0.52
ecrrs_global_5c 0.83 0.84 0.84 0.51 5.2 0.042 0.023 0.51
ecrrs_global_6c 0.79 0.81 0.82 0.46 4.3 0.051 0.035 0.50
Item statistics
n raw.r std.r r.cor r.drop mean sd
ecrrs_global_1r 39 0.57 0.64 0.53 0.46 2.0 0.93
ecrrs_global_2r 39 0.87 0.89 0.89 0.80 3.1 1.32
ecrrs_global_3r 39 0.80 0.83 0.82 0.70 2.9 1.42
ecrrs_global_4r 39 0.69 0.68 0.56 0.53 4.3 1.59
ecrrs_global_5c 39 0.74 0.69 0.65 0.58 4.0 1.72
ecrrs_global_6c 39 0.83 0.80 0.78 0.72 4.2 1.71
Non missing response frequency for each item
1 2 3 4 5 6 7 miss
ecrrs_global_1r 0.33 0.44 0.18 0.03 0.03 0.00 0.00 0
ecrrs_global_2r 0.10 0.26 0.36 0.08 0.18 0.03 0.00 0
ecrrs_global_3r 0.15 0.31 0.28 0.08 0.13 0.05 0.00 0
ecrrs_global_4r 0.08 0.05 0.18 0.10 0.41 0.10 0.08 0
ecrrs_global_5c 0.05 0.15 0.26 0.15 0.13 0.18 0.08 0
ecrrs_global_6c 0.05 0.13 0.23 0.10 0.26 0.13 0.10 0## ECRRS-spouse anxiety
mlm_tot_ecrrs_spouse_anx <- subset(mlm_scales, select=c(ecrrs_spouse_7c:ecrrs_spouse_9c))
psych::alpha(mlm_tot_ecrrs_spouse_anx)
Reliability analysis
Call: psych::alpha(x = mlm_tot_ecrrs_spouse_anx)
raw_alpha std.alpha G6(smc) average_r S/N ase mean sd median_r
0.86 0.86 0.84 0.67 6.1 0.042 2.2 1.5 0.63
lower alpha upper 95% confidence boundaries
0.77 0.86 0.94
Reliability if an item is dropped:
raw_alpha std.alpha G6(smc) average_r S/N alpha se var.r med.r
ecrrs_spouse_7c 0.92 0.92 0.86 0.86 11.9 0.025 NA 0.86
ecrrs_spouse_8c 0.69 0.69 0.53 0.53 2.2 0.099 NA 0.53
ecrrs_spouse_9c 0.77 0.77 0.63 0.63 3.3 0.074 NA 0.63
Item statistics
n raw.r std.r r.cor r.drop mean sd
ecrrs_spouse_7c 39 0.82 0.81 0.63 0.60 2.2 1.8
ecrrs_spouse_8c 39 0.93 0.94 0.93 0.84 2.3 1.8
ecrrs_spouse_9c 39 0.89 0.90 0.87 0.77 2.1 1.6
Non missing response frequency for each item
1 2 3 4 5 6 7 miss
ecrrs_spouse_7c 0.59 0.15 0.03 0.08 0.08 0.03 0.05 0
ecrrs_spouse_8c 0.54 0.18 0.00 0.13 0.08 0.05 0.03 0
ecrrs_spouse_9c 0.59 0.18 0.00 0.13 0.03 0.08 0.00 0## ECRRS-spouse avoid
mlm_tot_ecrrs_spouse_avoid <- subset(mlm_scales, select=c(ecrrs_spouse_1r:ecrrs_spouse_4r, ecrrs_spouse_5c, ecrrs_spouse_6c))
psych::alpha(mlm_tot_ecrrs_spouse_avoid)
Reliability analysis
Call: psych::alpha(x = mlm_tot_ecrrs_spouse_avoid)
raw_alpha std.alpha G6(smc) average_r S/N ase mean sd median_r
0.91 0.93 0.95 0.68 13 0.024 2.1 1.2 0.67
lower alpha upper 95% confidence boundaries
0.86 0.91 0.95
Reliability if an item is dropped:
raw_alpha std.alpha G6(smc) average_r S/N alpha se var.r med.r
ecrrs_spouse_1r 0.87 0.89 0.91 0.63 8.5 0.034 0.024 0.60
ecrrs_spouse_2r 0.88 0.91 0.92 0.66 9.6 0.030 0.021 0.65
ecrrs_spouse_3r 0.88 0.90 0.92 0.65 9.1 0.031 0.025 0.62
ecrrs_spouse_4r 0.89 0.92 0.94 0.69 11.0 0.029 0.029 0.65
ecrrs_spouse_5c 0.92 0.94 0.95 0.75 15.2 0.021 0.021 0.76
ecrrs_spouse_6c 0.89 0.92 0.94 0.71 12.2 0.030 0.036 0.76
Item statistics
n raw.r std.r r.cor r.drop mean sd
ecrrs_spouse_1r 39 0.94 0.96 0.97 0.91 2.0 1.2
ecrrs_spouse_2r 39 0.87 0.90 0.91 0.81 1.9 1.1
ecrrs_spouse_3r 39 0.90 0.92 0.93 0.86 1.8 1.0
ecrrs_spouse_4r 39 0.82 0.84 0.81 0.74 2.0 1.4
ecrrs_spouse_5c 39 0.77 0.72 0.63 0.61 2.7 1.9
ecrrs_spouse_6c 39 0.83 0.80 0.76 0.73 2.3 1.6
Non missing response frequency for each item
1 2 3 4 5 6 7 miss
ecrrs_spouse_1r 0.44 0.31 0.13 0.10 0.00 0.03 0.00 0
ecrrs_spouse_2r 0.44 0.41 0.05 0.08 0.00 0.03 0.00 0
ecrrs_spouse_3r 0.51 0.33 0.05 0.08 0.03 0.00 0.00 0
ecrrs_spouse_4r 0.51 0.23 0.10 0.10 0.03 0.00 0.03 0
ecrrs_spouse_5c 0.38 0.23 0.03 0.18 0.05 0.10 0.03 0
ecrrs_spouse_6c 0.49 0.23 0.00 0.13 0.13 0.03 0.00 0Drop the 4 people with low trial counts
data <- filter(mlm_bx5, !grepl("D101|D141|D147|D148",ID))
unique(data$ID) [1] "D102" "D103" "D104" "D105" "D107" "D110" "D113" "D114" "D115" "D117" "D118" "D119" "D120" "D121" "D122" "D123" "D125" "D126" "D127" "D128" "D129" "D130" "D131" "D132" "D133"
[26] "D134" "D135" "D137" "D138" "D139" "D140" "D142" "D144" "D145" "D146"OLS estimates for exploratory purposes
# getting regular regression estimates one person at a time for exploratory purposes:
lmEst <- by(data, data$ID, function(x) summary(lm(bias_t ~ trialnum, data=x)))
lmEstdata$ID: D102
Call:
lm(formula = bias_t ~ trialnum, data = x)
Residuals:
Min 1Q Median 3Q Max
-2.48996 -0.58245 0.06197 0.68084 2.64005
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) -1.291e-01 1.136e-01 -1.137 0.257
trialnum -2.241e-05 1.359e-03 -0.016 0.987
Residual standard error: 0.9253 on 273 degrees of freedom
Multiple R-squared: 9.965e-07, Adjusted R-squared: -0.003662
F-statistic: 0.000272 on 1 and 273 DF, p-value: 0.9869
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D103
Call:
lm(formula = bias_t ~ trialnum, data = x)
Residuals:
Min 1Q Median 3Q Max
-2.2719 -0.5849 -0.0927 0.3886 2.9673
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 0.082364 0.102043 0.807 0.420
trialnum -0.001906 0.001211 -1.573 0.117
Residual standard error: 0.8135 on 262 degrees of freedom
Multiple R-squared: 0.009358, Adjusted R-squared: 0.005577
F-statistic: 2.475 on 1 and 262 DF, p-value: 0.1169
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D104
Call:
lm(formula = bias_t ~ trialnum, data = x)
Residuals:
Min 1Q Median 3Q Max
-2.34415 -0.69203 -0.01214 0.68738 2.23131
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) -0.1884022 0.1162064 -1.621 0.106
trialnum 0.0006281 0.0013690 0.459 0.647
Residual standard error: 0.9107 on 260 degrees of freedom
Multiple R-squared: 0.000809, Adjusted R-squared: -0.003034
F-statistic: 0.2105 on 1 and 260 DF, p-value: 0.6468
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D105
Call:
lm(formula = bias_t ~ trialnum, data = x)
Residuals:
Min 1Q Median 3Q Max
-3.3081 -0.7206 -0.0130 0.6973 3.2083
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) -0.0087356 0.1191993 -0.073 0.942
trialnum 0.0001354 0.0014298 0.095 0.925
Residual standard error: 0.9797 on 269 degrees of freedom
Multiple R-squared: 3.331e-05, Adjusted R-squared: -0.003684
F-statistic: 0.008962 on 1 and 269 DF, p-value: 0.9247
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D107
Call:
lm(formula = bias_t ~ trialnum, data = x)
Residuals:
Min 1Q Median 3Q Max
-1.85010 -0.44853 -0.01855 0.41297 3.11259
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) -0.060853 0.101464 -0.600 0.549
trialnum -0.001334 0.001215 -1.098 0.273
Residual standard error: 0.731 on 222 degrees of freedom
Multiple R-squared: 0.0054, Adjusted R-squared: 0.0009193
F-statistic: 1.205 on 1 and 222 DF, p-value: 0.2735
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D110
Call:
lm(formula = bias_t ~ trialnum, data = x)
Residuals:
Min 1Q Median 3Q Max
-2.67052 -0.56069 -0.05879 0.55996 2.49168
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) -0.364749 0.096444 -3.782 0.00019 ***
trialnum 0.001562 0.001150 1.359 0.17533
---
Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1
Residual standard error: 0.8085 on 282 degrees of freedom
Multiple R-squared: 0.006504, Adjusted R-squared: 0.002981
F-statistic: 1.846 on 1 and 282 DF, p-value: 0.1753
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D113
Call:
lm(formula = bias_t ~ trialnum, data = x)
Residuals:
Min 1Q Median 3Q Max
-3.5435 -0.7334 -0.0605 0.6933 3.8484
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 0.156910 0.143946 1.09 0.277
trialnum -0.001568 0.001723 -0.91 0.364
Residual standard error: 1.158 on 255 degrees of freedom
Multiple R-squared: 0.003239, Adjusted R-squared: -0.0006703
F-statistic: 0.8285 on 1 and 255 DF, p-value: 0.3636
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D114
Call:
lm(formula = bias_t ~ trialnum, data = x)
Residuals:
Min 1Q Median 3Q Max
-2.50969 -0.65882 -0.00707 0.71733 2.52092
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) -0.025504 0.120929 -0.211 0.833
trialnum 0.000752 0.001435 0.524 0.601
Residual standard error: 0.9673 on 264 degrees of freedom
Multiple R-squared: 0.001039, Adjusted R-squared: -0.002745
F-statistic: 0.2745 on 1 and 264 DF, p-value: 0.6007
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D115
Call:
lm(formula = bias_t ~ trialnum, data = x)
Residuals:
Min 1Q Median 3Q Max
-2.9324 -0.7991 0.0765 0.8424 3.6521
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) -0.029711 0.148768 -0.200 0.842
trialnum -0.000728 0.001758 -0.414 0.679
Residual standard error: 1.191 on 268 degrees of freedom
Multiple R-squared: 0.0006395, Adjusted R-squared: -0.00309
F-statistic: 0.1715 on 1 and 268 DF, p-value: 0.6791
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D117
Call:
lm(formula = bias_t ~ trialnum, data = x)
Residuals:
Min 1Q Median 3Q Max
-2.64965 -0.58759 0.01891 0.64528 2.42830
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 0.1011772 0.1241156 0.815 0.416
trialnum 0.0005858 0.0014759 0.397 0.692
Residual standard error: 1.006 on 265 degrees of freedom
Multiple R-squared: 0.000594, Adjusted R-squared: -0.003177
F-statistic: 0.1575 on 1 and 265 DF, p-value: 0.6918
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D118
Call:
lm(formula = bias_t ~ trialnum, data = x)
Residuals:
Min 1Q Median 3Q Max
-2.5708 -0.6143 0.0243 0.5573 3.5952
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) -0.147982 0.115324 -1.283 0.201
trialnum 0.001085 0.001367 0.794 0.428
Residual standard error: 0.9324 on 258 degrees of freedom
Multiple R-squared: 0.002435, Adjusted R-squared: -0.001432
F-statistic: 0.6298 on 1 and 258 DF, p-value: 0.4282
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D119
Call:
lm(formula = bias_t ~ trialnum, data = x)
Residuals:
Min 1Q Median 3Q Max
-1.46893 -0.28725 -0.04541 0.27308 1.41940
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) -0.1848698 0.0580857 -3.183 0.00163 **
trialnum 0.0009938 0.0006790 1.464 0.14452
---
Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1
Residual standard error: 0.4621 on 263 degrees of freedom
Multiple R-squared: 0.008078, Adjusted R-squared: 0.004307
F-statistic: 2.142 on 1 and 263 DF, p-value: 0.1445
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D120
Call:
lm(formula = bias_t ~ trialnum, data = x)
Residuals:
Min 1Q Median 3Q Max
-2.23591 -0.59528 0.02358 0.66195 2.25539
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 0.013139 0.106695 0.123 0.902
trialnum 0.001517 0.001279 1.186 0.237
Residual standard error: 0.8919 on 281 degrees of freedom
Multiple R-squared: 0.004979, Adjusted R-squared: 0.001438
F-statistic: 1.406 on 1 and 281 DF, p-value: 0.2367
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D121
Call:
lm(formula = bias_t ~ trialnum, data = x)
Residuals:
Min 1Q Median 3Q Max
-2.43694 -0.91284 0.06214 0.88456 2.63851
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 0.0733386 0.1441131 0.509 0.611
trialnum 0.0007977 0.0016891 0.472 0.637
Residual standard error: 1.109 on 250 degrees of freedom
Multiple R-squared: 0.0008913, Adjusted R-squared: -0.003105
F-statistic: 0.223 on 1 and 250 DF, p-value: 0.6372
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D122
Call:
lm(formula = bias_t ~ trialnum, data = x)
Residuals:
Min 1Q Median 3Q Max
-2.56956 -0.41297 0.06257 0.47489 2.13686
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 0.363954 0.087539 4.158 4.36e-05 ***
trialnum -0.002274 0.001048 -2.170 0.0309 *
---
Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1
Residual standard error: 0.7109 on 262 degrees of freedom
Multiple R-squared: 0.01766, Adjusted R-squared: 0.01391
F-statistic: 4.71 on 1 and 262 DF, p-value: 0.03089
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D123
Call:
lm(formula = bias_t ~ trialnum, data = x)
Residuals:
Min 1Q Median 3Q Max
-2.40012 -0.56537 -0.00043 0.66146 2.34616
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 0.0491546 0.1061556 0.463 0.644
trialnum 0.0006319 0.0012798 0.494 0.622
Residual standard error: 0.8798 on 280 degrees of freedom
Multiple R-squared: 0.0008698, Adjusted R-squared: -0.002698
F-statistic: 0.2438 on 1 and 280 DF, p-value: 0.6219
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D125
Call:
lm(formula = bias_t ~ trialnum, data = x)
Residuals:
Min 1Q Median 3Q Max
-2.8243 -0.7796 0.1010 0.8776 2.5089
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) -0.104281 0.149377 -0.698 0.4858
trialnum 0.003034 0.001758 1.726 0.0855 .
---
Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1
Residual standard error: 1.171 on 251 degrees of freedom
Multiple R-squared: 0.01174, Adjusted R-squared: 0.007799
F-statistic: 2.981 on 1 and 251 DF, p-value: 0.08549
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D126
Call:
lm(formula = bias_t ~ trialnum, data = x)
Residuals:
Min 1Q Median 3Q Max
-2.59811 -0.84432 0.03587 0.79812 2.77645
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 0.116054 0.146348 0.793 0.429
trialnum -0.001164 0.001716 -0.678 0.498
Residual standard error: 1.132 on 251 degrees of freedom
Multiple R-squared: 0.001829, Adjusted R-squared: -0.002148
F-statistic: 0.4599 on 1 and 251 DF, p-value: 0.4983
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D127
Call:
lm(formula = bias_t ~ trialnum, data = x)
Residuals:
Min 1Q Median 3Q Max
-2.34833 -0.46407 0.01749 0.49797 2.14017
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 0.0083635 0.0926001 0.090 0.928
trialnum 0.0002109 0.0011159 0.189 0.850
Residual standard error: 0.7748 on 277 degrees of freedom
Multiple R-squared: 0.0001289, Adjusted R-squared: -0.003481
F-statistic: 0.03571 on 1 and 277 DF, p-value: 0.8503
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D128
Call:
lm(formula = bias_t ~ trialnum, data = x)
Residuals:
Min 1Q Median 3Q Max
-2.88746 -0.77939 0.01618 0.90018 2.92400
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 0.036492 0.144944 0.252 0.801
trialnum 0.001748 0.001781 0.982 0.327
Residual standard error: 1.122 on 246 degrees of freedom
Multiple R-squared: 0.003902, Adjusted R-squared: -0.0001475
F-statistic: 0.9636 on 1 and 246 DF, p-value: 0.3273
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D129
Call:
lm(formula = bias_t ~ trialnum, data = x)
Residuals:
Min 1Q Median 3Q Max
-2.29761 -0.68312 -0.07219 0.64877 2.57404
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 0.271839 0.116233 2.339 0.0201 *
trialnum -0.001223 0.001378 -0.887 0.3756
---
Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1
Residual standard error: 0.9355 on 270 degrees of freedom
Multiple R-squared: 0.002909, Adjusted R-squared: -0.0007842
F-statistic: 0.7876 on 1 and 270 DF, p-value: 0.3756
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D130
Call:
lm(formula = bias_t ~ trialnum, data = x)
Residuals:
Min 1Q Median 3Q Max
-1.96670 -0.73599 0.05166 0.64512 2.42892
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) -0.286183 0.107700 -2.657 0.00834 **
trialnum 0.002860 0.001289 2.218 0.02737 *
---
Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1
Residual standard error: 0.8939 on 273 degrees of freedom
Multiple R-squared: 0.0177, Adjusted R-squared: 0.01411
F-statistic: 4.92 on 1 and 273 DF, p-value: 0.02737
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D131
Call:
lm(formula = bias_t ~ trialnum, data = x)
Residuals:
Min 1Q Median 3Q Max
-3.2194 -0.5982 -0.0545 0.6498 2.7764
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 0.0791588 0.1059716 0.747 0.456
trialnum -0.0003126 0.0012645 -0.247 0.805
Residual standard error: 0.8565 on 271 degrees of freedom
Multiple R-squared: 0.0002255, Adjusted R-squared: -0.003464
F-statistic: 0.06111 on 1 and 271 DF, p-value: 0.8049
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D132
Call:
lm(formula = bias_t ~ trialnum, data = x)
Residuals:
Min 1Q Median 3Q Max
-3.1408 -0.7653 0.1364 0.8599 2.3351
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 0.013177 0.136249 0.097 0.923
trialnum 0.001955 0.001622 1.206 0.229
Residual standard error: 1.121 on 279 degrees of freedom
Multiple R-squared: 0.005182, Adjusted R-squared: 0.001616
F-statistic: 1.453 on 1 and 279 DF, p-value: 0.229
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D133
Call:
lm(formula = bias_t ~ trialnum, data = x)
Residuals:
Min 1Q Median 3Q Max
-2.4840 -0.8749 -0.1888 0.8248 3.3248
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) -0.1745814 0.1439426 -1.213 0.226
trialnum -0.0008207 0.0017355 -0.473 0.637
Residual standard error: 1.142 on 240 degrees of freedom
Multiple R-squared: 0.000931, Adjusted R-squared: -0.003232
F-statistic: 0.2236 on 1 and 240 DF, p-value: 0.6367
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D134
Call:
lm(formula = bias_t ~ trialnum, data = x)
Residuals:
Min 1Q Median 3Q Max
-3.2731 -0.5992 -0.0479 0.7295 3.3435
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 0.0536221 0.1424674 0.376 0.707
trialnum -0.0004335 0.0016789 -0.258 0.796
Residual standard error: 1.138 on 262 degrees of freedom
Multiple R-squared: 0.0002544, Adjusted R-squared: -0.003561
F-statistic: 0.06666 on 1 and 262 DF, p-value: 0.7965
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D135
Call:
lm(formula = bias_t ~ trialnum, data = x)
Residuals:
Min 1Q Median 3Q Max
-2.78490 -0.53797 0.01393 0.67350 2.64560
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 0.053305 0.123706 0.431 0.6669
trialnum 0.003670 0.001462 2.510 0.0127 *
---
Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1
Residual standard error: 0.9873 on 261 degrees of freedom
Multiple R-squared: 0.02356, Adjusted R-squared: 0.01982
F-statistic: 6.298 on 1 and 261 DF, p-value: 0.01269
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D137
Call:
lm(formula = bias_t ~ trialnum, data = x)
Residuals:
Min 1Q Median 3Q Max
-2.6075 -0.9216 -0.0313 0.7593 3.2136
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) -0.2405934 0.1503080 -1.601 0.111
trialnum 0.0008816 0.0017989 0.490 0.624
Residual standard error: 1.231 on 270 degrees of freedom
Multiple R-squared: 0.0008888, Adjusted R-squared: -0.002812
F-statistic: 0.2402 on 1 and 270 DF, p-value: 0.6245
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D138
Call:
lm(formula = bias_t ~ trialnum, data = x)
Residuals:
Min 1Q Median 3Q Max
-1.90652 -0.57527 -0.05418 0.52103 2.44687
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) -0.2472722 0.1014525 -2.437 0.0154 *
trialnum 0.0003618 0.0012118 0.299 0.7655
---
Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1
Residual standard error: 0.8344 on 272 degrees of freedom
Multiple R-squared: 0.0003276, Adjusted R-squared: -0.003348
F-statistic: 0.08913 on 1 and 272 DF, p-value: 0.7655
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D139
Call:
lm(formula = bias_t ~ trialnum, data = x)
Residuals:
Min 1Q Median 3Q Max
-2.89378 -0.76546 0.05778 0.67061 2.69126
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 0.1587970 0.1281068 1.24 0.216
trialnum -0.0001376 0.0015243 -0.09 0.928
Residual standard error: 1.025 on 260 degrees of freedom
Multiple R-squared: 3.136e-05, Adjusted R-squared: -0.003815
F-statistic: 0.008153 on 1 and 260 DF, p-value: 0.9281
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D140
Call:
lm(formula = bias_t ~ trialnum, data = x)
Residuals:
Min 1Q Median 3Q Max
-3.3323 -0.6421 0.0875 0.6323 3.0150
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 0.03402 0.12900 0.264 0.792
trialnum -0.00110 0.00152 -0.724 0.470
Residual standard error: 1.031 on 251 degrees of freedom
Multiple R-squared: 0.002084, Adjusted R-squared: -0.001892
F-statistic: 0.5241 on 1 and 251 DF, p-value: 0.4698
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D142
Call:
lm(formula = bias_t ~ trialnum, data = x)
Residuals:
Min 1Q Median 3Q Max
-2.9667 -0.7474 0.1062 0.7347 2.7858
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 0.046481 0.128445 0.362 0.718
trialnum -0.001103 0.001506 -0.732 0.465
Residual standard error: 1.014 on 271 degrees of freedom
Multiple R-squared: 0.001975, Adjusted R-squared: -0.001707
F-statistic: 0.5364 on 1 and 271 DF, p-value: 0.4646
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D144
Call:
lm(formula = bias_t ~ trialnum, data = x)
Residuals:
Min 1Q Median 3Q Max
-3.4566 -0.6576 -0.1585 0.7136 3.0419
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) -0.154162 0.137451 -1.122 0.263
trialnum -0.000492 0.001635 -0.301 0.764
Residual standard error: 1.077 on 258 degrees of freedom
Multiple R-squared: 0.0003507, Adjusted R-squared: -0.003524
F-statistic: 0.0905 on 1 and 258 DF, p-value: 0.7638
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D145
Call:
lm(formula = bias_t ~ trialnum, data = x)
Residuals:
Min 1Q Median 3Q Max
-2.9882 -1.0491 0.1342 0.9403 3.2810
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 0.0368251 0.1526175 0.241 0.810
trialnum -0.0003689 0.0018315 -0.201 0.841
Residual standard error: 1.246 on 267 degrees of freedom
Multiple R-squared: 0.0001519, Adjusted R-squared: -0.003593
F-statistic: 0.04056 on 1 and 267 DF, p-value: 0.8405
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D146
Call:
lm(formula = bias_t ~ trialnum, data = x)
Residuals:
Min 1Q Median 3Q Max
-2.2402 -0.7404 -0.0087 0.6633 3.1953
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 0.075070 0.122868 0.611 0.542
trialnum -0.002039 0.001469 -1.388 0.166
Residual standard error: 1.014 on 275 degrees of freedom
Multiple R-squared: 0.00696, Adjusted R-squared: 0.003349
F-statistic: 1.928 on 1 and 275 DF, p-value: 0.1662Stem plot for the intercepts based on the OLS estimates:
int <- by(data, data$ID, function(x) coefficients(lm(bias_t ~ trialnum, data=x))[[1]])
intdata$ID: D102
[1] -0.1290878
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D103
[1] 0.08236442
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D104
[1] -0.1884022
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D105
[1] -0.008735585
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D107
[1] -0.06085291
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D110
[1] -0.3647491
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D113
[1] 0.1569096
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D114
[1] -0.02550412
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D115
[1] -0.02971102
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D117
[1] 0.1011772
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D118
[1] -0.1479823
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D119
[1] -0.1848698
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D120
[1] 0.01313922
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D121
[1] 0.07333861
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D122
[1] 0.3639537
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D123
[1] 0.04915464
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D125
[1] -0.1042809
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D126
[1] 0.116054
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D127
[1] 0.008363529
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D128
[1] 0.0364918
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D129
[1] 0.2718394
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D130
[1] -0.2861826
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D131
[1] 0.07915881
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D132
[1] 0.01317668
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D133
[1] -0.1745814
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D134
[1] 0.05362205
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D135
[1] 0.05330519
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D137
[1] -0.2405934
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D138
[1] -0.2472722
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D139
[1] 0.158797
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D140
[1] 0.03402106
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D142
[1] 0.04648122
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D144
[1] -0.1541616
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D145
[1] 0.03682513
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D146
[1] 0.07506976summary(int) Min. 1st Qu. Median Mean 3rd Qu. Max.
-0.36470 -0.13850 0.01318 -0.01496 0.07420 0.36400 stem(int, scale=2)
The decimal point is 1 digit(s) to the left of the |
-3 | 6
-3 |
-2 | 95
-2 | 4
-1 | 98755
-1 | 30
-0 | 6
-0 | 331
0 | 111344
0 | 55557888
1 | 02
1 | 66
2 |
2 | 7
3 |
3 | 6hist(int)
Stem plot for the slopes based on the OLS estimates
slope <- by(data, data$ID, function(x) coefficients(lm(bias_t ~ trialnum, data=x))[[2]])
slopedata$ID: D102
[1] -2.241218e-05
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D103
[1] -0.001905679
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D104
[1] 0.0006280884
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D105
[1] 0.0001353558
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D107
[1] -0.001334097
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D110
[1] 0.001561949
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D113
[1] -0.001568244
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D114
[1] 0.0007520295
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D115
[1] -0.0007279879
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D117
[1] 0.000585758
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D118
[1] 0.001084571
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D119
[1] 0.000993783
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D120
[1] 0.001516656
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D121
[1] 0.0007976749
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D122
[1] -0.002274025
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D123
[1] 0.0006318915
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D125
[1] 0.003034465
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D126
[1] -0.001163756
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D127
[1] 0.0002108626
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D128
[1] 0.001748003
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D129
[1] -0.001222927
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D130
[1] 0.002859666
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D131
[1] -0.0003125823
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D132
[1] 0.001955351
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D133
[1] -0.0008207093
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D134
[1] -0.0004334724
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D135
[1] 0.003669641
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D137
[1] 0.0008815924
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D138
[1] 0.000361766
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D139
[1] -0.0001376385
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D140
[1] -0.001100133
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D142
[1] -0.001103152
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D144
[1] -0.000491994
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D145
[1] -0.0003688567
-----------------------------------------------------------------------------------------------------------------------------------------
data$ID: D146
[1] -0.002038851summary(slope) Min. 1st Qu. Median Mean 3rd Qu. Max.
-0.0022740 -0.0009604 0.0001354 0.0001824 0.0009377 0.0036700 stem(slope, scale=2)
The decimal point is 3 digit(s) to the left of the |
-2 | 30
-1 | 96
-1 | 32211
-0 | 875
-0 | 44310
0 | 124
0 | 666889
1 | 01
1 | 567
2 | 0
2 | 9
3 | 0
3 | 7hist(slope)
Note that these are all extremely close to zero - probably because of the lack of time effect.
R-square for OLS models
rsq <- by(data, data$ID, function(x) summary(lm(bias_t ~ trialnum, data=x))$r.squared)
summary(rsq) Min. 1st Qu. Median Mean 3rd Qu. Max.
9.960e-07 4.724e-04 1.829e-03 4.105e-03 5.291e-03 2.356e-02 stem(rsq, scale=2)
The decimal point is 3 digit(s) to the left of the |
0 | 000122334668999908
2 | 014929
4 | 024
6 | 50
8 | 14
10 | 7
12 |
14 |
16 | 77
18 |
20 |
22 | 6cor(int, slope)[1] -0.475133The correlation between intercepts and slopes is -0.475, so people who show less avoidance bias overall change less over the course of the task.
Graphing multilevel data for exploratory purposes
library(lattice)
xyplot(bias_t ~ trialnum | ID, data = data, as.table=T) # too many people/hard to see, try random subset
ids <- sample(unique(data$ID), 12)
ids [1] "D125" "D128" "D145" "D114" "D115" "D129" "D117" "D131" "D123" "D134" "D132" "D118"temp <- data[data$ID %in% ids, ]
xyplot(bias_t ~ trialnum | ID, data = temp, as.table=T) 
# add fit line(s)
xyplot(bias_t ~ trialnum | ID, data = temp, type=c("p","r")) # linear fit
xyplot(bias_t ~ trialnum | ID, data = temp, type=c("p","smooth")) # curvilinear fit
# graph of the raw data for each person
interaction.plot(data$trialnum, data$ID, data$bias_t)
# generate linear fitted values for each person and then plot all together in one plot
fit <- by(data, data$ID, function(x) fitted.values(lm(bias_t ~ trialnum, data=x)))
fit2 <- unlist(fit)
interaction.plot(data$trialnum, data$ID, fit2, xlab="trial number", ylab="RT bias (transformed)")
There does not seem to be either a linear or curvilinear effect of trial number (i.e., time) on RT bias in the task.
Analyses (NHST)
trialnumber (this is NOT the time variable; time refers to time of day when task was run.)
Unconditional means model
library(nlme)
# unconditional means model
m1 <- lme(bias_t ~ 1, random = ~ 1 | ID, data=data, method="ML")
summary(m1)Linear mixed-effects model fit by maximum likelihood
Data: data
AIC BIC logLik
26249.82 26271.23 -13121.91
Random effects:
Formula: ~1 | ID
(Intercept) Residual
StdDev: 0.1244563 0.9906337
Fixed effects: bias_t ~ 1
Value Std.Error DF t-value p-value
(Intercept) -0.001588482 0.02341911 9254 -0.06782845 0.9459
Standardized Within-Group Residuals:
Min Q1 Med Q3 Max
-3.545388737 -0.657743071 0.002789368 0.676201102 3.889482930
Number of Observations: 9289
Number of Groups: 35 # ICC
iVar <- as.numeric(VarCorr(m1)[1,1])
residVar <- as.numeric(VarCorr(m1)[2,1])
icc1 <- iVar/(iVar+residVar)
icc1[1] 0.0155384The overall mean bias score (transformed) is about -0.002, with a standard deviation of 0.023.
ICC is about 1.6% of the variance. This means that 1.6% of the variance in bias is explained by people being different from one another.
Add fixed and random intercept and slope of time
# model with fixed and random intercept and slope of time (intercepts implied)
m2 <- lme(bias_t ~ trialnum, data = data, random = ~ trialnum | ID, method="ML")
summary(m2) Linear mixed-effects model fit by maximum likelihood
Data: data
AIC BIC logLik
26254.44 26297.26 -13121.22
Random effects:
Formula: ~trialnum | ID
Structure: General positive-definite, Log-Cholesky parametrization
StdDev Corr
(Intercept) 0.112903390 (Intr)
trialnum 0.000529973 0.112
Residual 0.990386738
Fixed effects: bias_t ~ trialnum
Value Std.Error DF t-value p-value
(Intercept) -0.015938869 0.028255586 9253 -0.5640962 0.5727
trialnum 0.000196016 0.000263655 9253 0.7434570 0.4572
Correlation:
(Intr)
trialnum -0.577
Standardized Within-Group Residuals:
Min Q1 Med Q3 Max
-3.540840497 -0.657596342 0.001668977 0.677196004 3.894566704
Number of Observations: 9289
Number of Groups: 35 anova(m2) numDF denDF F-value p-value
(Intercept) 1 9253 0.0272704 0.8688
trialnum 1 9253 0.5527283 0.4572The average bias at trial number = 0 is -0.016 and gets increasingly approach-biased by a nonsignificant fraction of a percent with each unit of time. There is no significant effect of trial number (time) on RT bias score, t = 0.74, p = 0.457.
# ICC
iVar <- as.numeric(VarCorr(m2)[1,1])
residVar <- as.numeric(VarCorr(m2)[2,1])
icc2 <- iVar/(iVar+residVar)
icc2[1] 0.99997899.99% of variance in bias is due to the between-person variance, after controlling for time. This is consistent with the lack of a significant effect of time. However… I have no clue how this makes sense with the ICC of 0.016 from the unconditional means model above, which suggests that <2% of the variance is due to between-person differences. ZERO clue. Atina tried to help me think through this for 20 minutes and I still don’t get it.
Adding stimulus as a fixed effect
There were 5 different types of stimuli, presented in a randomized order (consistent across participants/sessions) determined by genetic algorithm. Everyone saw the same stimuli in the same order, so it is a fixed effect. The different categories of images were: Death (generic), Deceased (personal photo), Living loved one (personal photo), Stranger (sex-matched to spouse), and Neutral (objects).
# add the fixed effect of stim and compare its fit to m2 by inspecting the t and f tests
m3 <- lme(bias_t ~ trialnum + stim, data = data, random = ~ trialnum | ID, method="ML")
summary(m3)Linear mixed-effects model fit by maximum likelihood
Data: data
AIC BIC logLik
26222.9 26294.27 -13101.45
Random effects:
Formula: ~trialnum | ID
Structure: General positive-definite, Log-Cholesky parametrization
StdDev Corr
(Intercept) 0.1132056534 (Intr)
trialnum 0.0005257672 0.108
Residual 0.9882755468
Fixed effects: bias_t ~ trialnum + stim
Value Std.Error DF t-value p-value
(Intercept) -0.01666628 0.03734155 9249 -0.446320 0.6554
trialnum 0.00006687 0.00026759 9249 0.249892 0.8027
stimdeath -0.05312693 0.03423609 9249 -1.551782 0.1207
stimliving 0.04449279 0.03262355 9249 1.363824 0.1727
stimspouse 0.11774054 0.03318866 9249 3.547614 0.0004
stimstranger -0.05577654 0.03227777 9249 -1.728017 0.0840
Correlation:
(Intr) trilnm stmdth stmlvn stmsps
trialnum -0.533
stimdeath -0.537 0.171
stimliving -0.529 0.123 0.517
stimspouse -0.484 0.063 0.497 0.518
stimstranger -0.534 0.123 0.523 0.541 0.523
Standardized Within-Group Residuals:
Min Q1 Med Q3 Max
-3.539701896 -0.662289657 0.002436611 0.671269781 3.967555161
Number of Observations: 9289
Number of Groups: 35 NO effect of time. There is a significant fixed effect of spouse, t = 3.55, p = .0004. There is also a non-significant effect of stranger, t = -1.73, p = .084. This indicates that people tended to show more approach bias to photos of their spouse (across conditions). The parameter estimate is 0.12 with an SE of 0.03. They also tended to show greater more avoidance bias to photos of the sex-matched stranger.
intervals(m3, which="fixed")Approximate 95% confidence intervals
Fixed effects:
lower est. upper
(Intercept) -0.0898403107 -1.666628e-02 0.056507748
trialnum -0.0004574916 6.686771e-05 0.000591227
stimdeath -0.1202155468 -5.312693e-02 0.013961677
stimliving -0.0194359045 4.449279e-02 0.108421484
stimspouse 0.0527044697 1.177405e-01 0.182776618
stimstranger -0.1190276408 -5.577654e-02 0.007474562
attr(,"label")
[1] "Fixed effects:"95% CIs don’t cross zero for spouse, but do for all other stimulus types.
iVar <- as.numeric(VarCorr(m3)[1,1])
residVar <- as.numeric(VarCorr(m3)[2,1])
icc3 <- iVar/(iVar+residVar)
icc3 # Same ICC as m2[1] 0.9999784The ICC is identical to that in model 2.
anova(m2, m3) # compare this model with the first one Model df AIC BIC logLik Test L.Ratio p-value
m2 1 6 26254.44 26297.26 -13121.22
m3 2 10 26222.90 26294.27 -13101.45 1 vs 2 39.53877 <.0001Comparing the model with the fixed effect of stimulus (m3) to the model without (m2), m3 is better (p < .0001) as evidenced by lower AIC, BIC, and lL values.
Take out fixed and random effect of time
Because there’s no significant effect of time, makes sense to drop it from the model. Now we’re basically doing regression but accounting for whatever interdependence exists. Note that these results will NOT match the results of the regressions, because the regressions use medians of the bias scores, rather than means.
# without fixed or random effect of time
m4 <- lme(bias_t ~ stim, data = data, random = ~ 1 | ID, method="ML")
summary(m4)Linear mixed-effects model fit by maximum likelihood
Data: data
AIC BIC logLik
26217.69 26267.65 -13101.85
Random effects:
Formula: ~1 | ID
(Intercept) Residual
StdDev: 0.1244692 0.9884897
Fixed effects: bias_t ~ stim
Value Std.Error DF t-value p-value
(Intercept) -0.01079980 0.03153608 9250 -0.342458 0.7320
stimdeath -0.05495775 0.03367448 9250 -1.632029 0.1027
stimliving 0.04329407 0.03234999 9250 1.338302 0.1808
stimspouse 0.11715733 0.03312053 9250 3.537302 0.0004
stimstranger -0.05692371 0.03200718 9250 -1.778467 0.0754
Correlation:
(Intr) stmdth stmlvn stmsps
stimdeath -0.519
stimliving -0.541 0.506
stimspouse -0.528 0.495 0.515
stimstranger -0.546 0.512 0.533 0.520
Standardized Within-Group Residuals:
Min Q1 Med Q3 Max
-3.543324753 -0.662107099 0.003549832 0.673528310 3.963270484
Number of Observations: 9289
Number of Groups: 35 Fixed effects are still more or less the same - significant for spouse, marginal for stranger - although the parameter estimates and test statistics are slightly different.
intervals(m4, which="fixed")Approximate 95% confidence intervals
Fixed effects:
lower est. upper
(Intercept) -0.07260082 -0.01079980 0.051001227
stimdeath -0.12094940 -0.05495775 0.011033896
stimliving -0.02010198 0.04329407 0.106690123
stimspouse 0.05225126 0.11715733 0.182063398
stimstranger -0.11964795 -0.05692371 0.005800537
attr(,"label")
[1] "Fixed effects:"As above, spouse is the only stimulus category whose 95 CIs don’t cross zero, supporting a significant effect of spouse on bias.
Is m4 any better than m3?
anova(m3,m4) Model df AIC BIC logLik Test L.Ratio p-value
m3 1 10 26222.90 26294.27 -13101.45
m4 2 7 26217.69 26267.65 -13101.85 1 vs 2 0.7920774 0.8514Nope. Models do not significantly differ (p = 0.851), though the AIC and BIC values are a little smaller for m4 than m3. So let’s forget time and go with m4…
Adding condition as a fixed effect
Participants completed the task at two different sessions, where they were randomized to receive treatment A at one and treatment B at the other (order counterbalanced across participants). The two treatments are oxytocin vs. placebo.
# add the interaction of stim and check its fit by inspecting t and f tests.
m5 <- lme(bias_t ~ stim + cond, data = data, random = ~ 1 | ID, method="ML")
summary(m5)Linear mixed-effects model fit by maximum likelihood
Data: data
AIC BIC logLik
26219.67 26276.77 -13101.84
Random effects:
Formula: ~1 | ID
(Intercept) Residual
StdDev: 0.1244747 0.9884885
Fixed effects: bias_t ~ stim + cond
Value Std.Error DF t-value p-value
(Intercept) -0.01230112 0.03317411 9249 -0.370805 0.7108
stimdeath -0.05494483 0.03367637 9249 -1.631554 0.1028
stimliving 0.04326388 0.03235236 9249 1.337271 0.1812
stimspouse 0.11715898 0.03312228 9249 3.537166 0.0004
stimstranger -0.05694662 0.03200925 9249 -1.779068 0.0753
condB 0.00299612 0.02053218 9249 0.145923 0.8840
Correlation:
(Intr) stmdth stmlvn stmsps stmstr
stimdeath -0.495
stimliving -0.512 0.506
stimspouse -0.502 0.494 0.515
stimstranger -0.518 0.512 0.533 0.520
condB -0.310 0.003 -0.006 0.000 -0.005
Standardized Within-Group Residuals:
Min Q1 Med Q3 Max
-3.544942380 -0.661684418 0.005083279 0.672392393 3.961649422
Number of Observations: 9289
Number of Groups: 35 The fixed effect of condition B is not significant, t = 0.15, p = 0.884.
anova(m4, m5) Model df AIC BIC logLik Test L.Ratio p-value
m4 1 7 26217.69 26267.65 -13101.85
m5 2 8 26219.67 26276.76 -13101.84 1 vs 2 0.02130728 0.8839The two models are not significantly different, but the one with the fixed effect of condition (m5) has slightly higher AIC/BIC.
Adding the stimulus*condition interaction
We might expect that peoples’ tendency to approach or avoid might differ depending on which treatment they got, but only for certain stimuli.
# add the interaction of stim and check its fit by inspecting t and f tests.
m6 <- lme(bias_t ~ stim*cond, data = data, random = ~ 1 | ID, method="ML")
summary(m6)Linear mixed-effects model fit by maximum likelihood
Data: data
AIC BIC logLik
26222.36 26308 -13099.18
Random effects:
Formula: ~1 | ID
(Intercept) Residual
StdDev: 0.124494 0.9882046
Fixed effects: bias_t ~ stim * cond
Value Std.Error DF t-value p-value
(Intercept) 0.01640033 0.03934944 9245 0.4167868 0.6768
stimdeath -0.11111299 0.04756084 9245 -2.3362283 0.0195
stimliving 0.04131019 0.04600610 9245 0.8979286 0.3692
stimspouse 0.06476556 0.04686377 9245 1.3819963 0.1670
stimstranger -0.09233079 0.04545796 9245 -2.0311251 0.0423
condB -0.05431038 0.04696981 9245 -1.1562826 0.2476
stimdeath:condB 0.11261285 0.06734696 9245 1.6721298 0.0945
stimliving:condB 0.00494200 0.06470579 9245 0.0763764 0.9391
stimspouse:condB 0.10467698 0.06624022 9245 1.5802632 0.1141
stimstranger:condB 0.07047422 0.06401636 9245 1.1008783 0.2710
Correlation:
(Intr) stmdth stmlvn stmsps stmstr condB stmd:B stml:B stmsp:B
stimdeath -0.590
stimliving -0.610 0.505
stimspouse -0.599 0.496 0.513
stimstranger -0.618 0.511 0.528 0.519
condB -0.598 0.495 0.511 0.502 0.517
stimdeath:condB 0.417 -0.706 -0.357 -0.350 -0.361 -0.697
stimliving:condB 0.434 -0.359 -0.711 -0.364 -0.376 -0.726 0.506
stimspouse:condB 0.424 -0.351 -0.363 -0.707 -0.367 -0.709 0.495 0.515
stimstranger:condB 0.439 -0.363 -0.375 -0.368 -0.710 -0.734 0.512 0.533 0.520
Standardized Within-Group Residuals:
Min Q1 Med Q3 Max
-3.517164674 -0.660296590 0.006315667 0.672822601 3.934464966
Number of Observations: 9289
Number of Groups: 35 Interesting. With the interaction in the model, there is a non-significant interaction between death and condition B.
anova(m6,m4,m5) Model df AIC BIC logLik Test L.Ratio p-value
m6 1 12 26222.36 26308.00 -13099.18
m4 2 7 26217.69 26267.65 -13101.85 1 vs 2 5.332051 0.3767
m5 3 8 26219.67 26276.76 -13101.84 2 vs 3 0.021307 0.8839intervals(m6)Approximate 95% confidence intervals
Fixed effects:
lower est. upper
(Intercept) -0.06069172 0.016400326 0.09349237
stimdeath -0.20429254 -0.111112992 -0.01793344
stimliving -0.04882335 0.041310191 0.13144373
stimspouse -0.02704831 0.064765560 0.15657943
stimstranger -0.18139044 -0.092330795 -0.00327115
condB -0.14633201 -0.054310379 0.03771125
stimdeath:condB -0.01933096 0.112612852 0.24455667
stimliving:condB -0.12182734 0.004941997 0.13171134
stimspouse:condB -0.02509855 0.104676978 0.23445251
stimstranger:condB -0.05494441 0.070474223 0.19589286
attr(,"label")
[1] "Fixed effects:"
Random Effects:
Level: ID
lower est. upper
sd((Intercept)) 0.0931069 0.124494 0.1664618
Within-group standard error:
lower est. upper
0.9740020 0.9882046 1.0026143 The model with the interaction in it is not significantly better than either the one with just the fixed effect of condition or with no effect of condition at all, so makes sense to go with the simplest model which only includes stimulus as a fixed effect.
Adding other plausible predictors
There are a few other variables that we might expect to impact approach/avoidance bias, namely grief severity, OXTR genotype, time since death, and attachment style (avoidant, anxious).
# used group mean centered scores for the additional variables for interpretability
m7 <- lme(bias_t ~ stim + rs53576_A.carrier + rs2268498_C.carrier + gmean_ecrrs_global_anx + gmean_ecrrs_global_avoid + gmean_age + gmean_icg, data = data, random = ~ 1 | ID, method="ML")
summary(m7)Linear mixed-effects model fit by maximum likelihood
Data: data
AIC BIC logLik
26227.59 26320.36 -13100.79
Random effects:
Formula: ~1 | ID
(Intercept) Residual
StdDev: 0.1198702 0.9884902
Fixed effects: bias_t ~ stim + rs53576_A.carrier + rs2268498_C.carrier + gmean_ecrrs_global_anx + gmean_ecrrs_global_avoid + gmean_age + gmean_icg
Value Std.Error DF t-value p-value
(Intercept) -0.01203754 0.03405637 9250 -0.353459 0.7238
stimdeath -0.05487972 0.03368552 9250 -1.629178 0.1033
stimliving 0.04330158 0.03236055 9250 1.338098 0.1809
stimspouse 0.11722059 0.03313178 9250 3.538010 0.0004
stimstranger -0.05691502 0.03201784 9250 -1.777603 0.0755
rs53576_A.carrier.L 0.00525467 0.04347813 28 0.120858 0.9047
rs2268498_C.carrier.L 0.00193315 0.04822525 28 0.040086 0.9683
gmean_ecrrs_global_anx -0.01559904 0.01800716 28 -0.866269 0.3937
gmean_ecrrs_global_avoid -0.00361422 0.02238085 28 -0.161487 0.8729
gmean_age 0.00000470 0.00001033 28 0.455159 0.6525
gmean_icg -0.00073388 0.00229617 28 -0.319611 0.7516
Correlation:
(Intr) stmdth stmlvn stmsps stmstr r53576 r22684 gmn_crrs_glbl_n gmn_crrs_glbl_v gmen_g
stimdeath -0.481
stimliving -0.500 0.506
stimspouse -0.489 0.495 0.515
stimstranger -0.506 0.512 0.533 0.520
rs53576_A.carrier.L 0.248 0.001 0.000 -0.002 -0.001
rs2268498_C.carrier.L -0.406 0.000 0.000 0.001 0.001 -0.646
gmean_ecrrs_global_anx 0.017 0.000 0.000 0.000 0.000 -0.143 0.054
gmean_ecrrs_global_avoid -0.078 -0.002 -0.002 -0.001 -0.001 -0.111 0.120 -0.049
gmean_age -0.026 0.002 0.002 0.004 0.003 -0.187 0.171 0.304 0.142
gmean_icg -0.021 0.000 0.001 0.002 0.003 0.150 0.055 -0.468 -0.179 -0.263
Standardized Within-Group Residuals:
Min Q1 Med Q3 Max
-3.540273271 -0.660509033 0.004325344 0.672841199 3.966239659
Number of Observations: 9289
Number of Groups: 35 anova(m4,m7) Model df AIC BIC logLik Test L.Ratio p-value
m4 1 7 26217.69 26267.65 -13101.85
m7 2 13 26227.59 26320.37 -13100.80 1 vs 2 2.104686 0.9098None of the added fixed effects are significant and the AIC/BIC values are higher, so take ’em out.
Final model
# variance explained by the entire model
fitted <- fitted(m4)
data$fitted <- as.vector(fitted)
rsq <- lm(bias ~ fitted, data=data)
summary(rsq)
Call:
lm(formula = bias ~ fitted, data = data)
Residuals:
Min 1Q Median 3Q Max
-1170.66 -128.74 -2.77 127.93 1115.32
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 11.850 2.532 4.68 2.91e-06 ***
fitted 272.525 19.581 13.92 < 2e-16 ***
---
Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1
Residual standard error: 244 on 9287 degrees of freedom
Multiple R-squared: 0.02043, Adjusted R-squared: 0.02033
F-statistic: 193.7 on 1 and 9287 DF, p-value: < 2.2e-16A case of significant, but not meaningful: The R2 for the entire model is .02, indicating that 2% of the variance in bias is explained by the model. So this model is not very good at predicting approach/avoidance bias from the fixed effect of stimulus within person. Oh well.
Check final model assumptions
Checking normality of the residuals:
# checking normality of residuals
# level 1:
qqnorm(m4, ~resid(.), id=0.00075)
plot(m4, resid(., type="p") ~ trialnum, id=0.0025)
The QQ plot looks pretty okay, albeit a few outliers. D113 is the person who most falls off the line, and does so at both ends. The residuals are also pretty evenly distributed across time, though many fall outside of the +/- 2 range.
# the following bit wants IDs to be numeric, so take out the "D" from each ID
data <- data %>% mutate(numID = as.numeric(str_replace(ID, "D", "")))
# level 2:
qqnorm(m4, ~ranef(.), id=0.25)
ranInt <- ranef(m4)[1] # create object with the random intercept estimates
ranInt <- unlist(ranInt)
names(ranInt) <- NULL
ID <- unlist(subset(data, !duplicated(data$numID), select="numID")) # create an ID variable
plot(ranInt ~ ID)
ranSlope <- ranef(m4)[2] # create an object with the random slopesError in `[.data.frame`(ranef(m4), 2) : undefined columns selectedGetting an error here Error in [.data.frame(ranef(m4), 72) : undefined columns selected, which I got stuck for way too long on and am leaving alone for now.
Checking homoscedasticity:
# checking homoscedasticity
# level 1:
data$resid <- as.numeric(residuals(m4)) # create an object with the Level-1 residuals
plot(data$resid ~ data$stim)
# level 2:
library(lattice)
stim <- unlist(subset(data, !duplicated(data$numID), select="stim"))Unknown or uninitialised column: 'numID'.Length of logical index must be 1 or 9289, not 0xyplot(ranInt ~ stim)
xyplot(ranSlope ~ stim)Error in eval(expr, envir, enclos) : object 'ranSlope' not foundNote that again there are a lot of residuals falling outside of the +/-2 range.
Also, there’s something weird about the L2 plot. Not sure why it shows only 3 of 5 stimulus types (edit: now not showing anything).
The error message is because the ranSlope object does not exist (see error message in output from previous chunk.)
OT RT plots
Long dataset for regressions
More data cleaning
Continuing from the data cleaning above…
library(psych)
library(tidyverse)[30m── [1mAttaching packages[22m ────────────────────────────────────────────────────────────────────────────────────────────────────────────── tidyverse 1.2.1 ──[39m
[30m[32m✔[30m [34mggplot2[30m 3.0.0 [32m✔[30m [34mpurrr [30m 0.2.4
[32m✔[30m [34mtibble [30m 1.4.2 [32m✔[30m [34mdplyr [30m 0.7.4
[32m✔[30m [34mtidyr [30m 0.8.1 [32m✔[30m [34mstringr[30m 1.2.0
[32m✔[30m [34mreadr [30m 1.1.1 [32m✔[30m [34mforcats[30m 0.3.0[39m
[30m── [1mConflicts[22m ───────────────────────────────────────────────────────────────────────────────────────────────────────────────── tidyverse_conflicts() ──
[31m✖[30m [34mggplot2[30m::[32m%+%()[30m masks [34mpsych[30m::%+%()
[31m✖[30m [34mggplot2[30m::[32malpha()[30m masks [34mpsych[30m::alpha()
[31m✖[30m [34m.GlobalEnv[30m::[32mfilter()[30m masks [34mdplyr[30m::filter(), [34mstats[30m::filter()
[31m✖[30m [34mdplyr[30m::[32mlag()[30m masks [34mstats[30m::lag()[39mfilter <- dplyr::filter
select <- dplyr::select
mlm_r1r2_long <- bind_rows(mlm_r1.2, mlm_r2.2)
head(mlm_r1r2_long) ## 22464 observations# get rid of any trials with outliers
mlm_long <- mlm_r1r2_long %>% filter(outlier_RT == "0")
count(mlm_r1r2.1) # 22007 obs.22007/22464 # 98% of trials retained = 2% of trials dropped.[1] 0.9796563mlm_long1 <- left_join(mlm_long, mlm_add, by="ID") # add the self-report variables
head(mlm_long1)gmeans <- select(mlm_bx5.1, starts_with("gmean")) # add grand mean centered variables from mlm_bx5.1 object
ID <- select(mlm_bx5.1, starts_with("ID"))
ID$ID1 <- NULL
gmeans_ID <- bind_cols(ID, gmeans) %>% distinct(gmeans_ID, ID, .keep_all = TRUE)
mlm_long2 <- left_join(mlm_long1, gmeans_ID, by="ID")
library(bestNormalize)
describe(mlm_long1$gAAT_RT) # RT data has skewness of 1.17 and kurtosis of 1.7. Min is 464 and max is 1712, as we filtered out trials above and below the 99th and 1st percentiles already vars n mean sd median trimmed mad min max range skew kurtosis se
X1 1 22007 788.6 205.1 747 765.68 179.39 464 1712 1248 1.17 1.7 1.38bestNormalize(mlm_long2$gAAT_RT)exp_x did not work; Error in exp_x(standardize = TRUE, warn = TRUE, x = c(1139, 980, 1235, :
Transformation finite for less than 3 x values
Ties in data, Normal distribution not guaranteed
|== | 2% ~9 s remaining
|===== | 4% ~10 s remaining
|======= | 6% ~9 s remaining
|========== | 8% ~8 s remaining
|============ | 10% ~8 s remaining
|=============== | 12% ~8 s remaining
|================= | 14% ~8 s remaining
|==================== | 16% ~9 s remaining
|====================== | 18% ~8 s remaining
|========================= | 20% ~8 s remaining
|=========================== | 22% ~7 s remaining
|============================== | 24% ~7 s remaining
|================================ | 26% ~7 s remaining
|=================================== | 28% ~7 s remaining
|===================================== | 30% ~6 s remaining
|======================================== | 32% ~6 s remaining
|========================================== | 34% ~6 s remaining
|============================================= | 36% ~6 s remaining
|=============================================== | 38% ~5 s remaining
|================================================== | 40% ~5 s remaining
|==================================================== | 42% ~5 s remaining
|======================================================= | 44% ~5 s remaining
|========================================================= | 46% ~5 s remaining
|============================================================ | 48% ~4 s remaining
|============================================================== | 50% ~4 s remaining
|================================================================= | 52% ~4 s remaining
|=================================================================== | 54% ~4 s remaining
|====================================================================== | 56% ~4 s remaining
|======================================================================== | 58% ~4 s remaining
|=========================================================================== | 60% ~3 s remaining
|============================================================================= | 62% ~3 s remaining
|================================================================================ | 64% ~3 s remaining
|================================================================================== | 66% ~3 s remaining
|===================================================================================== | 68% ~3 s remaining
|======================================================================================= | 70% ~2 s remaining
|========================================================================================== | 72% ~2 s remaining
|============================================================================================ | 74% ~2 s remaining
|=============================================================================================== | 76% ~2 s remaining
|================================================================================================= | 78% ~2 s remaining
|==================================================================================================== | 80% ~2 s remaining
|====================================================================================================== | 82% ~1 s remaining
|========================================================================================================= | 84% ~1 s remaining
|=========================================================================================================== | 86% ~1 s remaining
|============================================================================================================== | 88% ~1 s remaining
|================================================================================================================ | 90% ~1 s remaining
|=================================================================================================================== | 92% ~1 s remaining
|===================================================================================================================== | 94% ~1 s remaining
|======================================================================================================================== | 96% ~0 s remaining
|========================================================================================================================== | 98% ~0 s remaining
|=============================================================================================================================|100% ~0 s remaining
Best Normalizing transformation with 22007 Observations
Estimated Normality Statistics (Pearson P / df, lower => more normal):
- No transform: 10.717
- Box-Cox: 1.3513
- Log_b(x+a): 3.5498
- sqrt(x+a): 6.4216
- arcsinh(x): 3.5498
- Yeo-Johnson: 1.3516
- orderNorm: 1.1981
Estimation method: Out-of-sample via CV with 10 folds and 5 repeats
Based off these, bestNormalize chose:
orderNorm Transformation with 22007 nonmissing obs and ties
- 1111 unique values
- Original quantiles:
0% 25% 50% 75% 100%
464 640 747 892 1712 gAAT_RT_t <- bestNormalize(mlm_long2$gAAT_RT) # transform the RT dataexp_x did not work; Error in exp_x(standardize = TRUE, warn = TRUE, x = c(1139, 980, 1235, :
Transformation finite for less than 3 x values
Ties in data, Normal distribution not guaranteed
|== | 2% ~8 s remaining
|===== | 4% ~7 s remaining
|======= | 6% ~7 s remaining
|========== | 8% ~7 s remaining
|============ | 10% ~7 s remaining
|=============== | 12% ~7 s remaining
|================= | 14% ~7 s remaining
|==================== | 16% ~7 s remaining
|====================== | 18% ~7 s remaining
|========================= | 20% ~6 s remaining
|=========================== | 22% ~6 s remaining
|============================== | 24% ~6 s remaining
|================================ | 26% ~6 s remaining
|=================================== | 28% ~6 s remaining
|===================================== | 30% ~6 s remaining
|======================================== | 32% ~5 s remaining
|========================================== | 34% ~5 s remaining
|============================================= | 36% ~5 s remaining
|=============================================== | 38% ~5 s remaining
|================================================== | 40% ~5 s remaining
|==================================================== | 42% ~5 s remaining
|======================================================= | 44% ~5 s remaining
|========================================================= | 46% ~5 s remaining
|============================================================ | 48% ~4 s remaining
|============================================================== | 50% ~4 s remaining
|================================================================= | 52% ~4 s remaining
|=================================================================== | 54% ~4 s remaining
|====================================================================== | 56% ~4 s remaining
|======================================================================== | 58% ~3 s remaining
|=========================================================================== | 60% ~3 s remaining
|============================================================================= | 62% ~3 s remaining
|================================================================================ | 64% ~3 s remaining
|================================================================================== | 66% ~3 s remaining
|===================================================================================== | 68% ~3 s remaining
|======================================================================================= | 70% ~2 s remaining
|========================================================================================== | 72% ~2 s remaining
|============================================================================================ | 74% ~2 s remaining
|=============================================================================================== | 76% ~2 s remaining
|================================================================================================= | 78% ~2 s remaining
|==================================================================================================== | 80% ~2 s remaining
|====================================================================================================== | 82% ~1 s remaining
|========================================================================================================= | 84% ~1 s remaining
|=========================================================================================================== | 86% ~1 s remaining
|============================================================================================================== | 88% ~1 s remaining
|================================================================================================================ | 90% ~1 s remaining
|=================================================================================================================== | 92% ~1 s remaining
|===================================================================================================================== | 94% ~0 s remaining
|======================================================================================================================== | 96% ~0 s remaining
|========================================================================================================================== | 98% ~0 s remaining
|=============================================================================================================================|100% ~0 s remaining mlm_long2$gAAT_RT_t <- gAAT_RT_t$x.t # make a new variable for the transformed values and attach it to the long dataset
hist(mlm_long2$gAAT_RT) # compare histograms for the transformed and non-transformed values
hist(mlm_long2$gAAT_RT_t) 
qqnorm(mlm_long2$gAAT_RT) #compare QQ plots for the transformed and non-transformed values
qqnorm(mlm_long2$gAAT_RT_t)
mlm_long2 %>% group_by(ID) %>% count(cond) # look at how many trials each person has for each condition (A/B)# splitting up by instruction
mlm_long2_push <- filter(mlm_long2, grepl("PUSH",push_pull))
head(mlm_long2_push)mlm_long2_pull <- filter(mlm_long2, grepl("PULL",push_pull))
head(mlm_long2_push)Transforming really improved the RT data. Everyone looks like they have a good number of trials (out of 288; 288 = 144 trials*2 runs).
Bias scores (based on medians)
library(tidyverse)
# get the OXTR and self-report scores
# load in master dataset
master <- readRDS("~/Dropbox/GLASS Lab/OT Study/data/cleaned-data/selfreports_oxtr_cortisol_random_AB_bx_clean.rds")
# subset the selected variables
subjvars <- subset(master, select=c(ID,age, age_yrs, sex_m, ethnicity_hisp, race, timesincedeath, rs2254298, rs2268498, rs53576, rs2254298_A.carrier, rs2268498_C.carrier, rs53576_A.carrier, tot_bdi, tot_bgq, tot_ecrrs_global_anx,tot_ecrrs_global_avoid, tot_ecrrs_spouse_anx, tot_ecrrs_spouse_avoid, tot_ysl, tot_icg))
head(subjvars)# add a group variable for CG/NCG
subjvars <- subjvars %>%
mutate(grp_cg = as.factor(ifelse(tot_icg >= 25, "CG", "NCG")))
# all of the OXTR vars should be factors but aren't
subjvars <- subjvars %>% mutate(rs2268498 = as.factor(rs2268498),
rs53576 = as.factor(rs53576))
# creating a wide dataset with the bias variables, which will then be converted into a long dataset
# The arguments to spread():
# - data: Data object
# - key: Name of column containing the new column names
# - value: Name of column containing values
data_wide <- spread(mlm_r1r2_long, key=stim, value=gAAT_RT)
colnames(data_wide) [1] "date" "time" "ID" "blockcode" "blocknum" "trialcode" "values.trialcode" "values.stimulus" "push_pull" "trialnum" "run"
[12] "visit" "cond_v1" "cond_v2" "cond" "outlier_RT" "neutral" "death" "living" "spouse" "stranger" View(data_wide)
# subset and remove outliers
data_pushA <- data_wide %>% select(ID, cond, push_pull, visit, outlier_RT, neutral, death, living, spouse, stranger) %>% filter(outlier_RT == "0" & cond == "A" & push_pull == "PUSH") %>% group_by(ID) %>% mutate(neutralApush = median(neutral, na.rm = TRUE), deathApush = median(death, na.rm = TRUE), spouseApush = median(spouse, na.rm=TRUE), livingApush = median(living, na.rm=TRUE), strangerApush = median(stranger, na.rm=TRUE))
data_pullA <- data_wide %>% select(ID, cond, push_pull, visit, outlier_RT, neutral, death, living, spouse, stranger) %>% filter(outlier_RT == "0" & cond == "A" & push_pull == "PULL") %>% group_by(ID) %>% mutate(neutralApull = median(neutral, na.rm = TRUE), deathApull = median(death, na.rm = TRUE), spouseApull = median(spouse, na.rm=TRUE), livingApull = median(living, na.rm=TRUE), strangerApull = median(stranger, na.rm=TRUE))
data_pushB <- data_wide %>% select(ID, cond, push_pull, visit, outlier_RT, neutral, death, living, spouse, stranger) %>% filter(outlier_RT == "0" & cond == "B" & push_pull == "PUSH") %>% group_by(ID) %>% mutate(neutralBpush = median(neutral, na.rm = TRUE), deathBpush = median(death, na.rm = TRUE), spouseBpush = median(spouse, na.rm=TRUE), livingBpush = median(living, na.rm=TRUE), strangerBpush = median(stranger, na.rm=TRUE))
data_pullB <- data_wide %>% select(ID, cond, push_pull, visit, outlier_RT, neutral, death, living, spouse, stranger) %>% filter(outlier_RT == "0" & cond == "B" & push_pull == "PULL") %>% group_by(ID) %>% mutate(neutralBpull = median(neutral, na.rm = TRUE), deathBpull = median(death, na.rm = TRUE), spouseBpull = median(spouse, na.rm=TRUE), livingBpull = median(living, na.rm=TRUE), strangerBpull = median(stranger, na.rm=TRUE))
# summarize by ID
data_pushA1 <- data_pushA[!duplicated(data_pushA$ID), ] %>% select(-c(neutral, death, living, spouse, stranger, visit, outlier_RT, cond, push_pull))
data_pushB1 <- data_pushB[!duplicated(data_pushB$ID), ] %>% select(-c(neutral, death, living, spouse, stranger, visit, outlier_RT, cond, push_pull))
data_pullA1 <- data_pullA[!duplicated(data_pullA$ID), ] %>% select(-c(neutral, death, living, spouse, stranger, visit, outlier_RT, cond, push_pull))
data_pullB1 <- data_pullB[!duplicated(data_pullB$ID), ] %>% select(-c(neutral, death, living, spouse, stranger, visit, outlier_RT, cond, push_pull))
head(data_pullB1)# merge the 4 subsets together
join1 <- left_join(data_pushA1, data_pushB1, by="ID")
join2 <- left_join(join1, data_pullA1, by = "ID")
medians <- left_join(join2, data_pullB1, by = "ID")
head(medians)medians1 <- medians %>% mutate(bias_neu_A = neutralApush - neutralApull,
bias_dea_A = deathApush - deathApull,
bias_spo_A = spouseApush - spouseApull,
bias_str_A = strangerApush - strangerApull,
bias_liv_A = livingApush - livingApull,
bias_neu_B = neutralBpush - neutralBpull,
bias_dea_B = deathBpush - deathApull,
bias_spo_B = spouseBpush - spouseBpull,
bias_str_B = strangerBpush - strangerBpull,
bias_liv_B = livingBpush - livingBpull
)
# now add the grp_cg/oxtr/self-report variables
medians2 <- left_join(medians1, subjvars, by="ID")
head(medians2)# drop the condition/stim specific variables
medians2 <- medians2 %>% select(-c(neutralApush, deathApush, spouseApush, livingApush, strangerApush, neutralBpush, deathBpush, spouseBpush, livingBpush, strangerBpush, neutralApull, deathApull, spouseApull, livingApull, strangerApull, neutralBpull, deathBpull, spouseBpull, livingBpull, strangerBpull))
colnames(medians2) [1] "ID" "bias_neu_A" "bias_dea_A" "bias_spo_A" "bias_str_A" "bias_liv_A" "bias_neu_B" "bias_dea_B"
[9] "bias_spo_B" "bias_str_B" "bias_liv_B" "age" "age_yrs" "sex_m" "ethnicity_hisp" "race"
[17] "timesincedeath" "rs2254298" "rs2268498" "rs53576" "rs2254298_A.carrier" "rs2268498_C.carrier" "rs53576_A.carrier" "tot_bdi"
[25] "tot_bgq" "tot_ecrrs_global_anx" "tot_ecrrs_global_avoid" "tot_ecrrs_spouse_anx" "tot_ecrrs_spouse_avoid" "tot_ysl" "tot_icg" "grp_cg" # turn it into a long dataset
medians_long <- gather(medians2,
key = "stim",
value = "bias", -c(ID,age, age_yrs, sex_m, ethnicity_hisp, race, timesincedeath, rs2254298, rs2268498, rs53576, rs2254298_A.carrier, rs2268498_C.carrier, rs53576_A.carrier, tot_bdi, tot_bgq, tot_ecrrs_global_anx,tot_ecrrs_global_avoid, tot_ecrrs_spouse_anx, tot_ecrrs_spouse_avoid, tot_ysl, tot_icg, grp_cg))
str(medians_long)Classes ‘grouped_df’, ‘tbl_df’, ‘tbl’ and 'data.frame': 390 obs. of 24 variables:
$ ID : chr "D101" "D105" "D110" "D114" ...
$ age : num 25597 26613 25049 27122 28295 ...
$ age_yrs : num 70.1 72.9 68.6 74.3 77.5 ...
$ sex_m : Ord.factor w/ 2 levels "female"<"male": 2 1 1 1 2 1 2 1 1 1 ...
$ ethnicity_hisp : Ord.factor w/ 2 levels "not Hispanic or Latino"<..: 1 1 1 1 1 1 1 1 1 1 ...
$ race : Factor w/ 2 levels "White","Other (specify)": 1 1 1 1 1 1 1 1 1 1 ...
$ timesincedeath : num 402 317 277 934 281 ...
$ rs2254298 : Factor w/ 2 levels "GG","A/G": 1 1 2 2 1 1 1 1 1 2 ...
$ rs2268498 : Factor w/ 3 levels "C/T","CC","TT": 1 1 1 1 3 2 1 1 2 2 ...
$ rs53576 : Factor w/ 2 levels "A/G","GG": 1 2 2 1 2 1 1 1 2 1 ...
$ rs2254298_A.carrier : Ord.factor w/ 2 levels "0"<"1": 1 1 2 2 1 1 1 1 1 2 ...
$ rs2268498_C.carrier : Ord.factor w/ 2 levels "0"<"1": 2 2 2 2 1 2 2 2 2 2 ...
$ rs53576_A.carrier : Ord.factor w/ 2 levels "0"<"1": 2 1 1 2 1 2 2 2 1 2 ...
$ tot_bdi : num 3 14 6 8 2 5 5 3 5 0 ...
$ tot_bgq : num 6 11 9 9 9 10 8 9 8 6 ...
$ tot_ecrrs_global_anx : num 3.33 2.33 3.33 1.33 4 ...
$ tot_ecrrs_global_avoid: num 1 3.5 4.17 4.5 3.33 ...
$ tot_ecrrs_spouse_anx : num 1 1 1 2.67 1 ...
$ tot_ecrrs_spouse_avoid: num 1 1 1.17 2.83 2.33 ...
$ tot_ysl : num 44 77 48 45 62 79 57 41 49 55 ...
$ tot_icg : num 7 27 21 6 26 22 10 12 16 19 ...
$ grp_cg : Factor w/ 2 levels "CG","NCG": 2 1 2 2 1 2 2 2 2 2 ...
$ stim : chr "bias_neu_A" "bias_neu_A" "bias_neu_A" "bias_neu_A" ...
$ bias : num 52 32 -76 11 -60 129 47.5 -4 1 29.5 ...
- attr(*, "vars")= chr "ID"
- attr(*, "drop")= logi TRUE
- attr(*, "indices")=List of 39
..$ : int 0 39 78 117 156 195 234 273 312 351
..$ : int 20 59 98 137 176 215 254 293 332 371
..$ : int 21 60 99 138 177 216 255 294 333 372
..$ : int 22 61 100 139 178 217 256 295 334 373
..$ : int 1 40 79 118 157 196 235 274 313 352
..$ : int 23 62 101 140 179 218 257 296 335 374
..$ : int 2 41 80 119 158 197 236 275 314 353
..$ : int 24 63 102 141 180 219 258 297 336 375
..$ : int 3 42 81 120 159 198 237 276 315 354
..$ : int 4 43 82 121 160 199 238 277 316 355
..$ : int 5 44 83 122 161 200 239 278 317 356
..$ : int 6 45 84 123 162 201 240 279 318 357
..$ : int 7 46 85 124 163 202 241 280 319 358
..$ : int 8 47 86 125 164 203 242 281 320 359
..$ : int 25 64 103 142 181 220 259 298 337 376
..$ : int 26 65 104 143 182 221 260 299 338 377
..$ : int 9 48 87 126 165 204 243 282 321 360
..$ : int 27 66 105 144 183 222 261 300 339 378
..$ : int 10 49 88 127 166 205 244 283 322 361
..$ : int 28 67 106 145 184 223 262 301 340 379
..$ : int 11 50 89 128 167 206 245 284 323 362
..$ : int 29 68 107 146 185 224 263 302 341 380
..$ : int 30 69 108 147 186 225 264 303 342 381
..$ : int 31 70 109 148 187 226 265 304 343 382
..$ : int 12 51 90 129 168 207 246 285 324 363
..$ : int 32 71 110 149 188 227 266 305 344 383
..$ : int 33 72 111 150 189 228 267 306 345 384
..$ : int 13 52 91 130 169 208 247 286 325 364
..$ : int 14 53 92 131 170 209 248 287 326 365
..$ : int 15 54 93 132 171 210 249 288 327 366
..$ : int 34 73 112 151 190 229 268 307 346 385
..$ : int 16 55 94 133 172 211 250 289 328 367
..$ : int 17 56 95 134 173 212 251 290 329 368
..$ : int 35 74 113 152 191 230 269 308 347 386
..$ : int 36 75 114 153 192 231 270 309 348 387
..$ : int 18 57 96 135 174 213 252 291 330 369
..$ : int 37 76 115 154 193 232 271 310 349 388
..$ : int 38 77 116 155 194 233 272 311 350 389
..$ : int 19 58 97 136 175 214 253 292 331 370
- attr(*, "group_sizes")= int 10 10 10 10 10 10 10 10 10 10 ...
- attr(*, "biggest_group_size")= int 10
- attr(*, "labels")='data.frame': 39 obs. of 1 variable:
..$ ID: chr "D101" "D102" "D103" "D104" ...
..- attr(*, "vars")= chr "ID"
..- attr(*, "drop")= logi TRUE# create new columns for stimulus category and condition
medians_long$cond <- as.factor(ifelse(grepl("*_A", data_long$stim), "A", "B"))
medians_long$stimulus <- as.factor(ifelse(grepl("*neu*", data_long$stim), "neutral",
ifelse(grepl("*dea*", data_long$stim), "death",
ifelse(grepl("*spo*", data_long$stim), "spouse",
ifelse(grepl("*str*", data_long$stim), "stranger",
ifelse(grepl("*liv*", data_long$stim), "living", NA))))))
View(medians_long) # 390 obs. of 26 vars, that's correct
library(psych)
describe(medians_long$bias) # skewness is -.07, kurtosis is 1.57, SD = 74.95 vars n mean sd median trimmed mad min max range skew kurtosis se
X1 1 390 14.38 74.94 13.75 14.08 64.12 -284 295 579 -0.07 1.57 3.79hist(medians_long$bias)
qqnorm(medians_long$bias) # not terrible, but definitely some outliers
# check out the outliers
## function from https://stackoverflow.com/questions/12866189/calculating-the-outliers-in-r
outfun <- function(x) {
abs(x-mean(x,na.rm=TRUE)) > 3*sd(x,na.rm=TRUE)
}
# add a variable for outlier = T/F
medians_long$outlier <- outfun(medians_long$bias)
table(medians_long$outlier) # 5 observations where outlier = TRUE
FALSE TRUE
385 5 # which are these?
medians_long %>% filter(outlier==TRUE)-
D137 death A (-284.0) D145 death A (-247.5) D137 death B (-261.0) D147 death B (295.0) D139 spouse B (275.5)
What’s interesting here is that 4/5 of the outliers are in the CG group, and 3/4 of those show extreme avoidance bias to death stimuli. D137 has an extreme avoidance bias to death in both A and B. The the remaining two are extreme approach biases to death and spouse (NCG, condition B).
D147 will be dropped in the next chunk (low trial count), the others…??
Dropping the 4 people with low trial counts
medians_long.1 <- filter(medians_long, !grepl("D101|D141|D147|D148",ID))
unique(medians_long.1$ID) # dropped the 4 participantsBoxplots
panelbystim <- ggplot(medians_long.1, aes(fill=cond, y=bias, x=grp_cg)) +
geom_boxplot(aes(fill=cond), outlier.alpha = 0.3)
p1 <- panelbystim + facet_grid(. ~ stimulus) + theme(strip.text.x = element_text(size=12, color="red",
face="bold.italic"),
strip.text.y = element_text(size=12, color="red",
face="bold.italic")) + geom_hline(yintercept=0, linetype="solid", color="black", size=.5) + xlab("Group") + ylab("Avoid bias Approach bias")
panelbyCG <- ggplot(medians_long.1, aes(fill=cond, y=bias, x=stimulus)) +
geom_boxplot(aes(fill=cond), outlier.alpha = 0.3)
p2 <- panelbyCG + facet_grid(. ~ grp_cg) + theme(strip.text.x = element_text(size=12, color="red",
face="bold.italic"),
strip.text.y = element_text(size=12, color="red",
face="bold.italic")) + geom_hline(yintercept=0, linetype="solid", color="black", size=.5) + xlab("Stimuli") + ylab("Avoid bias Approach bias")
# What do the boxplots look like after excluding the outliers identified above?
medians_long.2 <- medians_long.1 %>% mutate(bias_no.out = ifelse(outlier==FALSE, bias, NA)) %>% filter(!is.na(bias_no.out))
View(medians_long.2)
panelbystim.2 <- ggplot(medians_long.2, aes(fill=cond, y=bias_no.out, x=grp_cg)) +
geom_boxplot(aes(fill=cond), outlier.alpha = 0.3)
p3 <- panelbystim.2 + facet_grid(. ~ stimulus) + theme(strip.text.x = element_text(size=12, color="red",
face="bold.italic"),
strip.text.y = element_text(size=12, color="red",
face="bold.italic")) + geom_hline(yintercept=0, linetype="solid", color="black", size=.5) + xlab("Group") + ylab("Avoid bias Approach bias")
panelbyCG.2 <- ggplot(medians_long.2, aes(fill=cond, y=bias_no.out, x=stimulus)) +
geom_boxplot(aes(fill=cond), outlier.alpha = 0.3)
p4 <- panelbyCG.2 + facet_grid(. ~ grp_cg) + theme(strip.text.x = element_text(size=12, color="red",
face="bold.italic"),
strip.text.y = element_text(size=12, color="red",
face="bold.italic")) + geom_hline(yintercept=0, linetype="solid", color="black", size=.5) + xlab("Stimuli") + ylab("Avoid bias Approach bias")
p1 # with outliers
p3 # no outliers
p2 # with outliers
p4 # no outliers
Note that the error bars are wayyyy wider if outliers not dropped.
Use plotly to explore outliers and stats
The plotly package allows you to interactively explore your ggplot objects. Conditions A/B are plotted on top of each other, which makes it hard to see both together, but you can click the legend to show just A or just B, which is pretty cool (see https://plot.ly/r/getting-started/ for more info). It doesn’t seem to ID all of the same outliers that ggplot2’s geom_boxplot does, but does provide a way to look at the values for some of them at least.
# install.packages("plotly")
# install.packages("shiny")
library(plotly)
Attaching package: ‘plotly’
The following object is masked from ‘package:ggplot2’:
last_plot
The following object is masked from ‘package:stats’:
filter
The following object is masked from ‘package:graphics’:
layoutlibrary(shiny)
ggplotly(p1) # with outliers
ggplotly(p3) # no outliers
ggplotly(p2) # with outliers
ggplotly(p4) # no outliers[Spouse/Living/Death/Stranger] vs. Neutral plots
# computing bias relative to neutral:
medians3 <- medians2 %>% mutate(diff_bias_spo_A = bias_spo_A - bias_neu_A,
diff_bias_str_A = bias_str_A - bias_neu_A,
diff_bias_liv_A = bias_liv_A - bias_neu_A,
diff_bias_dea_A = bias_dea_A - bias_neu_A,
diff_bias_spo_B = bias_spo_B - bias_neu_B,
diff_bias_str_B = bias_str_B - bias_neu_B,
diff_bias_liv_B = bias_liv_B - bias_neu_B,
diff_bias_dea_B = bias_dea_B - bias_neu_B)
View(medians3)
data_long2 <- gather(medians3,
key = "stim",
value = "diff_bias", -ID, -grp_cg)attributes are not identical across measure variables;
they will be droppeddata_long3 <- filter(data_long2, grepl("^diff",stim))
data_long3$cond <- as.factor(ifelse(grepl("*_A", data_long3$stim), "A", "B"))
data_long3$stimulus <- as.factor(ifelse(grepl("*dea*", data_long3$stim), "death-neu",
ifelse(grepl("*spo*", data_long3$stim), "spouse-neu",
ifelse(grepl("*str*", data_long3$stim), "stranger-neu",
ifelse(grepl("*liv*", data_long3$stim), "living-neu", NA)))))
minus_neu <- data_long3
View(minus_neu)
# diff_bias is chr rather than num for some reason
minus_neu$diff_bias <-as.numeric(minus_neu$diff_bias)
describe(minus_neu$diff_bias) # skewness is -0.16, kurtosis is .95 vars n mean sd median trimmed mad min max range skew kurtosis se
X1 1 312 16.62 85.94 13.75 17.65 83.77 -304.5 292.5 597 -0.16 0.95 4.87hist(minus_neu$diff_bias) # not bad
qqnorm(minus_neu$diff_bias) # not too bad, but definitely a few extreme values
# panel by stimulus category
panelbystim_diff <- ggplot(minus_neu, aes(fill=cond, y=diff_bias, x=grp_cg)) +
geom_boxplot(aes(fill=cond), outlier.alpha = 0.3)
p5 <- panelbystim_diff + facet_grid(. ~ stimulus) + theme(strip.text.x = element_text(size=12, color="red",
face="bold.italic"),
strip.text.y = element_text(size=12, color="red",
face="bold.italic")) + geom_hline(yintercept=0, linetype="solid", color="black", size=.5) + xlab("Group") + ylab("Avoid bias Approach bias")
p5
ggplotly(p5)
# panel by group
panelbyCG_diff <- ggplot(minus_neu, aes(fill=cond, y=diff_bias, x=stimulus)) +
geom_boxplot(aes(fill=cond), outlier.alpha = 0.3)
p6 <- panelbyCG_diff + facet_grid(. ~ grp_cg) + theme(strip.text.x = element_text(size=12, color="red",
face="bold.italic"),
strip.text.y = element_text(size=12, color="red",
face="bold.italic")) + geom_hline(yintercept=0, linetype="solid", color="black", size=.5) + xlab("Group") + ylab("Avoid bias Approach bias")
p6
ggplotly(p6)
# dropping low-trial count people
minus_neu.1 <- filter(minus_neu, !grepl("D101|D141|D147|D148",ID))
# panel by stimulus category
panelbystim_diff.1 <- ggplot(minus_neu.1, aes(fill=cond, y=diff_bias, x=grp_cg)) +
geom_boxplot(aes(fill=cond), outlier.alpha = 0.3)
p7 <- panelbystim_diff.1 + facet_grid(. ~ stimulus) + theme(strip.text.x = element_text(size=12, color="red",
face="bold.italic"),
strip.text.y = element_text(size=12, color="red",
face="bold.italic")) + geom_hline(yintercept=0, linetype="solid", color="black", size=.5) + xlab("Group") + ylab("Avoid bias Approach bias")
p7
ggplotly(p7)
# panel by group
panelbyCG_diff.1 <- ggplot(minus_neu.1, aes(fill=cond, y=diff_bias, x=stimulus)) +
geom_boxplot(aes(fill=cond), outlier.alpha = 0.3)
p8 <- panelbyCG_diff.1 + facet_grid(. ~ grp_cg) + theme(strip.text.x = element_text(size=12, color="red",
face="bold.italic"),
strip.text.y = element_text(size=12, color="red",
face="bold.italic")) + geom_hline(yintercept=0, linetype="solid", color="black", size=.5) + xlab("Group") + ylab("Avoid bias Approach bias")
p8
ggplotly(p8)Spouse vs. Stranger plots
# computing spouse vs. stranger
medians4 <- medians3 %>% mutate(spo_vs_str_A = bias_spo_A - bias_str_A,
spo_vs_str_B = bias_spo_B - bias_str_B,
liv_vs_str_A = bias_liv_A - bias_str_A,
liv_vs_str_B = bias_liv_B - bias_str_B)
data_long4 <- gather(data_means4,
key = "stim",
value = "diff_bias", -ID, -grp_cg)
data_long4 <- filter(data_long4, grepl("^spo_|^liv_",stim))
data_long4$cond <- as.factor(ifelse(grepl("*_A", data_long4$stim), "A", "B"))
data_long4$stimulus <- as.factor(ifelse(grepl("*spo*", data_long4$stim), "spouse-stranger",
ifelse(grepl("*liv*", data_long4$stim), "living-stranger", NA)))
spouse_vs_str <- data_long4
View(spouse_vs_str)# panel by stimulus category
panelbystim_diff2 <- ggplot(spouse_vs_str, aes(fill=cond, y=diff_bias, x=grp_cg)) +
geom_boxplot(aes(fill=cond), outlier.alpha = 0.3)
p9 <- panelbystim_diff2 + facet_grid(. ~ stimulus) + theme(strip.text.x = element_text(size=12, color="red",
face="bold.italic"),
strip.text.y = element_text(size=12, color="red",
face="bold.italic")) + geom_hline(yintercept=0, linetype="solid", color="black", size=.5) + xlab("Group") + ylab("Avoid bias Approach bias")
p9
ggplotly(p9)
# panel by group
panelbyCG_diff2 <- ggplot(spouse_vs_str, aes(fill=cond, y=diff_bias, x=stimulus)) +
geom_boxplot(aes(fill=cond), outlier.alpha = 0.3)
p10 <- panelbyCG_diff2 + facet_grid(. ~ grp_cg) + theme(strip.text.x = element_text(size=12, color="red",
face="bold.italic"),
strip.text.y = element_text(size=12, color="red",
face="bold.italic")) + geom_hline(yintercept=0, linetype="solid", color="black", size=.5) + xlab("Group") + ylab("Avoid bias Approach bias")
p10
ggplotly(p10)
# dropping low-trial count people
spouse_vs_str.1 <- filter(spouse_vs_str, !grepl("D101|D141|D147|D148",ID))
# panel by stimulus category
panelbystim_diff2.1 <- ggplot(spouse_vs_str.1, aes(fill=cond, y=diff_bias, x=grp_cg)) +
geom_boxplot(aes(fill=cond), outlier.alpha = 0.3)
p11 <- panelbystim_diff2.1 + facet_grid(. ~ stimulus) + theme(strip.text.x = element_text(size=12, color="red",
face="bold.italic"),
strip.text.y = element_text(size=12, color="red",
face="bold.italic")) + geom_hline(yintercept=0, linetype="solid", color="black", size=.5) + xlab("Group") + ylab("Avoid bias Approach bias")
p11
ggplotly(p11)
# panel by group
panelbyCG_diff2.1 <- ggplot(spouse_vs_str.1, aes(fill=cond, y=diff_bias, x=stimulus)) +
geom_boxplot(aes(fill=cond), outlier.alpha = 0.3)
p12 <- panelbyCG_diff2.1 + facet_grid(. ~ grp_cg) + theme(strip.text.x = element_text(size=12, color="red",
face="bold.italic"),
strip.text.y = element_text(size=12, color="red",
face="bold.italic")) + geom_hline(yintercept=0, linetype="solid", color="black", size=.5) + xlab("Group") + ylab("Avoid bias Approach bias")
p12
ggplotly(p12)Regressions
# predict from stimulus
m1 <- lm(bias ~ stimulus, data=medians_long.3)
summary(m1)
Call:
lm(formula = bias ~ stimulus, data = medians_long.3)
Residuals:
Min 1Q Median 3Q Max
-211.214 -42.371 2.786 39.877 176.710
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 1.5896 8.0430 0.198 0.84345
stimulusliving 24.1247 11.2520 2.144 0.03274 *
stimulusneutral -1.8681 11.2520 -0.166 0.86823
stimulusspouse 36.7003 11.2918 3.250 0.00127 **
stimulusstranger -0.4324 11.2520 -0.038 0.96937
---
Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1
Residual standard error: 65.83 on 341 degrees of freedom
Multiple R-squared: 0.05517, Adjusted R-squared: 0.04408
F-statistic: 4.977 on 4 and 341 DF, p-value: 0.0006538# predict from condition
m2 <- lm(bias ~ cond, data=medians_long.3)
summary(m2)
Call:
lm(formula = bias ~ cond, data = medians_long.3)
Residuals:
Min 1Q Median 3Q Max
-206.142 -43.290 -2.142 43.767 201.494
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 13.1416 5.1269 2.563 0.0108 *
condB 0.3642 7.2505 0.050 0.9600
---
Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1
Residual standard error: 67.43 on 344 degrees of freedom
Multiple R-squared: 7.333e-06, Adjusted R-squared: -0.0029
F-statistic: 0.002523 on 1 and 344 DF, p-value: 0.96# predict from stimulus*condition
m3 <- lm(bias ~ stimulus*cond, data=medians_long.3)
summary(m3)
Call:
lm(formula = bias ~ stimulus * cond, data = medians_long.3)
Residuals:
Min 1Q Median 3Q Max
-204.186 -43.439 2.779 37.625 175.809
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) -5.485 11.518 -0.476 0.63425
stimulusliving 38.228 16.055 2.381 0.01782 *
stimulusneutral 5.756 16.055 0.359 0.72017
stimulusspouse 42.899 16.055 2.672 0.00791 **
stimulusstranger 5.185 16.055 0.323 0.74694
condB 13.941 16.169 0.862 0.38920
stimulusliving:condB -27.998 22.619 -1.238 0.21665
stimulusneutral:condB -15.041 22.619 -0.665 0.50653
stimulusspouse:condB -12.164 22.700 -0.536 0.59242
stimulusstranger:condB -11.026 22.619 -0.487 0.62623
---
Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1
Residual standard error: 66.17 on 336 degrees of freedom
Multiple R-squared: 0.0596, Adjusted R-squared: 0.03441
F-statistic: 2.366 on 9 and 336 DF, p-value: 0.01328# predict from stimulus*condition*group
m4 <- lm(bias ~ stimulus*cond*grp_cg, data=medians_long.3)
summary(m4)
Call:
lm(formula = bias ~ stimulus * cond * grp_cg, data = medians_long.3)
Residuals:
Min 1Q Median 3Q Max
-216.321 -42.661 -0.645 44.052 182.711
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) -16.5769 18.2348 -0.909 0.364
stimulusliving 38.4436 24.9135 1.543 0.124
stimulusneutral -0.5897 24.9135 -0.024 0.981
stimulusspouse 31.4769 24.9135 1.263 0.207
stimulusstranger -9.8231 24.9135 -0.394 0.694
condB 40.8984 25.3233 1.615 0.107
grp_cgNCG 18.3019 23.4231 0.781 0.435
stimulusliving:condB -37.0984 34.8944 -1.063 0.288
stimulusneutral:condB -29.5984 34.8944 -0.848 0.397
stimulusspouse:condB -7.8650 34.8944 -0.225 0.822
stimulusstranger:condB -28.1650 34.8944 -0.807 0.420
stimulusliving:grp_cgNCG 0.7314 32.4491 0.023 0.982
stimulusneutral:grp_cgNCG 12.2147 32.4491 0.376 0.707
stimulusspouse:grp_cgNCG 21.0981 32.4491 0.650 0.516
stimulusstranger:grp_cgNCG 27.3731 32.4491 0.844 0.400
condB:grp_cgNCG -45.2734 32.7648 -1.382 0.168
stimulusliving:condB:grp_cgNCG 14.0234 45.6305 0.307 0.759
stimulusneutral:condB:grp_cgNCG 23.5734 45.6305 0.517 0.606
stimulusspouse:condB:grp_cgNCG -9.7705 45.7550 -0.214 0.831
stimulusstranger:condB:grp_cgNCG 28.0900 45.6305 0.616 0.539
Residual standard error: 65.75 on 326 degrees of freedom
Multiple R-squared: 0.09915, Adjusted R-squared: 0.04664
F-statistic: 1.888 on 19 and 326 DF, p-value: 0.01431# predict from stimulus + condition*group
m5 <- lm(bias ~ stimulus + cond*grp_cg, data=medians_long.3)
summary(m5)
Call:
lm(formula = bias ~ stimulus + cond * grp_cg, data = medians_long.3)
Residuals:
Min 1Q Median 3Q Max
-210.25 -41.33 -0.83 43.29 177.69
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) -16.78345 10.55990 -1.589 0.112915
stimulusliving 24.62532 11.14989 2.209 0.027875 *
stimulusneutral -1.36754 11.14989 -0.123 0.902457
stimulusspouse 37.18685 11.19033 3.323 0.000988 ***
stimulusstranger 0.06817 11.14989 0.006 0.995125
condB 20.07815 10.76037 1.866 0.062916 .
grp_cgNCG 30.59089 10.04317 3.046 0.002502 **
condB:grp_cgNCG -33.76508 14.18831 -2.380 0.017877 *
---
Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1
Residual standard error: 65.23 on 338 degrees of freedom
Multiple R-squared: 0.08069, Adjusted R-squared: 0.06165
F-statistic: 4.238 on 7 and 338 DF, p-value: 0.0001679cat_plot(m5, pred="grp_cg", modx = "cond", plot.points=T, jitter=0.1, point.shape=T)
# predict from stimulus*condition + group
m6 <- lm(bias ~ stimulus*cond + grp_cg, data=medians_long.3)
summary(m6)
Call:
lm(formula = bias ~ stimulus * cond + grp_cg, data = medians_long.3)
Residuals:
Min 1Q Median 3Q Max
-210.069 -42.615 0.774 40.045 169.752
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) -13.805 12.268 -1.125 0.26129
stimulusliving 38.703 15.993 2.420 0.01605 *
stimulusneutral 6.232 15.993 0.390 0.69705
stimulusspouse 43.375 15.993 2.712 0.00703 **
stimulusstranger 5.660 15.993 0.354 0.72363
condB 14.185 16.106 0.881 0.37907
grp_cgNCG 13.728 7.170 1.915 0.05639 .
stimulusliving:condB -28.243 22.530 -1.254 0.21088
stimulusneutral:condB -15.285 22.530 -0.678 0.49796
stimulusspouse:condB -12.236 22.611 -0.541 0.58877
stimulusstranger:condB -11.271 22.530 -0.500 0.61721
---
Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1
Residual standard error: 65.91 on 335 degrees of freedom
Multiple R-squared: 0.06978, Adjusted R-squared: 0.04201
F-statistic: 2.513 on 10 and 335 DF, p-value: 0.006337anova(m1,m2) # m2 > m1Analysis of Variance Table
Model 1: bias ~ stimulus
Model 2: bias ~ cond
Res.Df RSS Df Sum of Sq F Pr(>F)
1 341 1477973
2 344 1564255 -3 -86282 6.6357 0.0002286 ***
---
Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1anova(m2,m3) # m3 > m2Analysis of Variance Table
Model 1: bias ~ cond
Model 2: bias ~ stimulus * cond
Res.Df RSS Df Sum of Sq F Pr(>F)
1 344 1564255
2 336 1471036 8 93219 2.6615 0.007619 **
---
Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1anova(m3,m4) # nsAnalysis of Variance Table
Model 1: bias ~ stimulus * cond
Model 2: bias ~ stimulus * cond * grp_cg
Res.Df RSS Df Sum of Sq F Pr(>F)
1 336 1471036
2 326 1409176 10 61860 1.4311 0.1651anova(m4,m5) # nsAnalysis of Variance Table
Model 1: bias ~ stimulus * cond * grp_cg
Model 2: bias ~ stimulus + cond * grp_cg
Res.Df RSS Df Sum of Sq F Pr(>F)
1 326 1409176
2 338 1438043 -12 -28867 0.5565 0.8761anova(m4,m6) # nsAnalysis of Variance Table
Model 1: bias ~ stimulus * cond * grp_cg
Model 2: bias ~ stimulus * cond + grp_cg
Res.Df RSS Df Sum of Sq F Pr(>F)
1 326 1409176
2 335 1455112 -9 -45937 1.1808 0.3064# predict from stimulus*condition*tot_icg
m7 <- lm(bias ~ stimulus*cond*tot_icg, data=medians_long.3)
summary(m7) # the tot_icg*cond interaction is a significant predictor, t = 2.522, p = .012
Call:
lm(formula = bias ~ stimulus * cond * tot_icg, data = medians_long.3)
Residuals:
Min 1Q Median 3Q Max
-207.64 -41.77 -1.76 43.87 177.39
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 39.9964 23.8580 1.676 0.0946 .
stimulusliving 20.3388 33.6526 0.604 0.5460
stimulusneutral -13.9277 33.6526 -0.414 0.6792
stimulusspouse 38.2107 33.6526 1.135 0.2570
stimulusstranger 10.2604 33.6526 0.305 0.7606
condB -61.1171 33.7395 -1.811 0.0710 .
tot_icg -2.0337 0.9399 -2.164 0.0312 *
stimulusliving:condB -10.1968 47.5913 -0.214 0.8305
stimulusneutral:condB 26.6026 47.5913 0.559 0.5766
stimulusspouse:condB 13.1576 47.7113 0.276 0.7829
stimulusstranger:condB 45.4550 47.5913 0.955 0.3402
stimulusliving:tot_icg 0.8311 1.3136 0.633 0.5274
stimulusneutral:tot_icg 0.9093 1.3136 0.692 0.4893
stimulusspouse:tot_icg 0.2557 1.3136 0.195 0.8458
stimulusstranger:tot_icg -0.1699 1.3136 -0.129 0.8972
condB:tot_icg 3.3465 1.3271 2.522 0.0122 *
stimulusliving:condB:tot_icg -0.8509 1.8561 -0.458 0.6470
stimulusneutral:condB:tot_icg -1.8901 1.8561 -1.018 0.3093
stimulusspouse:condB:tot_icg -1.1811 1.8573 -0.636 0.5253
stimulusstranger:condB:tot_icg -2.5368 1.8561 -1.367 0.1726
---
Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1
Residual standard error: 64.83 on 326 degrees of freedom
Multiple R-squared: 0.1241, Adjusted R-squared: 0.073
F-statistic: 2.43 on 19 and 326 DF, p-value: 0.0008619# no 3-way interaction
interact_plot(m7, pred="tot_icg", modx = "cond", plot.points=T, jitter=0.1, point.shape=T)
Note that in the last plot, people in the CG group shows increased approach bias under condition B.
Exploratory analyses with the genotype data
I wanted to take a look at attachment styles, OXTR genotype, and condition. All of the ECRRS variables are super negatively skewed. I tried some transformations using bestNormalize but their recommendations didn’t help much. However, the residuals for the models do look okay imo. But do bear that in mind as you look at these.
Also, keep in mind that this is still the long dataset, so each person has multiple observations of the bias score. This makes it look like there are more datapoints than there are, and I’m not sure if this is correct because it doesn’t model the interdependence in the data.
# library(bestNormalize)
# norm <- bestNormalize(medians_long.3$tot_ecrrs_spouse_anx)
# medians_long.3$tot_ecrrs_spouse_anx_t <- norm$x.t # pull x.t from norm and assign it back into dataset
# hist(medians_long.3$tot_ecrrs_spouse_anx_t)
# The recent Schiele et al. paper on CG, rs2254298, behavioral inhibition and separation anxiety found:
# - No significant main effect of OXTR genotype on ICG score (same as we found)
# - Significant interaction of OXTR x behavioral inhibition on ICG score
# - Marginal interaction of OXTR x adult separation anxiety on ICG score
m8 <- lm(bias ~ stimulus*cond+tot_ecrrs_global_anx, data=medians_long.3)
summary(m8) # interesting - GLOBAL anxious attachment style OVERALL predicts bias
Call:
lm(formula = bias ~ stimulus * cond + tot_ecrrs_global_anx, data = medians_long.3)
Residuals:
Min 1Q Median 3Q Max
-210.349 -39.758 -0.459 40.775 169.249
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 12.021 13.760 0.874 0.38296
stimulusliving 38.429 15.954 2.409 0.01655 *
stimulusneutral 5.957 15.954 0.373 0.70909
stimulusspouse 43.100 15.954 2.701 0.00725 **
stimulusstranger 5.386 15.954 0.338 0.73589
condB 13.641 16.068 0.849 0.39652
tot_ecrrs_global_anx -5.484 2.393 -2.292 0.02253 *
stimulusliving:condB -27.698 22.477 -1.232 0.21872
stimulusneutral:condB -14.741 22.477 -0.656 0.51240
stimulusspouse:condB -12.042 22.558 -0.534 0.59381
stimulusstranger:condB -10.727 22.477 -0.477 0.63352
---
Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1
Residual standard error: 65.75 on 335 degrees of freedom
Multiple R-squared: 0.07412, Adjusted R-squared: 0.04648
F-statistic: 2.682 on 10 and 335 DF, p-value: 0.003604qqnorm(resid(m8))
m9 <- lm(bias ~ stimulus+cond+tot_ecrrs_spouse_anx, data=medians_long.3)
summary(m9) # but SPOUSE anxious attachment style does NOT predict bias
Call:
lm(formula = bias ~ stimulus + cond + tot_ecrrs_spouse_anx, data = medians_long.3)
Residuals:
Min 1Q Median 3Q Max
-212.285 -42.418 0.487 38.900 175.662
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 7.1528 10.2102 0.701 0.48406
stimulusliving 24.3143 11.2649 2.158 0.03160 *
stimulusneutral -1.6786 11.2649 -0.149 0.88163
stimulusspouse 36.8675 11.3047 3.261 0.00122 **
stimulusstranger -0.2429 11.2649 -0.022 0.98281
condB 0.5470 7.0862 0.077 0.93851
tot_ecrrs_spouse_anx -2.6147 2.2984 -1.138 0.25608
---
Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1
Residual standard error: 65.9 on 339 degrees of freedom
Multiple R-squared: 0.05878, Adjusted R-squared: 0.04212
F-statistic: 3.528 on 6 and 339 DF, p-value: 0.002115qqnorm(resid(m9))
m10 <- lm(bias ~ stimulus+cond+tot_ecrrs_spouse_anx*rs2268498, data=medians_long.3)
summary(m10) # SPOUSE anxious attachment style DOES predict bias in interaction with rs2268498, p = .009 (this also works with rs2268498_C.carrier)
Call:
lm(formula = bias ~ stimulus + cond + tot_ecrrs_spouse_anx *
rs2268498, data = medians_long.3)
Residuals:
Min 1Q Median 3Q Max
-230.84 -40.28 2.06 39.51 169.01
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 8.7028 12.2860 0.708 0.479220
stimulusliving 24.7203 11.0979 2.227 0.026579 *
stimulusneutral -1.2725 11.0979 -0.115 0.908780
stimulusspouse 37.4645 11.1385 3.364 0.000859 ***
stimulusstranger 0.1632 11.0979 0.015 0.988277
condB 0.5418 6.9792 0.078 0.938165
tot_ecrrs_spouse_anx -5.4620 3.8413 -1.422 0.155983
rs2268498CC -25.5855 15.0986 -1.695 0.091087 .
rs2268498TT 20.9495 15.4776 1.354 0.176797
tot_ecrrs_spouse_anx:rs2268498CC 15.1189 5.7161 2.645 0.008555 **
tot_ecrrs_spouse_anx:rs2268498TT -5.3741 5.4725 -0.982 0.326802
---
Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1
Residual standard error: 64.9 on 335 degrees of freedom
Multiple R-squared: 0.09785, Adjusted R-squared: 0.07092
F-statistic: 3.634 on 10 and 335 DF, p-value: 0.0001296qqnorm(resid(m10))
interact_plot(m10, pred="tot_ecrrs_spouse_anx", modx = "rs2268498", plot.points=T, jitter=0.1, point.shape=T)
m11 <- lm(bias ~ stimulus+cond+tot_ecrrs_spouse_anx*rs2254298, data=medians_long.3)
summary(m11) # but SPOUSE anxious attachment style does not significantly predict bias in interaction with rs2254298, p = .066
Call:
lm(formula = bias ~ stimulus + cond + tot_ecrrs_spouse_anx *
rs2254298, data = medians_long.3)
Residuals:
Min 1Q Median 3Q Max
-211.34 -41.97 2.42 38.87 165.22
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 11.5514 11.0908 1.042 0.29840
stimulusliving 22.6773 11.2490 2.016 0.04462 *
stimulusneutral -1.9845 11.2490 -0.176 0.86008
stimulusspouse 33.6134 11.2899 2.977 0.00313 **
stimulusstranger -3.5066 11.2490 -0.312 0.75545
condB -0.1525 7.0749 -0.022 0.98281
tot_ecrrs_spouse_anx -4.1191 2.5190 -1.635 0.10296
rs2254298A/G -24.1837 14.7420 -1.640 0.10187
tot_ecrrs_spouse_anx:rs2254298A/G 13.3575 7.2449 1.844 0.06613 .
---
Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1
Residual standard error: 64.84 on 327 degrees of freedom
(10 observations deleted due to missingness)
Multiple R-squared: 0.06512, Adjusted R-squared: 0.04225
F-statistic: 2.847 on 8 and 327 DF, p-value: 0.004524qqnorm(resid(m11))
m12 <- lm(bias ~ stimulus+cond*tot_ecrrs_spouse_anx*rs2268498, data=medians_long.3)
summary(m12) # non-significant 3-way interaction of condition*spouse anxious attachment*rs2268498CC
Call:
lm(formula = bias ~ stimulus + cond * tot_ecrrs_spouse_anx *
rs2268498, data = medians_long.3)
Residuals:
Min 1Q Median 3Q Max
-208.851 -42.218 0.567 40.922 173.054
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 4.2576 15.0098 0.284 0.776852
stimulusliving 24.6716 11.0607 2.231 0.026382 *
stimulusneutral -1.3212 11.0607 -0.119 0.904990
stimulusspouse 37.5057 11.1014 3.378 0.000816 ***
stimulusstranger 0.1145 11.0607 0.010 0.991747
condB 9.4741 18.7429 0.505 0.613560
tot_ecrrs_spouse_anx -5.0629 5.4139 -0.935 0.350385
rs2268498CC 4.3260 21.2774 0.203 0.839015
rs2268498TT 27.9779 21.9489 1.275 0.203317
condB:tot_ecrrs_spouse_anx -0.7982 7.6565 -0.104 0.917035
condB:rs2268498CC -59.7803 30.0941 -1.986 0.047811 *
condB:rs2268498TT -13.8829 30.8551 -0.450 0.653049
tot_ecrrs_spouse_anx:rs2268498CC 4.2111 8.0519 0.523 0.601335
tot_ecrrs_spouse_anx:rs2268498TT -4.9553 7.7318 -0.641 0.522033
condB:tot_ecrrs_spouse_anx:rs2268498CC 21.8513 11.3933 1.918 0.055985 .
condB:tot_ecrrs_spouse_anx:rs2268498TT -0.8768 10.9069 -0.080 0.935978
---
Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1
Residual standard error: 64.68 on 330 degrees of freedom
Multiple R-squared: 0.1174, Adjusted R-squared: 0.07725
F-statistic: 2.926 on 15 and 330 DF, p-value: 0.0002247### I THINK I MIGHT NEED TO REDO THIS ONE AFTER RE-LEVELING rs2268498 - REFERENCE LEVEL IS C/T, SHOULD BE TT OR CC?
qqnorm(resid(m12))
m13 <- lm(bias ~ stimulus+cond*tot_ecrrs_spouse_anx*rs2254298, data=medians_long.3)
summary(m13) # significant interaction of spouse anxious attachment*rs2254298, p = .018, no 3-way interaction so m11 > m13 for parsimony
Call:
lm(formula = bias ~ stimulus + cond * tot_ecrrs_spouse_anx *
rs2254298, data = medians_long.3)
Residuals:
Min 1Q Median 3Q Max
-211.971 -42.557 2.942 38.186 163.337
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 16.897 13.051 1.295 0.19635
stimulusliving 22.641 11.233 2.016 0.04467 *
stimulusneutral -2.021 11.233 -0.180 0.85737
stimulusspouse 33.631 11.274 2.983 0.00307 **
stimulusstranger -3.543 11.233 -0.315 0.75269
condB -10.743 15.336 -0.701 0.48411
tot_ecrrs_spouse_anx -7.082 3.563 -1.988 0.04769 *
rs2254298A/G -35.561 20.839 -1.706 0.08888 .
condB:tot_ecrrs_spouse_anx 5.920 5.030 1.177 0.24009
condB:rs2254298A/G 22.689 29.443 0.771 0.44149
tot_ecrrs_spouse_anx:rs2254298A/G 24.268 10.233 2.371 0.01830 *
condB:tot_ecrrs_spouse_anx:rs2254298A/G -21.814 14.469 -1.508 0.13262
---
Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1
Residual standard error: 64.75 on 324 degrees of freedom
(10 observations deleted due to missingness)
Multiple R-squared: 0.07632, Adjusted R-squared: 0.04496
F-statistic: 2.434 on 11 and 324 DF, p-value: 0.006327qqnorm(resid(m13))
m14 <- lm(bias ~ stimulus+cond+tot_ecrrs_spouse_anx*rs53576, data=medians_long.3)
summary(m14) # no effect of interaction
Call:
lm(formula = bias ~ stimulus + cond + tot_ecrrs_spouse_anx *
rs53576, data = medians_long.3)
Residuals:
Min 1Q Median 3Q Max
-211.42 -41.80 3.57 40.99 175.57
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) -0.8630 12.1489 -0.071 0.94341
stimulusliving 24.6402 11.2592 2.188 0.02932 *
stimulusneutral -1.3526 11.2592 -0.120 0.90445
stimulusspouse 37.2304 11.3003 3.295 0.00109 **
stimulusstranger 0.0831 11.2592 0.007 0.99412
condB 0.5411 7.0809 0.076 0.93913
tot_ecrrs_spouse_anx 0.8011 3.1744 0.252 0.80091
rs53576GG 15.5190 12.6943 1.223 0.22237
tot_ecrrs_spouse_anx:rs53576GG -7.3005 4.6192 -1.580 0.11494
---
Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1
Residual standard error: 65.85 on 337 degrees of freedom
Multiple R-squared: 0.06577, Adjusted R-squared: 0.04359
F-statistic: 2.965 on 8 and 337 DF, p-value: 0.003203qqnorm(resid(m14))
m15 <- lm(bias ~ stimulus+cond*tot_ecrrs_spouse_anx*rs53576, data=medians_long.3)
summary(m15) # significant 3-way interaction of condition*spouse anxious attachment*rs53576 (GG), p = 0.019
Call:
lm(formula = bias ~ stimulus + cond * tot_ecrrs_spouse_anx *
rs53576, data = medians_long.3)
Residuals:
Min 1Q Median 3Q Max
-207.456 -43.412 -0.263 41.221 172.034
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 20.0558 14.6747 1.367 0.172639
stimulusliving 24.7431 11.1872 2.212 0.027662 *
stimulusneutral -1.2498 11.1872 -0.112 0.911116
stimulusspouse 37.3550 11.2279 3.327 0.000976 ***
stimulusstranger 0.1859 11.1872 0.017 0.986751
condB -41.4628 18.1445 -2.285 0.022931 *
tot_ecrrs_spouse_anx -6.6900 4.4587 -1.500 0.134450
rs53576GG -15.8468 17.8724 -0.887 0.375900
condB:tot_ecrrs_spouse_anx 14.9862 6.3081 2.376 0.018078 *
condB:rs53576GG 62.5554 25.2260 2.480 0.013638 *
tot_ecrrs_spouse_anx:rs53576GG 3.5756 6.4942 0.551 0.582290
condB:tot_ecrrs_spouse_anx:rs53576GG -21.7174 9.1772 -2.366 0.018529 *
---
Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1
Residual standard error: 65.43 on 334 degrees of freedom
Multiple R-squared: 0.08593, Adjusted R-squared: 0.05582
F-statistic: 2.854 on 11 and 334 DF, p-value: 0.001366qqnorm(resid(m15))
Some more data viz
library(lattice)
xyplot(bias ~ cond | as.factor(ID), data=medians_long.3, as.table=T, type=c("p","r")) # look at peoples' individual slopes between conditions
xyplot(bias ~ cond | as.factor(grp_cg), data=medians_long.3, as.table=T, type=c("p","r")) ## look at slopes between groups
xyplot(bias ~ stimulus | as.factor(grp_cg), data=medians_long.3, as.table=T, type=c("p","r")) ## look at slopes between groups
New ANOVAs and plots
Repeated-measures ANOVA on the aggregate RTs
Caveat: I didn’t include any covariates in the model yet.
library(tidyverse)
library(afex)
library(emmeans)
library(jtools)
# use the dataset "mlm_long2" that was created in a previous step (it has trial-level RTs; stim, cond, and push_pull are factors)
# add a group variable for CG/NCG, make push_pull & run into factors, and drop the 4 people who failed to reverse the instructions
anovaData <- mlm_long2 %>%
mutate(grp_cg = as.factor(ifelse(tot_icg >= 25, "CG", "NCG")), push_pull = as.factor(push_pull), run = as.factor(run)) %>% filter(!grepl("D101|D141|D147|D148",ID))
# repeated-measures ANOVA using medians, with 3 within-subjects factors (stimulus, condition, push or pull) and 1 between-subjects factor (CG vs. NCG)
a1 <- aov_ez(id = "ID", dv = "gAAT_RT", anovaData, between = "grp_cg", within = c("stim", "cond", "push_pull"), fun_aggregate = median) # using non-transformed RTsContrasts set to contr.sum for the following variables: grp_cga1 Anova Table (Type 3 tests)
Response: gAAT_RT
Effect df MSE F ges p.value
1 grp_cg 1, 33 114188.41 1.00 .02 .32
2 stim 3.57, 117.74 2826.95 7.76 *** .01 <.0001
3 grp_cg:stim 3.57, 117.74 2826.95 1.24 .002 .30
4 cond 1, 33 25949.97 2.65 .01 .11
5 grp_cg:cond 1, 33 25949.97 0.38 .002 .54
6 push_pull 1, 33 6543.37 2.62 .003 .12
7 grp_cg:push_pull 1, 33 6543.37 2.27 .003 .14
8 stim:cond 3.79, 125.20 1461.71 1.01 .0009 .40
9 grp_cg:stim:cond 3.79, 125.20 1461.71 0.67 .0006 .61
10 stim:push_pull 3.46, 114.10 2332.98 8.27 *** .01 <.0001
11 grp_cg:stim:push_pull 3.46, 114.10 2332.98 0.62 .0009 .62
12 cond:push_pull 1, 33 1615.08 0.78 .0002 .38
13 grp_cg:cond:push_pull 1, 33 1615.08 9.19 ** .003 .005
14 stim:cond:push_pull 3.37, 111.20 1847.22 0.91 .0010 .45
15 grp_cg:stim:cond:push_pull 3.37, 111.20 1847.22 0.69 .0007 .58
---
Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘+’ 0.1 ‘ ’ 1
Sphericity correction method: GG # repeated-measures ANOVA using medians, with 3 within-subjects factors (stimulus, condition, push or pull) and 1 between-subjects factor (CG vs. NCG)
a1_t <- aov_ez(id = "ID", dv = "gAAT_RT_t", anovaData, between = "grp_cg", within = c("stim", "cond", "push_pull"), fun_aggregate = median) # using transformed RTsContrasts set to contr.sum for the following variables: grp_cga1_tAnova Table (Type 3 tests)
Response: gAAT_RT_t
Effect df MSE F ges p.value
1 grp_cg 1, 33 4.02 0.64 .01 .43
2 stim 3.45, 113.87 0.09 7.38 *** .01 <.0001
3 grp_cg:stim 3.45, 113.87 0.09 1.21 .002 .31
4 cond 1, 33 0.81 2.66 .01 .11
5 grp_cg:cond 1, 33 0.81 0.75 .003 .39
6 push_pull 1, 33 0.22 1.71 .002 .20
7 grp_cg:push_pull 1, 33 0.22 2.10 .002 .16
8 stim:cond 3.78, 124.73 0.04 0.67 .0005 .60
9 grp_cg:stim:cond 3.78, 124.73 0.04 0.92 .0007 .45
10 stim:push_pull 3.64, 120.19 0.06 7.87 *** .009 <.0001
11 grp_cg:stim:push_pull 3.64, 120.19 0.06 0.71 .0008 .58
12 cond:push_pull 1, 33 0.05 0.19 <.0001 .66
13 grp_cg:cond:push_pull 1, 33 0.05 10.09 ** .003 .003
14 stim:cond:push_pull 3.58, 118.06 0.05 0.62 .0006 .63
15 grp_cg:stim:cond:push_pull 3.58, 118.06 0.05 0.47 .0004 .74
---
Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘+’ 0.1 ‘ ’ 1
Sphericity correction method: GG Results don’t differ appreciably between using the transformed and non-transformed RTs.
For both the transformed and non-transformed RTs, there is a significant three-way interaction of Group x Condition x Push_Pull, F(1,33) = 10.09, p = .003, generalized eta-squared = .003 (stats are for transformed variable). However, if I’m interpreting that effect size correctly, it’s a pretty tiny effect (.02 = small effect, .13 = medium, .26 = large).
p13 <- afex_plot(a1, x = "push_pull", trace = "cond", panel = "grp_cg",
error = "within", mapping="linetype", error_arg = list(width = .1))NOTE: Results may be misleading due to involvement in interactionsp13 + theme_light() # greyscale, light theme
p13 + theme_apa() # greyscale, APA theme
p14 <- afex_plot(a1, x = "push_pull", trace = "cond", panel = "grp_cg",
error = "within", mapping="color", error_arg = list(width = .1))NOTE: Results may be misleading due to involvement in interactionsp14 + theme_light() # color, light theme
p14 + theme_apa() # color, APA theme
From these, it looks like the interaction shows a significant effect of Condition (spray A/B), but only for people with CG and only on their push behavior. In the CG group, B decreased avoidance bias* as shown by the within-subjects error bars that barely overlap if at all.
In the two-way interaction plot for the bias score (from the regression), people in the CG group appeared to show increased approach bias under condition B. From the plots above, it looks like what is driving this apparent increase in approach bias is actually decreased avoidance behavior rather than increased approach behavior. It’s just not evident from the difference scores, which are agnostic to cause.
*(well, is it really bias per se if it’s not relative to pull? hmm)
Estimated marginal means
emm <- emmeans(a1, ~c(grp_cg,cond,push_pull))NOTE: Results may be misleading due to involvement in interactionsemm grp_cg cond push_pull emmean SE df lower.CL upper.CL
CG A PULL 749.4461 21.05578 55.6 707.2597 791.6326
NCG A PULL 712.5678 20.36964 50.2 671.6583 753.4773
CG B PULL 765.0661 21.05578 55.6 722.8797 807.2526
NCG B PULL 731.6028 20.36964 50.2 690.6933 772.5123
CG A PUSH 738.1261 21.05578 55.6 695.9397 780.3126
NCG A PUSH 738.4778 20.36964 50.2 697.5683 779.3873
CG B PUSH 777.7661 21.05578 55.6 735.5797 819.9526
NCG B PUSH 744.3128 20.36964 50.2 703.4033 785.2223
Results are averaged over the levels of: stim
Confidence level used: 0.95 update(pairs(emm), by=NULL, adjust = "holm") contrast estimate SE df t.ratio p.value
CG,A,PULL - NCG,A,PULL 36.8783333 29.411984 52.75 1.254 1.0000
CG,A,PULL - CG,B,PULL -15.6200000 19.171175 37.09 -0.815 1.0000
CG,A,PULL - NCG,B,PULL 17.8433333 29.411984 52.75 0.607 1.0000
CG,A,PULL - CG,A,PUSH 11.3200000 10.429733 48.36 1.085 1.0000
CG,A,PULL - NCG,A,PUSH 10.9683333 29.411984 52.75 0.373 1.0000
CG,A,PULL - CG,B,PUSH -28.3200000 20.814526 48.65 -1.361 1.0000
CG,A,PULL - NCG,B,PUSH 5.1333333 29.411984 52.75 0.175 1.0000
NCG,A,PULL - CG,B,PULL -52.4983333 29.411984 52.75 -1.785 1.0000
NCG,A,PULL - NCG,B,PULL -19.0350000 16.602725 37.09 -1.146 1.0000
NCG,A,PULL - CG,A,PUSH -25.5583333 29.411984 52.75 -0.869 1.0000
NCG,A,PULL - NCG,A,PUSH -25.9100000 9.032414 48.36 -2.869 0.1707
NCG,A,PULL - CG,B,PUSH -65.1983333 29.411984 52.75 -2.217 0.8363
NCG,A,PULL - NCG,B,PUSH -31.7450000 18.025909 48.65 -1.761 1.0000
CG,B,PULL - NCG,B,PULL 33.4633333 29.411984 52.75 1.138 1.0000
CG,B,PULL - CG,A,PUSH 26.9400000 20.814526 48.65 1.294 1.0000
CG,B,PULL - NCG,A,PUSH 26.5883333 29.411984 52.75 0.904 1.0000
CG,B,PULL - CG,B,PUSH -12.7000000 10.429733 48.36 -1.218 1.0000
CG,B,PULL - NCG,B,PUSH 20.7533333 29.411984 52.75 0.706 1.0000
NCG,B,PULL - CG,A,PUSH -6.5233333 29.411984 52.75 -0.222 1.0000
NCG,B,PULL - NCG,A,PUSH -6.8750000 18.025909 48.65 -0.381 1.0000
NCG,B,PULL - CG,B,PUSH -46.1633333 29.411984 52.75 -1.570 1.0000
NCG,B,PULL - NCG,B,PUSH -12.7100000 9.032414 48.36 -1.407 1.0000
CG,A,PUSH - NCG,A,PUSH -0.3516667 29.411984 52.75 -0.012 1.0000
CG,A,PUSH - CG,B,PUSH -39.6400000 19.171175 37.09 -2.068 1.0000
CG,A,PUSH - NCG,B,PUSH -6.1866667 29.411984 52.75 -0.210 1.0000
NCG,A,PUSH - CG,B,PUSH -39.2883333 29.411984 52.75 -1.336 1.0000
NCG,A,PUSH - NCG,B,PUSH -5.8350000 16.602725 37.09 -0.351 1.0000
CG,B,PUSH - NCG,B,PUSH 33.4533333 29.411984 52.75 1.137 1.0000
Results are averaged over the levels of: stim
P value adjustment: holm method for 28 tests Not quite sure about these pairwise comparisons. Ideally, we’d be able to set up specific contrasts to test as described below but I haven’t figured that out yet. However, looking at the plots, I think it’s safe to interpret the interaction as stated above. I will work on this.
?aov_ez
The S3 object returned per default can be directly passed to emmeans::emmeans for further analysis. This allows to test any type of contrasts that might be of interest independent of whether or not this contrast involves between-subject variables, within-subject variables, or a combination thereof. The general procedure to run those contrasts is the following (see Examples for a full example):
(1) Estimate an afex_aov object with the function returned here. For example: x <- aov_car(dv ~ a*b + (id/c), d)
(2) Obtain a emmGrid-class object by running emmeans on the afex_aov object from step 1 using the factors involved in the contrast. For example: r <- emmeans(x, ~a:c)
(3) Create a list containing the desired contrasts on the reference grid object from step 2. For example:
con1 <- list(a_x = c(-1, 1, 0, 0, 0, 0), b_x = c(0, 0, -0.5, -0.5, 0, 1))
(4) Test the contrast on the reference grid using contrast. For example: contrast(r, con1)
To control for multiple testing p-value adjustments can be specified. For example the Bonferroni-Holm correction: contrast(r, con1, adjust = "holm")Writing plots to .pptx
This is a useful tool for high-res figures! Using the officer package to write plots directly to a Powerpoint presentation:
library(officer)
# Create a new powerpoint document
ot_plots <- read_pptx()
# Add a new slide into the ppt document
ot_plots <- ot_plots %>%
add_slide(layout = "Title and Content", master = "Office Theme")
# Add the ggplot2 objects to the slide
ot_plots <- ph_with_gg(ot_plots, value=p14)
# write the document to a file
print(ot_plots, target = "ot-rt-plots.pptx")
LS0tCnRpdGxlOiAiT1QgUlQgcGxvdHMiCmF1dGhvcjogIlNhcmVuIFNlZWxleSIKZGF0ZTogIjEwLTIyLTIwMTgiCm91dHB1dDoKICBodG1sX25vdGVib29rOgogICAgbnVtYmVyX3NlY3Rpb25zOiBubwogICAgdGhlbWU6IHBhcGVyCiAgICB0b2M6IHllcwogICAgdG9jX2Zsb2F0OiB5ZXMKICBodG1sX2RvY3VtZW50OgogICAgZGZfcHJpbnQ6IHBhZ2VkCiAgICB0b2M6IHllcwotLS0KIyBNTE0gc3R1ZmYgZnJvbSBGU0hENjE3QyBhc3NpZ25tZW50CiMjIEFib3V0CiMjIyBPdmVydmlldwpUaGlzIEFEQSB1c2VzIGRhdGEgZnJvbSB0aGUgcHJvamVjdCDigJxUaGUgZWZmZWN0IG9mIGludHJhbmFzYWwgb3h5dG9jaW4gb24gbmV1cmFsIGZ1bmN0aW9uaW5nIGluIHdpZG93KGVyKXPigJ0gKCMxNTAzNzQ0NDIwLCBQSTogTWFyeS1GcmFuY2VzIE8nQ29ubm9yLCBDby1QSTogQnJpYW4gQXJpem1lbmRpKS4gSXQgd2FzIGEgZG91YmxlLWJsaW5kIHJhbmRvbWl6ZWQgY3Jvc3NvdmVyIHN0dWR5LCBkZXNpZ25lZCB0byBhZGRyZXNzIGNvbmZsaWN0aW5nIGFjY291bnRzIG9mIG1vdGl2YXRlZCBiZWhhdmlvciBpbiBjb21wbGljYXRlZGdyaWVmIHVzaW5nIGEgbm92ZWwgYXBwcm9hY2gtYXZvaWRhbmNlIHRhc2sgdmFyaWFudCAoZ3JpZWYgQUFUOyBnQUFUKSB0aGF0IGFsbG93cyBmb3IgY29tcGFyaXNvbiBiZXR3ZWVuIHBhcnRpY2lwYW50LXByb3ZpZGVkIHBob3RvcyBhbmQgbm9tb3RoZXRpYyBncmllZiBzdGltdWxpLiBQYXJ0aWNpcGFudHMgd2VyZSA0MCBFbmdsaXNoLXNwZWFraW5nIGFkdWx0cyBhZ2VzIDU1LTgwLCB3aG8gZXhwZXJpZW5jZWQgdGhlIGRlYXRoIG9mIGEgc3BvdXNlIG9yIGxvbmctdGVybSByb21hbnRpYyBwYXJ0bmVyIGJldHdlZW4gc2l4IG1vbnRocyBhbmQgdGhyZWUgeWVhcnMgcHJpb3IgdG8gdGhlaXIgcGFydGljaXBhdGlvbi4gCgojIyMgVGFzawpQYXJ0aWNpcGFudHMgYXR0ZW5kZWQgdHdvIGlkZW50aWNhbCBleHBlcmltZW50YWwgc2Vzc2lvbnMsIGF0IHdoaWNoIHRoZXkgcmVjZWl2ZWQgb25lIG9mIHR3byBpbnRyYW5hc2FsIHNwcmF5cyAodHJlYXRtZW50IEEvQikgYW5kIHRoZW4gdG9vayBwYXJ0IGluIGFuIGZNUkkgc2Nhbiwgd2hpY2ggaW52b2x2ZWQgYSBzdHJ1Y3R1cmFsIHNlcXVlbmNlLCB0aGUgZ0FBVCwgYW5kIGEgcmVzdGluZyBzdGF0ZSBzZXF1ZW5jZS4KCkZvciB0aGUgZ0FBVCwgZml2ZSBzdGltdWx1cyBjYXRlZ29yaWVzIHdlcmUgcHJlc2VudGVkOiAoMSkgZGVjZWFzZWQgc3BvdXNlLCAoMikgbGl2aW5nIGxvdmVkIG9uZSBbYXR0YWNobWVudCBmaWd1cmVdLCAoMykgc3RyYW5nZXIsICg0KSBnZW5lcmljIGdyaWVmLXJlbGF0ZWQgc2NlbmVzLCBhbmQgKDUpIG5ldXRyYWwgc2NlbmVzLiBQaG90b3MgcHJvdmlkZWQgYnkgdGhlIHBhcnRpY2lwYW50IHdlcmUgc2Nhbm5lZCBhbmQgcmVzaXplZCB0byBhIHN0YW5kYXJkIDc1MC1waXhlbCBoZWlnaHQgYW5kIHdpZHRoLCBhbmQgZnJhbWVkIGluIGNvbG9yZWQgZnJhbWVzIHRvIG1hdGNoIHRoZSBzdGltdWxpIHVzZWQgZm9yIG5vbi1pZGlvZ3JhcGhpYyBjYXRlZ29yaWVzIChpLmUuLCBzdHJhbmdlciwgZ3JpZWYtcmVsYXRlZCwgbmV1dHJhbCkuIFBob3RvcyBvZiB0aGUgc3RyYW5nZXIgd2VyZSBzZXgtbWF0Y2hlZCB0byB0aGUgcGFydGljaXBhbnQncyBwYXJ0bmVyLiAKCkR1cmluZyB0aGUgdGFzaywgcGFydGljaXBhbnRzIHdlcmUgaW5zdHJ1Y3RlZCB0byBmb2xsb3cgcnVsZXMgYmFzZWQgb24gYW4gaXJyZWxldmFudCBjaGFyYWN0ZXJpc3RpYyBvZiB0aGUgc3RpbXVsaSwgbmFtZWx5LCB0aGUgY29sb3Igb2YgdGhlIGZyYW1lIGFyb3VuZCB0aGUgcGhvdG8gKGUuZy4sIF8icHVzaCB0aGUgam95c3RpY2sgd2hlbiB0aGUgZnJhbWUgaXMgYmx1ZSwgcHVsbCB3aGVuIHRoZSBmcmFtZSBpcyB5ZWxsb3ciXykuIFRoZSB0YXNrIHdhcyBjb21wbGV0ZWQgaW4gdHdvIHJ1bnMgb2YgYXBwcm94aW1hdGVseSBzZXZlbiBtaW51dGVzIGVhY2guIEluIHRoZSBzZWNvbmQgcnVuLCB0aGUgaW5zdHJ1Y3Rpb25zIHdlcmUgcmV2ZXJzZWQgKGUuZy4gXyJub3cgcHVsbCB0aGUgam95c3RpY2sgZm9yIGJsdWUgZnJhbWVkIHBob3RvcyJfKS4gT3JkZXIgb2YgaW5zdHJ1Y3Rpb25zIHdhcyBjb3VudGVyYmFsYW5jZWQgYWNyb3NzIHBhcnRpY2lwYW50cy4gU3RpbXVsaSB3ZXJlIHByZXNlbnRlZCB2aWEgSW5xdWlzaXQgNCAoMjAxNCksIGluIGEgcHNldWRvcmFuZG9taXplZCBvcmRlciBkZXRlcm1pbmVkIGJ5IGdlbmV0aWMgYWxnb3JpdGhtIHRvIG9wdGltaXplIHN0YXRpc3RpY2FsIHBvd2VyIGFuZCBwc3ljaG9sb2dpY2FsIHZhbGlkaXR5IChXYWdlciAmIE5pY2hvbHMsIDIwMDMpLiBFYWNoIHRyaWFsIGxhc3QgMzAwMG1zLCB3aXRoIDI1MDAgbXMgYWxsb3dlZCBmb3IgcmVzcG9uc2UuIEludGVydHJpYWwgaW50ZXJ2YWwgd2FzIDUwMG1zLgoKUGFydGljaXBhbnRzIGNvbXBsZXRlZCB0aGUgdGFzayB1c2luZyBhbiBNUkktY29tcGF0aWJsZSBqb3lzdGljay4gVGhlIHN0aW11bGkgd2VyZSBhbmltYXRlZCBzbyB0aGF0IGEgam95c3RpY2sgcHVzaCB3b3VsZCBtYWtlIHRoZSBpbWFnZSBzbWFsbGVyIChhcyBpZiB0aGV5IHdlcmUgcHVzaGluZyBpdCBhd2F5IGZyb20gdGhlbSkgYW5kIGEgam95c3RpY2sgcHVsbCB3b3VsZCBtYWtlIHRoZSBpbWFnZSBsYXJnZXIgKGFzIGlmIHRoZXkgd2VyZSBicmluZ2luZyBpdCBuZWFyZXIgdG8gdGhlbSkuCgojIyMgVmFyaWFibGVzClRoZSBwcmltYXJ5IGRlcGVuZGVudCB2YXJpYWJsZSBvZiBpbnRlcmVzdCBmb3IgdGhlIHByZXNlbnQgYW5hbHlzaXMgaXMgKipyZWFjdGlvbiB0aW1lIGJpYXMqKiwgY29tcHV0ZWQgYXMgUlQ8c3ViPnB1c2g8L3N1Yj4tUlQ8c3ViPnB1bGw8L3N1Yj4uIE5lZ2F0aXZlIGJpYXMgc2NvcmVzIChmYXN0ZXIgdG8gcHVzaCB0aGFuIHB1bGwpIGluZGljYXRlIHJlbGF0aXZlIGF2b2lkYW5jZSBiaWFzLCB3aGlsZSBwb3NpdGl2ZSBzY29yZXMgKGZhc3RlciB0byBwdWxsIHRoYW4gdG8gcHVzaCkgaW5kaWNhdGUgcmVsYXRpdmUgYXBwcm9hY2ggYmlhcy4gQmVjYXVzZSB0aGUgdHdvIHJ1bnMgd2VyZSBpZGVudGljYWwgaW4gZXZlcnkgd2F5IGV4Y2VwdCBmb3IgdGhlIGluc3RydWN0aW9uIHByb3ZpZGVkLCBlYWNoIHRyaWFsIGhhZCBib3RoIGEgcHVzaCBSVCBhbmQgYSBwdWxsIFJUIChlLmcuLCBydW4xIHRyaWFsMSB3YXMgcHVzaCwgcnVuMiB0cmlhbDEgd2FzIHB1bGwsIHNvIHN1YnRyYWN0IFJUIG9uIHJ1bjIgdHJpYWwgMSBmcm9tIHJ1bjEgdHJpYWwxIHRvIGdldCB0aGUgZGlmZmVyZW5jZSAtIHRoaXMgaXMgZnVydGhlciBlbGFib3JhdGVkIGluIHRoZSBkYXRhIGNsZWFuaW5nIHNjcmlwdCBiZWxvdyksIHVubGVzcyB0aGV5IGZhaWxlZCB0byByZXZlcnNlIHRoZSBpbnN0cnVjdGlvbnMuCgpNYWluIHByZWRpY3RvcnMgb2YgaW50ZXJlc3QgaW5jbHVkZWQgKip0cmlhbCBudW1iZXIqKiAoaW4gb3JkZXIgdG8gZXN0YWJsaXNoIHdoZXRoZXIgcGVvcGxlcycgcmVzcG9uc2UgYmlhcyBjaGFuZ2VkIG92ZXIgdGhlIDctbWludXRlIHJ1biksICoqc3RpbXVsdXMqKiAobmV1dHJhbCwgc3BvdXNlLCBzdHJhbmdlciwgbGl2aW5nIGxvdmVkIG9uZSwgZGVhdGgpLCBhbmQgKipjb25kaXRpb24qKiAodHJlYXRtZW50IEEvQiAtIG94eXRvY2luIG9yIHBsYWNlYm8gW0knbSBzdGlsbCBibGluZGVkXSkuIAoKUGFydGljaXBhbnRzIGFsc28gY29tcGxldGVkIGEgbnVtYmVyIG9mIHNlbGYtcmVwb3J0IG1lYXN1cmVzIChzdGF0ZSBhbmQgdHJhaXQpIGFuZCBwcm92aWRlZCBiaW9sb2dpY2FsIHNhbXBsZXMgZm9yIE9YVFIgZ2Vub3R5cGluZyBhbmQgY29ydGlzb2wgYXNzYXksIHNvbWUgb2Ygd2hpY2ggd2VyZSB1c2VkIGFzIHByZWRpY3RvcnMuCgojIyBFcXVhdGlvbnMKIyMjIyBMZXZlbCAxOgpXZSBmaXJzdCBwZXJmb3JtZWQgTUxNIHRvIGVzdGltYXRlIHRoZSBlZmZlY3Qgb2YgdHJpYWwgbnVtYmVyIChpLmUuLCB0aGUgcmFuZG9tIGVmZmVjdCBvZiB0aW1lKSBvbiByZXNwb25zZSBiaWFzIChwdXNoIFJULXB1bGwgUlQpIG9uIGEgZ2l2ZW4gdHJpYWwuIFRoZSBsZXZlbC0xIG1vZGVsIGVzdGltYXRlZCwgZm9yIGVhY2ggcGFydGljaXBhbnQgX2pfIChfal8gPSAx4oCTMzUpLCBhIHJlZ3Jlc3Npb24gbGluZSB0aGF0IHByZWRpY3RlZCBlYWNoIHBhcnRpY2lwYW504oCZcyByZXNwb25zZSBiaWFzIGluIG1pbGxpc2Vjb25kcyBvbiBlYWNoIHRyaWFsIF9pXyBmcm9tIHRoZSB0cmlhbCBudW1iZXIuIFRoaXMgbW9kZWwgd2FzIHJlcHJlc2VudGVkIGFzIGZvbGxvd3M6IAo8YmxvY2txdW90ZT48Y2VudGVyPjxmb250IHNpemU9ND4KW2JpYXM8aT48c3ViPmk8L3N1Yj48L2k+XTxzdWI+ajwvc3ViPiA9IDxpPmI8L2k+PHN1Yj4wPGk+PHN1Yj5qPC9zdWI+PC9pPjwvc3ViPiArIDxpPmI8L2k+PHN1Yj4xPGk+PHN1Yj5qPC9zdWI+PC9pPjwvc3ViPiBbdHJpYWxudW1iZXI8aT48c3ViPmk8L3N1Yj48L2k+XSArIDxpPnI8c3ViPmlqPC9zdWI+PC9pPgo8L2ZvbnQ+PC9jZW50ZXI+CjwvYmxvY2txdW90ZT4KCndoZXJlIDxpPmI8L2k+PHN1Yj4wPGk+PHN1Yj5qPC9zdWI+PC9pPjwvc3ViPiwgdGhlIGludGVyY2VwdCwgaXMgaW50ZXJwcmV0ZWQgYXMgcGFydGljaXBhbnQgX2pf4oCZcyBtZWFuIHJlc3BvbnNlIGJpYXMgZm9yIGEgZ2l2ZW4gdHJpYWw7IDxpPmI8L2k+PHN1Yj4xPGk+PHN1Yj5qPC9zdWI+PC9pPjwvc3ViPiwgdGhlIHNsb3BlLCByZXByZXNlbnRzIHRoZSBlZmZlY3Qgb2YgdHJpYWwgbnVtYmVyIG9uIHJlc3BvbnNlIGJpYXMgZm9yIGVhY2ggcGFydGljaXBhbnQgX2pfIChwb3NpdGl2ZSBjb2VmZmljaWVudHMgcmVwcmVzZW50IHRoZSBwcmVkaWN0aXZlIG1hZ25pdHVkZSBvZiB0cmlhbCBudW1iZXIgb24gcmVzcG9uc2UgYmlhcyBmb3IgYSBnaXZlbiBwYXJ0aWNpcGFudCk7IGFuZCA8aT5yPHN1Yj5pajwvc3ViPjwvaT4gaXMgdGhlIHJlc2lkdWFsIGVycm9yIHRlcm0uCgojIyMjIExldmVsIDI6ClRoZSBsZXZlbC0yIG1vZGVscyBlc3RpbWF0ZWQgdGhlIGF2ZXJhZ2UgZWZmZWN0cyBmb3IgdGhlIGVudGlyZSBzYW1wbGUuIFRoZSBtb2RlbHMgd2VyZSByZXByZXNlbnRlZCBhcyBmb2xsb3dzOiAKCjxibG9ja3F1b3RlPjxjZW50ZXI+PGZvbnQgc2l6ZT00Pgo8aT5iPC9pPjxzdWI+MDwvc3ViPjxzdWI+ajwvc3ViPiA9IM6zPHN1Yj4wMDwvc3ViPiArIM68PHN1Yj4wPHN1Yj5qPC9zdWI+PC9zdWI+CjxwPgo8aT5iPC9pPjxzdWI+MTxzdWI+PGk+ajwvaT48L3N1Yj48L3N1Yj4gPSDOszxzdWI+MTA8L3N1Yj4gKyAgzrw8c3ViPjE8c3ViPmo8L3N1Yj48L3N1Yj4KPC9mb250PjwvY2VudGVyPjwvYmxvY2txdW90ZT4KCndoZXJlIHRoZSBpbnRlcmNlcHQsIM6zPHN1Yj4wMDwvc3ViPiwgaXMgaW50ZXJwcmV0ZWQgYXMgdGhlIGF2ZXJhZ2UgcmVzcG9uc2UgYmlhcyBmb3IgdGhlIGVudGlyZSBzYW1wbGU7IM6zPHN1Yj4xMDwvc3ViPiBpcyB0aGUgYXZlcmFnZSBlZmZlY3Qgb2YgcmVwcmVzZW50cyB0aGUgZWZmZWN0IG9mIHRyaWFsIG51bWJlciBvbiByZXNwb25zZSBiaWFzIGZvciBlYWNoIHBhcnRpY2lwYW50IF9qXyAocG9zaXRpdmUgY29lZmZpY2llbnRzIHJlcHJlc2VudCB0aGUgcHJlZGljdGl2ZSBtYWduaXR1ZGUgb2YgdHJpYWwgbnVtYmVyIG9uIHJlc3BvbnNlIGJpYXMgZm9yIHRoZSBzYW1wbGUgYXMgYSB3aG9sZSksIGFuZCB0aHVzLCB0aGUgcHJpbWFyeSBlc3RpbWF0ZSBvZiBpbnRlcmVzdDsgYW5kIM68PHN1Yj4wPHN1Yj5qPC9zdWI+PC9zdWI+IGFuZCDOvDxzdWI+MTxzdWI+ajwvc3ViPjwvc3ViPiBhcmUgdGhlIHJlc2lkdWFsIGVycm9yIHRlcm1zLiAKCkFkZGluZyB0aGUgZml4ZWQgZWZmZWN0IG9mIHN0aW11bHVzIHR5cGUgcmVzdWx0ZWQgaW4gdGhlIGZvbGxvd2luZyBtb2RlbDoKCjxibG9ja3F1b3RlPjxjZW50ZXI+PGZvbnQgc2l6ZT00Pgo8aT5iPC9pPjxzdWI+MDwvc3ViPjxzdWI+ajwvc3ViPiA9IM6zPHN1Yj4wMDwvc3ViPiArIM6zPHN1Yj4wMTwvc3ViPihzdGltdWx1czxzdWI+aTwvc3ViPikgKyDOvDxzdWI+MDxzdWI+ajwvc3ViPjwvc3ViPgo8cD4KPGk+YjwvaT48c3ViPjE8c3ViPjxpPmo8L2k+PC9zdWI+PC9zdWI+ID0gzrM8c3ViPjEwPC9zdWI+ICsgzrM8c3ViPjExPC9zdWI+KHN0aW11bHVzPHN1Yj5pPC9zdWI+KSArIM68PHN1Yj4xPHN1Yj5qPC9zdWI+PC9zdWI+PC9mb250PjwvY2VudGVyPjwvYmxvY2txdW90ZT4KCgojIyBEYXRhIGNsZWFuaW5nCjxpPk5vdGU6IFdlbnQgYmFjayB0byB0aGUgcmF3IGRhdGEgZHVlIHRvIHNvbWUgaW5jb25zaXN0ZW5jaWVzIGluIHRoZSBgT1RfQURBQV9PbW5pYnVzLnhsc3hgIGZpbGUgZnJvbSBCQSB0aGF0IEkgZm91bmQuPC9pPgoKPGI+UHJlLVIgc3RlcHM8L2I+OgoKMS4gUmVtb3ZlZCBhbGwgLmlxZGF0IGZpbGVzIHVuZGVyIDI1S0Igb3Igc28gaW4gb3JkZXIgdG8gZmlsdGVyIG91dCBwaWxvdCBkYXRhIGFuZCBmYWxzZSBzdGFydHMuPGJyPgoyLiBSZW1vdmVkIG5vbi1zdHVkeSBkYXRhIChpLmUuLCB0ZXN0cyBhbmQgT1QgdW5kZXJncmFkIGZpbGVzKS4gPGJyPgozLiBPcmdhbml6ZWQgcmF3IC5pcWRhdCBmaWxlcyBmb3IgZWFjaCB2aXNpdCBieSBydW4gMS9ydW4gMiAodHdvIHNlcGFyYXRlIGZvbGRlcnMpIGJhc2VkIG9uIGRhdGUvdGltZSBzdGFtcC4gPHA+CjxpPkluIFRlcm1pbmFsLCB3aXRoaW4gZWFjaCBvZiB0aGUgZm9sZGVycyBpbiB0dXJuLi4uPC9pPjxwPgo0LiBDaGFuZ2VkIGZpbGUgZXh0ZW5zaW9ucyB0byAudHN2ICh0YWItc2VwYXJhdGVkKSBmcm9tIC5pcWRhdDogYGZpbmQgLiAtaW5hbWUgIiouaXFkYXQiIC1leGVjIGJhc2ggLWMgJ212ICIkMCIgIiR7MCVcLmlxZGF0fS50c3YiJyB7fSBcO2A8YnI+CjUuIE1lcmdlZCB0aGUgZmlsZXM6IGBjYXQgKi50c3YgPiBPVF9nQUFUX3J1bi0xLnRzdmAgKG9yIGBPVF9nQUFUX3J1bi0yLnRzdmApCjxzdHJpa2U+NS4gTWVyZ2VkIHRoZSBmaWxlczogYG1sciAtLXRzdmxpdGUgY2F0ICoudHN2ID4gT1RfZ0FBVF9ydW4tMS50c3ZgIChvciBgT1RfZ0FBVF9ydW4tMi50c3ZgKQo8dWw+NWEuIGBtbHIgLS10c3ZsaXRlYCBkcm9wcyB0aGUgaGVhZGVyIGZyb20gYWxsIGJ1dCB0aGUgZmlyc3QgZmlsZSwgc28gY29sdW1uIG5hbWVzIGFyZSBub3QgcmVwZWF0ZWQgdGhyb3VnaG91dCB0aGUgZGF0YXNldC48L3VsPgo8dWw+NWIuIFRoaXMgcmVxdWlyZXMgTWlsbGVyLCB3aGljaCBjYW4gYmUgaW5zdGFsbGVkIHZpYSBIb21lYnJldyBvbiBPU1ggKGh0dHA6Ly9qb2hua2VybC5vcmcvbWlsbGVyL2RvYy9idWlsZC5odG1sKTwvc3RyaWtlPiA8aT50cmllZCB0byBtYWtlIHRoaXMgd29yayBidXQgbm8gbHVjazwvaT48L3VsPgoKPGk+Tm90ZXM6PGJyPgo8dWw+PGxpPkQxMTc6IEhhZCAzIHZpc2l0cyBkdWUgdG8gc2Nhbm5lciB0ZWNobmljYWwgaXNzdWVzLiBVc2UgIl9iIiBhbmQgIl9jIiBhcyB2aXNpdCAxIGFuZCB2aXNpdCAyIHJlc3BlY3RpdmVseS48L2xpPgo8bGk+RDExNDogSGFzIG11bHRpcGxlIGZpbGVzIGZyb20gdmlzaXQgMi4gVXNlIHRoZSBsYXN0IHR3by48L2xpPgo8bGk+RDEzNTogVXNlIGZpbGVzIGZyb20gNi8wNi8xNiBhbmQgNi8xNy8xOCAoc2Nhbm5lciBpc3N1ZXMgb24gMDYvMTMvMTYpLiBVc2UgIl9iIiBhbmQgIl9jIiBhcyB2aXNpdCAxIGFuZCB2aXNpdCAyIHJlc3BlY3RpdmVseS48L2xpPgo8bGk+RDE0NzogVmlzaXQgMSBydW4gMiBpcyBwYXJ0aWFsIGRhdGEgZm9yIHNvbWUgcmVhc29uIChJIGRvIGhhdmUgbm90ZXMgdGhhdCBzaGUgc3dpdGNoZWQgYmFjayB0byA8aT5QVVNILVlFTExPVzwvaT4gZHVyaW5nIHJ1biAyLCBidXQgZGlkIG5vdCByZS1ydW4gYmVjYXVzZSBydW5uaW5nIHdheSBvdmVyIHRpbWUuKTwvbGk+PC91bD48L2k+CgojIyBDcmVhdGluZyB0aGUgTUxNIGRhdGFzZXQKIyMjIEltcG9ydCBkYXRhCmBgYHtyfQpsaWJyYXJ5KHRpZHl2ZXJzZSkKZmlsdGVyIDwtIGRwbHlyOjpmaWx0ZXIKc2VsZWN0IDwtIGRwbHlyOjpzZWxlY3QKCiMgcmVhZCBpbiB0aGUgZGF0YSAob25seSBpbXBvcnRpbmcgYSBzdWJzZXQgb2YgY29sdW1ucykKcmF3X3IxIDwtIGRhdGEuZnJhbWUocmVhZF90c3YoIn4vRGVza3RvcC9PVC1nQUFUX01MTS1kYXRhL1J1bjFfdHN2L09UX2dBQVRfcnVuLTEudHN2IiwgY29sX3R5cGVzPWNvbHNfb25seSgKICBkYXRlID0gY29sX2ludGVnZXIoKSwKICB0aW1lID0gY29sX2NoYXJhY3RlcigpLAogIHN1YmplY3QgPSBjb2xfY2hhcmFjdGVyKCksCiAgYmxvY2tjb2RlID0gY29sX2NoYXJhY3RlcigpLAogIGJsb2NrbnVtID0gY29sX2NoYXJhY3RlcigpLAogIHRyaWFsY29kZSA9IGNvbF9jaGFyYWN0ZXIoKSwKICB2YWx1ZXMudHJpYWxjb2RlID0gY29sX2NoYXJhY3RlcigpLAogIHZhbHVlcy5zdGltdWx1cyA9IGNvbF9jaGFyYWN0ZXIoKSwKICB2YWx1ZXMuaW5pdGlhbHJlc3BvbnNlID0gY29sX2NoYXJhY3RlcigpLAogIHZhbHVlcy5SVCA9IGNvbF9udW1iZXIoKQopKSkKCnJhd19yMiA8LSBkYXRhLmZyYW1lKHJlYWRfdHN2KCJ+L0Rlc2t0b3AvT1QtZ0FBVF9NTE0tZGF0YS9SdW4yX3Rzdi9PVF9nQUFUX3J1bi0yLnRzdiIsIGNvbF90eXBlcz1jb2xzX29ubHkoCiAgZGF0ZSA9IGNvbF9pbnRlZ2VyKCksCiAgdGltZSA9IGNvbF9jaGFyYWN0ZXIoKSwKICBzdWJqZWN0ID0gY29sX2NoYXJhY3RlcigpLAogIGJsb2NrY29kZSA9IGNvbF9jaGFyYWN0ZXIoKSwKICBibG9ja251bSA9IGNvbF9jaGFyYWN0ZXIoKSwKICB0cmlhbGNvZGUgPSBjb2xfY2hhcmFjdGVyKCksCiAgdmFsdWVzLnRyaWFsY29kZSA9IGNvbF9jaGFyYWN0ZXIoKSwKICB2YWx1ZXMuc3RpbXVsdXMgPSBjb2xfY2hhcmFjdGVyKCksCiAgdmFsdWVzLmluaXRpYWxyZXNwb25zZSA9IGNvbF9jaGFyYWN0ZXIoKSwKICB2YWx1ZXMuUlQgPSBjb2xfbnVtYmVyKCkKKSkpCgojIGhlYWRlciBsaW5lIHJlcGVhdHMgd2hlbiBJIHVzZWQgYGNhdGAgdG8gbWVyZ2UsIHNvIGdldCB0aG9zZSBvdXQgb2YgdGhlcmUKcmF3X3IxIDwtIHJhd19yMSAlPiUgZmlsdGVyKCFpcy5uYShkYXRlKSkKcmF3X3IyIDwtIHJhd19yMiAlPiUgZmlsdGVyKCFpcy5uYShkYXRlKSkKCnVuaXF1ZShyYXdfcjEkc3ViamVjdCkKIyBEMTE4IGlzIHNob3dpbmcgdXAgYXMgInRlc3QiIGZvciBzb21lIHJlYXNvbiAoY2hlY2tlZCBhZ2FpbnN0IHRoZSAuaXFkYXQgZmlsZSksIGFuZCBEMTMwX2IgaXMgbWlzc2luZwojIGJvdGggb2YgRDEzMCdzIGFuZCBEMTQyJ3MgdmlzaXRzIHdlcmUgZW50ZXJlZCBhcyAiRDEzMCIvIkQxNDIiLCBzbyBjaGFuZ2UgdGhlIHN1YmplY3QgSUQgZm9yIHRoZSB2aXNpdCBvbiAwNTI0MTYgdG8gRDEzMF9iIGFuZCBvbiAKcmF3X3IxJHN1YmplY3RbcmF3X3IxJGRhdGUgPT0gMDIwOTE2XSA8LSAiRDExOCIKcmF3X3IxJHN1YmplY3RbcmF3X3IxJGRhdGUgPT0gMDUyNDE2XSA8LSAiRDEzMF9iIgpyYXdfcjEkc3ViamVjdFtyYXdfcjEkZGF0ZSA9PSAxMTE1MTZdIDwtICJEMTQyX2IiCgojIGZpeGluZyBzb21lIG90aGVyIHN0dWZmIGluIGEgc2ltaWxhciB2ZWluCnJhd19yMSRzdWJqZWN0W3Jhd19yMSRzdWJqZWN0ID09ICJEMTAxXzIiXSA8LSAiRDEwMV9iIgpyYXdfcjEkc3ViamVjdFtyYXdfcjEkc3ViamVjdCA9PSAiRDEwMl9CIl0gPC0gIkQxMDJfYiIKcmF3X3IxJHN1YmplY3RbcmF3X3IxJHN1YmplY3QgPT0gIkQxMTdfYiJdIDwtICJEMTE3IgpyYXdfcjEkc3ViamVjdFtyYXdfcjEkc3ViamVjdCA9PSAiRDExN19jIl0gPC0gIkQxMTdfYiIKcmF3X3IxJHN1YmplY3RbcmF3X3IxJHN1YmplY3QgPT0gIkQxMzVfYyJdIDwtICJEMTM1X2IiCgp1bmlxdWUocmF3X3IxJHN1YmplY3QpICMgNzggdW5pcXVlIC0gdGhhdCBpcyBjb3JyZWN0Cgp1bmlxdWUocmF3X3IyJHN1YmplY3QpCiMgc29tZSBzaW1pbGFyIGlzc3VlcyB0byBmaXgKcmF3X3IyJHN1YmplY3RbcmF3X3IyJHN1YmplY3QgPT0gIkQxMDFfMlkiXSA8LSAiRDEwMV9iIgpyYXdfcjIkc3ViamVjdFtyYXdfcjIkc3ViamVjdCA9PSAiRDEwMl9CIl0gPC0gIkQxMDJfYiIKcmF3X3IyJHN1YmplY3RbcmF3X3IyJHN1YmplY3QgPT0gIkQxMDdfQl8yIl0gPC0gIkQxMDdfYiIKcmF3X3IyJHN1YmplY3RbcmF3X3IyJHN1YmplY3QgPT0gIkQxMTdfYiJdIDwtICJEMTE3IgpyYXdfcjIkc3ViamVjdFtyYXdfcjIkc3ViamVjdCA9PSAiRDExN19jIl0gPC0gIkQxMTdfYiIKcmF3X3IyJHN1YmplY3RbcmF3X3IyJHN1YmplY3QgPT0gIkQxMjZfQiJdIDwtICJEMTI2X2IiCnJhd19yMiRzdWJqZWN0W3Jhd19yMiRzdWJqZWN0ID09ICJEMTM1X2MiXSA8LSAiRDEzNV9iIgpyYXdfcjIkc3ViamVjdFtyYXdfcjIkZGF0ZSA9PSAxMTE1MTZdIDwtICJEMTQyX2IiCgoKdW5pcXVlKHJhd19yMiRzdWJqZWN0KSAjIDc4IHVuaXF1ZSAtIHRoYXQgaXMgY29ycmVjdAoKc3RyKHJhd19yMSkKc3RyKHJhd19yMikKYGBgCgpgYGB7cn0KIyB0YWtlIG91dCBJVElzCnVuaXF1ZShyYXdfcjEkdHJpYWxjb2RlKQptbG1fcjEgPC0gZmlsdGVyKHJhd19yMSwgZ3JlcGwoIl5BIix0cmlhbGNvZGUpKQp1bmlxdWUobWxtX3IxJHRyaWFsY29kZSkKCnVuaXF1ZShyYXdfcjIkdHJpYWxjb2RlKQptbG1fcjIgPC0gZmlsdGVyKHJhd19yMiwgZ3JlcGwoIl5BIix0cmlhbGNvZGUpKQp1bmlxdWUobWxtX3IyJHRyaWFsY29kZSkKCiMgYWRkIGEgInRyaWFsbnVtIiB2YXJpYWJsZSwgZ3JvdXBlZCBieSBJRAptbG1fcjEgPC0gbWxtX3IxICU+JSBncm91cF9ieShzdWJqZWN0KSAlPiUgbXV0YXRlKHRyaWFsbnVtID0gcm93X251bWJlcigpKQpWaWV3KG1sbV9yMikKbWxtX3IyIDwtIG1sbV9yMiAlPiUgZ3JvdXBfYnkoc3ViamVjdCkgJT4lIG11dGF0ZSh0cmlhbG51bSA9IHJvd19udW1iZXIoKSkKVmlldyhtbG1fcjIpCgptbG1fcjEgJT4lIGdyb3VwX2J5KHRyaWFsbnVtKSAlPiUgY291bnQodHJpYWxudW0pICMgZXZlcnlvbmUgaGFzIDE0NCB0cmlhbHMsIGhvb3JheSEKbWxtX3IyICU+JSBncm91cF9ieSh0cmlhbG51bSkgJT4lIGNvdW50KHRyaWFsbnVtKSAjIGV2ZXJ5b25lIGhhcyAxNDQgdHJpYWxzLCBvbmUgcGVyc29uIGhhcyAxNzcKbWxtX3IyICU+JSBncm91cF9ieShzdWJqZWN0KSAlPiUgY291bnQoKSAjIHRoYXQgcGVyc29uIGlzIEQxMjJfYgojIG5vIGNsdWUgd2h5IHRoYXQgaGFwcGVuZWQsIGFsdGhvdWdoIEkgZG8gdmFndWVseSByZW1lbWJlciB3ZSBoYWQgb25lIHNlc3Npb24gd2hlcmUgdGhlIHRhc2sgc2VlbWVkIHRvIGdvIG9uIGFuZCBvbiBhbmQgd2UgZm9yY2UgcXVpdCBpdD8KIyByZW1vdmUgdHJpYWxzIDE0NS0xNzcgZm9yIEQxMjJfYgoKbWxtX3IyIDwtIGZpbHRlcihtbG1fcjIsIHRyaWFsbnVtIDw9MTQ0KQptbG1fcjIgJT4lIGdyb3VwX2J5KHRyaWFsbnVtKSAlPiUgY291bnQodHJpYWxudW0pCiMgbm93IGV2ZXJ5b25lIGhhcyAxNDQgdHJpYWxzCgojIGFkZCBhIGNvbHVtbiBmb3IgInJ1biIKbWxtX3IxJHJ1biA8LSAiMSIKbWxtX3IyJHJ1biA8LSAiMiIKCiMgYWRkIGEgY29sdW1uIGZvciAidmlzaXQiCm1sbV9yMSR2aXNpdCA8LSBhcy5mYWN0b3IoaWZlbHNlKGdyZXBsKCIqX2IiLCBtbG1fcjEkc3ViamVjdCksICIyIiwgIjEiKSkKbWxtX3IyJHZpc2l0IDwtIGFzLmZhY3RvcihpZmVsc2UoZ3JlcGwoIipfYiIsIG1sbV9yMiRzdWJqZWN0KSwgIjIiLCAiMSIpKQoKbWxtX3IxICU+JSBncm91cF9ieShzdWJqZWN0KSAlPiUgY291bnQodmlzaXQpICMgYWxsIGxvb2tzIGdvb2QKbWxtX3IyICU+JSBncm91cF9ieShzdWJqZWN0KSAlPiUgY291bnQodmlzaXQpICMgYWxsIGxvb2tzIGdvb2QKCiMgbm93IHJlbW92ZSB0aGUgIl9iIiBmcm9tIHZpc2l0IDIgSURzCm1sbV9yMSA8LSBtbG1fcjEgJT4lIHVuZ3JvdXAoKSAlPiUKICBtdXRhdGUoc3ViamVjdCA9IHN0cl9yZXBsYWNlKHN1YmplY3QsICJfYiIsICIiKSkKdW5pcXVlKG1sbV9yMSRzdWJqZWN0KQoKbWxtX3IyIDwtIG1sbV9yMiAlPiUgdW5ncm91cCgpICU+JQogIG11dGF0ZShzdWJqZWN0ID0gc3RyX3JlcGxhY2Uoc3ViamVjdCwgIl9iIiwgIiIpKQp1bmlxdWUobWxtX3IyJHN1YmplY3QpCgojIG1lcmdlIGRhdGEgZnJvbSB0aGUgMiBydW5zIAptbG1fYnggPC0gYmluZF9yb3dzKG1sbV9yMSwgbWxtX3IyKQoKIyBzcGxpdCB1cCBieSB2aXNpdAptbG1fdjEgPC0gbWxtX2J4ICU+JSBmaWx0ZXIodmlzaXQgPT0gIjEiKQptbG1fdjIgPC0gbWxtX2J4ICU+JSBmaWx0ZXIodmlzaXQgPT0gIjIiKQoKbWxtX3YxICU+JSBncm91cF9ieSh0cmlhbG51bSkgJT4lIGNvdW50KHRyaWFsbnVtKSAjIGV2ZXJ5b25lIGhhcyAxNDQgdHJpYWxzLCBob29yYXkhCm1sbV92MiAlPiUgZ3JvdXBfYnkodHJpYWxudW0pICU+JSBjb3VudCh0cmlhbG51bSkgIyBldmVyeW9uZSBoYXMgMTQ0IHRyaWFscywgaG9vcmF5IQpgYGAKCmBgYHtyfQojIGFkZCBjb2x1bW5zIGZvciAiY29uZCIgYXQgdmlzaXQgMSBhbmQgdmlzaXQgMiBbY29uZGl0aW9uOiBBIG9yIEJdCiMgbG9hZCBpbiB0aGUgcmFuZG9taXphdGlvbiBkYXRhCnJhbmRvbWl6ZSA8LSByZWFkUkRTKCJ+L0Ryb3Bib3gvR0xBU1MgTGFiL09UIFN0dWR5L2RhdGEvY2xlYW5lZC1kYXRhL3JhbmRvbWl6YXRpb25fY2xlYW4ucmRzIikKaGVhZChyYW5kb21pemUpCgptbG1fdjEgPC0gbWxtX3YxICU+JQogIHJlbmFtZSgiSUQiID0gc3ViamVjdCkKCm1sbV92MiA8LSBtbG1fdjIgJT4lCiAgcmVuYW1lKCJJRCIgPSBzdWJqZWN0KQoKIyBnZXQgdGhlIElEcyBmb3IgZXZlcnlvbmUgd2hvIGdvdCB0cmVhdG1lbnQgQSBhdCB2aXNpdCAxIApJRHNfdjFfdHhBIDwtIHJhbmRvbWl6ZSAlPiUgZmlsdGVyKHR4X3YxID09ICJBIikKVmlldyhJRHNfdjFfdHhBKQoKIyBpZmVsc2Ugc3RhdGVtZW50OiBpZiBJRCA9IGFueSBvZiB0aG9zZSBsaXN0ZWQgaW4gdHhBX2xpc3QsIG1ha2UgY29uZF92MSA9ICJBIiwgZWxzZSBtYWtlIGl0ICJCIgptbG1fdjEgPC0gbWxtX3YxICU+JQogIG11dGF0ZShjb25kX3YxID0gYXMuZmFjdG9yKGlmZWxzZShJRCA9PSAiRDEwMSIgfCBJRCA9PSAiRDEwNSIgfCBJRCA9PSAiRDEwOSIgfCBJRCA9PSAiRDExMCIgfCBJRCA9PSAiRDExNCIgfCBJRCA9PSAiRDExNSIgfCBJRCA9PSAiRDExNiIgfCBJRCA9PSAiRDExOCIgfCBJRCA9PSAiRDExOSIgfCBJRCA9PSAiRDEyMCIgfCBJRCA9PSAiRDEyMyIgfCBJRCA9PSAiRDEyNCIgfCBJRCA9PSAiRDEyNiIgfCBJRCA9PSAiRDEyOCIgfCBJRCA9PSAiRDEzMiIgfCBJRCA9PSAiRDEzNSIgfCBJRCA9PSAiRDEzNiIgfCBJRCA9PSAiRDEzNyIgfCBJRCA9PSAiRDEzOCIgfCBJRCA9PSAiRDE0MCIgfCBJRCA9PSAiRDE0MSIgfCBJRCA9PSAiRDE0NSIgfCBJRCA9PSAiRDE0OCIgfCBJRCA9PSAiRDE0OSIgfCBJRCA9PSAiRDExNyIsICJBIiwgIkIiKSksIGNvbmRfdjIgPSBhcy5mYWN0b3IoaWZlbHNlKElEID09ICJEMTAxIiB8IElEID09ICJEMTA1IiB8IElEID09ICJEMTA5IiB8IElEID09ICJEMTEwIiB8IElEID09ICJEMTE0IiB8IElEID09ICJEMTE1IiB8IElEID09ICJEMTE2IiB8IElEID09ICJEMTE4IiB8IElEID09ICJEMTE5IiB8IElEID09ICJEMTIwIiB8IElEID09ICJEMTIzIiB8IElEID09ICJEMTI0IiB8IElEID09ICJEMTI2IiB8IElEID09ICJEMTI4IiB8IElEID09ICJEMTMyIiB8IElEID09ICJEMTM1IiB8IElEID09ICJEMTM2IiB8IElEID09ICJEMTM3IiB8IElEID09ICJEMTM4IiB8IElEID09ICJEMTQwIiB8IElEID09ICJEMTQxIiB8IElEID09ICJEMTQ1IiB8IElEID09ICJEMTQ4IiB8IElEID09ICJEMTQ5IiB8IElEID09ICJEMTE3IiwgIkIiLCAiQSIpKSkKaGVhZChtbG1fdjEpCgojIGlmZWxzZSBzdGF0ZW1lbnQ6IGlmIElEID0gYW55IG9mIHRob3NlIGxpc3RlZCBpbiB0eEFfbGlzdCwgbWFrZSBjb25kX3YyID0gIkIiLCBlbHNlIG1ha2UgaXQgIkEiIChwZW9wbGUgd2hvIHdlcmUgQSBhdCB2aXNpdCAxIHNob3VsZCBiZSBCIGZvciB2aXNpdCAyLCBhbmQgdmljZSB2ZXJzYSkKbWxtX3YyIDwtIG1sbV92MiAlPiUKICBtdXRhdGUoY29uZF92MiA9IGFzLmZhY3RvcihpZmVsc2UoSUQgPT0gIkQxMDEiIHwgSUQgPT0gIkQxMDUiIHwgSUQgPT0gIkQxMDkiIHwgSUQgPT0gIkQxMTAiIHwgSUQgPT0gIkQxMTQiIHwgSUQgPT0gIkQxMTUiIHwgSUQgPT0gIkQxMTYiIHwgSUQgPT0gIkQxMTgiIHwgSUQgPT0gIkQxMTkiIHwgSUQgPT0gIkQxMjAiIHwgSUQgPT0gIkQxMjMiIHwgSUQgPT0gIkQxMjQiIHwgSUQgPT0gIkQxMjYiIHwgSUQgPT0gIkQxMjgiIHwgSUQgPT0gIkQxMzIiIHwgSUQgPT0gIkQxMzUiIHwgSUQgPT0gIkQxMzYiIHwgSUQgPT0gIkQxMzciIHwgSUQgPT0gIkQxMzgiIHwgSUQgPT0gIkQxNDAiIHwgSUQgPT0gIkQxNDEiIHwgSUQgPT0gIkQxNDUiIHwgSUQgPT0gIkQxNDgiIHwgSUQgPT0gIkQxNDkiIHwgSUQgPT0gIkQxMTciLCAiQiIsICJBIikpLCBjb25kX3YxID0gYXMuZmFjdG9yKGlmZWxzZShJRCA9PSAiRDEwMSIgfCBJRCA9PSAiRDEwNSIgfCBJRCA9PSAiRDEwOSIgfCBJRCA9PSAiRDExMCIgfCBJRCA9PSAiRDExNCIgfCBJRCA9PSAiRDExNSIgfCBJRCA9PSAiRDExNiIgfCBJRCA9PSAiRDExOCIgfCBJRCA9PSAiRDExOSIgfCBJRCA9PSAiRDEyMCIgfCBJRCA9PSAiRDEyMyIgfCBJRCA9PSAiRDEyNCIgfCBJRCA9PSAiRDEyNiIgfCBJRCA9PSAiRDEyOCIgfCBJRCA9PSAiRDEzMiIgfCBJRCA9PSAiRDEzNSIgfCBJRCA9PSAiRDEzNiIgfCBJRCA9PSAiRDEzNyIgfCBJRCA9PSAiRDEzOCIgfCBJRCA9PSAiRDE0MCIgfCBJRCA9PSAiRDE0MSIgfCBJRCA9PSAiRDE0NSIgfCBJRCA9PSAiRDE0OCIgfCBJRCA9PSAiRDE0OSIgfCBJRCA9PSAiRDExNyIsICJBIiwgIkIiKSkpCgpsZXZlbHMobWxtX3YxJGNvbmRfdjEpCmxldmVscyhtbG1fdjIkY29uZF92MikKCmhlYWQobWxtX3YxKQogIApJRHNfdjFfdHhBJElECm1sbV92MSAlPiUgZ3JvdXBfYnkoY29uZF92MSkgJT4lIGNvdW50KElEKSAjIElEcyBhbmQgY29uZCBtYXRjaCB0eEFfbGlzdAptbG1fdjIgJT4lIGdyb3VwX2J5KGNvbmRfdjIpICU+JSBjb3VudChJRCkgIyBJRHMgYW5kIGNvbmQgbWF0Y2ggdHhBX2xpc3QKCm1sbV9ieCA8LSBiaW5kX3Jvd3MobWxtX3YxLG1sbV92MikKVmlldyhtbG1fYngpCgojIHNhdmUgaXQKc2F2ZVJEUyhtbG1fYngsICJ+L0Ryb3Bib3gvMjAxOEZhbGwvRlNIRDYxN0MvbWxtX2J4LnJkcyIpCmBgYAoKYGBge3J9CiMgcmVuYW1lIHNvbWUgdmFyaWFibGVzCmNvbG5hbWVzKG1sbV9ieCkKbWxtX2J4IDwtIG1sbV9ieCAlPiUgcmVuYW1lKCJwdXNoX3B1bGwiID0gdmFsdWVzLmluaXRpYWxyZXNwb25zZSwKICAgICAgICAgICAgICAgICAgImdBQVRfUlQiID0gdmFsdWVzLlJUKQpoZWFkKG1sbV9ieCkKCiMgYWRkIGEgbmV3IHZhcmlhYmxlIGZvciBjb25kaXRpb24KbWxtX2J4MSA8LSBtbG1fYnggJT4lIG11dGF0ZShjb25kID0gYXMuZmFjdG9yKGlmZWxzZShjb25kX3YxID09ICJBIiAmIHZpc2l0ID09ICIxIiwgIkEiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICBpZmVsc2UoY29uZF92MiA9PSAiQSIgJiB2aXNpdCA9PSAiMiIsICJBIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgaWZlbHNlKGNvbmRfdjEgPT0gIkIiICYgdmlzaXQgPT0gIjEiLCAiQiIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBpZmVsc2UoY29uZF92MiA9PSAiQiIgJiB2aXNpdCA9PSAiMiIsICJCIiwgTkEpKSkpKSkKClZpZXcobWxtX2J4MSkgIyBjaGVjayB0aGF0IGl0IGNvZGVkIHRoZSAiY29uZCIgY29sdW1uIGNvcnJlY3RseSAgICAgIAoKIyBhZGQgYSBuZXcgdmFyaWFibGUgZm9yIHN0aW11bHVzIGNhdGVnb3J5CiMgaW4gdmFsdWVzLnN0aW11bHVzOgojIDEgPSBzcG91c2UsIDIgPSBsaXZpbmcgbG92ZWQgb25lL1dIT1RPLCAzID0gc3RyYW5nZXIsIDQgPSBub21vdGhldGljIGRlYXRoLXJlbGF0ZWQsIDUgPSBuZXV0cmFsIGltYWdlcwoKc29ydCh1bmlxdWUobWxtX2J4MSR2YWx1ZXMuc3RpbXVsdXMpKQoKbWxtX2J4MiA8LSBtbG1fYngxICU+JQogIG11dGF0ZShzdGltID0gYXMuZmFjdG9yKGlmZWxzZSh2YWx1ZXMuc3RpbXVsdXMgPT0gIjFCXzEuanBnInx2YWx1ZXMuc3RpbXVsdXMgPT0gIjFCXzIuanBnInx2YWx1ZXMuc3RpbXVsdXMgPT0gIjFCXzMuanBnInx2YWx1ZXMuc3RpbXVsdXMgPT0gIjFZXzEuanBnInx2YWx1ZXMuc3RpbXVsdXMgPT0gIjFZXzIuanBnInx2YWx1ZXMuc3RpbXVsdXMgPT0gIjFZXzMuanBnIiwgInNwb3VzZSIsIAogICAgICAgICAgICAgICAgICAgICAgIGlmZWxzZSh2YWx1ZXMuc3RpbXVsdXMgPT0gIjJCXzEuanBnInx2YWx1ZXMuc3RpbXVsdXMgPT0gIjJCXzIuanBnInx2YWx1ZXMuc3RpbXVsdXMgPT0gIjJCXzMuanBnInx2YWx1ZXMuc3RpbXVsdXMgPT0gIjJZXzEuanBnInx2YWx1ZXMuc3RpbXVsdXMgPT0gIjJZXzIuanBnInx2YWx1ZXMuc3RpbXVsdXMgPT0gIjJZXzMuanBnIiwgImxpdmluZyIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGlmZWxzZSh2YWx1ZXMuc3RpbXVsdXMgPT0gIjNCXzEuanBnInx2YWx1ZXMuc3RpbXVsdXMgPT0gIjNCXzIuanBnInx2YWx1ZXMuc3RpbXVsdXMgPT0gIjNCXzMuanBnInx2YWx1ZXMuc3RpbXVsdXMgPT0gIjNZXzEuanBnInx2YWx1ZXMuc3RpbXVsdXMgPT0gIjNZXzIuanBnInx2YWx1ZXMuc3RpbXVsdXMgPT0gIjNZXzMuanBnIiwgInN0cmFuZ2VyIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGlmZWxzZSh2YWx1ZXMuc3RpbXVsdXMgPT0gIjRCXzEuanBnInx2YWx1ZXMuc3RpbXVsdXMgPT0gIjRCXzIuanBnInx2YWx1ZXMuc3RpbXVsdXMgPT0gIjRCXzMuanBnInx2YWx1ZXMuc3RpbXVsdXMgPT0gIjRZXzEuanBnInx2YWx1ZXMuc3RpbXVsdXMgPT0gIjRZXzIuanBnInx2YWx1ZXMuc3RpbXVsdXMgPT0gIjRZXzMuanBnIiwgImRlYXRoIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBpZmVsc2UodmFsdWVzLnN0aW11bHVzID09ICI1Ql8xLmpwZyJ8dmFsdWVzLnN0aW11bHVzID09ICI1Ql8yLmpwZyJ8dmFsdWVzLnN0aW11bHVzID09ICI1Ql8zLmpwZyJ8dmFsdWVzLnN0aW11bHVzID09ICI1WV8xLmpwZyJ8dmFsdWVzLnN0aW11bHVzID09ICI1WV8yLmpwZyJ8dmFsdWVzLnN0aW11bHVzID09ICI1WV8zLmpwZyIsICJuZXV0cmFsIiwgTkEpKSkpKSkpCgpsZXZlbHMobWxtX2J4MiRzdGltKQptbG1fYngyJHN0aW0gPC0gcmVsZXZlbChtbG1fYngyJHN0aW0sIHJlZiA9ICJuZXV0cmFsIikgIyBtYWtlIG5ldXRyYWwgdGhlIHJlZmVyZW5jZSBsZXZlbAogICAgICAgICAgICAgICAgICAgICAgIAojIHNhdmUgaXQKc2F2ZVJEUyhtbG1fYngyLCAifi9Ecm9wYm94LzIwMThGYWxsL0ZTSEQ2MTdDL21sbV9ieDIucmRzIikKYGBgCgojIyMgQmlhcyBzY29yZXMKU2VwYXJhdGUgb3V0IHB1c2ggbWludXMgcHVsbCwgdGhlbiBzdWJ0cmFjdCBydW4xIGZyb20gcnVuMi4KYGBge3J9CgptbG1fcjEuMSA8LSBtbG1fYngyICU+JSBmaWx0ZXIocnVuID09ICIxIikKdGFpbChtbG1fcjEuMSkgIyBkb2VzIGl0IGxpbmUgdXA/Cm1sbV9yMi4xIDwtIG1sbV9ieDIgJT4lIGZpbHRlcihydW4gPT0gIjIiKQp0YWlsKG1sbV9yMi4xKSAKCnA5OXIxIDwtIHF1YW50aWxlKG1sbV9yMS4xJGdBQVRfUlQsIDAuOTkpIApwMDFyMSA8LSBxdWFudGlsZShtbG1fcjEuMSRnQUFUX1JULCAwLjAxKSAKcDk5cjEgIyA5OXRoIHBlcmNlbnRpbGUgUlRzID49IDE3MTMuNDhtcyAKcDAxcjEgIyAxc3QgcGVyY2VudGlsZSBSVHMgPD0gNDcybXMKCnA5OXIyIDwtIHF1YW50aWxlKG1sbV9yMi4xJGdBQVRfUlQsIDAuOTkpIApwMDFyMiA8LSBxdWFudGlsZShtbG1fcjIuMSRnQUFUX1JULCAwLjAxKSAjIDFzdCBwZXJjZW50aWxlIFJUcyA8PSA0NjNtcwpwOTlyMiAjIDk5dGggcGVyY2VudGlsZSBSVHMgPj0gMTcxMi40NW1zIApwMDFyMiAjIDFzdCBwZXJjZW50aWxlIFJUcyA8PSA0NjNtcwoKbWxtX3IxLjIgPC0gbWxtX3IxLjEgJT4lCiAgbXV0YXRlKG91dGxpZXJfUlQgPSBpZmVsc2UoZ0FBVF9SVCA8PSBwMDFyMSB8IGdBQVRfUlQgPj0gcDk5cjEsIDEsIDApKQp0YWJsZShtbG1fcjEuMiRvdXRsaWVyX1JUKSAKMjI3LzExMDA1ICMgMjI3IHRyaWFscyB3aWxsIGJlIGRyb3BwZWQsIDExMDA1IHdpbGwgYmUgcmV0YWluZWQuLi5hYm91dCAyJSBvZiB0cmlhbHMuCgptbG1fcjIuMiA8LSBtbG1fcjIuMSAlPiUKICBtdXRhdGUob3V0bGllcl9SVCA9IGlmZWxzZShnQUFUX1JUIDw9IHAwMXIyIHwgZ0FBVF9SVCA+PSBwOTlyMiwgMSwgMCkpCnRhYmxlKG1sbV9yMi4yJG91dGxpZXJfUlQpIAoyMzAvMTEwMDIgIyAyMzAgdHJpYWxzIHdpbGwgYmUgZHJvcHBlZCwgMTEwMDIgd2lsbCBiZSByZXRhaW5lZC4uLmFib3V0IDIlIG9mIHRyaWFscy4KCm1sbV9yMXIyIDwtIGJpbmRfY29scyhtbG1fcjEuMiwgbWxtX3IyLjIpICMgMTEyMzIgdHJpYWxzIHRvdGFsLgpoZWFkKG1sbV9yMXIyKSAjIG1ha2Ugc3VyZSB0aGF0IHRyaWFscyBpbiB0aGUgdHdvIHJ1bnMgbGluZSB1cCBwb3N0LW1lcmdlCnRhaWwobWxtX3IxcjIpICMgbWFrZSBzdXJlIHRoYXQgdHJpYWxzIGluIHRoZSB0d28gcnVucyBsaW5lIHVwIHBvc3QtbWVyZ2UKCiMgZ2V0IHJpZCBvZiBhbnkgdHJpYWxzIHdpdGggb3V0bGllcnMgaW4gZWl0aGVyIHJ1bjEgb3IgcnVuMiAKIyAobmVlZCBydW4xL3J1bjIgdG8gYmUgdGhlIHNhbWUgbGVuZ3RoIHNvIHRoYXQgdGhlIHRyaWFscyBtYXRjaCB1cCkKbWxtX3IxcjIuMSA8LSBtbG1fcjFyMiAlPiUgZmlsdGVyKG91dGxpZXJfUlQgPT0gIjAiICYgb3V0bGllcl9SVDEgPT0gIjAiKSAKY291bnQobWxtX3IxcjIuMSkgIyAxMDc5MCBvYnMuCjEwNzkwLzExMjMyICMgOTYlIG9mIHRyaWFscyByZXRhaW5lZCA9IDQlIG9mIHRyaWFscyBkcm9wcGVkLiBUaGF0IGZlZWxzIGFjY2VwdGFibGUuCgpwdXNoX3B1bGwgPC0gbWxtX3IxcjIuMSAlPiUgZmlsdGVyKHB1c2hfcHVsbCA9PSAiUFVTSCIgJiBwdXNoX3B1bGwxID09ICJQVUxMIikgJT4lIG11dGF0ZShiaWFzID0gKGdBQVRfUlQtZ0FBVF9SVDEpKQpwdWxsX3B1c2ggPC0gbWxtX3IxcjIuMSAlPiUgZmlsdGVyKHB1c2hfcHVsbCA9PSAiUFVMTCIgJiBwdXNoX3B1bGwxID09ICJQVVNIIikgJT4lIG11dGF0ZShiaWFzID0gKGdBQVRfUlQxLWdBQVRfUlQpKQoKbWxtX3BwIDwtIGJpbmRfcm93cyhwdXNoX3B1bGwscHVsbF9wdXNoKQoKVmlldyhtbG1fcHApCmBgYAoKIyMjIFRyYW5zZm9ybWF0aW9ucwpgYGB7cn0KbGlicmFyeShwc3ljaCkKZGVzY3JpYmUobWxtX3BwJGJpYXMpICMgc2tld25lc3MgaXMgMC4xLCBrdXJ0b3NpcyBpcyAxLjY5Cmhpc3QobWxtX3BwJGJpYXMpCnFxbm9ybShtbG1fcHAkYmlhcykKZ2dwbG90KG1sbV9wcCwgYWVzKHNhbXBsZT1iaWFzKSkrc3RhdF9xcSgpK3N0YXRfcXFfbGluZSgpICMgbm90IGEgZ29vZCBsb29rIGF0IGFsbC4uLgoKIyBpbnN0YWxsLnBhY2thZ2VzKCJiZXN0Tm9ybWFsaXplIikKIyB3aGF0J3MgdGhlIGJlc3QgdHJhbnNmb3JtYXRpb24gZm9yIG15IGRhdGE/CmxpYnJhcnkoYmVzdE5vcm1hbGl6ZSkKCm9yZGVyTm9ybV9iaWFzIDwtIGJlc3ROb3JtYWxpemUobWxtX3BwJGJpYXMpICMgc3VnZ2VzdGVkIG9yZGVyTm9ybSB0cmFuc2Zvcm0gYXMgYmVzdAptbG1fcHAkYmlhc190IDwtIG9yZGVyTm9ybV9iaWFzJHgudCAjIHB1bGwgeC50IGZyb20gb3JkZXJOb3JtX2JpYXMgYW5kIGFzc2lnbiBpdCBiYWNrIGludG8gZGF0YXNldAoKZGVzY3JpYmUobWxtX3BwJGJpYXNfdCkKaGlzdChtbG1fcHAkYmlhc190KQpxcW5vcm0obWxtX3BwJGJpYXNfdCkKZ2dwbG90KG1sbV9wcCwgYWVzKHNhbXBsZT1iaWFzX3QpKStzdGF0X3FxKCkrc3RhdF9xcV9saW5lKCkgIyBzbyBtdWNoIGJldHRlciEKCiMgYmFjay10cmFuc2Zvcm1hdGlvbiwganVzdCB0byBzaG93IGhvdyB0byBkbyBpdDoKcCA8LSBwcmVkaWN0KG9yZGVyTm9ybV9iaWFzKQogICAgeDIgPC0gcHJlZGljdChvcmRlck5vcm1fYmlhcywgbmV3ZGF0YSA9IHAsIGludmVyc2UgPSBUUlVFKSAjIHgyIGlzIHRoZSBiYWNrLXRyYW5zZm9ybWVkIGRhdGEKICAgIGFsbC5lcXVhbCh4MiwgbWxtX3BwJGJpYXNfdCkgCgptbG1fYngzIDwtIG1sbV9wcApzYXZlUkRTKG1sbV9ieDMsICJ+L0Ryb3Bib3gvMjAxOEZhbGwvRlNIRDYxN0MvbWxtX2J4My5yZHMiKQpgYGAKCiMjIyBDaGVja2luZyB0aGUgZGF0YQpgYGB7cn0KdGFibGUgPC0gbWxtX2J4MyAlPiUgZ3JvdXBfYnkoSUQpICU+JSBncm91cF9ieShjb25kKSAlPiUgY291bnQoSUQpIAp0YWJsZQojIG1pc3NpbmcgZGF0YS4uLgojIGNvbmQgQTogRDEwMSAoMyB0cmlhbHMpLCBEMTQxICgxOCB0cmlhbHMpLCBEMTQ4ICgxOSB0cmlhbHMpCiMgY29uZCBCOiAgRDE0NyAoMSB0cmlhbCkKCmRlc2NyaWJlKHRhYmxlJG4pCmdncGxvdCh0YWJsZSwgYWVzKHNhbXBsZT1uKSkrc3RhdF9xcSgpK3N0YXRfcXFfbGluZSgpICMgY2FuIHNlZSB0aG9zZSA0IG9uIHRoZSBRUSBwbG90CgojIHdoZXJlIGFyZSB0aGUgdHJpYWxzIGdldHRpbmcgZHJvcHBlZD8KbWxtX3IxcjIgJT4lIGdyb3VwX2J5KElEKSAlPiUgZ3JvdXBfYnkoY29uZCkgJT4lIGNvdW50KElEKSAjIGV2ZXJ5b25lIGhhcyAxNDQgaGVyZQptbG1fcjFyMi4xICU+JSBncm91cF9ieShJRCkgJT4lIGdyb3VwX2J5KGNvbmQpICU+JSBjb3VudChJRCkgCiMgYWZ0ZXIgZ2V0dGluZyByaWQgb2Ygb3V0bGllcnMsIG1vc3QgcGVvcGxlIG1pc3NpbmcgYSBmZXcgdHJpYWxzIChEMTA3IGNvbmQgQS9CIGFuZCBEMTEzIGNvbmQgQSBtaXNzaW5nID4yMCkKCm1sbV9yMXIyLjEgJT4lIGZpbHRlcihJRD09IkQxMDEiICYgY29uZD09IkEiKQptbG1fcjFyMi4xICU+JSBmaWx0ZXIoSUQ9PSJEMTQxIiAmIGNvbmQ9PSJBIikKbWxtX3IxcjIuMSAlPiUgZmlsdGVyKElEPT0iRDE0OCIgJiBjb25kPT0iQSIpCm1sbV9yMXIyLjEgJT4lIGZpbHRlcihJRD09IkQxNDciICYgY29uZD09IkIiKQojIHNvIHRyaWFscyBhcmUgZ2V0dGluZyBkcm9wcGVkIGJlY2F1c2UgdGhleSBkaWRuJ3QgZWZmZWN0aXZlbHkgcmV2ZXJzZSB0aGUgaW5zdHJ1Y3Rpb25zIG9yIHRoZXkgcmV2ZXJ0ZWQgdG8gdGhlIG9sZCBpbnN0cnVjdGlvbnMKIyBpbiBlc3NlbmNlLCB0aGlzIHJlbW92ZXMgZXJyb3IgdHJpYWxzCgojIGNyZWF0ZSBhICJkcm9wIiB2YXJpYWJsZSBmb3IgdGhlc2UgNCwganVzdCBpbiBjYXNlLi4uCm1sbV9ieDMgPC0gbWxtX2J4MyAlPiUgbXV0YXRlKGxvd19uX3RyaWFscyA9IGlmZWxzZShJRCA9PSAiRDEwMSIgfCBJRCA9PSAiRDE0MSIgfCBJRCA9PSAiRDE0NyIgfCBJRCA9PSAiRDE0OCIsIDEsIDApKQoKIyBjaGVjayB3aGV0aGVyIHRoZSByb3dzIGxpbmUgdXAKbm90bGluZWR1cCA8LSBtbG1fYngzICU+JSBmaWx0ZXIoc3RpbSAhPSBzdGltMSkKbm90bGluZWR1cApub3RsaW5lZHVwIDwtIG1sbV9ieDMgJT4lIGZpbHRlcih0cmlhbGNvZGUgIT0gdHJpYWxjb2RlMSkKbm90bGluZWR1cApub3RsaW5lZHVwIDwtIG1sbV9ieDMgJT4lIGZpbHRlcih0cmlhbG51bSAhPSB0cmlhbG51bTEpCm5vdGxpbmVkdXAKIyAwIHJvd3MgcmV0dXJuZWQ7IGFsbCB0aGUgcm93cyBtYXRjaAoKaGVhZChtbG1fYngzKQpzYXZlUkRTKG1sbV9ieDMsICJ+L0Ryb3Bib3gvMjAxOEZhbGwvRlNIRDYxN0MvbWxtX2J4My5yZHMiKQpgYGAKCiMjIyBBZGQgdGltZS1pbnZhcmlhbnQgdmFyaWFibGVzCk5leHQgc3RlcCBpcyB0byBhZGQgZGVtb2dyYXBoaWNzIGFuZCBvdGhlciB2YXJpYWJsZXMgdGhhdCB3ZSBtaWdodCBwb3RlbnRpYWxseSB3YW50IHRvIGluY2x1ZGUgaW4gdGhlIG1vZGVsIGJ1dCB0aGF0IGRvIG5vdCBjaGFuZ2Ugb3ZlciB0aW1lLiBMb29raW5nIGF0IHRoZSBjb2RlYm9vayBmb3IgdGhlIG1hc3RlciBkYXRhc2V0LCB0aGVzZSBpbmNsdWRlOgoKRGVtb2dyYXBoaWNzOgoKKiBgYWdlYAoqIGBhZ2VfeXJzYAoqIGBzZXhfbWAKKiBgZXRobmljaXR5X2hpc3BgCiogYHJhY2VgCiogYHRpbWVzaW5jZWRlYXRoYAoKR2VuZXRpYyB2YXJpYWJsZXM6CgoqIGByczIyNTQyOThgCiogYHJzMjI2ODQ5OGAKKiBgcnM1MzU3NmAKKiBgcnMyMjU0Mjk4X0EuY2FycmllcmAKKiBgcnMyMjY4NDk4X0MuY2FycmllcmAKKiBgcnM1MzU3Nl9BLmNhcnJpZXJgCgpTZWxmLXJlcG9ydCBtZWFzdXJlczoKCiogYHRvdF9pY2dgIFtncmllZl0KKiBgdG90X2JkaWAgW2RlcHJlc3Npb25dCiogYHRvdF9iZ3FgIFticmllZiBncmllZiBxdWVzdGlvbm5haXJlIHdpdGggaW1wYWlybWVudCBpdGVtXQoqIGB0b3RfZWNycnNfZ2xvYmFsX2FueGAgW2FueGlvdXMgYXR0YWNobWVudCAtIGdsb2JhbF0KKiBgdG90X2VjcnJzX2dsb2JhbF9hdm9pZGAgW2F2b2lkYW50IGF0dGFjaG1lbnQgLSBnbG9iYWxdCiogYHRvdF9lY3Jyc19zcG91c2VfYW54YCBbYW54aW91cyBhdHRhY2htZW50IC0gc3BvdXNlXQoqIGB0b3RfZWNycnNfc3BvdXNlX2F2b2lkYCBbYXZvaWRhbnQgYXR0YWNobWVudCAtIHNwb3VzZV0KKiBgdG90X3lzbGAgW3llYXJuaW5nIGZvciB0aGUgZGVjZWFzZWRdCgoKYGBge3J9CiMgbG9hZCBpbiBtYXN0ZXIgZGF0YXNldAptYXN0ZXIgPC0gcmVhZFJEUygifi9Ecm9wYm94L0dMQVNTIExhYi9PVCBTdHVkeS9kYXRhL2NsZWFuZWQtZGF0YS9zZWxmcmVwb3J0c19veHRyX2NvcnRpc29sX3JhbmRvbV9BQl9ieF9jbGVhbi5yZHMiKSAKCiMgc3Vic2V0IHRoZSBzZWxlY3RlZCB2YXJpYWJsZXMKbWxtX2FkZCA8LSBzdWJzZXQobWFzdGVyLCBzZWxlY3Q9YyhJRCxhZ2UsIGFnZV95cnMsIHNleF9tLCBldGhuaWNpdHlfaGlzcCwgcmFjZSwgdGltZXNpbmNlZGVhdGgsIHJzMjI1NDI5OCwgcnMyMjY4NDk4LCByczUzNTc2LCByczIyNTQyOThfQS5jYXJyaWVyLCByczIyNjg0OThfQy5jYXJyaWVyLCByczUzNTc2X0EuY2FycmllciwgdG90X2JkaSwgdG90X2JncSwgdG90X2VjcnJzX2dsb2JhbF9hbngsdG90X2VjcnJzX2dsb2JhbF9hdm9pZCwgdG90X2VjcnJzX3Nwb3VzZV9hbngsIHRvdF9lY3Jyc19zcG91c2VfYXZvaWQsIHRvdF95c2wsIHRvdF9pY2cpKQpoZWFkKG1sbV9hZGQpCgojIG1lcmdlIGludG8gdGhlIGJlaGF2aW9yYWwgZGF0YXNldAptbG1fYng0IDwtIGxlZnRfam9pbihtbG1fYngzLCBtbG1fYWRkLCBieT0iSUQiKQpoZWFkKG1sbV9ieDQpCgojIHNhdmUgaXQKc2F2ZVJEUyhtbG1fYng0LCAifi9Ecm9wYm94LzIwMThGYWxsL0ZTSEQ2MTdDL21sbV9ieDQucmRzIikKYGBgCgoKIyMgRXhwbG9yYXRvcnkgYW5hbHlzaXMgYW5kIGNoZWNraW5nIGFzc3VtcHRpb25zCgpGaXJzdCBzdGVwIGlzIHRvIG92ZXJ2aWV3IHRoZSBlbnRpcmUgZGF0YXNldCB1c2luZyBgc3VtbWFyeXRvb2xzYC4gCmBgYHtyfQpsaWJyYXJ5KHN1bW1hcnl0b29scykKCiMgb3ZlcnZpZXcgdGhlIGVudGlyZSBkYXRhc2V0CiMgdGhpcyB3aWxsIGxvb2sgbGlrZSBUT1RBTCBjcmFwIGluIHRoZSBjb25zb2xlIChub3RlYm9vayBvdXRwdXQpCiMgdXNlIHZpZXcoZGZTdW1tYXJ5KG1sbV9ieDQpKSBmcm9tIHRoZSBjb25zb2xlIHRvIHNlZSBhIG11Y2ggbW9yZSByZWFkYWJsZSBhbmQgYXR0cmFjdGl2ZSBvdXRwdXQKZGZTdW1tYXJ5KG1sbV9ieDQpCiAjIG5vIG1pc3NpbmcgZGF0YSBvbiBhbnkgb2YgdGhlIHZhcmlhYmxlcyEKYGBgCgojIyMgRGVzY3JpcHRpdmVzCmBgYHtyfQpsaWJyYXJ5KHBzeWNoKQpsaWJyYXJ5KHN0YXJnYXplcikKbGlicmFyeShzdW1tYXJ5dG9vbHMpCgojIGRlc2NyaXB0aXZlcyBmb3IgdGhlIHRpbWUtaW52YXJpYW50IHZhcmlhYmxlcyBhcmUgZ29pbmcgdG8gYmUgd3JvbmcgaWYgd2UgdXNlIG1sbV9ieDQgKHNpbmNlIG9ic2VydmF0aW9ucyBhcmUgZHVwbGljYXRlZCkKIyBzbyBnb2luZyBiYWNrIHRvIHRoZSBtbG1fYWRkIG9iamVjdC4uLgojIG5vdGUgdGhhdCBuID0gNDAsIGJ1dCBuID0gMzkgd2l0aCBSVCBkYXRhCiMgRDE0OSdzIGJlaGF2aW9yYWwgZGF0YSB3YXMgZHJvcHBlZCAocmFuIG91dHNpZGUgb2Ygc2Nhbm5lciksIHNvIGRyb3AgaGlzIGNhc2UKCm1sbV9hZGQgPC0gZmlsdGVyKG1sbV9hZGQsICFncmVwbCgiRDE0OSIsSUQpKQp1bmlxdWUobWxtX2FkZCRJRCkgIyBpdCB3b3JrZWQKbnVtcyA8LSBzZWxlY3RfaWYobWxtX2FkZCwgaXMubnVtZXJpYykgIyBqdXN0IGdldCB0aGUgbnVtZXJpYyB2YXJpYWJsZXMKdmlldyhkZlN1bW1hcnkobnVtcykpIApzdGFyZ2F6ZXIobnVtcywgdHlwZT0idGV4dCIsIHRpdGxlPSJEZXNjcmlwdGl2ZXMiLCBkaWdpdHM9Miwgb3V0PSJ0YWJsZTEudHh0Iiwgbm90ZXMgPSAiTm90ZTogJ3N0YXJnYXplcicgbWFrZXMgbmljZXIgbG9va2luZyB0YWJsZXMsIGJ1dCBkb2Vzbid0IHByb3ZpZGUgc2tld25lc3Mgb3Iga3VydG9zaXMgc3RhdGlzdGljcywgc28gd2UnbGwgdXNlICdwc3ljaCcgZm9yIHRoYXQuIikgCgpkZXNjcmliZShudW1zKQpgYGAKCiMjIyBGcmVxdWVuY2llcwpgYGB7cn0KIyB3aGljaCB2YXJpYWJsZXMgYXJlIGZhY3RvcnM/Cm1sbV9hZGQgJT4lIHNlbGVjdF9pZihpcy5mYWN0b3IpICU+JSBjb2xuYW1lcygpCgojIGhtbSwgcnMyMjY4NDk4IGFuZCByczUzNTc2IHNob3VsZCBhbHNvIGJlIGZhY3RvcnMsIHNvIGZpeCB0aGF0IG5vdwptbG1fYWRkIDwtIG1sbV9hZGQgJT4lIG11dGF0ZShyczIyNjg0OTggPSByZWNvZGVfZmFjdG9yKHJzMjI2ODQ5OCwgIkMvVCIgPSAiQy9UIiwgIkNDIiA9ICJDQyIsICJUVCIgPSAiVFQiKSwgcnM1MzU3NiA9IHJlY29kZV9mYWN0b3IocnM1MzU3NiwgIkEvRyIgPSAiQS9HIiwgIkFBIiA9ICJBQSIsICJHRyIgPSAiR0ciKSkKbWxtX2FkZCAlPiUgc2VsZWN0X2lmKGlzLmZhY3RvcikgJT4lIGNvbG5hbWVzKCkKCiMgZnVuY3Rpb24gdG8gY291bnQgZnJlcXVlbmNpZXMgZm9yIHZhcmlhYmxlcyB0aGF0IGFyZSBmYWN0b3JzLi4udGhpcyBpc24ndCB3b3JraW5nCiMgY291bnRBbGwgPC0gZnVuY3Rpb24oYmFzZWRhdGEpCiMgewojCWZhY3MgPC0gc2FwcGx5KGJhc2VkYXRhLCBpcy5mYWN0b3IpCiMJZmFjZGF0YSA8LSBiYXNlZGF0YVsgLGZhY3NdCiMJZm9yKGkgaW4gMTpsZW5ndGgoZmFjZGF0YSkpCiMJewojCQljb3VudChmYWNkYXRhKQojCSB9CiMgfQojIGNvdW50QWxsKG1sbV9ieDQpCgptbG1fYWRkICU+JSBjb3VudChzZXhfbSkgIyAyOCBmZW1hbGVzLCAxMSBtYWxlcwptbG1fYWRkICU+JSBjb3VudChyYWNlKSAjIDM4IHdoaXRlLCAxIGFub3RoZXIgcmFjZSBub3QgbGlzdGVkCm1sbV9hZGQgJT4lIGNvdW50KGV0aG5pY2l0eV9oaXNwKSAjIDM3IG5vbi1IaXNwYW5pYy9MYXRpbm8sIDIgSGlzcGFuaWMvTGF0aW5vCm1sbV9hZGQgJT4lIGNvdW50KHJzMjI1NDI5OCkgIyAyMiBHRywgMTAgQS9HLCAxIE5BL21pc3NpbmcgKDAgQUEpCm1sbV9hZGQgJT4lIGNvdW50KHJzMjI2ODQ5OCkgIyAxNyBDL1QsIDEwIENDLCAxMiBUVAptbG1fYWRkICU+JSBjb3VudChyczUzNTc2KSAjIDIxIEEvRywgMTggR0cgKDAgQUEpCm1sbV9hZGQgJT4lIGNvdW50KHJzMjI1NDI5OF9BLmNhcnJpZXIpICMgeWVzID0gMTAsIG5vID0gMjgsIE5BID0gMQptbG1fYWRkICU+JSBjb3VudChyczIyNjg0OThfQy5jYXJyaWVyKSAjIHllcyA9IDI3LCBubyA9IDEyCm1sbV9hZGQgJT4lIGNvdW50KHJzNTM1NzZfQS5jYXJyaWVyKSAjIHllcyA9IDIxLCBubyA9IDE4CmBgYAoKIyMjIENoZWNraW5nIGRpc3RyaWJ1dGlvbiBzaGFwZXMgYW5kIG5vcm1hbGl0eQpHb3QgYSBwcmV2aWV3IG9mIHRoaXMgYWJvdmUgd2hlbiB3ZSB1c2VkIGBzdW1tYXJ5dG9vbHNgLCBidXQgaGVyZSdzIGEgY2xvc2VyIGxvb2sgYXQgc29tZSBoaXN0b2dyYW1zIGFuZCBRUSBwbG90cy4KYGBge3J9CiMgYSBmdW5jdGlvbiB0byBwcm9kdWNlIGhpc3RvZ3JhbXMgZm9yIGFsbCBudW1lcmljIHZhcmlhYmxlcyBpbiBhIGRhdGFmcmFtZQpoaXN0QWxsIDwtIGZ1bmN0aW9uKGJhc2VkYXRhKQp7CgludW1zIDwtIHNhcHBseSgoYmFzZWRhdGEpLCBpcy5udW1lcmljKQoJbnVtZGF0YSA8LSBiYXNlZGF0YVsgLG51bXNdCglwYXIobWZyb3c9Yyg0LDQpKQoJZm9yKGkgaW4gMTpsZW5ndGgobnVtZGF0YSkpCgl7CgkJaGlzdChudW1kYXRhWyxpXSwgeGxhYj1OVUxMLCBtYWluPW5hbWVzKG51bWRhdGFbaV0pKQoJfQp9CgpoaXN0QWxsKGFzLmRhdGEuZnJhbWUobWxtX2J4NCkpCgpgYGAKCiMjIyBDZW50ZXJpbmcgTDIgcHJlZGljdG9ycwoKYGBge3J9CiMgcHVsbCBvdXQgb25seSB0aGUgdG90YWwgc2NvcmUgdmFyaWFibGVzLCBhZ2UsIHRpbWVzaW5jZWRlYXRoCmdjdmFycyA8LSBhcy5kYXRhLmZyYW1lKG1sbV9ieDRbLCBncmVwKCdedG90fGFnZXx0aW1lc2luY2VkZWF0aHxJRCcsIG5hbWVzKG1sbV9ieDQpKV0pCmdjdmFyczEgPC0gZ2N2YXJzWyFkdXBsaWNhdGVkKGdjdmFycyRJRCksIF0Kc3RhcmdhemVyKGdjdmFyczEsIHR5cGU9InRleHQiLCBtZWRpYW4gPSBULCBkaWdpdHM9MykKCmdtZWFuX2FnZSA8LSBtZWFuKGdjdmFyczEkYWdlKQpnbWVhbl9hZ2VfeXJzIDwtIG1lYW4oZ2N2YXJzMSRhZ2VfeXJzKQpnbWVhbl90aW1lIDwtIG1lYW4oZ2N2YXJzMSR0aW1lc2luY2VkZWF0aCkKZ21lYW5fYmRpIDwtIG1lYW4oZ2N2YXJzMSR0b3RfYmRpKQpnbWVhbl9iZ3EgPC0gbWVhbihnY3ZhcnMxJHRvdF9iZ3EpCmdtZWFuX2VjcnJzX2dfYW54IDwtIG1lYW4oZ2N2YXJzMSR0b3RfZWNycnNfZ2xvYmFsX2FueCkKZ21lYW5fZWNycnNfZ19hdiA8LSBtZWFuKGdjdmFyczEkdG90X2VjcnJzX2dsb2JhbF9hdm9pZCkKZ21lYW5fZWNycnNfc19hbnggPC0gbWVhbihnY3ZhcnMxJHRvdF9lY3Jyc19zcG91c2VfYW54KQpnbWVhbl9lY3Jyc19zX2F2IDwtIG1lYW4oZ2N2YXJzMSR0b3RfZWNycnNfc3BvdXNlX2F2b2lkKQpnbWVhbl9pY2cgPC0gbWVhbihnY3ZhcnMxJHRvdF9pY2cpCmdtZWFuX3lzbCA8LSBtZWFuKGdjdmFyczEkdG90X3lzbCkKCm1sbV9ieDUgPC0gbWxtX2J4NCAlPiUgbXV0YXRlKGdtZWFuX2FnZSA9IGFnZS1nbWVhbl9hZ2UsIGdtZWFuX2FnZV95cnMgPSBhZ2VfeXJzLWdtZWFuX2FnZV95cnMsIGdtZWFuX3RpbWVzaW5jZWRlYXRoID0gdGltZXNpbmNlZGVhdGgtZ21lYW5fdGltZSwgZ21lYW5fYmRpID0gdG90X2JkaS1nbWVhbl9iZGksIGdtZWFuX2JncSA9IHRvdF9iZ3EtZ21lYW5fYmdxLCBnbWVhbl9lY3Jyc19nbG9iYWxfYW54ID0gdG90X2VjcnJzX2dsb2JhbF9hbngtZ21lYW5fZWNycnNfZ19hbngsIGdtZWFuX2VjcnJzX2dsb2JhbF9hdm9pZCA9IHRvdF9lY3Jyc19nbG9iYWxfYXZvaWQtZ21lYW5fZWNycnNfZ19hdiwgZ21lYW5fZWNycnNfc3BvdXNlX2FueCA9IHRvdF9lY3Jyc19zcG91c2VfYW54LWdtZWFuX2VjcnJzX3NfYW54LCBnbWVhbl9lY3Jyc19zcG91c2VfYXZvaWQgPSB0b3RfZWNycnNfc3BvdXNlX2F2b2lkLWdtZWFuX2VjcnJzX3NfYXYsIGdtZWFuX3lzbCA9IHRvdF95c2wtZ21lYW5feXNsLCBnbWVhbl9pY2cgPSB0b3RfaWNnLWdtZWFuX2ljZykKc3RhcmdhemVyKGFzLmRhdGEuZnJhbWUobWxtX2J4NSksIHR5cGU9InRleHQiKSAjIG5vdGUgdGhhdCBtZWFucyBvZiB0aGUgZ3JvdXAtbWVhbiBjZW50ZXJlZCB2YXJpYWJsZXMgYXJlIG5vdCB6ZXJvIC0gSSB0aGluayB0aGlzIGlzIGJlY2F1c2Ugc29tZSBwZW9wbGUgaGFkIG1vcmUgdHJpYWxzIHRoYW4gb3RoZXJzCgojIHRlc3QgdGhhdCBoeXBvdGhlc2lzIHdpdGggdGhlIG5vbi1kdXBsaWNhdGVkIGRhdGEKZ2N2YXJzMiA8LSBnY3ZhcnMxICU+JSBtdXRhdGUoZ21lYW5fYWdlID0gYWdlLWdtZWFuX2FnZSwgZ21lYW5fYWdlX3lycyA9IGFnZV95cnMtZ21lYW5fYWdlX3lycywgZ21lYW5fdGltZXNpbmNlZGVhdGggPSB0aW1lc2luY2VkZWF0aC1nbWVhbl90aW1lLCBnbWVhbl9iZGkgPSB0b3RfYmRpLWdtZWFuX2JkaSwgZ21lYW5fYmdxID0gdG90X2JncS1nbWVhbl9iZ3EsIGdtZWFuX2VjcnJzX2dsb2JhbF9hbnggPSB0b3RfZWNycnNfZ2xvYmFsX2FueC1nbWVhbl9lY3Jyc19nX2FueCwgZ21lYW5fZWNycnNfZ2xvYmFsX2F2b2lkID0gdG90X2VjcnJzX2dsb2JhbF9hdm9pZC1nbWVhbl9lY3Jyc19nX2F2LCBnbWVhbl9lY3Jyc19zcG91c2VfYW54ID0gdG90X2VjcnJzX3Nwb3VzZV9hbngtZ21lYW5fZWNycnNfc19hbngsIGdtZWFuX2VjcnJzX3Nwb3VzZV9hdm9pZCA9IHRvdF9lY3Jyc19zcG91c2VfYXZvaWQtZ21lYW5fZWNycnNfc19hdiwgZ21lYW5feXNsID0gdG90X3lzbC1nbWVhbl95c2wsIGdtZWFuX2ljZyA9IHRvdF9pY2ctZ21lYW5faWNnKQpzdGFyZ2F6ZXIoYXMuZGF0YS5mcmFtZShnY3ZhcnMyKSwgdHlwZT0idGV4dCIpICMgeWVzLCB0aGUgbGF0dGVyIGFyZSB6ZXJvCgpzYXZlUkRTKG1sbV9ieDUsICJ+L0Ryb3Bib3gvMjAxOEZhbGwvRlNIRDYxN0MvbWxtX2J4NS5yZHMiKQpgYGAKCiMjIyBFdmFsdWF0ZSBtaXNzaW5nIGRhdGEgCmBgYHtyfQptbG1fYng1ICU+JSAKICBzZWxlY3RfaWYoZnVuY3Rpb24oeCkgYW55KGlzLm5hKHgpKSkgJT4lIAogIHN1bW1hcmlzZV9hbGwoZnVucyhtZWFuKGlzLm5hKC4pKSkpIC0+IG1sbV9ieDVfTkFzICMgb3IgdXNlIHN1bSgpIGluc3RlYWQgb2YgbWVhbigpIHRvIGZpbmQgbiBtaXNzaW5nIHZhbHVlcwoKbWxtX2J4NV9OQXMgPC0gZ2F0aGVyKG1sbV9ieDVfTkFzKSAjIGNyZWF0ZSBsb25nIGRhdGEgdGhhdCBsaXN0cyB2YXJpYWJsZXMgd2l0aCBhbnkgTkFzLCBhbmQgJSBvZiBkYXRhIG1pc3NpbmcKbWxtX2J4NV9OQXMKYGBgCgpPbmUgcGVyc29uIGlzIG1pc3NpbmcgcnMyMjU0Mjk4IGdlbm90eXBlIChgcnMyMjU0Mjk4YCBhbmQgYHJzMjI1NDI5OF9BLmNhcnJpZXJgKSwgd2hpY2ggd2UgYWxyZWFkeSBrbmV3IGFib3V0LgoKIyMjIFNjYWxlIHJlbGlhYmlsaXRpZXMKVGhpcyBkYXRhc2V0IGRvZXMgbm90IGluY2x1ZGUgdGhlIGl0ZW0tbGV2ZWwgZGF0YSwgYnV0IHdlIGNhbiBnZXQgdGhhdCBmcm9tIHRoZSBtYXN0ZXIgZGF0YXNldCB3ZSBsb2FkZWQgaW4gZWFybGllci4KYGBge3J9CmxpYnJhcnkocHN5Y2gpCm1sbV9zY2FsZXMgPC0gZmlsdGVyKG1hc3RlciwgIWdyZXBsKCJEMTQ5IixJRCkpCgojIyBCREkKbWxtX3RvdF9iZGkgPC0gc3Vic2V0KG1sbV9zY2FsZXMsIHNlbGVjdD1jKGJkaV8xYzpiZGlfMjFjKSkgIApwc3ljaDo6YWxwaGEobWxtX3RvdF9iZGkpCgojIyBCR1EKbWxtX3RvdF9iZ3EgPC0gc3Vic2V0KG1sbV9zY2FsZXMsIHNlbGVjdD1jKGJncV8xOmJncV81KSkKcHN5Y2g6OmFscGhhKG1sbV90b3RfYmdxKQoKIyMgSUNHCm1sbV90b3RfaWNnIDwtIHN1YnNldChtbG1fc2NhbGVzLCBzZWxlY3Q9YyhpY2dfMTppY2dfMTkpKQpwc3ljaDo6YWxwaGEobWxtX3RvdF9pY2cpCgojIyBZU0wKbWxtX3RvdF95c2wgPC0gc3Vic2V0KG1sbV9zY2FsZXMsIHNlbGVjdD1jKHlzbF8xOnlzbF8yMSkpCnBzeWNoOjphbHBoYShtbG1fdG90X3lzbCkKCiMjIEVDUlJTLWdsb2JhbCBhbnhpZXR5Cm1sbV90b3RfZWNycnNfZ2xvYmFsX2FueCA8LSBzdWJzZXQobWxtX3NjYWxlcywgIHNlbGVjdD1jKGVjcnJzX2dsb2JhbF83YzplY3Jyc19nbG9iYWxfOWMpKQpwc3ljaDo6YWxwaGEobWxtX3RvdF9lY3Jyc19nbG9iYWxfYW54KQoKIyMgRUNSUlMtZ2xvYmFsIGF2b2lkCm1sbV90b3RfZWNycnNfZ2xvYmFsX2F2b2lkIDwtIHN1YnNldChtbG1fc2NhbGVzLCAgc2VsZWN0PWMoZWNycnNfZ2xvYmFsXzFyOmVjcnJzX2dsb2JhbF80ciwgZWNycnNfZ2xvYmFsXzVjLCBlY3Jyc19nbG9iYWxfNmMpKQpwc3ljaDo6YWxwaGEobWxtX3RvdF9lY3Jyc19nbG9iYWxfYXZvaWQpCgojIyBFQ1JSUy1zcG91c2UgYW54aWV0eQptbG1fdG90X2VjcnJzX3Nwb3VzZV9hbnggPC0gc3Vic2V0KG1sbV9zY2FsZXMsICBzZWxlY3Q9YyhlY3Jyc19zcG91c2VfN2M6ZWNycnNfc3BvdXNlXzljKSkKcHN5Y2g6OmFscGhhKG1sbV90b3RfZWNycnNfc3BvdXNlX2FueCkKCiMjIEVDUlJTLXNwb3VzZSBhdm9pZAptbG1fdG90X2VjcnJzX3Nwb3VzZV9hdm9pZCA8LSBzdWJzZXQobWxtX3NjYWxlcywgIHNlbGVjdD1jKGVjcnJzX3Nwb3VzZV8xcjplY3Jyc19zcG91c2VfNHIsIGVjcnJzX3Nwb3VzZV81YywgZWNycnNfc3BvdXNlXzZjKSkKcHN5Y2g6OmFscGhhKG1sbV90b3RfZWNycnNfc3BvdXNlX2F2b2lkKQoKYGBgCgojIyMgRHJvcCB0aGUgNCBwZW9wbGUgd2l0aCBsb3cgdHJpYWwgY291bnRzCmBgYHtyfQpkYXRhIDwtIGZpbHRlcihtbG1fYng1LCAhZ3JlcGwoIkQxMDF8RDE0MXxEMTQ3fEQxNDgiLElEKSkKdW5pcXVlKGRhdGEkSUQpCmBgYAoKIyMgT0xTIGVzdGltYXRlcyBmb3IgZXhwbG9yYXRvcnkgcHVycG9zZXMKCmBgYHtyfQojIGdldHRpbmcgcmVndWxhciByZWdyZXNzaW9uIGVzdGltYXRlcyBvbmUgcGVyc29uIGF0IGEgdGltZSBmb3IgZXhwbG9yYXRvcnkgcHVycG9zZXM6CmxtRXN0IDwtIGJ5KGRhdGEsIGRhdGEkSUQsIGZ1bmN0aW9uKHgpIHN1bW1hcnkobG0oYmlhc190IH4gdHJpYWxudW0sIGRhdGE9eCkpKQpsbUVzdApgYGAKCiMjIyBTdGVtIHBsb3QgZm9yIHRoZSBpbnRlcmNlcHRzIGJhc2VkIG9uIHRoZSBPTFMgZXN0aW1hdGVzOgpgYGB7cn0KaW50IDwtIGJ5KGRhdGEsIGRhdGEkSUQsIGZ1bmN0aW9uKHgpIGNvZWZmaWNpZW50cyhsbShiaWFzX3QgfiB0cmlhbG51bSwgZGF0YT14KSlbWzFdXSkKaW50CgpzdW1tYXJ5KGludCkKc3RlbShpbnQsIHNjYWxlPTIpCmhpc3QoaW50KQpgYGAKIyMjIFN0ZW0gcGxvdCBmb3IgdGhlIHNsb3BlcyBiYXNlZCBvbiB0aGUgT0xTIGVzdGltYXRlcwpgYGB7cn0Kc2xvcGUgPC0gYnkoZGF0YSwgZGF0YSRJRCwgZnVuY3Rpb24oeCkgY29lZmZpY2llbnRzKGxtKGJpYXNfdCB+IHRyaWFsbnVtLCBkYXRhPXgpKVtbMl1dKQpzbG9wZQoKc3VtbWFyeShzbG9wZSkKc3RlbShzbG9wZSwgc2NhbGU9MikKaGlzdChzbG9wZSkKYGBgCk5vdGUgdGhhdCB0aGVzZSBhcmUgYWxsIGV4dHJlbWVseSBjbG9zZSB0byB6ZXJvIC0gcHJvYmFibHkgYmVjYXVzZSBvZiB0aGUgbGFjayBvZiB0aW1lIGVmZmVjdC4KCiMjIyBSLXNxdWFyZSBmb3IgT0xTIG1vZGVscwpgYGB7cn0KCnJzcSA8LSBieShkYXRhLCBkYXRhJElELCBmdW5jdGlvbih4KSBzdW1tYXJ5KGxtKGJpYXNfdCB+IHRyaWFsbnVtLCBkYXRhPXgpKSRyLnNxdWFyZWQpCnN1bW1hcnkocnNxKQpzdGVtKHJzcSwgc2NhbGU9MikKCmNvcihpbnQsIHNsb3BlKQpgYGAKVGhlIGNvcnJlbGF0aW9uIGJldHdlZW4gaW50ZXJjZXB0cyBhbmQgc2xvcGVzIGlzIC0wLjQ3NSwgc28gcGVvcGxlIHdobyBzaG93IGxlc3MgYXZvaWRhbmNlIGJpYXMgb3ZlcmFsbCBjaGFuZ2UgbGVzcyBvdmVyIHRoZSBjb3Vyc2Ugb2YgdGhlIHRhc2suCiAKIyMgR3JhcGhpbmcgbXVsdGlsZXZlbCBkYXRhIGZvciBleHBsb3JhdG9yeSBwdXJwb3NlcwpgYGB7cn0KbGlicmFyeShsYXR0aWNlKQp4eXBsb3QoYmlhc190IH4gdHJpYWxudW0gfCBJRCwgZGF0YSA9IGRhdGEsIGFzLnRhYmxlPVQpICMgdG9vIG1hbnkgcGVvcGxlL2hhcmQgdG8gc2VlLCB0cnkgcmFuZG9tIHN1YnNldAoKaWRzIDwtIHNhbXBsZSh1bmlxdWUoZGF0YSRJRCksIDEyKQppZHMKdGVtcCA8LSBkYXRhW2RhdGEkSUQgJWluJSBpZHMsIF0KeHlwbG90KGJpYXNfdCB+IHRyaWFsbnVtIHwgSUQsIGRhdGEgPSB0ZW1wLCBhcy50YWJsZT1UKSAKCiMgYWRkIGZpdCBsaW5lKHMpCnh5cGxvdChiaWFzX3QgfiB0cmlhbG51bSB8IElELCBkYXRhID0gdGVtcCwgdHlwZT1jKCJwIiwiciIpKSAjIGxpbmVhciBmaXQKeHlwbG90KGJpYXNfdCB+IHRyaWFsbnVtIHwgSUQsIGRhdGEgPSB0ZW1wLCB0eXBlPWMoInAiLCJzbW9vdGgiKSkgIyBjdXJ2aWxpbmVhciBmaXQKCiMgZ3JhcGggb2YgdGhlIHJhdyBkYXRhIGZvciBlYWNoIHBlcnNvbgppbnRlcmFjdGlvbi5wbG90KGRhdGEkdHJpYWxudW0sIGRhdGEkSUQsIGRhdGEkYmlhc190KQoKIyBnZW5lcmF0ZSBsaW5lYXIgZml0dGVkIHZhbHVlcyBmb3IgZWFjaCBwZXJzb24gYW5kIHRoZW4gcGxvdCBhbGwgdG9nZXRoZXIgaW4gb25lIHBsb3QKZml0IDwtIGJ5KGRhdGEsIGRhdGEkSUQsIGZ1bmN0aW9uKHgpIGZpdHRlZC52YWx1ZXMobG0oYmlhc190IH4gdHJpYWxudW0sIGRhdGE9eCkpKQpmaXQyIDwtIHVubGlzdChmaXQpCmludGVyYWN0aW9uLnBsb3QoZGF0YSR0cmlhbG51bSwgZGF0YSRJRCwgZml0MiwgeGxhYj0idHJpYWwgbnVtYmVyIiwgeWxhYj0iUlQgYmlhcyAodHJhbnNmb3JtZWQpIikKYGBgClRoZXJlIGRvZXMgbm90IHNlZW0gdG8gYmUgZWl0aGVyIGEgbGluZWFyIG9yIGN1cnZpbGluZWFyIGVmZmVjdCBvZiB0cmlhbCBudW1iZXIgKGkuZS4sIHRpbWUpIG9uIFJUIGJpYXMgaW4gdGhlIHRhc2suCgoKIyMgQW5hbHlzZXMgKE5IU1QpCjxjZW50ZXI+PGk+UmVtZW1iZXIsIHRoZSBlZmZlY3Qgb2YgdGltZSByZWZlcnMgdG8gYHRyaWFsbnVtYmVyYCAodGhpcyBpcyBOT1QgdGhlIGB0aW1lYCB2YXJpYWJsZTsgYHRpbWVgIHJlZmVycyB0byB0aW1lIG9mIGRheSB3aGVuIHRhc2sgd2FzIHJ1bi4pPC9pPjwvY2VudGVyPgoKIyMjIFVuY29uZGl0aW9uYWwgbWVhbnMgbW9kZWwKYGBge3J9CmxpYnJhcnkobmxtZSkKCiMgdW5jb25kaXRpb25hbCBtZWFucyBtb2RlbAptMSA8LSBsbWUoYmlhc190IH4gMSwgcmFuZG9tID0gfiAxIHwgSUQsIGRhdGE9ZGF0YSwgbWV0aG9kPSJNTCIpCnN1bW1hcnkobTEpCgojIElDQwppVmFyIDwtIGFzLm51bWVyaWMoVmFyQ29ycihtMSlbMSwxXSkKcmVzaWRWYXIgPC0gYXMubnVtZXJpYyhWYXJDb3JyKG0xKVsyLDFdKQppY2MxIDwtIGlWYXIvKGlWYXIrcmVzaWRWYXIpIAppY2MxCmBgYApUaGUgb3ZlcmFsbCBtZWFuIGJpYXMgc2NvcmUgKHRyYW5zZm9ybWVkKSBpcyBhYm91dCAtMC4wMDIsIHdpdGggYSBzdGFuZGFyZCBkZXZpYXRpb24gb2YgMC4wMjMuCgpJQ0MgaXMgYWJvdXQgMS42JSBvZiB0aGUgdmFyaWFuY2UuIFRoaXMgbWVhbnMgdGhhdCAxLjYlIG9mIHRoZSB2YXJpYW5jZSBpbiBiaWFzIGlzIGV4cGxhaW5lZCBieSBwZW9wbGUgYmVpbmcgZGlmZmVyZW50IGZyb20gb25lIGFub3RoZXIuCgojIyMgQWRkIGZpeGVkIGFuZCByYW5kb20gaW50ZXJjZXB0IGFuZCBzbG9wZSBvZiB0aW1lCmBgYHtyfQojIG1vZGVsIHdpdGggZml4ZWQgYW5kIHJhbmRvbSBpbnRlcmNlcHQgYW5kIHNsb3BlIG9mIHRpbWUgKGludGVyY2VwdHMgaW1wbGllZCkKbTIgPC0gbG1lKGJpYXNfdCB+IHRyaWFsbnVtLCBkYXRhID0gZGF0YSwgcmFuZG9tID0gfiB0cmlhbG51bSB8IElELCBtZXRob2Q9Ik1MIikKc3VtbWFyeShtMikgCmFub3ZhKG0yKQpgYGAKVGhlIGF2ZXJhZ2UgYmlhcyBhdCB0cmlhbCBudW1iZXIgPSAwIGlzIC0wLjAxNiBhbmQgZ2V0cyBpbmNyZWFzaW5nbHkgYXBwcm9hY2gtYmlhc2VkIGJ5IGEgbm9uc2lnbmlmaWNhbnQgZnJhY3Rpb24gb2YgYSBwZXJjZW50IHdpdGggZWFjaCB1bml0IG9mIHRpbWUuIFRoZXJlIGlzIG5vIHNpZ25pZmljYW50IGVmZmVjdCBvZiB0cmlhbCBudW1iZXIgKHRpbWUpIG9uIFJUIGJpYXMgc2NvcmUsIF90XyA9IDAuNzQsIF9wXyA9IDAuNDU3LiAKCmBgYHtyfQojIElDQwppVmFyIDwtIGFzLm51bWVyaWMoVmFyQ29ycihtMilbMSwxXSkKcmVzaWRWYXIgPC0gYXMubnVtZXJpYyhWYXJDb3JyKG0yKVsyLDFdKQppY2MyIDwtIGlWYXIvKGlWYXIrcmVzaWRWYXIpCmljYzIKYGBgCjk5Ljk5JSBvZiB2YXJpYW5jZSBpbiBiaWFzIGlzIGR1ZSB0byB0aGUgYmV0d2Vlbi1wZXJzb24gdmFyaWFuY2UsIGFmdGVyIGNvbnRyb2xsaW5nIGZvciB0aW1lLiBUaGlzIGlzIGNvbnNpc3RlbnQgd2l0aCB0aGUgbGFjayBvZiBhIHNpZ25pZmljYW50IGVmZmVjdCBvZiB0aW1lLiAKSG93ZXZlci4uLiBJIGhhdmUgbm8gY2x1ZSBob3cgdGhpcyBtYWtlcyBzZW5zZSB3aXRoIHRoZSBJQ0Mgb2YgMC4wMTYgZnJvbSB0aGUgdW5jb25kaXRpb25hbCBtZWFucyBtb2RlbCBhYm92ZSwgd2hpY2ggc3VnZ2VzdHMgdGhhdCA8MiUgb2YgdGhlIHZhcmlhbmNlIGlzIGR1ZSB0byBiZXR3ZWVuLXBlcnNvbiBkaWZmZXJlbmNlcy4gWkVSTyBjbHVlLiBBdGluYSB0cmllZCB0byBoZWxwIG1lIHRoaW5rIHRocm91Z2ggdGhpcyBmb3IgMjAgbWludXRlcyBhbmQgSSBzdGlsbCBkb24ndCBnZXQgaXQuCgojIyMgQWRkaW5nIHN0aW11bHVzIGFzIGEgZml4ZWQgZWZmZWN0ClRoZXJlIHdlcmUgNSBkaWZmZXJlbnQgdHlwZXMgb2Ygc3RpbXVsaSwgcHJlc2VudGVkIGluIGEgcmFuZG9taXplZCBvcmRlciAoY29uc2lzdGVudCBhY3Jvc3MgcGFydGljaXBhbnRzL3Nlc3Npb25zKSBkZXRlcm1pbmVkIGJ5IGdlbmV0aWMgYWxnb3JpdGhtLiBFdmVyeW9uZSBzYXcgdGhlIHNhbWUgc3RpbXVsaSBpbiB0aGUgc2FtZSBvcmRlciwgc28gaXQgaXMgYSBmaXhlZCBlZmZlY3QuIFRoZSBkaWZmZXJlbnQgY2F0ZWdvcmllcyBvZiBpbWFnZXMgd2VyZTogRGVhdGggKGdlbmVyaWMpLCBEZWNlYXNlZCAocGVyc29uYWwgcGhvdG8pLCBMaXZpbmcgbG92ZWQgb25lIChwZXJzb25hbCBwaG90byksIFN0cmFuZ2VyIChzZXgtbWF0Y2hlZCB0byBzcG91c2UpLCBhbmQgTmV1dHJhbCAob2JqZWN0cykuCmBgYHtyfQojIGFkZCB0aGUgZml4ZWQgZWZmZWN0IG9mIHN0aW0gYW5kIGNvbXBhcmUgaXRzIGZpdCB0byBtMiBieSBpbnNwZWN0aW5nIHRoZSB0IGFuZCBmIHRlc3RzCm0zIDwtIGxtZShiaWFzX3QgfiB0cmlhbG51bSArIHN0aW0sIGRhdGEgPSBkYXRhLCByYW5kb20gPSB+IHRyaWFsbnVtIHwgSUQsIG1ldGhvZD0iTUwiKQpzdW1tYXJ5KG0zKQpgYGAKTk8gZWZmZWN0IG9mIHRpbWUuIFRoZXJlIGlzIGEgc2lnbmlmaWNhbnQgZml4ZWQgZWZmZWN0IG9mIHNwb3VzZSwgX3RfID0gMy41NSwgX3BfID0gLjAwMDQuIFRoZXJlIGlzIGFsc28gYSBub24tc2lnbmlmaWNhbnQgZWZmZWN0IG9mIHN0cmFuZ2VyLCBfdF8gPSAtMS43MywgX3BfID0gLjA4NC4gVGhpcyBpbmRpY2F0ZXMgdGhhdCBwZW9wbGUgdGVuZGVkIHRvIHNob3cgbW9yZSBhcHByb2FjaCBiaWFzIHRvIHBob3RvcyBvZiB0aGVpciBzcG91c2UgKGFjcm9zcyBjb25kaXRpb25zKS4gVGhlIHBhcmFtZXRlciBlc3RpbWF0ZSBpcyAwLjEyIHdpdGggYW4gX1NFXyBvZiAwLjAzLiBUaGV5IGFsc28gdGVuZGVkIHRvIHNob3cgZ3JlYXRlciBtb3JlIGF2b2lkYW5jZSBiaWFzIHRvIHBob3RvcyBvZiB0aGUgc2V4LW1hdGNoZWQgc3RyYW5nZXIuCgpgYGB7cn0KaW50ZXJ2YWxzKG0zLCB3aGljaD0iZml4ZWQiKQpgYGAKOTUlIENJcyBkb24ndCBjcm9zcyB6ZXJvIGZvciBzcG91c2UsIGJ1dCBkbyBmb3IgYWxsIG90aGVyIHN0aW11bHVzIHR5cGVzLgoKYGBge3J9CmlWYXIgPC0gYXMubnVtZXJpYyhWYXJDb3JyKG0zKVsxLDFdKQpyZXNpZFZhciA8LSBhcy5udW1lcmljKFZhckNvcnIobTMpWzIsMV0pCmljYzMgPC0gaVZhci8oaVZhcityZXNpZFZhcikKaWNjMyAjIFNhbWUgSUNDIGFzIG0yCmBgYApUaGUgSUNDIGlzIGlkZW50aWNhbCB0byB0aGF0IGluIG1vZGVsIDIuIAoKYGBge3J9CmFub3ZhKG0yLCBtMykgIyBjb21wYXJlIHRoaXMgbW9kZWwgd2l0aCB0aGUgZmlyc3Qgb25lCmBgYApDb21wYXJpbmcgdGhlIG1vZGVsIHdpdGggdGhlIGZpeGVkIGVmZmVjdCBvZiBzdGltdWx1cyAobTMpIHRvIHRoZSBtb2RlbCB3aXRob3V0IChtMiksIG0zIGlzIGJldHRlciAoX3BfIDwgLjAwMDEpIGFzIGV2aWRlbmNlZCBieSBsb3dlciBBSUMsIEJJQywgYW5kIGxMIHZhbHVlcy4KCiMjIyBUYWtlIG91dCBmaXhlZCBhbmQgcmFuZG9tIGVmZmVjdCBvZiB0aW1lCkJlY2F1c2UgdGhlcmUncyBubyBzaWduaWZpY2FudCBlZmZlY3Qgb2YgdGltZSwgbWFrZXMgc2Vuc2UgdG8gZHJvcCBpdCBmcm9tIHRoZSBtb2RlbC4gTm93IHdlJ3JlIGJhc2ljYWxseSBkb2luZyByZWdyZXNzaW9uIGJ1dCBhY2NvdW50aW5nIGZvciB3aGF0ZXZlciBpbnRlcmRlcGVuZGVuY2UgZXhpc3RzLiA8Zm9udCBjb2xvcj0icmVkIj5Ob3RlIHRoYXQgdGhlc2UgcmVzdWx0cyB3aWxsIF9OT1RfIG1hdGNoIHRoZSByZXN1bHRzIG9mIHRoZSByZWdyZXNzaW9ucywgYmVjYXVzZSB0aGUgcmVncmVzc2lvbnMgdXNlIG1lZGlhbnMgb2YgdGhlIGJpYXMgc2NvcmVzLCByYXRoZXIgdGhhbiBtZWFucy48L2ZvbnQ+CgpgYGB7cn0KIyB3aXRob3V0IGZpeGVkIG9yIHJhbmRvbSBlZmZlY3Qgb2YgdGltZQptNCA8LSBsbWUoYmlhc190IH4gc3RpbSwgZGF0YSA9IGRhdGEsIHJhbmRvbSA9IH4gMSB8IElELCBtZXRob2Q9Ik1MIikKc3VtbWFyeShtNCkKYGBgCkZpeGVkIGVmZmVjdHMgYXJlIHN0aWxsIG1vcmUgb3IgbGVzcyB0aGUgc2FtZSAtIHNpZ25pZmljYW50IGZvciBzcG91c2UsIG1hcmdpbmFsIGZvciBzdHJhbmdlciAtIGFsdGhvdWdoIHRoZSBwYXJhbWV0ZXIgZXN0aW1hdGVzIGFuZCB0ZXN0IHN0YXRpc3RpY3MgYXJlIHNsaWdodGx5IGRpZmZlcmVudC4KCmBgYHtyfQppbnRlcnZhbHMobTQsIHdoaWNoPSJmaXhlZCIpCmBgYApBcyBhYm92ZSwgc3BvdXNlIGlzIHRoZSBvbmx5IHN0aW11bHVzIGNhdGVnb3J5IHdob3NlIDk1IENJcyBkb24ndCBjcm9zcyB6ZXJvLCBzdXBwb3J0aW5nIGEgc2lnbmlmaWNhbnQgZWZmZWN0IG9mIHNwb3VzZSBvbiBiaWFzLgoKSXMgbTQgYW55IGJldHRlciB0aGFuIG0zPwpgYGB7cn0KYW5vdmEobTMsbTQpCmBgYApOb3BlLiBNb2RlbHMgZG8gbm90IHNpZ25pZmljYW50bHkgZGlmZmVyIChfcF8gPSAwLjg1MSksIHRob3VnaCB0aGUgQUlDIGFuZCBCSUMgdmFsdWVzIGFyZSBhIGxpdHRsZSBzbWFsbGVyIGZvciBtNCB0aGFuIG0zLiBTbyBsZXQncyBmb3JnZXQgdGltZSBhbmQgZ28gd2l0aCBtNC4uLgoKIyMjIEFkZGluZyBjb25kaXRpb24gYXMgYSBmaXhlZCBlZmZlY3QKUGFydGljaXBhbnRzIGNvbXBsZXRlZCB0aGUgdGFzayBhdCB0d28gZGlmZmVyZW50IHNlc3Npb25zLCB3aGVyZSB0aGV5IHdlcmUgcmFuZG9taXplZCB0byByZWNlaXZlIHRyZWF0bWVudCBBIGF0IG9uZSBhbmQgdHJlYXRtZW50IEIgYXQgdGhlIG90aGVyIChvcmRlciBjb3VudGVyYmFsYW5jZWQgYWNyb3NzIHBhcnRpY2lwYW50cykuIFRoZSB0d28gdHJlYXRtZW50cyBhcmUgb3h5dG9jaW4gdnMuIHBsYWNlYm8uCmBgYHtyfQojIGFkZCB0aGUgaW50ZXJhY3Rpb24gb2Ygc3RpbSBhbmQgY2hlY2sgaXRzIGZpdCBieSBpbnNwZWN0aW5nIHQgYW5kIGYgdGVzdHMuIAptNSA8LSBsbWUoYmlhc190IH4gc3RpbSArIGNvbmQsIGRhdGEgPSBkYXRhLCByYW5kb20gPSB+IDEgfCBJRCwgbWV0aG9kPSJNTCIpCnN1bW1hcnkobTUpCmBgYApUaGUgZml4ZWQgZWZmZWN0IG9mIGNvbmRpdGlvbiBCIGlzIG5vdCBzaWduaWZpY2FudCwgX3RfID0gMC4xNSwgX3BfID0gMC44ODQuCgpgYGB7cn0KYW5vdmEobTQsIG01KQpgYGAKVGhlIHR3byBtb2RlbHMgYXJlIG5vdCBzaWduaWZpY2FudGx5IGRpZmZlcmVudCwgYnV0IHRoZSBvbmUgd2l0aCB0aGUgZml4ZWQgZWZmZWN0IG9mIGNvbmRpdGlvbiAobTUpIGhhcyBzbGlnaHRseSBoaWdoZXIgQUlDL0JJQy4gCgojIyMgQWRkaW5nIHRoZSBzdGltdWx1cypjb25kaXRpb24gaW50ZXJhY3Rpb24KCldlIG1pZ2h0IGV4cGVjdCB0aGF0IHBlb3BsZXMnIHRlbmRlbmN5IHRvIGFwcHJvYWNoIG9yIGF2b2lkIG1pZ2h0IGRpZmZlciBkZXBlbmRpbmcgb24gd2hpY2ggdHJlYXRtZW50IHRoZXkgZ290LCBidXQgb25seSBmb3IgY2VydGFpbiBzdGltdWxpLgpgYGB7cn0KIyBhZGQgdGhlIGludGVyYWN0aW9uIG9mIHN0aW0gYW5kIGNoZWNrIGl0cyBmaXQgYnkgaW5zcGVjdGluZyB0IGFuZCBmIHRlc3RzLiAKbTYgPC0gbG1lKGJpYXNfdCB+IHN0aW0qY29uZCwgZGF0YSA9IGRhdGEsIHJhbmRvbSA9IH4gMSB8IElELCBtZXRob2Q9Ik1MIikKc3VtbWFyeShtNikKYGBgCkludGVyZXN0aW5nLiBXaXRoIHRoZSBpbnRlcmFjdGlvbiBpbiB0aGUgbW9kZWwsIHRoZXJlIGlzIGEgbm9uLXNpZ25pZmljYW50IGludGVyYWN0aW9uIGJldHdlZW4gZGVhdGggYW5kIGNvbmRpdGlvbiBCLgoKYGBge3J9CmFub3ZhKG02LG00LG01KQppbnRlcnZhbHMobTYpCmBgYApUaGUgbW9kZWwgd2l0aCB0aGUgaW50ZXJhY3Rpb24gaW4gaXQgaXMgbm90IHNpZ25pZmljYW50bHkgYmV0dGVyIHRoYW4gZWl0aGVyIHRoZSBvbmUgd2l0aCBqdXN0IHRoZSBmaXhlZCBlZmZlY3Qgb2YgY29uZGl0aW9uIG9yIHdpdGggbm8gZWZmZWN0IG9mIGNvbmRpdGlvbiBhdCBhbGwsIHNvIG1ha2VzIHNlbnNlIHRvIGdvIHdpdGggdGhlIHNpbXBsZXN0IG1vZGVsIHdoaWNoIG9ubHkgaW5jbHVkZXMgc3RpbXVsdXMgYXMgYSBmaXhlZCBlZmZlY3QuCgojIyMgQWRkaW5nIG90aGVyIHBsYXVzaWJsZSBwcmVkaWN0b3JzClRoZXJlIGFyZSBhIGZldyBvdGhlciB2YXJpYWJsZXMgdGhhdCB3ZSBtaWdodCBleHBlY3QgdG8gaW1wYWN0IGFwcHJvYWNoL2F2b2lkYW5jZSBiaWFzLCBuYW1lbHkgZ3JpZWYgc2V2ZXJpdHksIE9YVFIgZ2Vub3R5cGUsIHRpbWUgc2luY2UgZGVhdGgsIGFuZCBhdHRhY2htZW50IHN0eWxlIChhdm9pZGFudCwgYW54aW91cykuIApgYGB7cn0KIyB1c2VkIGdyb3VwIG1lYW4gY2VudGVyZWQgc2NvcmVzIGZvciB0aGUgYWRkaXRpb25hbCB2YXJpYWJsZXMgZm9yIGludGVycHJldGFiaWxpdHkKbTcgPC0gbG1lKGJpYXNfdCB+IHN0aW0gKyByczUzNTc2X0EuY2FycmllciArIHJzMjI2ODQ5OF9DLmNhcnJpZXIgKyBnbWVhbl9lY3Jyc19nbG9iYWxfYW54ICsgZ21lYW5fZWNycnNfZ2xvYmFsX2F2b2lkICsgZ21lYW5fYWdlICsgZ21lYW5faWNnLCBkYXRhID0gZGF0YSwgcmFuZG9tID0gfiAxIHwgSUQsIG1ldGhvZD0iTUwiKQpzdW1tYXJ5KG03KQphbm92YShtNCxtNykKYGBgCk5vbmUgb2YgdGhlIGFkZGVkIGZpeGVkIGVmZmVjdHMgYXJlIHNpZ25pZmljYW50IGFuZCB0aGUgQUlDL0JJQyB2YWx1ZXMgYXJlIGhpZ2hlciwgc28gdGFrZSAnZW0gb3V0LiAKCiMjIyBGaW5hbCBtb2RlbAoKYGBge3J9CiMgdmFyaWFuY2UgZXhwbGFpbmVkIGJ5IHRoZSBlbnRpcmUgbW9kZWwgCmZpdHRlZCA8LSBmaXR0ZWQobTQpCmRhdGEkZml0dGVkIDwtIGFzLnZlY3RvcihmaXR0ZWQpCnJzcSA8LSBsbShiaWFzIH4gZml0dGVkLCBkYXRhPWRhdGEpIApzdW1tYXJ5KHJzcSkKYGBgCkEgY2FzZSBvZiBzaWduaWZpY2FudCwgYnV0IG5vdCBtZWFuaW5nZnVsOiBUaGUgUjxzdXA+Mjwvc3VwPiBmb3IgdGhlIGVudGlyZSBtb2RlbCBpcyAuMDIsIGluZGljYXRpbmcgdGhhdCAyJSBvZiB0aGUgdmFyaWFuY2UgaW4gYmlhcyBpcyBleHBsYWluZWQgYnkgdGhlIG1vZGVsLiBTbyB0aGlzIG1vZGVsIGlzIG5vdCB2ZXJ5IGdvb2QgYXQgcHJlZGljdGluZyBhcHByb2FjaC9hdm9pZGFuY2UgYmlhcyBmcm9tIHRoZSBmaXhlZCBlZmZlY3Qgb2Ygc3RpbXVsdXMgd2l0aGluIHBlcnNvbi4gT2ggd2VsbC4KCiMjIyBDaGVjayBmaW5hbCBtb2RlbCBhc3N1bXB0aW9ucwoKQ2hlY2tpbmcgbm9ybWFsaXR5IG9mIHRoZSByZXNpZHVhbHM6CmBgYHtyfQojIGNoZWNraW5nIG5vcm1hbGl0eSBvZiByZXNpZHVhbHMKCiMgbGV2ZWwgMToKcXFub3JtKG00LCB+cmVzaWQoLiksIGlkPTAuMDAwNzUpCnBsb3QobTQsIHJlc2lkKC4sIHR5cGU9InAiKSB+IHRyaWFsbnVtLCBpZD0wLjAwMjUpCmBgYApUaGUgUVEgcGxvdCBsb29rcyBwcmV0dHkgb2theSwgYWxiZWl0IGEgZmV3IG91dGxpZXJzLiBEMTEzIGlzIHRoZSBwZXJzb24gd2hvIG1vc3QgZmFsbHMgb2ZmIHRoZSBsaW5lLCBhbmQgZG9lcyBzbyBhdCBib3RoIGVuZHMuIFRoZSByZXNpZHVhbHMgYXJlIGFsc28gcHJldHR5IGV2ZW5seSBkaXN0cmlidXRlZCBhY3Jvc3MgdGltZSwgdGhvdWdoIG1hbnkgZmFsbCBvdXRzaWRlIG9mIHRoZSArLy0gMiByYW5nZS4KCmBgYHtyfQojIHRoZSBmb2xsb3dpbmcgYml0IHdhbnRzIElEcyB0byBiZSBudW1lcmljLCBzbyB0YWtlIG91dCB0aGUgIkQiIGZyb20gZWFjaCBJRApkYXRhIDwtIGRhdGEgJT4lIG11dGF0ZShudW1JRCA9IGFzLm51bWVyaWMoc3RyX3JlcGxhY2UoSUQsICJEIiwgIiIpKSkKCiMgbGV2ZWwgMjoKcXFub3JtKG00LCB+cmFuZWYoLiksIGlkPTAuMjUpCnJhbkludCA8LSByYW5lZihtNClbMV0gIyBjcmVhdGUgb2JqZWN0IHdpdGggdGhlIHJhbmRvbSBpbnRlcmNlcHQgZXN0aW1hdGVzCnJhbkludCA8LSB1bmxpc3QocmFuSW50KSAKbmFtZXMocmFuSW50KSA8LSBOVUxMIApJRCA8LSB1bmxpc3Qoc3Vic2V0KGRhdGEsICFkdXBsaWNhdGVkKGRhdGEkbnVtSUQpLCBzZWxlY3Q9Im51bUlEIikpICMgY3JlYXRlIGFuIElEIHZhcmlhYmxlCnBsb3QocmFuSW50IH4gSUQpCgpyYW5TbG9wZSA8LSByYW5lZihtNClbMl0gIyBjcmVhdGUgYW4gb2JqZWN0IHdpdGggdGhlIHJhbmRvbSBzbG9wZXMKcmFuU2xvcGU8LSB1bmxpc3QocmFuU2xvcGUpIApuYW1lcyhyYW5TbG9wZSkgPC0gTlVMTCAKcGxvdChyYW5TbG9wZSB+IElEKQoKYGBgCkdldHRpbmcgYW4gZXJyb3IgaGVyZSA8Zm9udCBjb2xvcj0icmVkIj5gRXJyb3IgaW4gWy5kYXRhLmZyYW1lKHJhbmVmKG00KSwgNzIpIDogdW5kZWZpbmVkIGNvbHVtbnMgc2VsZWN0ZWRgPC9mb250Piwgd2hpY2ggSSBnb3Qgc3R1Y2sgZm9yIHdheSB0b28gbG9uZyBvbiBhbmQgYW0gbGVhdmluZyBhbG9uZSBmb3Igbm93LgoKQ2hlY2tpbmcgaG9tb3NjZWRhc3RpY2l0eToKYGBge3J9CiMgY2hlY2tpbmcgaG9tb3NjZWRhc3RpY2l0eQoKIyBsZXZlbCAxOgpkYXRhJHJlc2lkIDwtIGFzLm51bWVyaWMocmVzaWR1YWxzKG00KSkgIyBjcmVhdGUgYW4gb2JqZWN0IHdpdGggdGhlIExldmVsLTEgcmVzaWR1YWxzCnBsb3QoZGF0YSRyZXNpZCB+IGRhdGEkc3RpbSkKCiMgbGV2ZWwgMjoKbGlicmFyeShsYXR0aWNlKQpzdGltIDwtIHVubGlzdChzdWJzZXQoZGF0YSwgIWR1cGxpY2F0ZWQoZGF0YSRudW1JRCksIHNlbGVjdD0ic3RpbSIpKQp4eXBsb3QocmFuSW50IH4gc3RpbSkKeHlwbG90KHJhblNsb3BlIH4gc3RpbSkKYGBgCk5vdGUgdGhhdCBhZ2FpbiB0aGVyZSBhcmUgYSBsb3Qgb2YgcmVzaWR1YWxzIGZhbGxpbmcgb3V0c2lkZSBvZiB0aGUgKy8tMiByYW5nZS4KCkFsc28sIHRoZXJlJ3Mgc29tZXRoaW5nIHdlaXJkIGFib3V0IHRoZSBMMiBwbG90LiBOb3Qgc3VyZSB3aHkgaXQgc2hvd3Mgb25seSAzIG9mIDUgc3RpbXVsdXMgdHlwZXMgKGVkaXQ6IG5vdyBub3Qgc2hvd2luZyBhbnl0aGluZykuCgpUaGUgZXJyb3IgbWVzc2FnZSBpcyBiZWNhdXNlIHRoZSByYW5TbG9wZSBvYmplY3QgZG9lcyBub3QgZXhpc3QgKHNlZSBlcnJvciBtZXNzYWdlIGluIG91dHB1dCBmcm9tIHByZXZpb3VzIGNodW5rLikKCiMgT1QgUlQgcGxvdHMKIyMjIExvbmcgZGF0YXNldCBmb3IgcmVncmVzc2lvbnMKIyMjIyBNb3JlIGRhdGEgY2xlYW5pbmcKQ29udGludWluZyBmcm9tIHRoZSBkYXRhIGNsZWFuaW5nIGFib3ZlLi4uCmBgYHtyfQpsaWJyYXJ5KHBzeWNoKQpsaWJyYXJ5KHRpZHl2ZXJzZSkKZmlsdGVyIDwtIGRwbHlyOjpmaWx0ZXIKc2VsZWN0IDwtIGRwbHlyOjpzZWxlY3QKCm1sbV9yMXIyX2xvbmcgPC0gYmluZF9yb3dzKG1sbV9yMS4yLCBtbG1fcjIuMikKaGVhZChtbG1fcjFyMl9sb25nKSAjIyAyMjQ2NCBvYnNlcnZhdGlvbnMKCiMgZ2V0IHJpZCBvZiBhbnkgdHJpYWxzIHdpdGggb3V0bGllcnMKbWxtX2xvbmcgPC0gbWxtX3IxcjJfbG9uZyAlPiUgZmlsdGVyKG91dGxpZXJfUlQgPT0gIjAiKSAKY291bnQobWxtX3IxcjIuMSkgIyAyMjAwNyBvYnMuCjIyMDA3LzIyNDY0ICMgOTglIG9mIHRyaWFscyByZXRhaW5lZCA9IDIlIG9mIHRyaWFscyBkcm9wcGVkLgoKbWxtX2xvbmcxIDwtIGxlZnRfam9pbihtbG1fbG9uZywgbWxtX2FkZCwgYnk9IklEIikgIyBhZGQgdGhlIHNlbGYtcmVwb3J0IHZhcmlhYmxlcwpoZWFkKG1sbV9sb25nMSkKCmdtZWFucyA8LSBzZWxlY3QobWxtX2J4NS4xLCBzdGFydHNfd2l0aCgiZ21lYW4iKSkgIyBhZGQgZ3JhbmQgbWVhbiBjZW50ZXJlZCB2YXJpYWJsZXMgZnJvbSBtbG1fYng1LjEgb2JqZWN0CklEIDwtIHNlbGVjdChtbG1fYng1LjEsIHN0YXJ0c193aXRoKCJJRCIpKSAKSUQkSUQxIDwtIE5VTEwKZ21lYW5zX0lEIDwtIGJpbmRfY29scyhJRCwgZ21lYW5zKSAlPiUgZGlzdGluY3QoZ21lYW5zX0lELCBJRCwgLmtlZXBfYWxsID0gVFJVRSkKCm1sbV9sb25nMiA8LSBsZWZ0X2pvaW4obWxtX2xvbmcxLCBnbWVhbnNfSUQsIGJ5PSJJRCIpCgoKbGlicmFyeShiZXN0Tm9ybWFsaXplKQpkZXNjcmliZShtbG1fbG9uZzEkZ0FBVF9SVCkgIyBSVCBkYXRhIGhhcyBza2V3bmVzcyBvZiAxLjE3IGFuZCBrdXJ0b3NpcyBvZiAxLjcuIE1pbiBpcyA0NjQgYW5kIG1heCBpcyAxNzEyLCBhcyB3ZSBmaWx0ZXJlZCBvdXQgdHJpYWxzIGFib3ZlIGFuZCBiZWxvdyB0aGUgOTl0aCBhbmQgMXN0IHBlcmNlbnRpbGVzIGFscmVhZHkKYmVzdE5vcm1hbGl6ZShtbG1fbG9uZzIkZ0FBVF9SVCkKZ0FBVF9SVF90IDwtIGJlc3ROb3JtYWxpemUobWxtX2xvbmcyJGdBQVRfUlQpICAjIHRyYW5zZm9ybSB0aGUgUlQgZGF0YQptbG1fbG9uZzIkZ0FBVF9SVF90IDwtIGdBQVRfUlRfdCR4LnQgIyBtYWtlIGEgbmV3IHZhcmlhYmxlIGZvciB0aGUgdHJhbnNmb3JtZWQgdmFsdWVzIGFuZCBhdHRhY2ggaXQgdG8gdGhlIGxvbmcgZGF0YXNldApoaXN0KG1sbV9sb25nMiRnQUFUX1JUKSAjIGNvbXBhcmUgaGlzdG9ncmFtcyBmb3IgdGhlIHRyYW5zZm9ybWVkIGFuZCBub24tdHJhbnNmb3JtZWQgdmFsdWVzCmhpc3QobWxtX2xvbmcyJGdBQVRfUlRfdCkgCnFxbm9ybShtbG1fbG9uZzIkZ0FBVF9SVCkgI2NvbXBhcmUgUVEgcGxvdHMgZm9yIHRoZSB0cmFuc2Zvcm1lZCBhbmQgbm9uLXRyYW5zZm9ybWVkIHZhbHVlcwpxcW5vcm0obWxtX2xvbmcyJGdBQVRfUlRfdCkKCm1sbV9sb25nMiAlPiUgZ3JvdXBfYnkoSUQpICU+JSBjb3VudChjb25kKSAjIGxvb2sgYXQgaG93IG1hbnkgdHJpYWxzIGVhY2ggcGVyc29uIGhhcyBmb3IgZWFjaCBjb25kaXRpb24gKEEvQikKCiMgc3BsaXR0aW5nIHVwIGJ5IGluc3RydWN0aW9uCm1sbV9sb25nMl9wdXNoIDwtIGZpbHRlcihtbG1fbG9uZzIsIGdyZXBsKCJQVVNIIixwdXNoX3B1bGwpKQpoZWFkKG1sbV9sb25nMl9wdXNoKQoKbWxtX2xvbmcyX3B1bGwgPC0gZmlsdGVyKG1sbV9sb25nMiwgZ3JlcGwoIlBVTEwiLHB1c2hfcHVsbCkpCmhlYWQobWxtX2xvbmcyX3B1c2gpCgpgYGAKVHJhbnNmb3JtaW5nIHJlYWxseSBpbXByb3ZlZCB0aGUgUlQgZGF0YS4gRXZlcnlvbmUgbG9va3MgbGlrZSB0aGV5IGhhdmUgYSBnb29kIG51bWJlciBvZiB0cmlhbHMgKG91dCBvZiAyODg7IDI4OCA9IDE0NCB0cmlhbHMqMiBydW5zKS4KCiMjIyBCaWFzIHNjb3JlcyAoYmFzZWQgb24gbWVkaWFucykKCmBgYHtyfQpsaWJyYXJ5KHRpZHl2ZXJzZSkKIyBnZXQgdGhlIE9YVFIgYW5kIHNlbGYtcmVwb3J0IHNjb3JlcwojIGxvYWQgaW4gbWFzdGVyIGRhdGFzZXQKbWFzdGVyIDwtIHJlYWRSRFMoIn4vRHJvcGJveC9HTEFTUyBMYWIvT1QgU3R1ZHkvZGF0YS9jbGVhbmVkLWRhdGEvc2VsZnJlcG9ydHNfb3h0cl9jb3J0aXNvbF9yYW5kb21fQUJfYnhfY2xlYW4ucmRzIikgCgojIHN1YnNldCB0aGUgc2VsZWN0ZWQgdmFyaWFibGVzCnN1Ymp2YXJzIDwtIHN1YnNldChtYXN0ZXIsIHNlbGVjdD1jKElELGFnZSwgYWdlX3lycywgc2V4X20sIGV0aG5pY2l0eV9oaXNwLCByYWNlLCB0aW1lc2luY2VkZWF0aCwgcnMyMjU0Mjk4LCByczIyNjg0OTgsIHJzNTM1NzYsIHJzMjI1NDI5OF9BLmNhcnJpZXIsIHJzMjI2ODQ5OF9DLmNhcnJpZXIsIHJzNTM1NzZfQS5jYXJyaWVyLCB0b3RfYmRpLCB0b3RfYmdxLCB0b3RfZWNycnNfZ2xvYmFsX2FueCx0b3RfZWNycnNfZ2xvYmFsX2F2b2lkLCB0b3RfZWNycnNfc3BvdXNlX2FueCwgdG90X2VjcnJzX3Nwb3VzZV9hdm9pZCwgdG90X3lzbCwgdG90X2ljZykpCmhlYWQoc3VianZhcnMpCgojIGFkZCBhIGdyb3VwIHZhcmlhYmxlIGZvciBDRy9OQ0cKc3VianZhcnMgPC0gc3VianZhcnMgJT4lCiAgbXV0YXRlKGdycF9jZyA9IGFzLmZhY3RvcihpZmVsc2UodG90X2ljZyA+PSAyNSwgIkNHIiwgIk5DRyIpKSkgCgojIGFsbCBvZiB0aGUgT1hUUiB2YXJzIHNob3VsZCBiZSBmYWN0b3JzIGJ1dCBhcmVuJ3QKc3VianZhcnMgPC0gc3VianZhcnMgJT4lIG11dGF0ZShyczIyNjg0OTggPSBhcy5mYWN0b3IocnMyMjY4NDk4KSwKICAgICAgICAgICAgICAgICAgICAgICAgcnM1MzU3NiA9IGFzLmZhY3RvcihyczUzNTc2KSkKCiMgY3JlYXRpbmcgYSB3aWRlIGRhdGFzZXQgd2l0aCB0aGUgYmlhcyB2YXJpYWJsZXMsIHdoaWNoIHdpbGwgdGhlbiBiZSBjb252ZXJ0ZWQgaW50byBhIGxvbmcgZGF0YXNldAojIFRoZSBhcmd1bWVudHMgdG8gc3ByZWFkKCk6CiMgLSBkYXRhOiBEYXRhIG9iamVjdAojIC0ga2V5OiBOYW1lIG9mIGNvbHVtbiBjb250YWluaW5nIHRoZSBuZXcgY29sdW1uIG5hbWVzCiMgLSB2YWx1ZTogTmFtZSBvZiBjb2x1bW4gY29udGFpbmluZyB2YWx1ZXMKZGF0YV93aWRlIDwtIHNwcmVhZChtbG1fcjFyMl9sb25nLCBrZXk9c3RpbSwgdmFsdWU9Z0FBVF9SVCkKY29sbmFtZXMoZGF0YV93aWRlKQpWaWV3KGRhdGFfd2lkZSkKCiMgc3Vic2V0IGFuZCByZW1vdmUgb3V0bGllcnMKZGF0YV9wdXNoQSA8LSBkYXRhX3dpZGUgJT4lIHNlbGVjdChJRCwgY29uZCwgcHVzaF9wdWxsLCB2aXNpdCwgb3V0bGllcl9SVCwgbmV1dHJhbCwgZGVhdGgsIGxpdmluZywgc3BvdXNlLCBzdHJhbmdlcikgJT4lIGZpbHRlcihvdXRsaWVyX1JUID09ICIwIiAmIGNvbmQgPT0gIkEiICYgcHVzaF9wdWxsID09ICJQVVNIIikgJT4lIGdyb3VwX2J5KElEKSAlPiUgbXV0YXRlKG5ldXRyYWxBcHVzaCA9IG1lZGlhbihuZXV0cmFsLCBuYS5ybSA9IFRSVUUpLCBkZWF0aEFwdXNoID0gbWVkaWFuKGRlYXRoLCBuYS5ybSA9IFRSVUUpLCBzcG91c2VBcHVzaCA9IG1lZGlhbihzcG91c2UsIG5hLnJtPVRSVUUpLCBsaXZpbmdBcHVzaCA9IG1lZGlhbihsaXZpbmcsIG5hLnJtPVRSVUUpLCBzdHJhbmdlckFwdXNoID0gbWVkaWFuKHN0cmFuZ2VyLCBuYS5ybT1UUlVFKSkKCmRhdGFfcHVsbEEgPC0gZGF0YV93aWRlICU+JSBzZWxlY3QoSUQsIGNvbmQsIHB1c2hfcHVsbCwgdmlzaXQsIG91dGxpZXJfUlQsIG5ldXRyYWwsIGRlYXRoLCBsaXZpbmcsIHNwb3VzZSwgc3RyYW5nZXIpICU+JSBmaWx0ZXIob3V0bGllcl9SVCA9PSAiMCIgJiBjb25kID09ICJBIiAmIHB1c2hfcHVsbCA9PSAiUFVMTCIpICU+JSBncm91cF9ieShJRCkgJT4lIG11dGF0ZShuZXV0cmFsQXB1bGwgPSBtZWRpYW4obmV1dHJhbCwgbmEucm0gPSBUUlVFKSwgZGVhdGhBcHVsbCA9IG1lZGlhbihkZWF0aCwgbmEucm0gPSBUUlVFKSwgc3BvdXNlQXB1bGwgPSBtZWRpYW4oc3BvdXNlLCBuYS5ybT1UUlVFKSwgbGl2aW5nQXB1bGwgPSBtZWRpYW4obGl2aW5nLCBuYS5ybT1UUlVFKSwgc3RyYW5nZXJBcHVsbCA9IG1lZGlhbihzdHJhbmdlciwgbmEucm09VFJVRSkpCgpkYXRhX3B1c2hCIDwtIGRhdGFfd2lkZSAlPiUgc2VsZWN0KElELCBjb25kLCBwdXNoX3B1bGwsIHZpc2l0LCBvdXRsaWVyX1JULCBuZXV0cmFsLCBkZWF0aCwgbGl2aW5nLCBzcG91c2UsIHN0cmFuZ2VyKSAlPiUgZmlsdGVyKG91dGxpZXJfUlQgPT0gIjAiICYgY29uZCA9PSAiQiIgJiBwdXNoX3B1bGwgPT0gIlBVU0giKSAlPiUgZ3JvdXBfYnkoSUQpICU+JSBtdXRhdGUobmV1dHJhbEJwdXNoID0gbWVkaWFuKG5ldXRyYWwsIG5hLnJtID0gVFJVRSksIGRlYXRoQnB1c2ggPSBtZWRpYW4oZGVhdGgsIG5hLnJtID0gVFJVRSksIHNwb3VzZUJwdXNoID0gbWVkaWFuKHNwb3VzZSwgbmEucm09VFJVRSksIGxpdmluZ0JwdXNoID0gbWVkaWFuKGxpdmluZywgbmEucm09VFJVRSksIHN0cmFuZ2VyQnB1c2ggPSBtZWRpYW4oc3RyYW5nZXIsIG5hLnJtPVRSVUUpKQoKZGF0YV9wdWxsQiA8LSBkYXRhX3dpZGUgJT4lIHNlbGVjdChJRCwgY29uZCwgcHVzaF9wdWxsLCB2aXNpdCwgb3V0bGllcl9SVCwgbmV1dHJhbCwgZGVhdGgsIGxpdmluZywgc3BvdXNlLCBzdHJhbmdlcikgJT4lIGZpbHRlcihvdXRsaWVyX1JUID09ICIwIiAmIGNvbmQgPT0gIkIiICYgcHVzaF9wdWxsID09ICJQVUxMIikgJT4lIGdyb3VwX2J5KElEKSAlPiUgbXV0YXRlKG5ldXRyYWxCcHVsbCA9IG1lZGlhbihuZXV0cmFsLCBuYS5ybSA9IFRSVUUpLCBkZWF0aEJwdWxsID0gbWVkaWFuKGRlYXRoLCBuYS5ybSA9IFRSVUUpLCBzcG91c2VCcHVsbCA9IG1lZGlhbihzcG91c2UsIG5hLnJtPVRSVUUpLCBsaXZpbmdCcHVsbCA9IG1lZGlhbihsaXZpbmcsIG5hLnJtPVRSVUUpLCBzdHJhbmdlckJwdWxsID0gbWVkaWFuKHN0cmFuZ2VyLCBuYS5ybT1UUlVFKSkKCiMgc3VtbWFyaXplIGJ5IElECmRhdGFfcHVzaEExIDwtIGRhdGFfcHVzaEFbIWR1cGxpY2F0ZWQoZGF0YV9wdXNoQSRJRCksIF0gJT4lIHNlbGVjdCgtYyhuZXV0cmFsLCBkZWF0aCwgbGl2aW5nLCBzcG91c2UsIHN0cmFuZ2VyLCB2aXNpdCwgb3V0bGllcl9SVCwgY29uZCwgcHVzaF9wdWxsKSkKZGF0YV9wdXNoQjEgPC0gZGF0YV9wdXNoQlshZHVwbGljYXRlZChkYXRhX3B1c2hCJElEKSwgXSAlPiUgc2VsZWN0KC1jKG5ldXRyYWwsIGRlYXRoLCBsaXZpbmcsIHNwb3VzZSwgc3RyYW5nZXIsIHZpc2l0LCBvdXRsaWVyX1JULCBjb25kLCBwdXNoX3B1bGwpKQpkYXRhX3B1bGxBMSA8LSBkYXRhX3B1bGxBWyFkdXBsaWNhdGVkKGRhdGFfcHVsbEEkSUQpLCBdICU+JSBzZWxlY3QoLWMobmV1dHJhbCwgZGVhdGgsIGxpdmluZywgc3BvdXNlLCBzdHJhbmdlciwgdmlzaXQsIG91dGxpZXJfUlQsIGNvbmQsIHB1c2hfcHVsbCkpCmRhdGFfcHVsbEIxIDwtIGRhdGFfcHVsbEJbIWR1cGxpY2F0ZWQoZGF0YV9wdWxsQiRJRCksIF0gJT4lIHNlbGVjdCgtYyhuZXV0cmFsLCBkZWF0aCwgbGl2aW5nLCBzcG91c2UsIHN0cmFuZ2VyLCB2aXNpdCwgb3V0bGllcl9SVCwgY29uZCwgcHVzaF9wdWxsKSkKaGVhZChkYXRhX3B1bGxCMSkKCiMgbWVyZ2UgdGhlIDQgc3Vic2V0cyB0b2dldGhlcgpqb2luMSA8LSBsZWZ0X2pvaW4oZGF0YV9wdXNoQTEsIGRhdGFfcHVzaEIxLCBieT0iSUQiKQpqb2luMiA8LSBsZWZ0X2pvaW4oam9pbjEsIGRhdGFfcHVsbEExLCBieSA9ICJJRCIpCm1lZGlhbnMgPC0gbGVmdF9qb2luKGpvaW4yLCBkYXRhX3B1bGxCMSwgYnkgPSAiSUQiKQpoZWFkKG1lZGlhbnMpCgptZWRpYW5zMSA8LSBtZWRpYW5zICU+JSBtdXRhdGUoYmlhc19uZXVfQSA9IG5ldXRyYWxBcHVzaCAtIG5ldXRyYWxBcHVsbCwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGJpYXNfZGVhX0EgPSBkZWF0aEFwdXNoIC0gZGVhdGhBcHVsbCwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGJpYXNfc3BvX0EgPSBzcG91c2VBcHVzaCAtIHNwb3VzZUFwdWxsLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgYmlhc19zdHJfQSA9IHN0cmFuZ2VyQXB1c2ggLSBzdHJhbmdlckFwdWxsLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgYmlhc19saXZfQSA9IGxpdmluZ0FwdXNoIC0gbGl2aW5nQXB1bGwsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBiaWFzX25ldV9CID0gbmV1dHJhbEJwdXNoIC0gbmV1dHJhbEJwdWxsLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgYmlhc19kZWFfQiA9IGRlYXRoQnB1c2ggLSBkZWF0aEFwdWxsLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgYmlhc19zcG9fQiA9IHNwb3VzZUJwdXNoIC0gc3BvdXNlQnB1bGwsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBiaWFzX3N0cl9CID0gc3RyYW5nZXJCcHVzaCAtIHN0cmFuZ2VyQnB1bGwsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBiaWFzX2xpdl9CID0gbGl2aW5nQnB1c2ggLSBsaXZpbmdCcHVsbAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgKQoKIyBub3cgYWRkIHRoZSBncnBfY2cvb3h0ci9zZWxmLXJlcG9ydCB2YXJpYWJsZXMKbWVkaWFuczIgPC0gbGVmdF9qb2luKG1lZGlhbnMxLCBzdWJqdmFycywgYnk9IklEIikKaGVhZChtZWRpYW5zMikKCiMgZHJvcCB0aGUgY29uZGl0aW9uL3N0aW0gc3BlY2lmaWMgdmFyaWFibGVzCm1lZGlhbnMyIDwtIG1lZGlhbnMyICU+JSBzZWxlY3QoLWMobmV1dHJhbEFwdXNoLCBkZWF0aEFwdXNoLCAgc3BvdXNlQXB1c2gsICBsaXZpbmdBcHVzaCwgc3RyYW5nZXJBcHVzaCwgbmV1dHJhbEJwdXNoLCBkZWF0aEJwdXNoLCAgIHNwb3VzZUJwdXNoLCAgbGl2aW5nQnB1c2gsICBzdHJhbmdlckJwdXNoLCBuZXV0cmFsQXB1bGwsIGRlYXRoQXB1bGwsIHNwb3VzZUFwdWxsLCBsaXZpbmdBcHVsbCwgc3RyYW5nZXJBcHVsbCwgbmV1dHJhbEJwdWxsLCBkZWF0aEJwdWxsLCBzcG91c2VCcHVsbCwgbGl2aW5nQnB1bGwsIHN0cmFuZ2VyQnB1bGwpKQpjb2xuYW1lcyhtZWRpYW5zMikKCiMgdHVybiBpdCBpbnRvIGEgbG9uZyBkYXRhc2V0Cm1lZGlhbnNfbG9uZyA8LSBnYXRoZXIobWVkaWFuczIsCiAgICAgICAgICAgICAgICAgICBrZXkgPSAic3RpbSIsCiAgICAgICAgICAgICAgICAgICB2YWx1ZSA9ICJiaWFzIiwgLWMoSUQsYWdlLCBhZ2VfeXJzLCBzZXhfbSwgZXRobmljaXR5X2hpc3AsIHJhY2UsIHRpbWVzaW5jZWRlYXRoLCByczIyNTQyOTgsIHJzMjI2ODQ5OCwgcnM1MzU3NiwgcnMyMjU0Mjk4X0EuY2FycmllciwgcnMyMjY4NDk4X0MuY2FycmllciwgcnM1MzU3Nl9BLmNhcnJpZXIsIHRvdF9iZGksIHRvdF9iZ3EsIHRvdF9lY3Jyc19nbG9iYWxfYW54LHRvdF9lY3Jyc19nbG9iYWxfYXZvaWQsIHRvdF9lY3Jyc19zcG91c2VfYW54LCB0b3RfZWNycnNfc3BvdXNlX2F2b2lkLCB0b3RfeXNsLCB0b3RfaWNnLCBncnBfY2cpKSAKc3RyKG1lZGlhbnNfbG9uZykKCiMgY3JlYXRlIG5ldyBjb2x1bW5zIGZvciBzdGltdWx1cyBjYXRlZ29yeSBhbmQgY29uZGl0aW9uCm1lZGlhbnNfbG9uZyRjb25kIDwtIGFzLmZhY3RvcihpZmVsc2UoZ3JlcGwoIipfQSIsIGRhdGFfbG9uZyRzdGltKSwgIkEiLCAiQiIpKQptZWRpYW5zX2xvbmckc3RpbXVsdXMgPC0gYXMuZmFjdG9yKGlmZWxzZShncmVwbCgiKm5ldSoiLCBkYXRhX2xvbmckc3RpbSksICJuZXV0cmFsIiwgCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgaWZlbHNlKGdyZXBsKCIqZGVhKiIsIGRhdGFfbG9uZyRzdGltKSwgImRlYXRoIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgaWZlbHNlKGdyZXBsKCIqc3BvKiIsIGRhdGFfbG9uZyRzdGltKSwgInNwb3VzZSIsIAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgaWZlbHNlKGdyZXBsKCIqc3RyKiIsIGRhdGFfbG9uZyRzdGltKSwgInN0cmFuZ2VyIiwgCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgaWZlbHNlKGdyZXBsKCIqbGl2KiIsIGRhdGFfbG9uZyRzdGltKSwgImxpdmluZyIsIE5BKSkpKSkpClZpZXcobWVkaWFuc19sb25nKSAjIDM5MCBvYnMuIG9mIDI2IHZhcnMsIHRoYXQncyBjb3JyZWN0CgpsaWJyYXJ5KHBzeWNoKQpkZXNjcmliZShtZWRpYW5zX2xvbmckYmlhcykgIyBza2V3bmVzcyBpcyAtLjA3LCBrdXJ0b3NpcyBpcyAxLjU3LCBTRCA9IDc0Ljk1Cmhpc3QobWVkaWFuc19sb25nJGJpYXMpCnFxbm9ybShtZWRpYW5zX2xvbmckYmlhcykgIyBub3QgdGVycmlibGUsIGJ1dCBkZWZpbml0ZWx5IHNvbWUgb3V0bGllcnMKCgoKIyBjaGVjayBvdXQgdGhlIG91dGxpZXJzCiMjIGZ1bmN0aW9uIGZyb20gaHR0cHM6Ly9zdGFja292ZXJmbG93LmNvbS9xdWVzdGlvbnMvMTI4NjYxODkvY2FsY3VsYXRpbmctdGhlLW91dGxpZXJzLWluLXIKb3V0ZnVuIDwtIGZ1bmN0aW9uKHgpIHsKICBhYnMoeC1tZWFuKHgsbmEucm09VFJVRSkpID4gMypzZCh4LG5hLnJtPVRSVUUpCn0KCiMgYWRkIGEgdmFyaWFibGUgZm9yIG91dGxpZXIgPSBUL0YKbWVkaWFuc19sb25nJG91dGxpZXIgPC0gb3V0ZnVuKG1lZGlhbnNfbG9uZyRiaWFzKQp0YWJsZShtZWRpYW5zX2xvbmckb3V0bGllcikgIyA1IG9ic2VydmF0aW9ucyB3aGVyZSBvdXRsaWVyID0gVFJVRSAoPjNTRCkKIyB3aGljaCBhcmUgdGhlc2U/Cm1lZGlhbnNfbG9uZyAlPiUgZmlsdGVyKG91dGxpZXI9PVRSVUUpCgojIyMgdGhpcyBpcyBhbm90aGVyIHdheSB0byBkbyBpdCB1c2luZyBib3hwbG90LnN0YXRzCiMgb3V0bGllcl92YWx1ZXMgPC0gYm94cGxvdC5zdGF0cyhtZWRpYW5zX2xvbmckYmlhcykkb3V0CiMgYm94cGxvdChkYXRhX2xvbmckYmlhcywgbWFpbj0iT3V0bGllcnMiLCBib3h3ZXg9MC4zKQojIG10ZXh0KHBhc3RlKCJPdXRseWluZyB2YWx1ZXM6ICIsIHBhc3RlKHJvdW5kKG91dGxpZXJfdmFsdWVzLCBkaWdpdHM9MiksIGNvbGxhcHNlPSIsICIpKSwgY2V4PTAuOSwgc2lkZT0xKQoKCmBgYApUaGUgZml2ZSBleHRyZW1lIG91dGxpZXJzICg+MyBTRCkgYXJlOgo8dWw+RDEzNyBkZWF0aCBBICgtMjg0LjApCkQxNDUgZGVhdGggQSAoLTI0Ny41KQpEMTM3IGRlYXRoIEIgKC0yNjEuMCkKRDE0NyBkZWF0aCBCICgyOTUuMCkKRDEzOSBzcG91c2UgQiAoMjc1LjUpPC91bD4KCldoYXTigJlzIGludGVyZXN0aW5nIGhlcmUgaXMgdGhhdCA0LzUgb2YgdGhlIG91dGxpZXJzIGFyZSBpbiB0aGUgQ0cgZ3JvdXAsIGFuZCAzLzQgb2YgdGhvc2Ugc2hvdyBleHRyZW1lIGF2b2lkYW5jZSBiaWFzIHRvIGRlYXRoIHN0aW11bGkuIEQxMzcgaGFzIGFuIGV4dHJlbWUgYXZvaWRhbmNlIGJpYXMgdG8gZGVhdGggaW4gYm90aCBBIGFuZCBCLiBUaGUgdGhlIHJlbWFpbmluZyB0d28gYXJlIGV4dHJlbWUgYXBwcm9hY2ggYmlhc2VzIHRvIGRlYXRoIGFuZCBzcG91c2UgKE5DRywgY29uZGl0aW9uIEIpLgoKRDE0NyB3aWxsIGJlIGRyb3BwZWQgaW4gdGhlIG5leHQgY2h1bmsgKGxvdyB0cmlhbCBjb3VudCksIHRoZSBvdGhlcnPigKY/PwoKIyMjIyBEcm9wcGluZyB0aGUgNCBwZW9wbGUgd2l0aCBsb3cgdHJpYWwgY291bnRzCmBgYHtyfQptZWRpYW5zX2xvbmcuMSA8LSBmaWx0ZXIobWVkaWFuc19sb25nLCAhZ3JlcGwoIkQxMDF8RDE0MXxEMTQ3fEQxNDgiLElEKSkgCnVuaXF1ZShtZWRpYW5zX2xvbmcuMSRJRCkgIyBkcm9wcGVkIHRoZSA0IHBhcnRpY2lwYW50cwpgYGAKCiMjIyBCb3hwbG90cwpgYGB7cn0KcGFuZWxieXN0aW0gPC0gZ2dwbG90KG1lZGlhbnNfbG9uZy4xLCBhZXMoZmlsbD1jb25kLCB5PWJpYXMsIHg9Z3JwX2NnKSkgKyAKICBnZW9tX2JveHBsb3QoYWVzKGZpbGw9Y29uZCksIG91dGxpZXIuYWxwaGEgPSAwLjMpCnAxIDwtIHBhbmVsYnlzdGltICsgZmFjZXRfZ3JpZCguIH4gc3RpbXVsdXMpICsgIHRoZW1lKHN0cmlwLnRleHQueCA9IGVsZW1lbnRfdGV4dChzaXplPTEyLCBjb2xvcj0icmVkIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBmYWNlPSJib2xkLml0YWxpYyIpLAogICAgICAgICAgc3RyaXAudGV4dC55ID0gZWxlbWVudF90ZXh0KHNpemU9MTIsIGNvbG9yPSJyZWQiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGZhY2U9ImJvbGQuaXRhbGljIikpICsgZ2VvbV9obGluZSh5aW50ZXJjZXB0PTAsIGxpbmV0eXBlPSJzb2xpZCIsIGNvbG9yPSJibGFjayIsIHNpemU9LjUpICsgeGxhYigiR3JvdXAiKSArIHlsYWIoIkF2b2lkIGJpYXMgICAgICAgICAgICAgICAgQXBwcm9hY2ggYmlhcyIpCgoKcGFuZWxieUNHIDwtIGdncGxvdChtZWRpYW5zX2xvbmcuMSwgYWVzKGZpbGw9Y29uZCwgeT1iaWFzLCB4PXN0aW11bHVzKSkgKyAKICBnZW9tX2JveHBsb3QoYWVzKGZpbGw9Y29uZCksIG91dGxpZXIuYWxwaGEgPSAwLjMpCnAyIDwtIHBhbmVsYnlDRyArIGZhY2V0X2dyaWQoLiB+IGdycF9jZykgKyAgdGhlbWUoc3RyaXAudGV4dC54ID0gZWxlbWVudF90ZXh0KHNpemU9MTIsIGNvbG9yPSJyZWQiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGZhY2U9ImJvbGQuaXRhbGljIiksCiAgICAgICAgICBzdHJpcC50ZXh0LnkgPSBlbGVtZW50X3RleHQoc2l6ZT0xMiwgY29sb3I9InJlZCIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgZmFjZT0iYm9sZC5pdGFsaWMiKSkgKyBnZW9tX2hsaW5lKHlpbnRlcmNlcHQ9MCwgbGluZXR5cGU9InNvbGlkIiwgY29sb3I9ImJsYWNrIiwgc2l6ZT0uNSkgKyB4bGFiKCJTdGltdWxpIikgKyB5bGFiKCJBdm9pZCBiaWFzICAgICAgICAgICAgICAgIEFwcHJvYWNoIGJpYXMiKQoKIyBXaGF0IGRvIHRoZSBib3hwbG90cyBsb29rIGxpa2UgYWZ0ZXIgZXhjbHVkaW5nIHRoZSBvdXRsaWVycyBpZGVudGlmaWVkIGFib3ZlPwptZWRpYW5zX2xvbmcuMiA8LSBtZWRpYW5zX2xvbmcuMSAlPiUgbXV0YXRlKGJpYXNfbm8ub3V0ID0gaWZlbHNlKG91dGxpZXI9PUZBTFNFLCBiaWFzLCBOQSkpICU+JSBmaWx0ZXIoIWlzLm5hKGJpYXNfbm8ub3V0KSkKVmlldyhtZWRpYW5zX2xvbmcuMikKCnBhbmVsYnlzdGltLjIgPC0gZ2dwbG90KG1lZGlhbnNfbG9uZy4yLCBhZXMoZmlsbD1jb25kLCB5PWJpYXNfbm8ub3V0LCB4PWdycF9jZykpICsgCiAgZ2VvbV9ib3hwbG90KGFlcyhmaWxsPWNvbmQpLCBvdXRsaWVyLmFscGhhID0gMC4zKQpwMyA8LSBwYW5lbGJ5c3RpbS4yICsgZmFjZXRfZ3JpZCguIH4gc3RpbXVsdXMpICsgIHRoZW1lKHN0cmlwLnRleHQueCA9IGVsZW1lbnRfdGV4dChzaXplPTEyLCBjb2xvcj0icmVkIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBmYWNlPSJib2xkLml0YWxpYyIpLAogICAgICAgICAgc3RyaXAudGV4dC55ID0gZWxlbWVudF90ZXh0KHNpemU9MTIsIGNvbG9yPSJyZWQiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGZhY2U9ImJvbGQuaXRhbGljIikpICsgZ2VvbV9obGluZSh5aW50ZXJjZXB0PTAsIGxpbmV0eXBlPSJzb2xpZCIsIGNvbG9yPSJibGFjayIsIHNpemU9LjUpICsgeGxhYigiR3JvdXAiKSArIHlsYWIoIkF2b2lkIGJpYXMgICAgICAgICAgICAgICAgQXBwcm9hY2ggYmlhcyIpCgpwYW5lbGJ5Q0cuMiA8LSBnZ3Bsb3QobWVkaWFuc19sb25nLjIsIGFlcyhmaWxsPWNvbmQsIHk9Ymlhc19uby5vdXQsIHg9c3RpbXVsdXMpKSArIAogIGdlb21fYm94cGxvdChhZXMoZmlsbD1jb25kKSwgb3V0bGllci5hbHBoYSA9IDAuMykKcDQgPC0gcGFuZWxieUNHLjIgKyBmYWNldF9ncmlkKC4gfiBncnBfY2cpICsgIHRoZW1lKHN0cmlwLnRleHQueCA9IGVsZW1lbnRfdGV4dChzaXplPTEyLCBjb2xvcj0icmVkIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBmYWNlPSJib2xkLml0YWxpYyIpLAogICAgICAgICAgc3RyaXAudGV4dC55ID0gZWxlbWVudF90ZXh0KHNpemU9MTIsIGNvbG9yPSJyZWQiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGZhY2U9ImJvbGQuaXRhbGljIikpICsgZ2VvbV9obGluZSh5aW50ZXJjZXB0PTAsIGxpbmV0eXBlPSJzb2xpZCIsIGNvbG9yPSJibGFjayIsIHNpemU9LjUpICsgeGxhYigiU3RpbXVsaSIpICsgeWxhYigiQXZvaWQgYmlhcyAgICAgICAgICAgICAgICBBcHByb2FjaCBiaWFzIikKCnAxICMgd2l0aCBvdXRsaWVycwpwMyAjIG5vIG91dGxpZXJzCnAyICMgd2l0aCBvdXRsaWVycwpwNCAjIG5vIG91dGxpZXJzCgpgYGAKTm90ZSB0aGF0IHRoZSBlcnJvciBiYXJzIGFyZSB3YXl5eXkgd2lkZXIgaWYgb3V0bGllcnMgbm90IGRyb3BwZWQuCgojIyMgVXNlIHBsb3RseSB0byBleHBsb3JlIG91dGxpZXJzIGFuZCBzdGF0cwpUaGUgcGxvdGx5IHBhY2thZ2UgYWxsb3dzIHlvdSB0byBpbnRlcmFjdGl2ZWx5IGV4cGxvcmUgeW91ciBnZ3Bsb3Qgb2JqZWN0cy4gQ29uZGl0aW9ucyBBL0IgYXJlIHBsb3R0ZWQgb24gdG9wIG9mIGVhY2ggb3RoZXIsIHdoaWNoIG1ha2VzIGl0IGhhcmQgdG8gc2VlIGJvdGggdG9nZXRoZXIsIGJ1dCB5b3UgY2FuIGNsaWNrIHRoZSBsZWdlbmQgdG8gc2hvdyBqdXN0IEEgb3IganVzdCBCLCB3aGljaCBpcyBwcmV0dHkgY29vbCAoc2VlIGh0dHBzOi8vcGxvdC5seS9yL2dldHRpbmctc3RhcnRlZC8gZm9yIG1vcmUgaW5mbykuIEl0IGRvZXNuJ3Qgc2VlbSB0byBJRCBhbGwgb2YgdGhlIHNhbWUgb3V0bGllcnMgdGhhdCBnZ3Bsb3QyJ3MgYGdlb21fYm94cGxvdGAgZG9lcywgYnV0IGRvZXMgcHJvdmlkZSBhIHdheSB0byBsb29rIGF0IHRoZSB2YWx1ZXMgZm9yIHNvbWUgb2YgdGhlbSBhdCBsZWFzdC4gCmBgYHtyfQojIGluc3RhbGwucGFja2FnZXMoInBsb3RseSIpCiMgaW5zdGFsbC5wYWNrYWdlcygic2hpbnkiKQpsaWJyYXJ5KHBsb3RseSkKbGlicmFyeShzaGlueSkKCmdncGxvdGx5KHAxKSAjIHdpdGggb3V0bGllcnMKZ2dwbG90bHkocDMpICMgbm8gb3V0bGllcnMKZ2dwbG90bHkocDIpICMgd2l0aCBvdXRsaWVycwpnZ3Bsb3RseShwNCkgIyBubyBvdXRsaWVycwoKIyB0aGUgZG90cyBpbmRpY2F0ZSBleHRyZW1lIHZhbHVlcyBidXQgdGhhdCBkb2Vzbid0IG5lY2Vzc2FyaWx5IG1lYW4gdGhleSBhcmUgb3V0bGllcnMKYGBgCgojIyMgW1Nwb3VzZS9MaXZpbmcvRGVhdGgvU3RyYW5nZXJdIHZzLiBOZXV0cmFsIHBsb3RzCmBgYHtyfQojIGNvbXB1dGluZyBiaWFzIHJlbGF0aXZlIHRvIG5ldXRyYWw6Cm1lZGlhbnMzIDwtIG1lZGlhbnMyICU+JSBtdXRhdGUoZGlmZl9iaWFzX3Nwb19BID0gYmlhc19zcG9fQSAtIGJpYXNfbmV1X0EsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBkaWZmX2JpYXNfc3RyX0EgPSBiaWFzX3N0cl9BIC0gYmlhc19uZXVfQSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGRpZmZfYmlhc19saXZfQSA9IGJpYXNfbGl2X0EgLSBiaWFzX25ldV9BLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgZGlmZl9iaWFzX2RlYV9BID0gYmlhc19kZWFfQSAtIGJpYXNfbmV1X0EsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBkaWZmX2JpYXNfc3BvX0IgPSBiaWFzX3Nwb19CIC0gYmlhc19uZXVfQiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGRpZmZfYmlhc19zdHJfQiA9IGJpYXNfc3RyX0IgLSBiaWFzX25ldV9CLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgZGlmZl9iaWFzX2xpdl9CID0gYmlhc19saXZfQiAtIGJpYXNfbmV1X0IsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBkaWZmX2JpYXNfZGVhX0IgPSBiaWFzX2RlYV9CIC0gYmlhc19uZXVfQikKClZpZXcobWVkaWFuczMpCgpkYXRhX2xvbmcyIDwtIGdhdGhlcihtZWRpYW5zMywKICAgICAgICAgICAgICAgICAgIGtleSA9ICJzdGltIiwKICAgICAgICAgICAgICAgICAgIHZhbHVlID0gImRpZmZfYmlhcyIsIC1JRCwgLWdycF9jZykKCmRhdGFfbG9uZzMgPC0gZmlsdGVyKGRhdGFfbG9uZzIsIGdyZXBsKCJeZGlmZiIsc3RpbSkpCgpkYXRhX2xvbmczJGNvbmQgPC0gYXMuZmFjdG9yKGlmZWxzZShncmVwbCgiKl9BIiwgZGF0YV9sb25nMyRzdGltKSwgIkEiLCAiQiIpKQpkYXRhX2xvbmczJHN0aW11bHVzIDwtIGFzLmZhY3RvcihpZmVsc2UoZ3JlcGwoIipkZWEqIiwgZGF0YV9sb25nMyRzdGltKSwgImRlYXRoLW5ldSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGlmZWxzZShncmVwbCgiKnNwbyoiLCBkYXRhX2xvbmczJHN0aW0pLCAic3BvdXNlLW5ldSIsIAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgaWZlbHNlKGdyZXBsKCIqc3RyKiIsIGRhdGFfbG9uZzMkc3RpbSksICJzdHJhbmdlci1uZXUiLCAKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBpZmVsc2UoZ3JlcGwoIipsaXYqIiwgZGF0YV9sb25nMyRzdGltKSwgImxpdmluZy1uZXUiLCBOQSkpKSkpCgptaW51c19uZXUgPC0gZGF0YV9sb25nMwpWaWV3KG1pbnVzX25ldSkKIyBkaWZmX2JpYXMgaXMgY2hyIHJhdGhlciB0aGFuIG51bSBmb3Igc29tZSByZWFzb24KbWludXNfbmV1JGRpZmZfYmlhcyA8LWFzLm51bWVyaWMobWludXNfbmV1JGRpZmZfYmlhcykKCmRlc2NyaWJlKG1pbnVzX25ldSRkaWZmX2JpYXMpICMgc2tld25lc3MgaXMgLTAuMTYsIGt1cnRvc2lzIGlzIC45NQpoaXN0KG1pbnVzX25ldSRkaWZmX2JpYXMpICMgbm90IGJhZApxcW5vcm0obWludXNfbmV1JGRpZmZfYmlhcykgIyBub3QgdG9vIGJhZCwgYnV0IGRlZmluaXRlbHkgYSBmZXcgZXh0cmVtZSB2YWx1ZXMKYGBgCgoKYGBge3J9CiMgcGFuZWwgYnkgc3RpbXVsdXMgY2F0ZWdvcnkKcGFuZWxieXN0aW1fZGlmZiA8LSBnZ3Bsb3QobWludXNfbmV1LCBhZXMoZmlsbD1jb25kLCB5PWRpZmZfYmlhcywgeD1ncnBfY2cpKSArIAogIGdlb21fYm94cGxvdChhZXMoZmlsbD1jb25kKSwgb3V0bGllci5hbHBoYSA9IDAuMykKcDUgPC0gcGFuZWxieXN0aW1fZGlmZiArIGZhY2V0X2dyaWQoLiB+IHN0aW11bHVzKSArICB0aGVtZShzdHJpcC50ZXh0LnggPSBlbGVtZW50X3RleHQoc2l6ZT0xMiwgY29sb3I9InJlZCIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgZmFjZT0iYm9sZC5pdGFsaWMiKSwKICAgICAgICAgIHN0cmlwLnRleHQueSA9IGVsZW1lbnRfdGV4dChzaXplPTEyLCBjb2xvcj0icmVkIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBmYWNlPSJib2xkLml0YWxpYyIpKSArIGdlb21faGxpbmUoeWludGVyY2VwdD0wLCBsaW5ldHlwZT0ic29saWQiLCBjb2xvcj0iYmxhY2siLCBzaXplPS41KSArIHhsYWIoIkdyb3VwIikgKyB5bGFiKCJBdm9pZCBiaWFzICAgICAgICAgICAgICAgIEFwcHJvYWNoIGJpYXMiKQpwNQpnZ3Bsb3RseShwNSkKCiMgcGFuZWwgYnkgZ3JvdXAKcGFuZWxieUNHX2RpZmYgPC0gZ2dwbG90KG1pbnVzX25ldSwgYWVzKGZpbGw9Y29uZCwgeT1kaWZmX2JpYXMsIHg9c3RpbXVsdXMpKSArIAogIGdlb21fYm94cGxvdChhZXMoZmlsbD1jb25kKSwgb3V0bGllci5hbHBoYSA9IDAuMykKcDYgPC0gcGFuZWxieUNHX2RpZmYgKyBmYWNldF9ncmlkKC4gfiBncnBfY2cpICsgIHRoZW1lKHN0cmlwLnRleHQueCA9IGVsZW1lbnRfdGV4dChzaXplPTEyLCBjb2xvcj0icmVkIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBmYWNlPSJib2xkLml0YWxpYyIpLAogICAgICAgICAgc3RyaXAudGV4dC55ID0gZWxlbWVudF90ZXh0KHNpemU9MTIsIGNvbG9yPSJyZWQiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGZhY2U9ImJvbGQuaXRhbGljIikpICsgZ2VvbV9obGluZSh5aW50ZXJjZXB0PTAsIGxpbmV0eXBlPSJzb2xpZCIsIGNvbG9yPSJibGFjayIsIHNpemU9LjUpICsgeGxhYigiR3JvdXAiKSArIHlsYWIoIkF2b2lkIGJpYXMgICAgICAgICAgICAgICAgQXBwcm9hY2ggYmlhcyIpCnA2CmdncGxvdGx5KHA2KQoKIyBkcm9wcGluZyBsb3ctdHJpYWwgY291bnQgcGVvcGxlCm1pbnVzX25ldS4xIDwtIGZpbHRlcihtaW51c19uZXUsICFncmVwbCgiRDEwMXxEMTQxfEQxNDd8RDE0OCIsSUQpKQoKIyBwYW5lbCBieSBzdGltdWx1cyBjYXRlZ29yeQpwYW5lbGJ5c3RpbV9kaWZmLjEgPC0gZ2dwbG90KG1pbnVzX25ldS4xLCBhZXMoZmlsbD1jb25kLCB5PWRpZmZfYmlhcywgeD1ncnBfY2cpKSArIAogIGdlb21fYm94cGxvdChhZXMoZmlsbD1jb25kKSwgb3V0bGllci5hbHBoYSA9IDAuMykKcDcgPC0gcGFuZWxieXN0aW1fZGlmZi4xICsgZmFjZXRfZ3JpZCguIH4gc3RpbXVsdXMpICsgIHRoZW1lKHN0cmlwLnRleHQueCA9IGVsZW1lbnRfdGV4dChzaXplPTEyLCBjb2xvcj0icmVkIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBmYWNlPSJib2xkLml0YWxpYyIpLAogICAgICAgICAgc3RyaXAudGV4dC55ID0gZWxlbWVudF90ZXh0KHNpemU9MTIsIGNvbG9yPSJyZWQiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGZhY2U9ImJvbGQuaXRhbGljIikpICsgZ2VvbV9obGluZSh5aW50ZXJjZXB0PTAsIGxpbmV0eXBlPSJzb2xpZCIsIGNvbG9yPSJibGFjayIsIHNpemU9LjUpICsgeGxhYigiR3JvdXAiKSArIHlsYWIoIkF2b2lkIGJpYXMgICAgICAgICAgICAgICAgQXBwcm9hY2ggYmlhcyIpCnA3CmdncGxvdGx5KHA3KQoKIyBwYW5lbCBieSBncm91cApwYW5lbGJ5Q0dfZGlmZi4xIDwtIGdncGxvdChtaW51c19uZXUuMSwgYWVzKGZpbGw9Y29uZCwgeT1kaWZmX2JpYXMsIHg9c3RpbXVsdXMpKSArIAogIGdlb21fYm94cGxvdChhZXMoZmlsbD1jb25kKSwgb3V0bGllci5hbHBoYSA9IDAuMykKcDggPC0gcGFuZWxieUNHX2RpZmYuMSArIGZhY2V0X2dyaWQoLiB+IGdycF9jZykgKyAgdGhlbWUoc3RyaXAudGV4dC54ID0gZWxlbWVudF90ZXh0KHNpemU9MTIsIGNvbG9yPSJyZWQiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGZhY2U9ImJvbGQuaXRhbGljIiksCiAgICAgICAgICBzdHJpcC50ZXh0LnkgPSBlbGVtZW50X3RleHQoc2l6ZT0xMiwgY29sb3I9InJlZCIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgZmFjZT0iYm9sZC5pdGFsaWMiKSkgKyBnZW9tX2hsaW5lKHlpbnRlcmNlcHQ9MCwgbGluZXR5cGU9InNvbGlkIiwgY29sb3I9ImJsYWNrIiwgc2l6ZT0uNSkgKyB4bGFiKCJHcm91cCIpICsgeWxhYigiQXZvaWQgYmlhcyAgICAgICAgICAgICAgICBBcHByb2FjaCBiaWFzIikKcDgKZ2dwbG90bHkocDgpCgpgYGAKCiMjIyBTcG91c2UgdnMuIFN0cmFuZ2VyIHBsb3RzCmBgYHtyfQojIGNvbXB1dGluZyBzcG91c2UgdnMuIHN0cmFuZ2VyCm1lZGlhbnM0IDwtIG1lZGlhbnMzICU+JSBtdXRhdGUoc3BvX3ZzX3N0cl9BID0gYmlhc19zcG9fQSAtIGJpYXNfc3RyX0EsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBzcG9fdnNfc3RyX0IgPSBiaWFzX3Nwb19CIC0gYmlhc19zdHJfQiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGxpdl92c19zdHJfQSA9IGJpYXNfbGl2X0EgLSBiaWFzX3N0cl9BLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbGl2X3ZzX3N0cl9CID0gYmlhc19saXZfQiAtIGJpYXNfc3RyX0IpCgoKZGF0YV9sb25nNCA8LSBnYXRoZXIoZGF0YV9tZWFuczQsCiAgICAgICAgICAgICAgICAgICBrZXkgPSAic3RpbSIsCiAgICAgICAgICAgICAgICAgICB2YWx1ZSA9ICJkaWZmX2JpYXMiLCAtSUQsIC1ncnBfY2cpCgpkYXRhX2xvbmc0IDwtIGZpbHRlcihkYXRhX2xvbmc0LCBncmVwbCgiXnNwb198Xmxpdl8iLHN0aW0pKQoKZGF0YV9sb25nNCRjb25kIDwtIGFzLmZhY3RvcihpZmVsc2UoZ3JlcGwoIipfQSIsIGRhdGFfbG9uZzQkc3RpbSksICJBIiwgIkIiKSkKZGF0YV9sb25nNCRzdGltdWx1cyA8LSBhcy5mYWN0b3IoaWZlbHNlKGdyZXBsKCIqc3BvKiIsIGRhdGFfbG9uZzQkc3RpbSksICJzcG91c2Utc3RyYW5nZXIiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBpZmVsc2UoZ3JlcGwoIipsaXYqIiwgZGF0YV9sb25nNCRzdGltKSwgImxpdmluZy1zdHJhbmdlciIsIE5BKSkpCgpzcG91c2VfdnNfc3RyIDwtIGRhdGFfbG9uZzQKVmlldyhzcG91c2VfdnNfc3RyKQpgYGAKCmBgYHtyfQojIHBhbmVsIGJ5IHN0aW11bHVzIGNhdGVnb3J5CnBhbmVsYnlzdGltX2RpZmYyIDwtIGdncGxvdChzcG91c2VfdnNfc3RyLCBhZXMoZmlsbD1jb25kLCB5PWRpZmZfYmlhcywgeD1ncnBfY2cpKSArIAogIGdlb21fYm94cGxvdChhZXMoZmlsbD1jb25kKSwgb3V0bGllci5hbHBoYSA9IDAuMykKcDkgPC0gcGFuZWxieXN0aW1fZGlmZjIgKyBmYWNldF9ncmlkKC4gfiBzdGltdWx1cykgKyAgdGhlbWUoc3RyaXAudGV4dC54ID0gZWxlbWVudF90ZXh0KHNpemU9MTIsIGNvbG9yPSJyZWQiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGZhY2U9ImJvbGQuaXRhbGljIiksCiAgICAgICAgICBzdHJpcC50ZXh0LnkgPSBlbGVtZW50X3RleHQoc2l6ZT0xMiwgY29sb3I9InJlZCIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgZmFjZT0iYm9sZC5pdGFsaWMiKSkgKyBnZW9tX2hsaW5lKHlpbnRlcmNlcHQ9MCwgbGluZXR5cGU9InNvbGlkIiwgY29sb3I9ImJsYWNrIiwgc2l6ZT0uNSkgKyB4bGFiKCJHcm91cCIpICsgeWxhYigiQXZvaWQgYmlhcyAgICAgICAgICAgICAgICBBcHByb2FjaCBiaWFzIikKcDkKZ2dwbG90bHkocDkpCgojIHBhbmVsIGJ5IGdyb3VwCnBhbmVsYnlDR19kaWZmMiA8LSBnZ3Bsb3Qoc3BvdXNlX3ZzX3N0ciwgYWVzKGZpbGw9Y29uZCwgeT1kaWZmX2JpYXMsIHg9c3RpbXVsdXMpKSArIAogIGdlb21fYm94cGxvdChhZXMoZmlsbD1jb25kKSwgb3V0bGllci5hbHBoYSA9IDAuMykKcDEwIDwtIHBhbmVsYnlDR19kaWZmMiArIGZhY2V0X2dyaWQoLiB+IGdycF9jZykgKyAgdGhlbWUoc3RyaXAudGV4dC54ID0gZWxlbWVudF90ZXh0KHNpemU9MTIsIGNvbG9yPSJyZWQiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGZhY2U9ImJvbGQuaXRhbGljIiksCiAgICAgICAgICBzdHJpcC50ZXh0LnkgPSBlbGVtZW50X3RleHQoc2l6ZT0xMiwgY29sb3I9InJlZCIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgZmFjZT0iYm9sZC5pdGFsaWMiKSkgKyBnZW9tX2hsaW5lKHlpbnRlcmNlcHQ9MCwgbGluZXR5cGU9InNvbGlkIiwgY29sb3I9ImJsYWNrIiwgc2l6ZT0uNSkgKyB4bGFiKCJHcm91cCIpICsgeWxhYigiQXZvaWQgYmlhcyAgICAgICAgICAgICAgICBBcHByb2FjaCBiaWFzIikKcDEwCmdncGxvdGx5KHAxMCkKCiMgZHJvcHBpbmcgbG93LXRyaWFsIGNvdW50IHBlb3BsZQpzcG91c2VfdnNfc3RyLjEgPC0gZmlsdGVyKHNwb3VzZV92c19zdHIsICFncmVwbCgiRDEwMXxEMTQxfEQxNDd8RDE0OCIsSUQpKQoKIyBwYW5lbCBieSBzdGltdWx1cyBjYXRlZ29yeQpwYW5lbGJ5c3RpbV9kaWZmMi4xIDwtIGdncGxvdChzcG91c2VfdnNfc3RyLjEsIGFlcyhmaWxsPWNvbmQsIHk9ZGlmZl9iaWFzLCB4PWdycF9jZykpICsgCiAgZ2VvbV9ib3hwbG90KGFlcyhmaWxsPWNvbmQpLCBvdXRsaWVyLmFscGhhID0gMC4zKQpwMTEgPC0gcGFuZWxieXN0aW1fZGlmZjIuMSArIGZhY2V0X2dyaWQoLiB+IHN0aW11bHVzKSArICB0aGVtZShzdHJpcC50ZXh0LnggPSBlbGVtZW50X3RleHQoc2l6ZT0xMiwgY29sb3I9InJlZCIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgZmFjZT0iYm9sZC5pdGFsaWMiKSwKICAgICAgICAgIHN0cmlwLnRleHQueSA9IGVsZW1lbnRfdGV4dChzaXplPTEyLCBjb2xvcj0icmVkIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBmYWNlPSJib2xkLml0YWxpYyIpKSArIGdlb21faGxpbmUoeWludGVyY2VwdD0wLCBsaW5ldHlwZT0ic29saWQiLCBjb2xvcj0iYmxhY2siLCBzaXplPS41KSArIHhsYWIoIkdyb3VwIikgKyB5bGFiKCJBdm9pZCBiaWFzICAgICAgICAgICAgICAgIEFwcHJvYWNoIGJpYXMiKQpwMTEKZ2dwbG90bHkocDExKQoKIyBwYW5lbCBieSBncm91cApwYW5lbGJ5Q0dfZGlmZjIuMSA8LSBnZ3Bsb3Qoc3BvdXNlX3ZzX3N0ci4xLCBhZXMoZmlsbD1jb25kLCB5PWRpZmZfYmlhcywgeD1zdGltdWx1cykpICsgCiAgZ2VvbV9ib3hwbG90KGFlcyhmaWxsPWNvbmQpLCBvdXRsaWVyLmFscGhhID0gMC4zKQpwMTIgPC0gcGFuZWxieUNHX2RpZmYyLjEgKyBmYWNldF9ncmlkKC4gfiBncnBfY2cpICsgIHRoZW1lKHN0cmlwLnRleHQueCA9IGVsZW1lbnRfdGV4dChzaXplPTEyLCBjb2xvcj0icmVkIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBmYWNlPSJib2xkLml0YWxpYyIpLAogICAgICAgICAgc3RyaXAudGV4dC55ID0gZWxlbWVudF90ZXh0KHNpemU9MTIsIGNvbG9yPSJyZWQiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGZhY2U9ImJvbGQuaXRhbGljIikpICsgZ2VvbV9obGluZSh5aW50ZXJjZXB0PTAsIGxpbmV0eXBlPSJzb2xpZCIsIGNvbG9yPSJibGFjayIsIHNpemU9LjUpICsgeGxhYigiR3JvdXAiKSArIHlsYWIoIkF2b2lkIGJpYXMgICAgICAgICAgICAgICAgQXBwcm9hY2ggYmlhcyIpCnAxMgpnZ3Bsb3RseShwMTIpCgpgYGAKIyMjIFJlZ3Jlc3Npb25zCmBgYHtyfQojIHByZWRpY3QgZnJvbSBzdGltdWx1cwptMSA8LSBsbShiaWFzIH4gc3RpbXVsdXMsIGRhdGE9bWVkaWFuc19sb25nLjMpCnN1bW1hcnkobTEpCgojIHByZWRpY3QgZnJvbSBjb25kaXRpb24KbTIgPC0gbG0oYmlhcyB+IGNvbmQsIGRhdGE9bWVkaWFuc19sb25nLjMpCnN1bW1hcnkobTIpCgojIHByZWRpY3QgZnJvbSBzdGltdWx1cypjb25kaXRpb24KbTMgPC0gbG0oYmlhcyB+IHN0aW11bHVzKmNvbmQsIGRhdGE9bWVkaWFuc19sb25nLjMpCnN1bW1hcnkobTMpCgojIHByZWRpY3QgZnJvbSBzdGltdWx1cypjb25kaXRpb24qZ3JvdXAKbTQgPC0gbG0oYmlhcyB+IHN0aW11bHVzKmNvbmQqZ3JwX2NnLCBkYXRhPW1lZGlhbnNfbG9uZy4zKQpzdW1tYXJ5KG00KQoKIyBwcmVkaWN0IGZyb20gc3RpbXVsdXMgKyBjb25kaXRpb24qZ3JvdXAKbTUgPC0gbG0oYmlhcyB+IHN0aW11bHVzICsgY29uZCpncnBfY2csIGRhdGE9bWVkaWFuc19sb25nLjMpCnN1bW1hcnkobTUpCmNhdF9wbG90KG01LCBwcmVkPSJncnBfY2ciLCBtb2R4ID0gImNvbmQiLCBwbG90LnBvaW50cz1ULCBqaXR0ZXI9MC4xLCBwb2ludC5zaGFwZT1UKQoKCiMgcHJlZGljdCBmcm9tIHN0aW11bHVzKmNvbmRpdGlvbiArIGdyb3VwCm02IDwtIGxtKGJpYXMgfiBzdGltdWx1cypjb25kICsgZ3JwX2NnLCBkYXRhPW1lZGlhbnNfbG9uZy4zKQpzdW1tYXJ5KG02KQoKYW5vdmEobTEsbTIpICMgbTIgPiBtMQphbm92YShtMixtMykgIyBtMyA+IG0yCmFub3ZhKG0zLG00KSAjIG5zCmFub3ZhKG00LG01KSAjIG5zCmFub3ZhKG00LG02KSAjIG5zCgojIHByZWRpY3QgZnJvbSBzdGltdWx1cypjb25kaXRpb24qdG90X2ljZwptNyA8LSBsbShiaWFzIH4gc3RpbXVsdXMqY29uZCp0b3RfaWNnLCBkYXRhPW1lZGlhbnNfbG9uZy4zKQpzdW1tYXJ5KG03KSAjIHRoZSB0b3RfaWNnKmNvbmQgaW50ZXJhY3Rpb24gaXMgYSBzaWduaWZpY2FudCBwcmVkaWN0b3IsIHQgPSAyLjUyMiwgcCA9IC4wMTIKIyBubyAzLXdheSBpbnRlcmFjdGlvbgppbnRlcmFjdF9wbG90KG03LCBwcmVkPSJ0b3RfaWNnIiwgbW9keCA9ICJjb25kIiwgcGxvdC5wb2ludHM9VCwgaml0dGVyPTAuMSwgcG9pbnQuc2hhcGU9VCkKCmBgYApOb3RlIHRoYXQgaW4gdGhlIGxhc3QgcGxvdCwgcGVvcGxlIGluIHRoZSBDRyBncm91cCBzaG93cyBpbmNyZWFzZWQgYXBwcm9hY2ggYmlhcyB1bmRlciBjb25kaXRpb24gQi4KCiMjIyMgRXhwbG9yYXRvcnkgYW5hbHlzZXMgd2l0aCB0aGUgZ2Vub3R5cGUgZGF0YQpJIHdhbnRlZCB0byB0YWtlIGEgbG9vayBhdCBhdHRhY2htZW50IHN0eWxlcywgX09YVFJfIGdlbm90eXBlLCBhbmQgY29uZGl0aW9uLiBBbGwgb2YgdGhlIEVDUlJTIHZhcmlhYmxlcyBhcmUgc3VwZXIgbmVnYXRpdmVseSBza2V3ZWQuIEkgdHJpZWQgc29tZSB0cmFuc2Zvcm1hdGlvbnMgdXNpbmcgYGJlc3ROb3JtYWxpemVgIGJ1dCB0aGVpciByZWNvbW1lbmRhdGlvbnMgZGlkbid0IGhlbHAgbXVjaC4gSG93ZXZlciwgdGhlIHJlc2lkdWFscyBmb3IgdGhlIG1vZGVscyBkbyBsb29rIG9rYXkgaW1vLiBCdXQgZG8gYmVhciB0aGF0IGluIG1pbmQgYXMgeW91IGxvb2sgYXQgdGhlc2UuCgoqKkFsc28sIGtlZXAgaW4gbWluZCB0aGF0IHRoaXMgaXMgc3RpbGwgdGhlIGxvbmcgZGF0YXNldCwgc28gZWFjaCBwZXJzb24gaGFzIG11bHRpcGxlIG9ic2VydmF0aW9ucyBvZiB0aGUgYGJpYXNgIHNjb3JlLiBUaGlzIG1ha2VzIGl0IGxvb2sgbGlrZSB0aGVyZSBhcmUgbW9yZSBkYXRhcG9pbnRzIHRoYW4gdGhlcmUgYXJlLCBhbmQgSSdtIG5vdCBzdXJlIGlmIHRoaXMgaXMgY29ycmVjdCBiZWNhdXNlIGl0IGRvZXNuJ3QgbW9kZWwgdGhlIGludGVyZGVwZW5kZW5jZSBpbiB0aGUgZGF0YS4qKgoKYGBge3J9CiMgbGlicmFyeShiZXN0Tm9ybWFsaXplKQojIG5vcm0gPC0gYmVzdE5vcm1hbGl6ZShtZWRpYW5zX2xvbmcuMyR0b3RfZWNycnNfc3BvdXNlX2FueCkKIyBtZWRpYW5zX2xvbmcuMyR0b3RfZWNycnNfc3BvdXNlX2FueF90IDwtIG5vcm0keC50ICMgcHVsbCB4LnQgZnJvbSBub3JtIGFuZCBhc3NpZ24gaXQgYmFjayBpbnRvIGRhdGFzZXQKIyBoaXN0KG1lZGlhbnNfbG9uZy4zJHRvdF9lY3Jyc19zcG91c2VfYW54X3QpCgojIFRoZSByZWNlbnQgU2NoaWVsZSBldCBhbC4gcGFwZXIgb24gQ0csIHJzMjI1NDI5OCwgYmVoYXZpb3JhbCBpbmhpYml0aW9uIGFuZCBzZXBhcmF0aW9uIGFueGlldHkgZm91bmQ6CiMgIC0gTm8gc2lnbmlmaWNhbnQgbWFpbiBlZmZlY3Qgb2YgT1hUUiBnZW5vdHlwZSBvbiBJQ0cgc2NvcmUgKHNhbWUgYXMgd2UgZm91bmQpCiMgIC0gU2lnbmlmaWNhbnQgaW50ZXJhY3Rpb24gb2YgT1hUUiB4IGJlaGF2aW9yYWwgaW5oaWJpdGlvbiBvbiBJQ0cgc2NvcmUKIyAgLSBNYXJnaW5hbCBpbnRlcmFjdGlvbiBvZiBPWFRSIHggYWR1bHQgc2VwYXJhdGlvbiBhbnhpZXR5IG9uIElDRyBzY29yZQojIFdFIEhBVkUgQklTL0JBUyBJTiBUSEUgTUFTVEVSIERBVEFTRVQgLSBDT1VMRCBSRVBMSUNBVEU/CgptOCA8LSBsbShiaWFzIH4gc3RpbXVsdXMqY29uZCt0b3RfZWNycnNfZ2xvYmFsX2FueCwgZGF0YT1tZWRpYW5zX2xvbmcuMykKc3VtbWFyeShtOCkgIyBpbnRlcmVzdGluZyAtIEdMT0JBTCBhbnhpb3VzIGF0dGFjaG1lbnQgc3R5bGUgT1ZFUkFMTCBwcmVkaWN0cyBiaWFzCnFxbm9ybShyZXNpZChtOCkpCgptOSA8LSBsbShiaWFzIH4gc3RpbXVsdXMrY29uZCt0b3RfZWNycnNfc3BvdXNlX2FueCwgZGF0YT1tZWRpYW5zX2xvbmcuMykKc3VtbWFyeShtOSkgIyBidXQgU1BPVVNFIGFueGlvdXMgYXR0YWNobWVudCBzdHlsZSBkb2VzIE5PVCBwcmVkaWN0IGJpYXMKcXFub3JtKHJlc2lkKG05KSkKCm0xMCA8LSBsbShiaWFzIH4gc3RpbXVsdXMrY29uZCt0b3RfZWNycnNfc3BvdXNlX2FueCpyczIyNjg0OTgsIGRhdGE9bWVkaWFuc19sb25nLjMpCnN1bW1hcnkobTEwKSAjIFNQT1VTRSBhbnhpb3VzIGF0dGFjaG1lbnQgc3R5bGUgRE9FUyBwcmVkaWN0IGJpYXMgaW4gaW50ZXJhY3Rpb24gd2l0aCByczIyNjg0OTgsIHAgPSAuMDA5ICh0aGlzIGFsc28gd29ya3Mgd2l0aCByczIyNjg0OThfQy5jYXJyaWVyKQpxcW5vcm0ocmVzaWQobTEwKSkKaW50ZXJhY3RfcGxvdChtMTAsIHByZWQ9InRvdF9lY3Jyc19zcG91c2VfYW54IiwgbW9keCA9ICJyczIyNjg0OTgiLCBwbG90LnBvaW50cz1ULCBqaXR0ZXI9MC4xLCBwb2ludC5zaGFwZT1UKQoKbTExIDwtIGxtKGJpYXMgfiBzdGltdWx1cytjb25kK3RvdF9lY3Jyc19zcG91c2VfYW54KnJzMjI1NDI5OCwgZGF0YT1tZWRpYW5zX2xvbmcuMykKc3VtbWFyeShtMTEpICMgYnV0IFNQT1VTRSBhbnhpb3VzIGF0dGFjaG1lbnQgc3R5bGUgZG9lcyBub3Qgc2lnbmlmaWNhbnRseSBwcmVkaWN0IGJpYXMgaW4gaW50ZXJhY3Rpb24gd2l0aCByczIyNTQyOTgsIHAgPSAuMDY2CnFxbm9ybShyZXNpZChtMTEpKQoKbTEyIDwtIGxtKGJpYXMgfiBzdGltdWx1cytjb25kKnRvdF9lY3Jyc19zcG91c2VfYW54KnJzMjI2ODQ5OCwgZGF0YT1tZWRpYW5zX2xvbmcuMykKc3VtbWFyeShtMTIpICMgbm9uLXNpZ25pZmljYW50IDMtd2F5IGludGVyYWN0aW9uIG9mIGNvbmRpdGlvbipzcG91c2UgYW54aW91cyBhdHRhY2htZW50KnJzMjI2ODQ5OENDIAojIyMgSSBUSElOSyBJIE1JR0hUIE5FRUQgVE8gUkVETyBUSElTIE9ORSBBRlRFUiBSRS1MRVZFTElORyByczIyNjg0OTggLSBSRUZFUkVOQ0UgTEVWRUwgSVMgQy9ULCBTSE9VTEQgQkUgVFQgT1IgQ0M/CnFxbm9ybShyZXNpZChtMTIpKQoKbTEzIDwtIGxtKGJpYXMgfiBzdGltdWx1cytjb25kKnRvdF9lY3Jyc19zcG91c2VfYW54KnJzMjI1NDI5OCwgZGF0YT1tZWRpYW5zX2xvbmcuMykKc3VtbWFyeShtMTMpICMgc2lnbmlmaWNhbnQgaW50ZXJhY3Rpb24gb2Ygc3BvdXNlIGFueGlvdXMgYXR0YWNobWVudCpyczIyNTQyOTgsIHAgPSAuMDE4LCBubyAzLXdheSBpbnRlcmFjdGlvbiBzbyBtMTEgPiBtMTMgZm9yIHBhcnNpbW9ueQpxcW5vcm0ocmVzaWQobTEzKSkKCm0xNCA8LSBsbShiaWFzIH4gc3RpbXVsdXMrY29uZCt0b3RfZWNycnNfc3BvdXNlX2FueCpyczUzNTc2LCBkYXRhPW1lZGlhbnNfbG9uZy4zKQpzdW1tYXJ5KG0xNCkgIyBubyBlZmZlY3Qgb2YgaW50ZXJhY3Rpb24KcXFub3JtKHJlc2lkKG0xNCkpCgptMTUgPC0gbG0oYmlhcyB+IHN0aW11bHVzK2NvbmQqdG90X2VjcnJzX3Nwb3VzZV9hbngqcnM1MzU3NiwgZGF0YT1tZWRpYW5zX2xvbmcuMykKc3VtbWFyeShtMTUpICMgc2lnbmlmaWNhbnQgMy13YXkgaW50ZXJhY3Rpb24gb2YgY29uZGl0aW9uKnNwb3VzZSBhbnhpb3VzIGF0dGFjaG1lbnQqcnM1MzU3NiAoR0cpLCBwID0gMC4wMTkKcXFub3JtKHJlc2lkKG0xNSkpCmBgYAoKCiMjIyBTb21lIG1vcmUgZGF0YSB2aXoKCmBgYHtyfQpsaWJyYXJ5KGxhdHRpY2UpCgp4eXBsb3QoYmlhcyB+IGNvbmQgfCBhcy5mYWN0b3IoSUQpLCBkYXRhPW1lZGlhbnNfbG9uZy4zLCBhcy50YWJsZT1ULCB0eXBlPWMoInAiLCJyIikpICMgbG9vayBhdCBwZW9wbGVzJyBpbmRpdmlkdWFsIHNsb3BlcyBiZXR3ZWVuIGNvbmRpdGlvbnMKCnh5cGxvdChiaWFzIH4gY29uZCB8IGFzLmZhY3RvcihncnBfY2cpLCBkYXRhPW1lZGlhbnNfbG9uZy4zLCBhcy50YWJsZT1ULCB0eXBlPWMoInAiLCJyIikpICMjIGxvb2sgYXQgc2xvcGVzIGJldHdlZW4gZ3JvdXBzCgp4eXBsb3QoYmlhcyB+IHN0aW11bHVzIHwgYXMuZmFjdG9yKGdycF9jZyksIGRhdGE9bWVkaWFuc19sb25nLjMsIGFzLnRhYmxlPVQsIHR5cGU9YygicCIsInIiKSkgIyMgbG9vayBhdCBzbG9wZXMgYmV0d2VlbiBncm91cHMKYGBgCgojIE5ldyBBTk9WQXMgYW5kIHBsb3RzCiMjIyMgUmVwZWF0ZWQtbWVhc3VyZXMgQU5PVkEgb24gdGhlIGFnZ3JlZ2F0ZSBSVHMKCioqQ2F2ZWF0OiBJIGRpZG4ndCBpbmNsdWRlIGFueSBjb3ZhcmlhdGVzIGluIHRoZSBtb2RlbCB5ZXQuKioKCmBgYHtyfQpsaWJyYXJ5KHRpZHl2ZXJzZSkKbGlicmFyeShhZmV4KQpsaWJyYXJ5KGVtbWVhbnMpCmxpYnJhcnkoanRvb2xzKQoKIyB1c2UgdGhlIGRhdGFzZXQgIm1sbV9sb25nMiIgdGhhdCB3YXMgY3JlYXRlZCBpbiBhIHByZXZpb3VzIHN0ZXAgKGl0IGhhcyB0cmlhbC1sZXZlbCBSVHM7IHN0aW0sIGNvbmQsIGFuZCBwdXNoX3B1bGwgYXJlIGZhY3RvcnMpCiMgYWRkIGEgZ3JvdXAgdmFyaWFibGUgZm9yIENHL05DRywgbWFrZSBwdXNoX3B1bGwgJiBydW4gaW50byBmYWN0b3JzLCBhbmQgZHJvcCB0aGUgNCBwZW9wbGUgd2hvIGZhaWxlZCB0byByZXZlcnNlIHRoZSBpbnN0cnVjdGlvbnMKYW5vdmFEYXRhIDwtIG1sbV9sb25nMiAlPiUgCiAgbXV0YXRlKGdycF9jZyA9IGFzLmZhY3RvcihpZmVsc2UodG90X2ljZyA+PSAyNSwgIkNHIiwgIk5DRyIpKSwgcHVzaF9wdWxsID0gYXMuZmFjdG9yKHB1c2hfcHVsbCksIHJ1biA9IGFzLmZhY3RvcihydW4pKSAlPiUgZmlsdGVyKCFncmVwbCgiRDEwMXxEMTQxfEQxNDd8RDE0OCIsSUQpKQoKIyByZXBlYXRlZC1tZWFzdXJlcyBBTk9WQSB1c2luZyBtZWRpYW5zLCB3aXRoIDMgd2l0aGluLXN1YmplY3RzIGZhY3RvcnMgKHN0aW11bHVzLCBjb25kaXRpb24sIHB1c2ggb3IgcHVsbCkgYW5kIDEgYmV0d2Vlbi1zdWJqZWN0cyBmYWN0b3IgKENHIHZzLiBOQ0cpCmExIDwtIGFvdl9leihpZCA9ICJJRCIsIGR2ID0gImdBQVRfUlQiLCBhbm92YURhdGEsIGJldHdlZW4gPSAiZ3JwX2NnIiwgd2l0aGluID0gYygic3RpbSIsICJjb25kIiwgInB1c2hfcHVsbCIpLCBmdW5fYWdncmVnYXRlID0gbWVkaWFuKSAjIHVzaW5nIG5vbi10cmFuc2Zvcm1lZCBSVHMKYTEgCgojIHJlcGVhdGVkLW1lYXN1cmVzIEFOT1ZBIHVzaW5nIG1lZGlhbnMsIHdpdGggMyB3aXRoaW4tc3ViamVjdHMgZmFjdG9ycyAoc3RpbXVsdXMsIGNvbmRpdGlvbiwgcHVzaCBvciBwdWxsKSBhbmQgMSBiZXR3ZWVuLXN1YmplY3RzIGZhY3RvciAoQ0cgdnMuIE5DRykKYTFfdCA8LSBhb3ZfZXooaWQgPSAiSUQiLCBkdiA9ICJnQUFUX1JUX3QiLCBhbm92YURhdGEsIGJldHdlZW4gPSAiZ3JwX2NnIiwgd2l0aGluID0gYygic3RpbSIsICJjb25kIiwgInB1c2hfcHVsbCIpLCBmdW5fYWdncmVnYXRlID0gbWVkaWFuKSAgIyB1c2luZyB0cmFuc2Zvcm1lZCBSVHMKYTFfdApgYGAKClJlc3VsdHMgZG9uJ3QgZGlmZmVyIGFwcHJlY2lhYmx5IGJldHdlZW4gdXNpbmcgdGhlIHRyYW5zZm9ybWVkIGFuZCBub24tdHJhbnNmb3JtZWQgUlRzLgoKRm9yIGJvdGggdGhlIHRyYW5zZm9ybWVkIGFuZCBub24tdHJhbnNmb3JtZWQgUlRzLCB0aGVyZSBpcyBhIHNpZ25pZmljYW50IHRocmVlLXdheSBpbnRlcmFjdGlvbiBvZiBgR3JvdXBgIHggYENvbmRpdGlvbmAgeCBgUHVzaF9QdWxsYCwgX0ZfKDEsMzMpID0gMTAuMDksIF9wXyA9IC4wMDMsIGdlbmVyYWxpemVkIF9ldGFfLXNxdWFyZWQgPSAuMDAzIChzdGF0cyBhcmUgZm9yIHRyYW5zZm9ybWVkIHZhcmlhYmxlKS4gSG93ZXZlciwgaWYgSSdtIGludGVycHJldGluZyB0aGF0IGVmZmVjdCBzaXplIGNvcnJlY3RseSwgaXQncyBhIHByZXR0eSB0aW55IGVmZmVjdCAoLjAyID0gc21hbGwgZWZmZWN0LCAuMTMgPSBtZWRpdW0sIC4yNiA9IGxhcmdlKS4gCgpgYGB7cn0KcDEzIDwtIGFmZXhfcGxvdChhMSwgeCA9ICJwdXNoX3B1bGwiLCB0cmFjZSA9ICJjb25kIiwgcGFuZWwgPSAiZ3JwX2NnIiwgCiAgICAgICAgICBlcnJvciA9ICJ3aXRoaW4iLCBtYXBwaW5nPSJsaW5ldHlwZSIsIGVycm9yX2FyZyA9IGxpc3Qod2lkdGggPSAuMSkpCnAxMyArIHRoZW1lX2xpZ2h0KCkgIyBncmV5c2NhbGUsIGxpZ2h0IHRoZW1lCnAxMyArIHRoZW1lX2FwYSgpICMgZ3JleXNjYWxlLCBBUEEgdGhlbWUKCnAxNCA8LSBhZmV4X3Bsb3QoYTEsIHggPSAicHVzaF9wdWxsIiwgdHJhY2UgPSAiY29uZCIsIHBhbmVsID0gImdycF9jZyIsIAogICAgICAgICAgZXJyb3IgPSAid2l0aGluIiwgbWFwcGluZz0iY29sb3IiLCBlcnJvcl9hcmcgPSBsaXN0KHdpZHRoID0gLjEpKQpwMTQgKyB0aGVtZV9saWdodCgpICMgY29sb3IsIGxpZ2h0IHRoZW1lCnAxNCArIHRoZW1lX2FwYSgpICMgY29sb3IsIEFQQSB0aGVtZQpgYGAKRnJvbSB0aGVzZSwgaXQgbG9va3MgbGlrZSB0aGUgaW50ZXJhY3Rpb24gc2hvd3MgYSBzaWduaWZpY2FudCBlZmZlY3Qgb2YgQ29uZGl0aW9uIChzcHJheSBBL0IpLCBidXQgX29ubHlfIGZvciBwZW9wbGUgd2l0aCBDRyBhbmQgX29ubHlfIG9uIHRoZWlyIHB1c2ggYmVoYXZpb3IuIEluIHRoZSBDRyBncm91cCwgQiBkZWNyZWFzZWQgYXZvaWRhbmNlIGJpYXMqIGFzIHNob3duIGJ5IHRoZSB3aXRoaW4tc3ViamVjdHMgZXJyb3IgYmFycyB0aGF0IGJhcmVseSBvdmVybGFwIGlmIGF0IGFsbC4gCgpJbiB0aGUgdHdvLXdheSBpbnRlcmFjdGlvbiBwbG90IGZvciB0aGUgYmlhcyBzY29yZSAoZnJvbSB0aGUgcmVncmVzc2lvbiksIHBlb3BsZSBpbiB0aGUgQ0cgZ3JvdXAgYXBwZWFyZWQgdG8gc2hvdyBpbmNyZWFzZWQgYXBwcm9hY2ggYmlhcyB1bmRlciBjb25kaXRpb24gQi4gRnJvbSB0aGUgcGxvdHMgYWJvdmUsIGl0IGxvb2tzIGxpa2Ugd2hhdCBpcyBkcml2aW5nIHRoaXMgYXBwYXJlbnQgaW5jcmVhc2UgaW4gYXBwcm9hY2ggYmlhcyBpcyBhY3R1YWxseSAqKmRlY3JlYXNlZCBhdm9pZGFuY2UgYmVoYXZpb3IqKiByYXRoZXIgdGhhbiAqKmluY3JlYXNlZCBhcHByb2FjaCBiZWhhdmlvcioqLiBJdCdzIGp1c3Qgbm90IGV2aWRlbnQgZnJvbSB0aGUgZGlmZmVyZW5jZSBzY29yZXMsIHdoaWNoIGFyZSBhZ25vc3RpYyB0byBjYXVzZS4KCipfKHdlbGwsIGlzIGl0IHJlYWxseSBiaWFzIHBlciBzZSBpZiBpdCdzIG5vdCByZWxhdGl2ZSB0byBwdWxsPyBobW0pXwoKIyMjIyBFc3RpbWF0ZWQgbWFyZ2luYWwgbWVhbnMKCmBgYHtyfQplbW0gPC0gZW1tZWFucyhhMSwgfmMoZ3JwX2NnLGNvbmQscHVzaF9wdWxsKSkKZW1tCnVwZGF0ZShwYWlycyhlbW0pLCBieT1OVUxMLCBhZGp1c3QgPSAiaG9sbSIpCgpgYGAKTm90IHF1aXRlIHN1cmUgYWJvdXQgdGhlc2UgcGFpcndpc2UgY29tcGFyaXNvbnMuIElkZWFsbHksIHdlJ2QgYmUgYWJsZSB0byBzZXQgdXAgc3BlY2lmaWMgY29udHJhc3RzIHRvIHRlc3QgYXMgZGVzY3JpYmVkIGJlbG93IGJ1dCBJIGhhdmVuJ3QgZmlndXJlZCB0aGF0IG91dCB5ZXQuIEhvd2V2ZXIsIGxvb2tpbmcgYXQgdGhlIHBsb3RzLCBJIHRoaW5rIGl0J3Mgc2FmZSB0byBpbnRlcnByZXQgdGhlIGludGVyYWN0aW9uIGFzIHN0YXRlZCBhYm92ZS4gSSB3aWxsIHdvcmsgb24gdGhpcy4KCmBgYAo/YW92X2V6CgpUaGUgUzMgb2JqZWN0IHJldHVybmVkIHBlciBkZWZhdWx0IGNhbiBiZSBkaXJlY3RseSBwYXNzZWQgdG8gZW1tZWFuczo6ZW1tZWFucyBmb3IgZnVydGhlciBhbmFseXNpcy4gVGhpcyBhbGxvd3MgdG8gdGVzdCBhbnkgdHlwZSBvZiBjb250cmFzdHMgdGhhdCBtaWdodCBiZSBvZiBpbnRlcmVzdCBpbmRlcGVuZGVudCBvZiB3aGV0aGVyIG9yIG5vdCB0aGlzIGNvbnRyYXN0IGludm9sdmVzIGJldHdlZW4tc3ViamVjdCB2YXJpYWJsZXMsIHdpdGhpbi1zdWJqZWN0IHZhcmlhYmxlcywgb3IgYSBjb21iaW5hdGlvbiB0aGVyZW9mLiBUaGUgZ2VuZXJhbCBwcm9jZWR1cmUgdG8gcnVuIHRob3NlIGNvbnRyYXN0cyBpcyB0aGUgZm9sbG93aW5nIChzZWUgRXhhbXBsZXMgZm9yIGEgZnVsbCBleGFtcGxlKToKCigxKSBFc3RpbWF0ZSBhbiBhZmV4X2FvdiBvYmplY3Qgd2l0aCB0aGUgZnVuY3Rpb24gcmV0dXJuZWQgaGVyZS4gRm9yIGV4YW1wbGU6IHggPC0gYW92X2NhcihkdiB+IGEqYiArIChpZC9jKSwgZCkKCigyKSBPYnRhaW4gYSBlbW1HcmlkLWNsYXNzIG9iamVjdCBieSBydW5uaW5nIGVtbWVhbnMgb24gdGhlIGFmZXhfYW92IG9iamVjdCBmcm9tIHN0ZXAgMSB1c2luZyB0aGUgZmFjdG9ycyBpbnZvbHZlZCBpbiB0aGUgY29udHJhc3QuIEZvciBleGFtcGxlOiByIDwtIGVtbWVhbnMoeCwgfmE6YykKCigzKSBDcmVhdGUgYSBsaXN0IGNvbnRhaW5pbmcgdGhlIGRlc2lyZWQgY29udHJhc3RzIG9uIHRoZSByZWZlcmVuY2UgZ3JpZCBvYmplY3QgZnJvbSBzdGVwIDIuIEZvciBleGFtcGxlOiAKY29uMSA8LSBsaXN0KGFfeCA9IGMoLTEsIDEsIDAsIDAsIDAsIDApLCBiX3ggPSBjKDAsIDAsIC0wLjUsIC0wLjUsIDAsIDEpKQoKKDQpIFRlc3QgdGhlIGNvbnRyYXN0IG9uIHRoZSByZWZlcmVuY2UgZ3JpZCB1c2luZyBjb250cmFzdC4gRm9yIGV4YW1wbGU6IGNvbnRyYXN0KHIsIGNvbjEpCgpUbyBjb250cm9sIGZvciBtdWx0aXBsZSB0ZXN0aW5nIHAtdmFsdWUgYWRqdXN0bWVudHMgY2FuIGJlIHNwZWNpZmllZC4gRm9yIGV4YW1wbGUgdGhlIEJvbmZlcnJvbmktSG9sbSBjb3JyZWN0aW9uOiBjb250cmFzdChyLCBjb24xLCBhZGp1c3QgPSAiaG9sbSIpCmBgYAoKIyMjIyBXcml0aW5nIHBsb3RzIHRvIC5wcHR4ClRoaXMgaXMgYSB1c2VmdWwgdG9vbCBmb3IgaGlnaC1yZXMgZmlndXJlcyEgVXNpbmcgdGhlIGBvZmZpY2VyYCBwYWNrYWdlIHRvIHdyaXRlIHBsb3RzIGRpcmVjdGx5IHRvIGEgUG93ZXJwb2ludCBwcmVzZW50YXRpb246CmBgYHtyfQpsaWJyYXJ5KG9mZmljZXIpCiMgQ3JlYXRlIGEgbmV3IHBvd2VycG9pbnQgZG9jdW1lbnQKb3RfcGxvdHMgPC0gcmVhZF9wcHR4KCkKIyBBZGQgYSBuZXcgc2xpZGUgaW50byB0aGUgcHB0IGRvY3VtZW50IApvdF9wbG90cyA8LSBvdF9wbG90cyAlPiUgCiAgYWRkX3NsaWRlKGxheW91dCA9ICJUaXRsZSBhbmQgQ29udGVudCIsIG1hc3RlciA9ICJPZmZpY2UgVGhlbWUiKQojIEFkZCB0aGUgZ2dwbG90MiBvYmplY3RzIHRvIHRoZSBzbGlkZQpvdF9wbG90cyA8LSBwaF93aXRoX2dnKG90X3Bsb3RzLCB2YWx1ZT1wMTQpCiMgd3JpdGUgdGhlIGRvY3VtZW50IHRvIGEgZmlsZQpwcmludChvdF9wbG90cywgdGFyZ2V0ID0gIm90LXJ0LXBsb3RzLnBwdHgiKSAKCgpgYGAKCg==