This output includes primary and exploratory analyses conducted on UK-based participants.

This analysis is based on the following packages.

library(readr)
library(dplyr)
library(psych)
library(haven)
library(broom)
library(papaja)
library(knitr)
library(ggplot2)

Begin by reading in the data and creating subsets for use in different analyses.

df <- read_sav("UK_munged.sav")

# Recode Petition for bionomial
df <- df %>% 
  mutate(Petition_RC = Petition - 1)

# Remove "Neither" ideology from dataset for primary analysis
df_ideological <- df %>% 
  filter(IdeologyLeftRight!=3)

# Create manipulation checks passed dataset
df_passed <- df_ideological %>% 
  filter((Source == "Radical" & MC_Source == 1) | 
         (Source == "Environmental" & MC_Source == 2) |
         (Source == "Doctor" & MC_Source == 3)) %>% ## Filter based on MC Check 1
  filter((Action == "Individual" & MC_Message == 1) |
         (Action == "Collective" & MC_Message == 2) |
         (Action == "No Behaviour" & MC_Message == 3))

# Create manipulation checks passed dataset for exploratory analyses
df_passed_explor <- df %>% 
  filter((Source == "Radical" & MC_Source == 1) | 
         (Source == "Environmental" & MC_Source == 2) |
         (Source == "Doctor" & MC_Source == 3)) %>% ## Filter based on MC Check 1
  filter((Action == "Individual" & MC_Message == 1) |
         (Action == "Collective" & MC_Message == 2) |
         (Action == "No Behaviour" & MC_Message == 3))

All Left and Right participants

These analyses include all participants who indicated that they were left or right leaning (i.e. the independents are removed). However, here participants have not been removed for failing manipulation checks.

Investigate Petition Signing

Frequency of signing behaviour by group

df_ideological %>%
  group_by(Action, Source, IdeologyLeftRight) %>%
  summarise("Declined Signing"=sum(Petition_RC)) %>% 
  apa_table(caption="Frequency of signing behaviour by group")
(#tab:freq) Frequency of signing behaviour by group
Action Source IdeologyLeftRight Declined Signing
Collective Doctor 1 9.00
Collective Doctor 2 10.00
Collective Environmental 1 5.00
Collective Environmental 2 13.00
Collective Radical 1 6.00
Collective Radical 2 11.00
Individual Doctor 1 7.00
Individual Doctor 2 12.00
Individual Environmental 1 8.00
Individual Environmental 2 12.00
Individual Radical 1 6.00
Individual Radical 2 12.00
No Behaviour Doctor 1 8.00
No Behaviour Doctor 2 12.00
No Behaviour Environmental 1 6.00
No Behaviour Environmental 2 9.00
No Behaviour Radical 1 7.00
No Behaviour Radical 2 12.00

Binomial logistic regression

Log liklihood of signing the petition was investigated using the generalised linear model and the binomial distribution. Petition signing was predicted by Source, Suggested Action, and their interaction.

Petition_analysis <- glm(Petition_RC ~ Source*Action, family="binomial", data=df_ideological)
tidy(Petition_analysis) %>% 
  apa_table()
(#tab:unnamed-chunk-3) **
term estimate std.error statistic p.value
(Intercept) -0.05 0.32 -0.16 0.87
SourceEnvironmental -0.28 0.45 -0.62 0.53
SourceRadical -0.16 0.46 -0.35 0.73
ActionIndividual -0.10 0.45 -0.21 0.83
ActionNo Behaviour 0.10 0.45 0.23 0.82
SourceEnvironmental:ActionIndividual 0.28 0.62 0.45 0.65
SourceRadical:ActionIndividual 0.11 0.64 0.17 0.87
SourceEnvironmental:ActionNo Behaviour -0.43 0.63 -0.68 0.49
SourceRadical:ActionNo Behaviour 0.01 0.64 0.01 0.99 
glance(Petition_analysis) %>% 
  apa_table()
(#tab:unnamed-chunk-3) **
null.deviance df.null logLik AIC BIC deviance df.residual
505.03 366 -250.84 519.69 554.84 501.69 358

Pro-environmental behaviour

Descriptives Citizenship Behaviour by Cell

data.frame(df_ideological) %>%
  group_by(Action, Source, IdeologyLeftRight) %>%
  summarise(mean=mean(CitizenshipPEB_Total)) %>% 
  apa_table()
(#tab:unnamed-chunk-4) **
Action Source IdeologyLeftRight mean
Collective Doctor 1 3.06
Collective Doctor 2 2.25
Collective Environmental 1 3.05
Collective Environmental 2 2.15
Collective Radical 1 3.20
Collective Radical 2 1.94
Individual Doctor 1 2.94
Individual Doctor 2 2.06
Individual Environmental 1 2.62
Individual Environmental 2 2.17
Individual Radical 1 3.08
Individual Radical 2 1.85
No Behaviour Doctor 1 2.99
No Behaviour Doctor 2 1.81
No Behaviour Environmental 1 3.23
No Behaviour Environmental 2 2.36
No Behaviour Radical 1 2.77
No Behaviour Radical 2 1.83

Descriptives Independent Behaviour by Cell

data.frame(df_ideological) %>%
  group_by(Action, Source, IdeologyLeftRight) %>%
  summarise(mean=mean(PersonalPEB_Total))  %>% 
  apa_table()
(#tab:unnamed-chunk-5) **
Action Source IdeologyLeftRight mean
Collective Doctor 1 3.77
Collective Doctor 2 3.32
Collective Environmental 1 4.14
Collective Environmental 2 3.16
Collective Radical 1 3.98
Collective Radical 2 3.42
Individual Doctor 1 4.04
Individual Doctor 2 3.54
Individual Environmental 1 3.87
Individual Environmental 2 3.53
Individual Radical 1 4.06
Individual Radical 2 3.23
No Behaviour Doctor 1 4.17
No Behaviour Doctor 2 3.50
No Behaviour Environmental 1 4.07
No Behaviour Environmental 2 3.66
No Behaviour Radical 1 3.89
No Behaviour Radical 2 3.35

MANOVA for Pro-Environmental Behaviour

Because of the two measures of pro-envionmental behaviour are correlated. A MANOVA was conducted to investigate the effect of Source, Suggested Action, and Ideology on the two DVs. Only individuals who indicated that they identified as “Left” or “Right” were included in the analysis.

# Investigate Pro-Environmental Behaviour
manova_analysis<-manova(cbind(CitizenshipPEB_Total, PersonalPEB_Total) ~ Source*as.factor(IdeologyLeftRight)*Action, data=df_ideological)
summary(manova_analysis)
##                                             Df   Pillai approx F num Df
## Source                                       2 0.003380    0.295      4
## as.factor(IdeologyLeftRight)                 1 0.251626   58.504      2
## Action                                       2 0.028792    2.549      4
## Source:as.factor(IdeologyLeftRight)          2 0.013808    1.213      4
## Source:Action                                4 0.037936    1.687      8
## as.factor(IdeologyLeftRight):Action          2 0.004732    0.414      4
## Source:as.factor(IdeologyLeftRight):Action   4 0.025733    1.137      8
## Residuals                                  349                         
##                                            den Df  Pr(>F)    
## Source                                        698 0.88099    
## as.factor(IdeologyLeftRight)                  348 < 2e-16 ***
## Action                                        698 0.03820 *  
## Source:as.factor(IdeologyLeftRight)           698 0.30383    
## Source:Action                                 698 0.09806 .  
## as.factor(IdeologyLeftRight):Action           698 0.79872    
## Source:as.factor(IdeologyLeftRight):Action    698 0.33576    
## Residuals                                                    
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1

ANOVA for Citizenship behaviours

An ANOVA was conducted to test the effect of Source (3) x Suggested Action (3) x Ideology (2) on Citizenship behaviours.

Citizenship_anova<-aov(CitizenshipPEB_Total ~ Source*as.factor(IdeologyLeftRight)*Action, data=df_ideological)

res<-papaja::apa_print(Citizenship_anova)
apa_table(res$table)
(#tab:unnamed-chunk-7) **
Effect \(F\) \(\mathit{df}_1\) \(\mathit{df}_2\) \(\mathit{MSE}\) \(p\) \(\hat{\eta}^2_G\)
Source 0.52 2 349 0.69 .597 .003
As factorIdeologyLeftRight 113.41 1 349 0.69 < .001 .245
Action 1.21 2 349 0.69 .298 .007
Source \(\times\) As factorIdeologyLeftRight 1.79 2 349 0.69 .168 .010
Source \(\times\) Action 1.93 4 349 0.69 .106 .022
As factorIdeologyLeftRight \(\times\) Action 0.32 2 349 0.69 .724 .002
Source \(\times\) As factorIdeologyLeftRight \(\times\) Action 0.81 4 349 0.69 .518 .009

ANOVA for Personal behaviours

An ANOVA was conducted to test the effect of Source (3) x Suggested Action (3) x Ideology (2) on Personal behaviours.

PersonalPEB_anova<-aov(PersonalPEB_Total ~ Source*as.factor(IdeologyLeftRight)*Action, data=df_ideological)

res<-papaja::apa_print(PersonalPEB_anova)
apa_table(res$table)
(#tab:unnamed-chunk-8) **
Effect \(F\) \(\mathit{df}_1\) \(\mathit{df}_2\) \(\mathit{MSE}\) \(p\) \(\hat{\eta}^2_G\)
Source 0.22 2 349 0.48 .805 .001
As factorIdeologyLeftRight 63.54 1 349 0.48 < .001 .154
Action 1.14 2 349 0.48 .322 .006
Source \(\times\) As factorIdeologyLeftRight 0.16 2 349 0.48 .849 .001
Source \(\times\) Action 1.02 4 349 0.48 .395 .012
As factorIdeologyLeftRight \(\times\) Action 0.37 2 349 0.48 .692 .002
Source \(\times\) As factorIdeologyLeftRight \(\times\) Action 1.56 4 349 0.48 .184 .018

Dataset that passed all manipulation checks

In this series of analyses we include only participants that have passed both manipulation checks. As with the previous series of analyses only participants who indicated that they were left or right were included (i.e. the independents are removed).

Investigate Petition Signing

Frequency of signing behaviour by group

data.frame(df_passed) %>%
  group_by(Action, Source, IdeologyLeftRight) %>%
  summarise("Declined Signing"=sum(Petition_RC))

Binomial logistic regression

Log liklihood of signing the petition was investigated using the generalised linear model and the binomial distribution. Petition signing was predicted by Source, Suggested Action, and their interaction.

Petition_analysis<-glm(Petition_RC ~ Source*Action, family="binomial", data=df_passed)
tidy(Petition_analysis)
glance(Petition_analysis)

Pro-environmental behaviour

Descriptives Citizenship Behaviour by Cell

data.frame(df_passed) %>%
  group_by(Action, Source, IdeologyLeftRight) %>%
  summarise(mean=mean(CitizenshipPEB_Total))

Descriptives Independent Behaviour by Cell

data.frame(df_passed) %>%
  group_by(Action, Source, IdeologyLeftRight) %>%
  summarise(mean=mean(PersonalPEB_Total))

MANOVA for Pro-Environmental Behaviour

Because of the two measures of pro-envionmental behaviour are correlated. A MANOVA was conducted to investigate the effect of Source, Suggested Action, and Ideology on the two DVs. Only individuals who indicated that they identified as “Left” or “Right” were included in the analysis.

# Investigate Pro-Environmental Behaviour
manova_analysis<-manova(cbind(CitizenshipPEB_Total, PersonalPEB_Total) ~ Source*as.factor(IdeologyLeftRight)*Action, data=df_passed)
summary(manova_analysis)
##                                             Df   Pillai approx F num Df
## Source                                       2 0.012287    0.754      4
## as.factor(IdeologyLeftRight)                 1 0.274502   45.971      2
## Action                                       2 0.040861    2.545      4
## Source:as.factor(IdeologyLeftRight)          2 0.025378    1.568      4
## Source:Action                                4 0.034773    1.079      8
## as.factor(IdeologyLeftRight):Action          2 0.006330    0.387      4
## Source:as.factor(IdeologyLeftRight):Action   4 0.029902    0.926      8
## Residuals                                  244                         
##                                            den Df  Pr(>F)    
## Source                                        488 0.55557    
## as.factor(IdeologyLeftRight)                  243 < 2e-16 ***
## Action                                        488 0.03887 *  
## Source:as.factor(IdeologyLeftRight)           488 0.18161    
## Source:Action                                 488 0.37611    
## as.factor(IdeologyLeftRight):Action           488 0.81774    
## Source:as.factor(IdeologyLeftRight):Action    488 0.49456    
## Residuals                                                    
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1

ANOVA for Citizenship behaviours

An ANOVA was conducted to test the effect of Source (3) x Suggested Action (3) x Ideology (2) on Citizenship behaviours.

Citizenship_anova<-aov(CitizenshipPEB_Total ~ Source*as.factor(IdeologyLeftRight)*Action, data=df_passed)

res<-papaja::apa_print(Citizenship_anova)
apa_table(res$table)
(#tab:unnamed-chunk-14) **
Effect \(F\) \(\mathit{df}_1\) \(\mathit{df}_2\) \(\mathit{MSE}\) \(p\) \(\hat{\eta}^2_G\)
Source 0.98 2 244 0.67 .377 .008
As factorIdeologyLeftRight 90.76 1 244 0.67 < .001 .271
Action 1.62 2 244 0.67 .199 .013
Source \(\times\) As factorIdeologyLeftRight 2.51 2 244 0.67 .083 .020
Source \(\times\) Action 1.01 4 244 0.67 .402 .016
As factorIdeologyLeftRight \(\times\) Action 0.48 2 244 0.67 .617 .004
Source \(\times\) As factorIdeologyLeftRight \(\times\) Action 0.48 4 244 0.67 .747 .008

ANOVA for Personal behaviours

An ANOVA was conducted to test the effect of Source (3) x Suggested Action (3) x Ideology (2) on Personal behaviours.

PersonalPEB_anova<-aov(PersonalPEB_Total ~ Source*as.factor(IdeologyLeftRight)*Action, data=df_passed)

res<-papaja::apa_print(PersonalPEB_anova)
apa_table(res$table)
(#tab:unnamed-chunk-15) **
Effect \(F\) \(\mathit{df}_1\) \(\mathit{df}_2\) \(\mathit{MSE}\) \(p\) \(\hat{\eta}^2_G\)
Source 0.64 2 244 0.50 .528 .005
As factorIdeologyLeftRight 41.86 1 244 0.50 < .001 .146
Action 1.89 2 244 0.50 .153 .015
Source \(\times\) As factorIdeologyLeftRight 0.22 2 244 0.50 .801 .002
Source \(\times\) Action 0.82 4 244 0.50 .516 .013
As factorIdeologyLeftRight \(\times\) Action 0.01 2 244 0.50 .993 .000
Source \(\times\) As factorIdeologyLeftRight \(\times\) Action 1.21 4 244 0.50 .307 .019

Exploratory analysis using ALL participants and continuous ideology

This series of exploratory analysis uses continuous (rather than categorical ideology), as such participants who indicated that they are independent are included in the analysis. To begin, no manipulation checks are applied.

Investigate Petition Signing

Binomial logistic regression

Log liklihood of signing the petition was investigated using the generalised linear model and the binomial distribution. Petition signing was predicted by Source, Suggested Action, and their interaction.

Petition_analysis<-glm(Petition_RC ~ Source*Action, family="binomial", data=df)
tidy(Petition_analysis)
glance(Petition_analysis)

Pro-environmental behaviour

MANOVA for Pro-Environmental Behaviour

Because of the two measures of pro-envionmental behaviour are correlated. A MANOVA was conducted to investigate the effect of Source, Suggested Action, and Ideology on the two DVs. A single self-placement ideology measure was used in this analysis.

# Investigate Pro-Environmental Behaviour
manova_analysis<-manova(cbind(CitizenshipPEB_Total, PersonalPEB_Total) ~ Source*IdeologySingleItem*Action, data=df)
summary(manova_analysis)
##                                   Df   Pillai approx F num Df den Df
## Source                             2 0.007212    0.695      4    768
## IdeologySingleItem                 1 0.250973   64.165      2    383
## Action                             2 0.027444    2.671      4    768
## Source:IdeologySingleItem          2 0.013735    1.328      4    768
## Source:Action                      4 0.035189    1.719      8    768
## IdeologySingleItem:Action          2 0.004439    0.427      4    768
## Source:IdeologySingleItem:Action   4 0.014834    0.717      8    768
## Residuals                        384                                
##                                   Pr(>F)    
## Source                           0.59560    
## IdeologySingleItem               < 2e-16 ***
## Action                           0.03112 *  
## Source:IdeologySingleItem        0.25794    
## Source:Action                    0.09033 .  
## IdeologySingleItem:Action        0.78914    
## Source:IdeologySingleItem:Action 0.67637    
## Residuals                                   
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1

ANOVA for Citizenship behaviours

An ANOVA was conducted to test the effect of Source (3) x Suggested Action (3) x Ideology on Citizenship behaviours.

Citizenship_anova<-aov(CitizenshipPEB_Total ~ Source*IdeologySingleItem*Action, data=df)

res<-papaja::apa_print(Citizenship_anova)
apa_table(res$table)
(#tab:unnamed-chunk-18) **
Effect \(F\) \(\mathit{df}_1\) \(\mathit{df}_2\) \(\mathit{MSE}\) \(p\) \(\hat{\eta}^2_G\)
Source 1.26 2 384 0.69 .284 .007
IdeologySingleItem 127.13 1 384 0.69 < .001 .249
Action 1.37 2 384 0.69 .256 .007
Source \(\times\) IdeologySingleItem 2.16 2 384 0.69 .117 .011
Source \(\times\) Action 2.09 4 384 0.69 .082 .021
IdeologySingleItem \(\times\) Action 0.36 2 384 0.69 .699 .002
Source \(\times\) IdeologySingleItem \(\times\) Action 0.61 4 384 0.69 .656 .006

ANOVA for Personal behaviours

An ANOVA was conducted to test the effect of Source (3) x Suggested Action (3) x Ideology on Personal behaviours.

PersonalPEB_anova<-aov(PersonalPEB_Total ~ Source*IdeologySingleItem*Action, data=df)

res<-papaja::apa_print(PersonalPEB_anova)
apa_table(res$table)
(#tab:unnamed-chunk-19) **
Effect \(F\) \(\mathit{df}_1\) \(\mathit{df}_2\) \(\mathit{MSE}\) \(p\) \(\hat{\eta}^2_G\)
Source 0.82 2 384 0.51 .440 .004
IdeologySingleItem 59.04 1 384 0.51 < .001 .133
Action 0.86 2 384 0.51 .424 .004
Source \(\times\) IdeologySingleItem 0.28 2 384 0.51 .756 .001
Source \(\times\) Action 1.21 4 384 0.51 .307 .012
IdeologySingleItem \(\times\) Action 0.30 2 384 0.51 .742 .002
Source \(\times\) IdeologySingleItem \(\times\) Action 0.84 4 384 0.51 .501 .009

Exploratory analysis using continuous ideology and manipulation checks.

Finally, this series of exploratory analysis uses continuous (rather than categorical ideology), as such participants who indicated that they are independent are included in the analysis. In this series of analyses only participants who have passed both manipulation checks are included.

Investigate Petition Signing

Binomial logistic regression

Log liklihood of signing the petition was investigated using the generalised linear model and the binomial distribution. Petition signing was predicted by Source, Suggested Action, and their interaction.

Petition_analysis<-glm(Petition_RC ~ Source*Action, family="binomial", data=df_passed_explor)
tidy(Petition_analysis)
glance(Petition_analysis)

Pro-environmental behaviour

MANOVA for Pro-Environmental Behaviour

Because of the two measures of pro-envionmental behaviour are correlated. A MANOVA was conducted to investigate the effect of Source, Suggested Action, and Ideology on the two DVs. A single self-placement ideology measure was used in this analysis.

# Investigate Pro-Environmental Behaviour
manova_analysis<-manova(cbind(CitizenshipPEB_Total, PersonalPEB_Total) ~ Source*IdeologySingleItem*Action, data=df_passed_explor)
summary(manova_analysis)
##                                   Df   Pillai approx F num Df den Df
## Source                             2 0.022069    1.478      4    530
## IdeologySingleItem                 1 0.295692   55.418      2    264
## Action                             2 0.027720    1.862      4    530
## Source:IdeologySingleItem          2 0.022700    1.521      4    530
## Source:Action                      4 0.031593    1.063      8    530
## IdeologySingleItem:Action          2 0.009016    0.600      4    530
## Source:IdeologySingleItem:Action   4 0.024903    0.835      8    530
## Residuals                        265                                
##                                  Pr(>F)    
## Source                           0.2074    
## IdeologySingleItem               <2e-16 ***
## Action                           0.1157    
## Source:IdeologySingleItem        0.1946    
## Source:Action                    0.3874    
## IdeologySingleItem:Action        0.6628    
## Source:IdeologySingleItem:Action 0.5717    
## Residuals                                  
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1

ANOVA for Citizenship behaviours

An ANOVA was conducted to test the effect of Source (3) x Suggested Action (3) x Ideology on Citizenship behaviours.

Citizenship_anova<-aov(CitizenshipPEB_Total ~ Source*IdeologySingleItem*Action, data=df_passed_explor)

res<-papaja::apa_print(Citizenship_anova)
apa_table(res$table)
(#tab:unnamed-chunk-22) **
Effect \(F\) \(\mathit{df}_1\) \(\mathit{df}_2\) \(\mathit{MSE}\) \(p\) \(\hat{\eta}^2_G\)
Source 2.26 2 265 0.66 .106 .017
IdeologySingleItem 111.10 1 265 0.66 < .001 .295
Action 1.93 2 265 0.66 .147 .014
Source \(\times\) IdeologySingleItem 2.58 2 265 0.66 .078 .019
Source \(\times\) Action 1.09 4 265 0.66 .361 .016
IdeologySingleItem \(\times\) Action 0.48 2 265 0.66 .619 .004
Source \(\times\) IdeologySingleItem \(\times\) Action 0.81 4 265 0.66 .519 .012

ANOVA for Personal behaviours

An ANOVA was conducted to test the effect of Source (3) x Suggested Action (3) x Ideology on Personal behaviours.

PersonalPEB_anova<-aov(PersonalPEB_Total ~ Source*IdeologySingleItem*Action, data=df_passed_explor)

res<-papaja::apa_print(PersonalPEB_anova)
apa_table(res$table)
(#tab:unnamed-chunk-23) **
Effect \(F\) \(\mathit{df}_1\) \(\mathit{df}_2\) \(\mathit{MSE}\) \(p\) \(\hat{\eta}^2_G\)
Source 1.96 2 265 0.54 .143 .015
IdeologySingleItem 40.43 1 265 0.54 < .001 .132
Action 0.43 2 265 0.54 .650 .003
Source \(\times\) IdeologySingleItem 0.21 2 265 0.54 .812 .002
Source \(\times\) Action 0.80 4 265 0.54 .529 .012
IdeologySingleItem \(\times\) Action 0.22 2 265 0.54 .802 .002
Source \(\times\) IdeologySingleItem \(\times\) Action 0.53 4 265 0.54 .715 .008