t-Test HW

Author

Kate Curtis

Loading Libraries

library(psych) # for the describe() command
library(car) # for the leveneTest() command
library(effsize) # for the cohen.d() command

Importing Data

# update for homework--- your data 
d <- read.csv(file="Data/mydata.csv", header=T)

State Your Hypothesis - PART OF YOUR WRITEUP

Women will report a higher usage of social media than men .

Check Your Assumptions

T-test Assumptions

  • Data values must be independent (independent t-test only) (confirmed by data report)
  • Data obtained via a random sample (confirmed by data report)
  • IV must have two levels (will check below)
  • Dependent variable must be normally distributed (will check below. if issues, note and proceed)
  • Variances of the two groups must be approximately equal, aka ‘homogeneity of variance’. Lacking this makes our results inaccurate (will check below - this really only applies to Student’s t-test, but we’ll check it anyway)

Checking IV levels

# preview the levels and counts for your IV
table(d$gender, useNA = "always")

   f    m   nb <NA> 
1582  543   31    0 
# # note that the table() output shows you exactly how the levels of your variable are written. when recoding, make sure you are spelling them exactly as they appear
# 
# # to drop levels from your variable
# # this subsets the data and says that any participant who is coded as 'LEVEL BAD' should be removed
# # if you don't need this for the homework, comment it out (add a # at the beginning of the line)
 d <- subset(d, gender != "nb")
 
 

# # preview your changes and make sure everything is correct
table(d$gender, useNA = "always")

   f    m <NA> 
1582  543    0 
# # check your variable types
str(d)
'data.frame':   2125 obs. of  6 variables:
 $ gender   : chr  "f" "m" "m" "f" ...
 $ age      : chr  "1 between 18 and 25" "1 between 18 and 25" "1 between 18 and 25" "1 between 18 and 25" ...
 $ swb      : num  4.33 4.17 1.83 5.17 3.67 ...
 $ mindful  : num  2.4 1.8 2.2 2.2 3.2 ...
 $ belong   : num  2.8 4.2 3.6 4 3.4 4.2 3.9 3.6 2.9 2.5 ...
 $ socmeduse: int  47 23 34 35 37 13 37 43 37 29 ...
# # make sure that your IV is recognized as a factor by R
d$gender <- as.factor(d$gender)

Testing Homogeneity of Variance with Levene’s Test

We can test whether the variances of our two groups are equal using Levene’s test. The null hypothesis is that the variance between the two groups is equal, which is the result we want. So when running Levene’s test we’re hoping for a non-significant result!

# # use the leveneTest() command from the car package to test homogeneity of variance
# # uses the same 'formula' setup that we'll use for our t-test: formula is y~x, where y is our DV and x is our IV
 leveneTest(socmeduse~gender, data = d)
Levene's Test for Homogeneity of Variance (center = median)
        Df F value  Pr(>F)  
group    1  5.7926 0.01618 *
      2123                  
---
Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1

if levene’s test is not significant it is a good thing data needs to have homogeneity of varience to function as a t-test is intended, and we use a levene’s test to see this, and we want the levene’s test to be non-significant because it indicates homogeneity of varience

This is more of a formality in our case, because we are using Welch’s t-test, which does not have the same assumptions as Student’s t-test (the default type of t-test) about variance. R defaults to using Welch’s t-test so this doesn’t require any extra effort on our part!

Check Normality

# you only need to check the variables you're using in the current analysis
# although you checked them previously, it's always a good idea to look them over again and be sure that everything is correct

# you can use the describe() command on an entire datafrom (d) or just on a single variable (d$pss)
# use it to check the skew and kurtosis of your DV
describe(d$socmeduse)
   vars    n  mean  sd median trimmed  mad min max range skew kurtosis   se
X1    1 2125 34.26 8.6     35   34.52 7.41  11  55    44 -0.3     0.18 0.19
# can use the describeBy() command to view the means and standard deviations by group
# it's very similar to the describe() command but splits the dataframe according to the 'group' variable
describeBy(d$socmeduse, group=d$gender)

 Descriptive statistics by group 
group: f
   vars    n  mean   sd median trimmed  mad min max range skew kurtosis   se
X1    1 1582 34.89 8.32     35   35.12 7.41  11  55    44 -0.3     0.24 0.21
------------------------------------------------------------ 
group: m
   vars   n  mean   sd median trimmed mad min max range  skew kurtosis   se
X1    1 543 32.42 9.13     33   32.69 8.9  11  55    44 -0.22    -0.02 0.39
# also use a histogram to examine your continuous variable
hist(d$socmeduse)

# last, use a boxplot to examine your continuous and categorical variables together
# categorical/IV goes on the right, continuous/DV goes on the left 
boxplot(d$socmeduse~d$gender)

Issues with My Data - PART OF YOUR WRITEUP

We dropped participants who were not men or women (e.g., nonbinary). Before proceeding with analysis, we confirmed that all t-test assumptions were met. Levene’s test found significant heterogenity of variance (p = .016). We found that our dependent variable is normally distributed (skew and kurtosis between -2 to +2). As a result, Welch’s t-test will be used.

Run a T-test

# # very simple! we specify the dataframe alongside the variables instead of having a separate argument for the dataframe like we did for leveneTest()
t_output <- t.test(d$socmeduse~d$gender)

View Test Output

 t_output

    Welch Two Sample t-test

data:  d$socmeduse by d$gender
t = 5.556, df = 871.13, p-value = 3.668e-08
alternative hypothesis: true difference in means between group f and group m is not equal to 0
95 percent confidence interval:
 1.595490 3.338435
sample estimates:
mean in group f mean in group m 
       34.88685        32.41989 
# just run line of code above 

Calculate Cohen’s d

# # once again, we use our formula to calculate cohen's d
d_output <- cohen.d(d$socmeduse~d$gender)

View Effect Size

  • Trivial: < .2
  • Small: between .2 and .5
  • Medium: between .5 and .8
  • Large: > .8
d_output

Cohen's d

d estimate: 0.2890795 (small)
95 percent confidence interval:
    lower     upper 
0.1911551 0.3870040 

Write Up Results

We tested our hypothesis that women would significantly report more social media use than men using independent samples t-test. We dropped participants who were not men or women (e.g., nonbinary). Before proceeding with the analysis, we confirmed that all t-test assumptions were met. Levene’s test found significant heterogenity of variance (p = .016). We found that our dependent variable is normally distributed (skew and kurtosis between -2 to +2). As a result, Welch’s t-test was used. We found a significant difference in variables and our effect size was small according to Choen (1988), t(871.13) = 5.56, p < .001, d= .29 95% = [1.60, 3.34]. (refer to Figure 1).

References

Cohen J. (1988). Statistical Power Analysis for the Behavioral Sciences. New York, NY: Routledge Academic.