March 20, 2024

Slide 1: Introduction

  • Define Simple Linear Regression: A statistical technique used to model the linear relationship between two continuous variables - an independent variable (X) and a dependent variable (Y).

  • Goal: To establish an equation of the form Y = a + bX to predict Y based on X.

Slide 2: Key Assumptions

  • Linearity: A linear relationship exists between X and Y.
  • Independence: Observations are independent of each other.
  • Homoscedasticity: The variance of errors is constant across X values.
  • Normality: Errors are normally distributed.

Slide 3: Mathematical Representation

The simple linear regression model is represented by the equation:

\[Y_i = \beta_0 + \beta_1 X_i + \epsilon_i\]

Where:

  • \(Y_i\) is the dependent variable
  • \(X_i\) is the independent variable
  • \(\beta_0\) is the intercept
  • \(\beta_1\) is the slope
  • \(\epsilon_i\) is the error term

Slide 4: Example Dataset (mtcars)

library(ggplot2)
data(mtcars)
head(mtcars) 
##                    mpg cyl disp  hp drat    wt  qsec vs am gear carb
## Mazda RX4         21.0   6  160 110 3.90 2.620 16.46  0  1    4    4
## Mazda RX4 Wag     21.0   6  160 110 3.90 2.875 17.02  0  1    4    4
## Datsun 710        22.8   4  108  93 3.85 2.320 18.61  1  1    4    1
## Hornet 4 Drive    21.4   6  258 110 3.08 3.215 19.44  1  0    3    1
## Hornet Sportabout 18.7   8  360 175 3.15 3.440 17.02  0  0    3    2
## Valiant           18.1   6  225 105 2.76 3.460 20.22  1  0    3    1
ggplot(mtcars, aes(x = wt, y = mpg)) + 
  geom_point() +
  labs(x = "Weight (wt)", y = "Miles Per Gallon (mpg)",
       title = "Relationship between Weight and MPG") 

model <- lm(mpg ~ wt, data = mtcars) 
summary(model) 
## 
## Call:
## lm(formula = mpg ~ wt, data = mtcars)
## 
## Residuals:
##     Min      1Q  Median      3Q     Max 
## -4.5432 -2.3647 -0.1252  1.4096  6.8727 
## 
## Coefficients:
##             Estimate Std. Error t value Pr(>|t|)    
## (Intercept)  37.2851     1.8776  19.858  < 2e-16 ***
## wt           -5.3445     0.5591  -9.559 1.29e-10 ***
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 3.046 on 30 degrees of freedom
## Multiple R-squared:  0.7528, Adjusted R-squared:  0.7446 
## F-statistic: 91.38 on 1 and 30 DF,  p-value: 1.294e-10
ggplot(mtcars, aes(x = wt, y = mpg)) + 
  geom_point() +
  geom_smooth(method = "lm", se = FALSE) +
  labs(x = "Weight (wt)", y = "Miles Per Gallon (mpg)",
       title = "Linear Regression Model")
## `geom_smooth()` using formula = 'y ~ x'

model <- lm(mpg ~ wt, data = mtcars)
summary(model) 
## 
## Call:
## lm(formula = mpg ~ wt, data = mtcars)
## 
## Residuals:
##     Min      1Q  Median      3Q     Max 
## -4.5432 -2.3647 -0.1252  1.4096  6.8727 
## 
## Coefficients:
##             Estimate Std. Error t value Pr(>|t|)    
## (Intercept)  37.2851     1.8776  19.858  < 2e-16 ***
## wt           -5.3445     0.5591  -9.559 1.29e-10 ***
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 3.046 on 30 degrees of freedom
## Multiple R-squared:  0.7528, Adjusted R-squared:  0.7446 
## F-statistic: 91.38 on 1 and 30 DF,  p-value: 1.294e-10