Simple linear regression models the relationship between:
- One response variable (Y)
- One explanatory variable (X)
It assumes a linear relationship between the two variables.
2026-02-07
Simple linear regression models the relationship between:
It assumes a linear relationship between the two variables.
The simple linear regression model is:
\[ Y = \beta_0 + \beta_1 X + \varepsilon \]
Where: \[ ( \beta_0 ): intercept \] \[ ( \beta_1 ): slope \] \[ ( \varepsilon ): random error term \]
The classical assumptions are:
\[ E(\varepsilon) = 0, \quad Var(\varepsilon) = \sigma^2 \]
\[ \varepsilon_i \text{ are independent and normally distributed} \]
These assumptions allow us to perform inference.
We consider a simple dataset where:
model <- lm(price ~ size, data = housing) summary(model)
The estimated slope tells us how much price increases per additional square foot.
We add a third variable: house age.
This approach is widely used in economics, engineering, and data science.
Linear regression is often the first statistical model used in practice.