2025-06-08

What is Simple Linear Regression?

Simple linear regression is a statistical method used to model the relationship between two continuous variables: one independent (predictor) and one dependent (response). It assumes a straight-line relationship of the form:

Y = β₀ + β₁X + ε

where:

  • Y is the response variable
  • X is the predictor
  • β₀ is the intercept
  • β₁ is the slope
  • ε is the error value

Simple Linear Regression Uses and Limitations

It is commonly used in statistics to predict outcomes, identify trends, and assess the strength of relationships between variables. Some examples of uses are predicting house prices, forecasting business sales, business risk assessment, or forecasting stock prices.

Limitations:

  • Assumes a linear relationship between variables.
  • Sensitive to outliers.
  • Assumes normally distributed residuals and constant variance.
  • Cannot capture complex, nonlinear patterns.

Exploring the Relationship Between Height and Weight (1/5)

The women dataset in R contains the average height and weight of American women aged 30–39.

# View the data
head(women)
  height weight
1     58    115
2     59    117
3     60    120
4     61    123
5     62    126
6     63    129

Exploring the Relationship Between Height and Weight (2/5).

Here is a plot of the data with the regression line:

Exploring the Relationship Between Height and Weight (3/5).

We fit a simple linear regression model using the women dataset:

\[ {y} = b_0 + b_1 \cdot x \]

Where:

  • \({y}\) = predicted weight (in pounds)
  • \(x\) = height (in inches)
  • \(b_0\) = intercept
  • \(b_1\) = slope

Exploring the Relationship Between Height and Weight (4/5).

From the model output:

\[ {\text{weight}} = -87.52 + 3.45 \cdot \text{height} \]

Interpretation:

  • For every 1 inch increase in height, weight increases by ~3.45 lbs.
  • The intercept (-87.52) is the predicted weight when height = 0 (not realistic, but needed for the formula).

Exploring the Relationship Between Height and Weight (5/5).

Conclusion

  • We explored the relationship between height and weight using the women dataset.
  • A simple linear regression model was used to quantify this relationship: \[ {\text{weight}} = -87.52 + 3.45 \cdot \text{height} \]
  • The model showed a positive linear trend: as height increases, weight tends to increase.
  • We visualized the model using both static and interactive plots, enhancing interpretability.

Takeaway:
Linear regression is a powerful but simple modeling tool — best used when its assumptions are satisfied and the relationships are reasonably linear.