2025-11-16

Overview

  • What is a p-value?
  • How it fits into hypothesis testing
  • Simulation example
  • Visual interpretation
  • Common misunderstandings

What is a p-value?

  • Probability of observing data as extreme as ours if the null hypothesis is true
  • Helps assess evidence against \(H_0\)

\[ p = P(\text{data as or more extreme than observed} \mid H_0) \]

Hypothesis Testing Setup

Let’s test whether the true mean is greater than 0:

\[ H_0: \mu = 0 \] \[ H_1: \mu > 0 \]

We take a sample (\(n = 30\)) and find: \[ \bar{x} = 0.4 \]

Sampling Distribution Under \(H_0\)

Slide 6: Plotting the p-value Region (ggplot)

Visualizing the p-value

Then replace your slide chunk with this:

Interactive Null Distribution (Plotly)

Common Misinterpretations

  • p = 0.05 means there’s a 5% chance the null is true
  • Small p-value does not mean a big effect
  • p-values do not tell you the probability data is random
  • Results near cutoff (e.g., 0.049 vs 0.051) aren’t drastically different