Questions, Hypotheses, and Predictions

M. Drew LaMar
February 10, 2017

“Good experimental design is all about maximizing the amount of information that we can get, given the resources that we have available.”

- Ruxton & Colegrave

Class Announcements

  • Reading assignment for Monday, Whitlock & Schluter, Chapter 6 (QUIZ = YES)

Buddy Has a Hypothesis!

Alright, back to hypotheses...

Definition: A hypothesisis a clear statement articulating a plausible candidate explanation for observations.

Observation \( \rightarrow \) Question \( \rightarrow \) Hypothesis \( \rightarrow \) Prediction

Q 2.1: Suggest some hypotheses that could explain the observation that people drive faster on the journey to work than on the way home.

A 2.1:

  (1) Time management - have a lot of work to do.

  (2) Energy difference - newly caffeinated vs. exhausted.

Example: Chimp activity

Question: Why does chimp activity vary during the day?

Hypothesis: Chimp activity pattern is affected by feeding regime.

Prediction: The fraction of time that a chimp spends moving around will be higher in the hour around feeding time than at other times of day.

Alternate hypothesis (statistical): \( p_{f} > p_{t} \), where \( p_{f} \) is the fraction of time that a chimp spends moving around in the hour around feeding time, with \( p_{t} \) the same metric for all other hours of the day.

Null hypothesis (statistical): \( p_{f} \leq p_{t} \).

Example: Multiple hypotheses

Question: Why do whelks group?

Hypothesis #1: Whelks group for shelter from wave action.

Prediction #1: Whelks are more likely to be found in groups in areas sheltered from wave action.

Hypothesis #2: Whelks group for feeding.

Prediction #2: Whelks are more likely to be found in groups in areas of higher food density.

Note: Multiple hypotheses can explain the same prediction.

Hypothesis #1b: Whelks are more vulnerable to predators in sheltered areas, but grouping provides protection from predators.

Concept maps of causation

Possibility 1: Neither hypothesis is true and the observed patters are due to something else entirely.

alt text

Concept maps of causation

Possibility 2: Predation is true and shelter is false.

alt text

Concept maps of causation

Possibility 3: Predation is false and shelter is true.

alt text

Concept maps of causation

Possibility 4: Both predation and shelter are true.

alt text

"Good" experimental design

“No matter how the study is organized, the important thing is that the best study will be the one that allows us to tease apart the influence of the different hypothesized unfluences on grouping behavior.”

- Ruxton & Colegrave

Experimental design example: Factorial experiment with predation and wave action.

  • With wave action and without predation.
  • Without wave action and with predation.
  • With wave action and predation (interaction effect).
  • Without wave action or predation (control).

Differing levels of predation and wave action?

alt text

alt text

3 levels of predation and 3 levels of wave action = 9 different experiments!!!

Oh, and don't forget about replication (Chapter 3)

The elusive "good idea"

“Perhaps the key to having really novel ideas is just to keep your eyes and ears open and try and question the things you see around you.”

- Ruxton & Colegrave

Switching from answers to questions

“We encourage you to design experiments that are interesting because of the question they ask more than because of the specific answer to the question that emerges from the data.”

- Ruxton & Colegrave

Yeah, but is it worth it to explore a question?

Three To-Dos:

  • Ask yourself: Is it possible to explore this question in a way to obtain a valuable answer? (i.e. do you have the resources? Careful, though: What is valuable?)
  • Ask yourself: Are you committed to obtaining an answer? (note: this is different than excited, which the book mentions - excitement comes and goes, but commitment sticks)
  • Bounce ideas off others you respect, but don't rely solely on their responses!!!

Understanding Science

Self awareness to satisfy sceptic

“You should think of the Devil's advocate as a highly intelligent but sceptical person. If there is a weakness in your argument, then they will find it.”

- Ruxton & Colegrave

The importance of pilot studies

Reason #1: One aim of a pilot study is to allow you to become well acquainted with the system that you will be working on.

  • Make sure observations are actually there!!
  • Don't just trust the literature - observe for yourself

The importance of pilot studies

Reason #2: A second crucial role for a pilot study is that it gives you a chance to practice and validate the techniques that you will use in the full study.

  • Practice protocols (minimize wasted time, money, and suffering)
    • e.g. Butterflies and plant choice for egg laying
  • Try out different protocols
  • Find biologically realistic values for variables
  • Pilot data used for statistical power calculations

Experimental vs observational

Causation vs correlation

The causal soup - Systems Biology

Issues with correlational results

Correlation issues - Reverse causation

alt text

alt text

Correlation issues - Confounding variable

alt text

alt text

Example:

  • A = tail length
  • B = # matings
  • C = territorial quality

Correlation issues - Confounding variable

Manipulative studies

“The only way to be certain of removing problems with third variables is to carry out experimental manipulations.”

- Ruxton & Colegrave

Difficulties:

  • Sometimes not possible to manipulate, for practical or ethical reasons.
  • Not technically feasible to carry out manipulative study.

Note: Correlational studies can be used as a first step towards a manipulative study. Also, if you are interested in natural variation, observational is a great way to go.