Hypothesis Testing

A pharmaceutical company claims their new drug lowers cholesterol. A skeptic says it does nothing. How do you settle the debate with data? You cannot just eyeball a graph and declare a winner. You need a formal framework - a set of rules that everyone agrees on before the experiment starts - that tells you when the evidence is strong enough to side with the company over the skeptic. That framework is hypothesis testing, and it is the backbone of every research study you will encounter on the MCAT.

The Jury Trial Analogy

Hypothesis testing works exactly like a criminal trial.

The Null Hypothesis (H-null)

The null hypothesis ($H_0$) is the default assumption: there is no effect, no difference, no relationship. It represents the skeptic’s position.

Examples:

• “The drug has no effect on cholesterol.” ($H_0$: μ-drug = μ-placebo)
• “There is no difference in test scores between the two teaching methods.”
• “There is no correlation between sleep and GPA.”

The null hypothesis always contains an equals sign. It claims nothing interesting is happening.

The Alternative Hypothesis ($H_1$ or Hₐ)

The alternative hypothesis is the researcher’s claim: there IS an effect, a difference, or a relationship. It is what you are trying to find evidence for.

Examples:

• “The drug lowers cholesterol.” ($H_1$: μ-drug < μ-placebo)
• “The two teaching methods produce different test scores.”
• “There is a correlation between sleep and GPA.”

The Steps of Hypothesis Testing

1. State hypotheses. Define $H_0$ (no effect) and $H_1$ (there is an effect).
2. Set the significance level (α). By convention, α = 0.05. This is the threshold for “strong enough evidence.”
3. Collect data and calculate a test statistic. The test statistic measures how far the sample result is from what $H_0$ predicts.
4. Find the p-value. The probability of getting a result this extreme (or more extreme) if $H_0$ is true.
5. Make a decision. If p < α, reject $H_0$. If p >= α, fail to reject $H_0$.

”Reject” vs. “Fail to Reject”

This language is deliberate and the MCAT tests it.

Reject $H_0$: The evidence is strong enough to conclude that the null hypothesis is unlikely. The result is “statistically significant.”

Fail to reject $H_0$: The evidence is not strong enough to rule out the null hypothesis. This does NOT mean $H_0$ is true - it means you do not have enough evidence to reject it.

One-Tailed vs. Two-Tailed Tests

A two-tailed test checks for a difference in either direction. $H_1$: the drug changes cholesterol (could go up or down). The α is split between both tails (0.025 in each tail for α = 0.05).

A one-tailed test checks for a difference in a specific direction. $H_1$: the drug lowers cholesterol. All of α (0.05) is in one tail, making it easier to achieve significance in that direction.