Start studying
Module 11 · Causal Inference Module contents
Module 11  ·  Card 9 / 13intermediate

Difference in Differences

Difference in differences compares the change over time in a treated group with the change in an untreated group.

The untreated group's change shows what would have happened anyway, and the extra change in the treated group is the effect.

For example, if employment falls 1% in a city that raised its minimum wage and 3% in a similar city, the estimate is plus 2 points.

It rests on the parallel trends assumption: without the change, both groups would have moved the same way.

Plotting both groups for several periods before the change is the usual check on that assumption.

Learn in depth ↓
Module 11 · Causal Inference · 13 concepts
In depth  /  15 lines

Difference in Differences, in more detail

Difference in differences estimates causal effects from changes that affect some groups and not others.

It suits policies, price changes and launches that reach one place before another.

It needs data from before and after the change in both groups.

Step 1 is the change in the treated group from before to after.

Step 2 is the change in the comparison group over the same period.

Step 3 subtracts the second from the first, which removes trends common to both groups.

It also removes fixed differences between the groups, such as one city always having higher wages.

The key assumption, parallel trends, says the groups would have moved together without the change.

Several periods of data before the change let analysts check whether the trends really were parallel.

If the groups were already drifting apart, the estimate mixes that drift with the effect.

Other events that hit only the treated group at the same time also bias the estimate.

Choosing a comparison group as similar as possible, such as a neighbouring region, makes the assumption more believable.

When many groups adopt a change at different times, newer methods avoid biases that affect the simple version.

In practice, difference in differences is one of the most common designs for judging policy and business changes.

The usual mistake is skipping the check of trends before the change, which is the main evidence that the assumption holds.

Want the full technical article? Wikipedia ↗
Test yourself

One question on this card. Every option explains itself once you pick, right or wrong.

Question 1
After a city raises its minimum wage, its employment falls 1%. In a similar city with no change, employment falls 3%. What is the estimate?
Causal Inference

13 concepts in this module, then a graded test with every answer explained.

Study this module →
↑↓ move↵ openesc close